2024-02-21T22:38:49.404 INFO:root:teuthology version: 0.0.1.dev260+gb1dac55 2024-02-21T22:38:49.404 DEBUG:teuthology.run:Teuthology command: teuthology --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} subvol_versions/create_subvol_version_v1 tasks/xfstests-dev} --archive /home/teuthworker/archive/leonidus-2024-02-21_22:31:03-fs-wip-lusov-qdb-distro-default-smithi/7569994 --verbose --owner scheduled_leonidus@teuthology --name leonidus-2024-02-21_22:31:03-fs-wip-lusov-qdb-distro-default-smithi -- /home/teuthworker/archive/leonidus-2024-02-21_22:31:03-fs-wip-lusov-qdb-distro-default-smithi/7569994/orig.config.yaml 2024-02-21T22:38:49.448 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-21T22:38:49.530 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/leonidus-2024-02-21_22:31:03-fs-wip-lusov-qdb-distro-default-smithi/7569994 branch: wip-lusov-qdb description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} subvol_versions/create_subvol_version_v1 tasks/xfstests-dev} email: null first_in_suite: false job_id: '7569994' kernel: client: sha1: distro kdb: true sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: leonidus-2024-02-21_22:31:03-fs-wip-lusov-qdb-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-lusov-qdb ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - POOL_APP_NOT_ENABLED - overall HEALTH_ - Replacing daemon - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: 3bfc837d7b45ce8e095d92fa9c342964cea5e95f ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 3bfc837d7b45ce8e095d92fa9c342964cea5e95f kclient: syntax: v2 subvolume_version: 1 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-lusov-qdb sha1: 3bfc837d7b45ce8e095d92fa9c342964cea5e95f owner: scheduled_leonidus@teuthology priority: 80 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 6562 sha1: 3bfc837d7b45ce8e095d92fa9c342964cea5e95f sleep_before_teardown: 0 subset: 111/10000 suite: fs suite_branch: wip-lusov-qdb suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_3bfc837d7b45ce8e095d92fa9c342964cea5e95f/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 3bfc837d7b45ce8e095d92fa9c342964cea5e95f syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi116.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKSYPdxFnYUkLRhg2JtiX1Zh5vfjR56FP+IfctDddmogYEscSQau+lo7M8WnEmFUldp0gBrzWER2oPOVT4f43bc= smithi142.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAObk+c0UTDo0O7FrphxqiW/noBoV3ao4Z+yYnKrmwK36r+iZ9qGOrFRurPgUxgH1MK7gk7y6SlrFCFjeovIrYc= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - kclient: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.tests_from_xfstests_dev teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: b1dac5519c57c269ea98a22fb7729016a1d0e4d2 timestamp: 2024-02-21_22:31:03 tube: smithi user: leonidus verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-02-21T22:38:49.531 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_3bfc837d7b45ce8e095d92fa9c342964cea5e95f/qa; will attempt to use it 2024-02-21T22:38:49.531 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_3bfc837d7b45ce8e095d92fa9c342964cea5e95f/qa/tasks 2024-02-21T22:38:49.531 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-02-21T22:38:49.533 INFO:teuthology.task.internal:Checking packages... 2024-02-21T22:38:49.557 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '3bfc837d7b45ce8e095d92fa9c342964cea5e95f' 2024-02-21T22:38:49.557 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-02-21T22:38:49.557 INFO:teuthology.packaging:ref: None 2024-02-21T22:38:49.557 INFO:teuthology.packaging:tag: None 2024-02-21T22:38:49.557 INFO:teuthology.packaging:branch: wip-lusov-qdb 2024-02-21T22:38:49.557 INFO:teuthology.packaging:sha1: 3bfc837d7b45ce8e095d92fa9c342964cea5e95f 2024-02-21T22:38:49.558 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-lusov-qdb 2024-02-21T22:38:49.706 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-1643.g3bfc837d 2024-02-21T22:38:49.708 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-02-21T22:38:49.715 INFO:teuthology.task.internal:no buildpackages task found 2024-02-21T22:38:49.716 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-02-21T22:38:49.721 INFO:teuthology.task.internal:Saving configuration 2024-02-21T22:38:49.737 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-02-21T22:38:49.742 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-02-21T22:38:49.766 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi116.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2024-02-21_22:31:03-fs-wip-lusov-qdb-distro-default-smithi/7569994', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-21 22:32:35.737239', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKSYPdxFnYUkLRhg2JtiX1Zh5vfjR56FP+IfctDddmogYEscSQau+lo7M8WnEmFUldp0gBrzWER2oPOVT4f43bc='} 2024-02-21T22:38:49.786 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi142.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2024-02-21_22:31:03-fs-wip-lusov-qdb-distro-default-smithi/7569994', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-21 22:32:35.738456', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAObk+c0UTDo0O7FrphxqiW/noBoV3ao4Z+yYnKrmwK36r+iZ9qGOrFRurPgUxgH1MK7gk7y6SlrFCFjeovIrYc='} 2024-02-21T22:38:49.786 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-02-21T22:38:49.792 INFO:teuthology.task.internal:roles: ubuntu@smithi116.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-02-21T22:38:49.792 INFO:teuthology.task.internal:roles: ubuntu@smithi142.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-02-21T22:38:49.792 INFO:teuthology.run_tasks:Running task console_log... 2024-02-21T22:38:49.859 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fe4596bcf70>, signals=[15]) 2024-02-21T22:38:49.860 INFO:teuthology.run_tasks:Running task internal.connect... 2024-02-21T22:38:49.867 INFO:teuthology.task.internal:Opening connections... 2024-02-21T22:38:49.867 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi116.front.sepia.ceph.com 2024-02-21T22:38:49.870 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-21T22:38:49.961 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi142.front.sepia.ceph.com 2024-02-21T22:38:49.962 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-21T22:38:50.054 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-02-21T22:38:50.060 DEBUG:teuthology.orchestra.run.smithi116:> uname -m 2024-02-21T22:38:50.077 INFO:teuthology.orchestra.run.smithi116.stdout:x86_64 2024-02-21T22:38:50.077 DEBUG:teuthology.orchestra.run.smithi116:> cat /etc/os-release 2024-02-21T22:38:50.134 INFO:teuthology.orchestra.run.smithi116.stdout:NAME="CentOS Stream" 2024-02-21T22:38:50.134 INFO:teuthology.orchestra.run.smithi116.stdout:VERSION="9" 2024-02-21T22:38:50.134 INFO:teuthology.orchestra.run.smithi116.stdout:ID="centos" 2024-02-21T22:38:50.134 INFO:teuthology.orchestra.run.smithi116.stdout:ID_LIKE="rhel fedora" 2024-02-21T22:38:50.134 INFO:teuthology.orchestra.run.smithi116.stdout:VERSION_ID="9" 2024-02-21T22:38:50.134 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM_ID="platform:el9" 2024-02-21T22:38:50.134 INFO:teuthology.orchestra.run.smithi116.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-21T22:38:50.134 INFO:teuthology.orchestra.run.smithi116.stdout:ANSI_COLOR="0;31" 2024-02-21T22:38:50.134 INFO:teuthology.orchestra.run.smithi116.stdout:LOGO="fedora-logo-icon" 2024-02-21T22:38:50.134 INFO:teuthology.orchestra.run.smithi116.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-21T22:38:50.135 INFO:teuthology.orchestra.run.smithi116.stdout:HOME_URL="https://centos.org/" 2024-02-21T22:38:50.135 INFO:teuthology.orchestra.run.smithi116.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-21T22:38:50.135 INFO:teuthology.orchestra.run.smithi116.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-21T22:38:50.135 INFO:teuthology.orchestra.run.smithi116.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-21T22:38:50.135 INFO:teuthology.lock.ops:Updating smithi116.front.sepia.ceph.com on lock server 2024-02-21T22:38:50.156 DEBUG:teuthology.orchestra.run.smithi142:> uname -m 2024-02-21T22:38:50.176 INFO:teuthology.orchestra.run.smithi142.stdout:x86_64 2024-02-21T22:38:50.177 DEBUG:teuthology.orchestra.run.smithi142:> cat /etc/os-release 2024-02-21T22:38:50.234 INFO:teuthology.orchestra.run.smithi142.stdout:NAME="CentOS Stream" 2024-02-21T22:38:50.234 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION="9" 2024-02-21T22:38:50.234 INFO:teuthology.orchestra.run.smithi142.stdout:ID="centos" 2024-02-21T22:38:50.234 INFO:teuthology.orchestra.run.smithi142.stdout:ID_LIKE="rhel fedora" 2024-02-21T22:38:50.234 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION_ID="9" 2024-02-21T22:38:50.234 INFO:teuthology.orchestra.run.smithi142.stdout:PLATFORM_ID="platform:el9" 2024-02-21T22:38:50.234 INFO:teuthology.orchestra.run.smithi142.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-21T22:38:50.234 INFO:teuthology.orchestra.run.smithi142.stdout:ANSI_COLOR="0;31" 2024-02-21T22:38:50.234 INFO:teuthology.orchestra.run.smithi142.stdout:LOGO="fedora-logo-icon" 2024-02-21T22:38:50.234 INFO:teuthology.orchestra.run.smithi142.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-21T22:38:50.234 INFO:teuthology.orchestra.run.smithi142.stdout:HOME_URL="https://centos.org/" 2024-02-21T22:38:50.234 INFO:teuthology.orchestra.run.smithi142.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-21T22:38:50.235 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-21T22:38:50.235 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-21T22:38:50.235 INFO:teuthology.lock.ops:Updating smithi142.front.sepia.ceph.com on lock server 2024-02-21T22:38:50.255 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-02-21T22:38:50.269 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-02-21T22:38:50.274 INFO:teuthology.task.internal:Checking for old test directory... 2024-02-21T22:38:50.274 DEBUG:teuthology.orchestra.run.smithi116:> test '!' -e /home/ubuntu/cephtest 2024-02-21T22:38:50.276 DEBUG:teuthology.orchestra.run.smithi142:> test '!' -e /home/ubuntu/cephtest 2024-02-21T22:38:50.292 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-02-21T22:38:50.297 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-02-21T22:38:50.297 DEBUG:teuthology.orchestra.run.smithi116:> test -z $(ls -A /var/lib/ceph) 2024-02-21T22:38:50.332 DEBUG:teuthology.orchestra.run.smithi142:> test -z $(ls -A /var/lib/ceph) 2024-02-21T22:38:50.421 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-02-21T22:38:50.476 INFO:teuthology.run_tasks:Running task kernel... 2024-02-21T22:38:50.494 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'} 2024-02-21T22:38:50.494 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}, 'client.2': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}, 'client.3': {'sha1': 'distro'}} 2024-02-21T22:38:50.494 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}}, timeout 300 2024-02-21T22:38:50.495 DEBUG:teuthology.orchestra.run.smithi116:> test -f /run/.containerenv -o -f /.dockerenv 2024-02-21T22:38:50.495 DEBUG:teuthology.orchestra.run.smithi142:> test -f /run/.containerenv -o -f /.dockerenv 2024-02-21T22:38:50.511 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-21T22:38:50.512 DEBUG:teuthology.orchestra.run.smithi116:> uname -r 2024-02-21T22:38:50.513 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-21T22:38:50.513 DEBUG:teuthology.orchestra.run.smithi142:> uname -r 2024-02-21T22:38:50.573 INFO:teuthology.orchestra.run.smithi142.stdout:5.14.0-361.el9.x86_64 2024-02-21T22:38:50.574 INFO:teuthology.orchestra.run.smithi116.stdout:5.14.0-361.el9.x86_64 2024-02-21T22:38:50.574 INFO:teuthology.task.kernel:Running kernel on smithi142: 5.14.0-361.el9.x86_64 2024-02-21T22:38:50.574 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum install -y kernel 2024-02-21T22:38:50.575 INFO:teuthology.task.kernel:Running kernel on smithi116: 5.14.0-361.el9.x86_64 2024-02-21T22:38:50.575 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum install -y kernel 2024-02-21T22:38:52.662 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS-9 - AppStream 17 MB/s | 8.1 MB 00:00 2024-02-21T22:38:52.747 INFO:teuthology.orchestra.run.smithi116.stdout:CentOS-9 - AppStream 17 MB/s | 8.1 MB 00:00 2024-02-21T22:38:54.362 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS-9 - BaseOS 6.8 MB/s | 2.5 MB 00:00 2024-02-21T22:38:54.398 INFO:teuthology.orchestra.run.smithi116.stdout:CentOS-9 - BaseOS 7.5 MB/s | 2.5 MB 00:00 2024-02-21T22:38:55.336 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 9 - BaseOS 15 MB/s | 8.0 MB 00:00 2024-02-21T22:38:56.530 INFO:teuthology.orchestra.run.smithi116.stdout:CentOS Stream 9 - BaseOS 4.8 MB/s | 8.0 MB 00:01 2024-02-21T22:38:57.179 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 9 - AppStream 26 MB/s | 19 MB 00:00 2024-02-21T22:38:59.689 INFO:teuthology.orchestra.run.smithi116.stdout:CentOS Stream 9 - AppStream 9.4 MB/s | 19 MB 00:02 2024-02-21T22:39:01.288 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 9 - CRB 13 MB/s | 6.1 MB 00:00 2024-02-21T22:39:03.080 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 9 - Extras packages 24 kB/s | 15 kB 00:00 2024-02-21T22:39:04.073 INFO:teuthology.orchestra.run.smithi116.stdout:CentOS Stream 9 - CRB 8.8 MB/s | 6.1 MB 00:00 2024-02-21T22:39:05.350 INFO:teuthology.orchestra.run.smithi142.stdout:Extra Packages for Enterprise Linux 9.7 MB/s | 20 MB 00:02 2024-02-21T22:39:05.632 INFO:teuthology.orchestra.run.smithi116.stdout:CentOS Stream 9 - Extras packages 40 kB/s | 15 kB 00:00 2024-02-21T22:39:06.575 INFO:teuthology.orchestra.run.smithi116.stdout:Extra Packages for Enterprise Linux 26 MB/s | 20 MB 00:00 2024-02-21T22:39:10.481 INFO:teuthology.orchestra.run.smithi142.stdout:lab-extras 13 kB/s | 1.7 kB 00:00 2024-02-21T22:39:11.716 INFO:teuthology.orchestra.run.smithi116.stdout:lab-extras 11 kB/s | 1.7 kB 00:00 2024-02-21T22:39:12.715 INFO:teuthology.orchestra.run.smithi142.stderr:Modular dependency problems: 2024-02-21T22:39:12.716 INFO:teuthology.orchestra.run.smithi142.stderr: 2024-02-21T22:39:12.716 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 1: conflicting requests 2024-02-21T22:39:12.716 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240219154654:20125149.x86_64 from CentOS-AppStream 2024-02-21T22:39:12.716 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 2: conflicting requests 2024-02-21T22:39:12.716 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-21T22:39:12.716 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 3: conflicting requests 2024-02-21T22:39:12.716 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-21T22:39:12.716 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 4: conflicting requests 2024-02-21T22:39:12.716 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-21T22:39:12.716 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 5: conflicting requests 2024-02-21T22:39:12.716 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-21T22:39:12.717 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 6: conflicting requests 2024-02-21T22:39:12.717 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-21T22:39:12.717 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 7: conflicting requests 2024-02-21T22:39:12.717 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-21T22:39:12.717 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 8: conflicting requests 2024-02-21T22:39:12.717 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-21T22:39:12.717 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 9: conflicting requests 2024-02-21T22:39:12.717 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-21T22:39:12.717 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 10: conflicting requests 2024-02-21T22:39:12.717 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-21T22:39:12.717 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 11: conflicting requests 2024-02-21T22:39:12.717 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-21T22:39:12.717 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 12: conflicting requests 2024-02-21T22:39:12.717 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-21T22:39:12.717 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 13: conflicting requests 2024-02-21T22:39:12.718 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-21T22:39:12.718 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 14: conflicting requests 2024-02-21T22:39:12.718 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-21T22:39:12.718 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 15: conflicting requests 2024-02-21T22:39:12.718 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-21T22:39:12.718 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 16: conflicting requests 2024-02-21T22:39:12.718 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-21T22:39:12.718 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 17: conflicting requests 2024-02-21T22:39:12.718 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-21T22:39:12.718 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 18: conflicting requests 2024-02-21T22:39:12.718 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-21T22:39:12.718 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 19: conflicting requests 2024-02-21T22:39:12.718 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-21T22:39:12.718 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 20: conflicting requests 2024-02-21T22:39:12.718 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-21T22:39:12.719 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 21: conflicting requests 2024-02-21T22:39:12.719 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-21T22:39:12.719 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 22: conflicting requests 2024-02-21T22:39:12.719 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-21T22:39:12.719 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 23: conflicting requests 2024-02-21T22:39:12.719 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-21T22:39:12.719 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 24: conflicting requests 2024-02-21T22:39:12.719 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-21T22:39:12.719 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 25: conflicting requests 2024-02-21T22:39:12.719 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-21T22:39:12.719 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 26: conflicting requests 2024-02-21T22:39:12.719 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-21T22:39:12.719 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 27: conflicting requests 2024-02-21T22:39:12.719 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-21T22:39:12.719 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 28: conflicting requests 2024-02-21T22:39:12.720 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-21T22:39:12.720 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 29: conflicting requests 2024-02-21T22:39:12.720 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-21T22:39:12.720 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 30: conflicting requests 2024-02-21T22:39:12.720 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-21T22:39:12.720 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 31: conflicting requests 2024-02-21T22:39:12.720 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-21T22:39:12.720 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 32: conflicting requests 2024-02-21T22:39:12.720 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-21T22:39:12.720 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 33: conflicting requests 2024-02-21T22:39:12.720 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-21T22:39:12.720 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 34: conflicting requests 2024-02-21T22:39:12.720 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-21T22:39:12.720 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 35: conflicting requests 2024-02-21T22:39:12.720 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240203221207:9edba152.x86_64 from CentOS-AppStream 2024-02-21T22:39:12.720 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 36: conflicting requests 2024-02-21T22:39:12.721 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-21T22:39:12.721 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-21T22:39:12.721 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-21T22:39:12.721 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 37: cannot install the best candidate for the job 2024-02-21T22:39:12.721 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-21T22:39:12.721 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-21T22:39:12.721 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-21T22:39:12.721 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-21T22:39:12.721 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 38: conflicting requests 2024-02-21T22:39:12.721 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-21T22:39:12.721 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-21T22:39:12.721 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-21T22:39:12.721 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-21T22:39:12.721 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-21T22:39:12.721 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-21T22:39:12.722 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 39: cannot install the best candidate for the job 2024-02-21T22:39:12.722 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-21T22:39:12.722 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-21T22:39:12.722 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-21T22:39:12.722 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-21T22:39:12.722 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 40: cannot install the best candidate for the job 2024-02-21T22:39:12.722 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-21T22:39:12.722 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-21T22:39:12.722 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-21T22:39:12.722 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-21T22:39:12.722 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 41: cannot install the best candidate for the job 2024-02-21T22:39:12.722 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-21T22:39:12.722 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-21T22:39:12.722 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-21T22:39:12.722 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-21T22:39:12.723 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 42: cannot install the best candidate for the job 2024-02-21T22:39:12.723 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-21T22:39:12.723 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-21T22:39:12.723 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-21T22:39:12.723 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-21T22:39:12.723 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 43: cannot install the best candidate for the job 2024-02-21T22:39:12.723 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-21T22:39:12.723 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-21T22:39:12.723 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-21T22:39:12.723 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-21T22:39:12.723 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 44: cannot install the best candidate for the job 2024-02-21T22:39:12.723 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-21T22:39:12.723 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-21T22:39:12.723 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-21T22:39:12.723 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-21T22:39:13.080 INFO:teuthology.orchestra.run.smithi142.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-02-21T22:39:13.080 INFO:teuthology.orchestra.run.smithi142.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2024-02-21T22:39:13.187 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-02-21T22:39:13.199 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-02-21T22:39:13.199 INFO:teuthology.orchestra.run.smithi142.stdout: Package Architecture Version Repository Size 2024-02-21T22:39:13.199 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-02-21T22:39:13.199 INFO:teuthology.orchestra.run.smithi142.stdout:Installing: 2024-02-21T22:39:13.200 INFO:teuthology.orchestra.run.smithi142.stdout: kernel x86_64 5.14.0-419.el9 baseos 6.0 M 2024-02-21T22:39:13.200 INFO:teuthology.orchestra.run.smithi142.stdout:Installing dependencies: 2024-02-21T22:39:13.200 INFO:teuthology.orchestra.run.smithi142.stdout: kernel-core x86_64 5.14.0-419.el9 baseos 21 M 2024-02-21T22:39:13.200 INFO:teuthology.orchestra.run.smithi142.stdout: kernel-modules x86_64 5.14.0-419.el9 baseos 39 M 2024-02-21T22:39:13.200 INFO:teuthology.orchestra.run.smithi142.stdout: kernel-modules-core x86_64 5.14.0-419.el9 baseos 33 M 2024-02-21T22:39:13.200 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-21T22:39:13.200 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2024-02-21T22:39:13.200 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-02-21T22:39:13.200 INFO:teuthology.orchestra.run.smithi142.stdout:Install 4 Packages 2024-02-21T22:39:13.200 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-21T22:39:13.200 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 99 M 2024-02-21T22:39:13.200 INFO:teuthology.orchestra.run.smithi142.stdout:Installed size: 122 M 2024-02-21T22:39:13.200 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2024-02-21T22:39:13.957 INFO:teuthology.orchestra.run.smithi116.stderr:Modular dependency problems: 2024-02-21T22:39:13.958 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-02-21T22:39:13.958 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 1: conflicting requests 2024-02-21T22:39:13.958 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240219154654:20125149.x86_64 from CentOS-AppStream 2024-02-21T22:39:13.958 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 2: conflicting requests 2024-02-21T22:39:13.958 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-21T22:39:13.958 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 3: conflicting requests 2024-02-21T22:39:13.958 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-21T22:39:13.958 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 4: conflicting requests 2024-02-21T22:39:13.958 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-21T22:39:13.958 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 5: conflicting requests 2024-02-21T22:39:13.958 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-21T22:39:13.958 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 6: conflicting requests 2024-02-21T22:39:13.959 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-21T22:39:13.959 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 7: conflicting requests 2024-02-21T22:39:13.959 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-21T22:39:13.959 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 8: conflicting requests 2024-02-21T22:39:13.959 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-21T22:39:13.959 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 9: conflicting requests 2024-02-21T22:39:13.959 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-21T22:39:13.959 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 10: conflicting requests 2024-02-21T22:39:13.959 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-21T22:39:13.959 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 11: conflicting requests 2024-02-21T22:39:13.959 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-21T22:39:13.959 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 12: conflicting requests 2024-02-21T22:39:13.959 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-21T22:39:13.959 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 13: conflicting requests 2024-02-21T22:39:13.959 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-21T22:39:13.959 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 14: conflicting requests 2024-02-21T22:39:13.960 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-21T22:39:13.960 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 15: conflicting requests 2024-02-21T22:39:13.960 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-21T22:39:13.960 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 16: conflicting requests 2024-02-21T22:39:13.960 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-21T22:39:13.960 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 17: conflicting requests 2024-02-21T22:39:13.960 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-21T22:39:13.960 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 18: conflicting requests 2024-02-21T22:39:13.960 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-21T22:39:13.960 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 19: conflicting requests 2024-02-21T22:39:13.960 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-21T22:39:13.960 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 20: conflicting requests 2024-02-21T22:39:13.960 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-21T22:39:13.960 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 21: conflicting requests 2024-02-21T22:39:13.960 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-21T22:39:13.961 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 22: conflicting requests 2024-02-21T22:39:13.961 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-21T22:39:13.961 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 23: conflicting requests 2024-02-21T22:39:13.961 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-21T22:39:13.961 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 24: conflicting requests 2024-02-21T22:39:13.961 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-21T22:39:13.961 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 25: conflicting requests 2024-02-21T22:39:13.961 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-21T22:39:13.961 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 26: conflicting requests 2024-02-21T22:39:13.961 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-21T22:39:13.961 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 27: conflicting requests 2024-02-21T22:39:13.961 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-21T22:39:13.961 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 28: conflicting requests 2024-02-21T22:39:13.961 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-21T22:39:13.961 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 29: conflicting requests 2024-02-21T22:39:13.961 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-21T22:39:13.962 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 30: conflicting requests 2024-02-21T22:39:13.962 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-21T22:39:13.962 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 31: conflicting requests 2024-02-21T22:39:13.962 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-21T22:39:13.962 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 32: conflicting requests 2024-02-21T22:39:13.962 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-21T22:39:13.962 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 33: conflicting requests 2024-02-21T22:39:13.962 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-21T22:39:13.962 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 34: conflicting requests 2024-02-21T22:39:13.962 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-21T22:39:13.962 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 35: conflicting requests 2024-02-21T22:39:13.962 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240203221207:9edba152.x86_64 from CentOS-AppStream 2024-02-21T22:39:13.962 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 36: conflicting requests 2024-02-21T22:39:13.962 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-21T22:39:13.962 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-21T22:39:13.962 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-21T22:39:13.963 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 37: cannot install the best candidate for the job 2024-02-21T22:39:13.963 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-21T22:39:13.963 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-21T22:39:13.963 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-21T22:39:13.963 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-21T22:39:13.963 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 38: conflicting requests 2024-02-21T22:39:13.963 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-21T22:39:13.963 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-21T22:39:13.963 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-21T22:39:13.963 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-21T22:39:13.963 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-21T22:39:13.963 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-21T22:39:13.963 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 39: cannot install the best candidate for the job 2024-02-21T22:39:13.963 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-21T22:39:13.963 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-21T22:39:13.963 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-21T22:39:13.963 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-21T22:39:13.964 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 40: cannot install the best candidate for the job 2024-02-21T22:39:13.964 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-21T22:39:13.964 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-21T22:39:13.964 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-21T22:39:13.964 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-21T22:39:13.964 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 41: cannot install the best candidate for the job 2024-02-21T22:39:13.964 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-21T22:39:13.964 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-21T22:39:13.964 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-21T22:39:13.964 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-21T22:39:13.964 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 42: cannot install the best candidate for the job 2024-02-21T22:39:13.964 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-21T22:39:13.964 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-21T22:39:13.964 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-21T22:39:13.964 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-21T22:39:13.965 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 43: cannot install the best candidate for the job 2024-02-21T22:39:13.965 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-21T22:39:13.965 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-21T22:39:13.965 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-21T22:39:13.965 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-21T22:39:13.965 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 44: cannot install the best candidate for the job 2024-02-21T22:39:13.965 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-21T22:39:13.965 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-21T22:39:13.965 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-21T22:39:13.965 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-21T22:39:14.365 INFO:teuthology.orchestra.run.smithi116.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-02-21T22:39:14.365 INFO:teuthology.orchestra.run.smithi116.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2024-02-21T22:39:14.466 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2024-02-21T22:39:14.477 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-02-21T22:39:14.477 INFO:teuthology.orchestra.run.smithi116.stdout: Package Architecture Version Repository Size 2024-02-21T22:39:14.478 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-02-21T22:39:14.478 INFO:teuthology.orchestra.run.smithi116.stdout:Installing: 2024-02-21T22:39:14.478 INFO:teuthology.orchestra.run.smithi116.stdout: kernel x86_64 5.14.0-419.el9 baseos 6.0 M 2024-02-21T22:39:14.478 INFO:teuthology.orchestra.run.smithi116.stdout:Installing dependencies: 2024-02-21T22:39:14.478 INFO:teuthology.orchestra.run.smithi116.stdout: kernel-core x86_64 5.14.0-419.el9 baseos 21 M 2024-02-21T22:39:14.478 INFO:teuthology.orchestra.run.smithi116.stdout: kernel-modules x86_64 5.14.0-419.el9 baseos 39 M 2024-02-21T22:39:14.478 INFO:teuthology.orchestra.run.smithi116.stdout: kernel-modules-core x86_64 5.14.0-419.el9 baseos 33 M 2024-02-21T22:39:14.478 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-02-21T22:39:14.478 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction Summary 2024-02-21T22:39:14.478 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-02-21T22:39:14.478 INFO:teuthology.orchestra.run.smithi116.stdout:Install 4 Packages 2024-02-21T22:39:14.478 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-02-21T22:39:14.479 INFO:teuthology.orchestra.run.smithi116.stdout:Total download size: 99 M 2024-02-21T22:39:14.479 INFO:teuthology.orchestra.run.smithi116.stdout:Installed size: 122 M 2024-02-21T22:39:14.479 INFO:teuthology.orchestra.run.smithi116.stdout:Downloading Packages: 2024-02-21T22:39:14.823 INFO:teuthology.orchestra.run.smithi142.stdout:(1/4): kernel-5.14.0-419.el9.x86_64.rpm 4.5 MB/s | 6.0 MB 00:01 2024-02-21T22:39:15.143 INFO:teuthology.orchestra.run.smithi116.stdout:(1/4): kernel-5.14.0-419.el9.x86_64.rpm 11 MB/s | 6.0 MB 00:00 2024-02-21T22:39:16.626 INFO:teuthology.orchestra.run.smithi116.stdout:(2/4): kernel-core-5.14.0-419.el9.x86_64.rpm 10 MB/s | 21 MB 00:02 2024-02-21T22:39:17.611 INFO:teuthology.orchestra.run.smithi116.stdout:(3/4): kernel-modules-core-5.14.0-419.el9.x86_6 14 MB/s | 33 MB 00:02 2024-02-21T22:39:17.951 INFO:teuthology.orchestra.run.smithi116.stdout:(4/4): kernel-modules-5.14.0-419.el9.x86_64.rpm 12 MB/s | 39 MB 00:03 2024-02-21T22:39:17.954 INFO:teuthology.orchestra.run.smithi116.stdout:-------------------------------------------------------------------------------- 2024-02-21T22:39:17.954 INFO:teuthology.orchestra.run.smithi116.stdout:Total 29 MB/s | 99 MB 00:03 2024-02-21T22:39:18.834 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction check 2024-02-21T22:39:19.231 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction check succeeded. 2024-02-21T22:39:19.231 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction test 2024-02-21T22:39:20.140 INFO:teuthology.orchestra.run.smithi142.stdout:(2/4): kernel-core-5.14.0-419.el9.x86_64.rpm 3.1 MB/s | 21 MB 00:06 2024-02-21T22:39:20.869 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction test succeeded. 2024-02-21T22:39:20.869 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction 2024-02-21T22:39:23.572 INFO:teuthology.orchestra.run.smithi116.stdout: Preparing : 1/1 2024-02-21T22:39:23.897 INFO:teuthology.orchestra.run.smithi142.stdout:(3/4): kernel-modules-5.14.0-419.el9.x86_64.rpm 3.8 MB/s | 39 MB 00:10 2024-02-21T22:39:24.221 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : kernel-modules-core-5.14.0-419.el9.x86_64 1/4 2024-02-21T22:39:24.343 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : kernel-core-5.14.0-419.el9.x86_64 2/4 2024-02-21T22:39:24.948 INFO:teuthology.orchestra.run.smithi142.stdout:(4/4): kernel-modules-core-5.14.0-419.el9.x86_6 3.3 MB/s | 33 MB 00:10 2024-02-21T22:39:24.948 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2024-02-21T22:39:24.948 INFO:teuthology.orchestra.run.smithi142.stdout:Total 8.5 MB/s | 99 MB 00:11 2024-02-21T22:39:25.828 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2024-02-21T22:39:26.215 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2024-02-21T22:39:26.215 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2024-02-21T22:39:27.128 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: kernel-core-5.14.0-419.el9.x86_64 2/4 2024-02-21T22:39:27.315 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : kernel-modules-5.14.0-419.el9.x86_64 3/4 2024-02-21T22:39:27.548 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2024-02-21T22:39:27.549 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2024-02-21T22:39:30.231 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2024-02-21T22:39:30.883 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : kernel-modules-core-5.14.0-419.el9.x86_64 1/4 2024-02-21T22:39:31.005 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : kernel-core-5.14.0-419.el9.x86_64 2/4 2024-02-21T22:39:32.028 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: kernel-modules-5.14.0-419.el9.x86_64 3/4 2024-02-21T22:39:32.156 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : kernel-5.14.0-419.el9.x86_64 4/4 2024-02-21T22:39:33.817 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: kernel-core-5.14.0-419.el9.x86_64 2/4 2024-02-21T22:39:34.005 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : kernel-modules-5.14.0-419.el9.x86_64 3/4 2024-02-21T22:39:36.999 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: kernel-modules-core-5.14.0-419.el9.x86_64 4/4 2024-02-21T22:39:38.711 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: kernel-modules-5.14.0-419.el9.x86_64 3/4 2024-02-21T22:39:38.898 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : kernel-5.14.0-419.el9.x86_64 4/4 2024-02-21T22:39:43.673 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: kernel-modules-core-5.14.0-419.el9.x86_64 4/4 2024-02-21T22:40:06.090 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: kernel-core-5.14.0-419.el9.x86_64 4/4 2024-02-21T22:40:06.091 INFO:teuthology.orchestra.run.smithi116.stdout:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-02-21T22:40:06.091 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-02-21T22:40:06.176 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: kernel-modules-5.14.0-419.el9.x86_64 4/4 2024-02-21T22:40:06.586 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: kernel-5.14.0-419.el9.x86_64 4/4 2024-02-21T22:40:06.586 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : kernel-5.14.0-419.el9.x86_64 1/4 2024-02-21T22:40:06.586 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : kernel-core-5.14.0-419.el9.x86_64 2/4 2024-02-21T22:40:06.586 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : kernel-modules-5.14.0-419.el9.x86_64 3/4 2024-02-21T22:40:07.041 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : kernel-modules-core-5.14.0-419.el9.x86_64 4/4 2024-02-21T22:40:07.041 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-02-21T22:40:07.041 INFO:teuthology.orchestra.run.smithi116.stdout:Installed: 2024-02-21T22:40:07.041 INFO:teuthology.orchestra.run.smithi116.stdout: kernel-5.14.0-419.el9.x86_64 2024-02-21T22:40:07.041 INFO:teuthology.orchestra.run.smithi116.stdout: kernel-core-5.14.0-419.el9.x86_64 2024-02-21T22:40:07.041 INFO:teuthology.orchestra.run.smithi116.stdout: kernel-modules-5.14.0-419.el9.x86_64 2024-02-21T22:40:07.041 INFO:teuthology.orchestra.run.smithi116.stdout: kernel-modules-core-5.14.0-419.el9.x86_64 2024-02-21T22:40:07.042 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-02-21T22:40:07.042 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2024-02-21T22:40:07.542 DEBUG:teuthology.orchestra.run.smithi116:> rpm -q kernel | sort -rV | head -n 1 2024-02-21T22:40:07.690 INFO:teuthology.orchestra.run.smithi116.stdout:kernel-5.14.0-419.el9.x86_64 2024-02-21T22:40:07.690 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-419.el9.x86_64 2024-02-21T22:40:07.690 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-419.el9.x86_64 2024-02-21T22:40:07.691 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-02-21T22:40:07.691 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-02-21T22:40:07.691 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2024-02-21T22:40:07.691 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi116.front.sepia.ceph.com, path=None, version=distro) 2024-02-21T22:40:07.691 DEBUG:teuthology.orchestra.run.smithi116:> rpm -q kernel | sort -rV | head -n 1 2024-02-21T22:40:07.813 INFO:teuthology.orchestra.run.smithi116.stdout:kernel-5.14.0-419.el9.x86_64 2024-02-21T22:40:07.813 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-419.el9.x86_64 2024-02-21T22:40:07.813 DEBUG:teuthology.orchestra.run.smithi116:> sudo rpm -qi grub2-tools 2024-02-21T22:40:07.854 INFO:teuthology.orchestra.run.smithi116.stdout:Name : grub2-tools 2024-02-21T22:40:07.854 INFO:teuthology.orchestra.run.smithi116.stdout:Epoch : 1 2024-02-21T22:40:07.854 INFO:teuthology.orchestra.run.smithi116.stdout:Version : 2.06 2024-02-21T22:40:07.854 INFO:teuthology.orchestra.run.smithi116.stdout:Release : 68.el9 2024-02-21T22:40:07.855 INFO:teuthology.orchestra.run.smithi116.stdout:Architecture: x86_64 2024-02-21T22:40:07.855 INFO:teuthology.orchestra.run.smithi116.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-02-21T22:40:07.855 INFO:teuthology.orchestra.run.smithi116.stdout:Group : Unspecified 2024-02-21T22:40:07.855 INFO:teuthology.orchestra.run.smithi116.stdout:Size : 8264254 2024-02-21T22:40:07.855 INFO:teuthology.orchestra.run.smithi116.stdout:License : GPLv3+ 2024-02-21T22:40:07.855 INFO:teuthology.orchestra.run.smithi116.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-02-21T22:40:07.855 INFO:teuthology.orchestra.run.smithi116.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-02-21T22:40:07.855 INFO:teuthology.orchestra.run.smithi116.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-02-21T22:40:07.855 INFO:teuthology.orchestra.run.smithi116.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-02-21T22:40:07.855 INFO:teuthology.orchestra.run.smithi116.stdout:Packager : builder@centos.org 2024-02-21T22:40:07.855 INFO:teuthology.orchestra.run.smithi116.stdout:Vendor : CentOS 2024-02-21T22:40:07.855 INFO:teuthology.orchestra.run.smithi116.stdout:URL : http://www.gnu.org/software/grub/ 2024-02-21T22:40:07.855 INFO:teuthology.orchestra.run.smithi116.stdout:Summary : Support tools for GRUB. 2024-02-21T22:40:07.855 INFO:teuthology.orchestra.run.smithi116.stdout:Description : 2024-02-21T22:40:07.856 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-02-21T22:40:07.856 INFO:teuthology.orchestra.run.smithi116.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-02-21T22:40:07.856 INFO:teuthology.orchestra.run.smithi116.stdout:customizable bootloader with modular architecture. It supports a rich 2024-02-21T22:40:07.856 INFO:teuthology.orchestra.run.smithi116.stdout:variety of kernel formats, file systems, computer architectures and 2024-02-21T22:40:07.856 INFO:teuthology.orchestra.run.smithi116.stdout:hardware devices. 2024-02-21T22:40:07.856 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-02-21T22:40:07.856 INFO:teuthology.orchestra.run.smithi116.stdout:This subpackage provides tools for support of all platforms. 2024-02-21T22:40:07.857 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-02-21T22:40:07.857 INFO:teuthology.task.kernel:Updating grub on smithi116 to boot 5.14.0-419.el9.x86_64 2024-02-21T22:40:07.857 DEBUG:teuthology.orchestra.run.smithi116:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-02-21T22:40:08.560 INFO:teuthology.orchestra.run.smithi116.stderr:Generating grub configuration file ... 2024-02-21T22:40:09.908 INFO:teuthology.orchestra.run.smithi116.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-02-21T22:40:09.943 INFO:teuthology.orchestra.run.smithi116.stderr:done 2024-02-21T22:40:09.946 DEBUG:teuthology.orchestra.run.smithi116:> mktemp 2024-02-21T22:40:09.961 INFO:teuthology.orchestra.run.smithi116.stdout:/tmp/tmp.qvTIciMrOv 2024-02-21T22:40:09.961 DEBUG:teuthology.orchestra.run.smithi116:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.qvTIciMrOv 2024-02-21T22:40:10.038 DEBUG:teuthology.orchestra.run.smithi116:> sudo chmod 0666 /tmp/tmp.qvTIciMrOv 2024-02-21T22:40:10.191 DEBUG:teuthology.orchestra.remote:smithi116:/tmp/tmp.qvTIciMrOv is 6KB 2024-02-21T22:40:10.239 DEBUG:teuthology.orchestra.run.smithi116:> rm -fr /tmp/tmp.qvTIciMrOv 2024-02-21T22:40:10.253 DEBUG:teuthology.orchestra.run.smithi116:> sudo /bin/ls /boot/loader/entries || true 2024-02-21T22:40:10.336 INFO:teuthology.orchestra.run.smithi116.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-02-21T22:40:10.336 INFO:teuthology.orchestra.run.smithi116.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-02-21T22:40:10.336 INFO:teuthology.orchestra.run.smithi116.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-02-21T22:40:10.336 INFO:teuthology.orchestra.run.smithi116.stdout:15949e3c88704300882482eddfd7baae-5.14.0-419.el9.x86_64.conf 2024-02-21T22:40:10.337 DEBUG:teuthology.orchestra.run.smithi116:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-419.el9.x86_64 2024-02-21T22:40:10.501 DEBUG:teuthology.orchestra.run.smithi116:> sudo shutdown -r now 2024-02-21T22:40:12.739 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: kernel-core-5.14.0-419.el9.x86_64 4/4 2024-02-21T22:40:12.739 INFO:teuthology.orchestra.run.smithi142.stdout:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-02-21T22:40:12.739 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-21T22:40:12.826 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: kernel-modules-5.14.0-419.el9.x86_64 4/4 2024-02-21T22:40:13.226 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: kernel-5.14.0-419.el9.x86_64 4/4 2024-02-21T22:40:13.226 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : kernel-5.14.0-419.el9.x86_64 1/4 2024-02-21T22:40:13.226 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : kernel-core-5.14.0-419.el9.x86_64 2/4 2024-02-21T22:40:13.226 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : kernel-modules-5.14.0-419.el9.x86_64 3/4 2024-02-21T22:40:13.676 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : kernel-modules-core-5.14.0-419.el9.x86_64 4/4 2024-02-21T22:40:13.676 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-21T22:40:13.676 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2024-02-21T22:40:13.676 INFO:teuthology.orchestra.run.smithi142.stdout: kernel-5.14.0-419.el9.x86_64 2024-02-21T22:40:13.676 INFO:teuthology.orchestra.run.smithi142.stdout: kernel-core-5.14.0-419.el9.x86_64 2024-02-21T22:40:13.676 INFO:teuthology.orchestra.run.smithi142.stdout: kernel-modules-5.14.0-419.el9.x86_64 2024-02-21T22:40:13.676 INFO:teuthology.orchestra.run.smithi142.stdout: kernel-modules-core-5.14.0-419.el9.x86_64 2024-02-21T22:40:13.677 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-21T22:40:13.677 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-02-21T22:40:14.183 DEBUG:teuthology.orchestra.run.smithi142:> rpm -q kernel | sort -rV | head -n 1 2024-02-21T22:40:14.325 INFO:teuthology.orchestra.run.smithi142.stdout:kernel-5.14.0-419.el9.x86_64 2024-02-21T22:40:14.325 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-419.el9.x86_64 2024-02-21T22:40:14.325 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-419.el9.x86_64 2024-02-21T22:40:14.325 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-02-21T22:40:14.326 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-02-21T22:40:14.326 INFO:teuthology.task.kernel:Installing distro kernel on client.1... 2024-02-21T22:40:14.326 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi142.front.sepia.ceph.com, path=None, version=distro) 2024-02-21T22:40:14.326 DEBUG:teuthology.orchestra.run.smithi142:> rpm -q kernel | sort -rV | head -n 1 2024-02-21T22:40:14.446 INFO:teuthology.orchestra.run.smithi142.stdout:kernel-5.14.0-419.el9.x86_64 2024-02-21T22:40:14.446 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-419.el9.x86_64 2024-02-21T22:40:14.446 DEBUG:teuthology.orchestra.run.smithi142:> sudo rpm -qi grub2-tools 2024-02-21T22:40:14.489 INFO:teuthology.orchestra.run.smithi142.stdout:Name : grub2-tools 2024-02-21T22:40:14.489 INFO:teuthology.orchestra.run.smithi142.stdout:Epoch : 1 2024-02-21T22:40:14.489 INFO:teuthology.orchestra.run.smithi142.stdout:Version : 2.06 2024-02-21T22:40:14.489 INFO:teuthology.orchestra.run.smithi142.stdout:Release : 68.el9 2024-02-21T22:40:14.489 INFO:teuthology.orchestra.run.smithi142.stdout:Architecture: x86_64 2024-02-21T22:40:14.490 INFO:teuthology.orchestra.run.smithi142.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-02-21T22:40:14.490 INFO:teuthology.orchestra.run.smithi142.stdout:Group : Unspecified 2024-02-21T22:40:14.490 INFO:teuthology.orchestra.run.smithi142.stdout:Size : 8264254 2024-02-21T22:40:14.490 INFO:teuthology.orchestra.run.smithi142.stdout:License : GPLv3+ 2024-02-21T22:40:14.490 INFO:teuthology.orchestra.run.smithi142.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-02-21T22:40:14.490 INFO:teuthology.orchestra.run.smithi142.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-02-21T22:40:14.490 INFO:teuthology.orchestra.run.smithi142.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-02-21T22:40:14.490 INFO:teuthology.orchestra.run.smithi142.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-02-21T22:40:14.490 INFO:teuthology.orchestra.run.smithi142.stdout:Packager : builder@centos.org 2024-02-21T22:40:14.490 INFO:teuthology.orchestra.run.smithi142.stdout:Vendor : CentOS 2024-02-21T22:40:14.490 INFO:teuthology.orchestra.run.smithi142.stdout:URL : http://www.gnu.org/software/grub/ 2024-02-21T22:40:14.490 INFO:teuthology.orchestra.run.smithi142.stdout:Summary : Support tools for GRUB. 2024-02-21T22:40:14.490 INFO:teuthology.orchestra.run.smithi142.stdout:Description : 2024-02-21T22:40:14.490 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-21T22:40:14.490 INFO:teuthology.orchestra.run.smithi142.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-02-21T22:40:14.491 INFO:teuthology.orchestra.run.smithi142.stdout:customizable bootloader with modular architecture. It supports a rich 2024-02-21T22:40:14.491 INFO:teuthology.orchestra.run.smithi142.stdout:variety of kernel formats, file systems, computer architectures and 2024-02-21T22:40:14.491 INFO:teuthology.orchestra.run.smithi142.stdout:hardware devices. 2024-02-21T22:40:14.491 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-21T22:40:14.491 INFO:teuthology.orchestra.run.smithi142.stdout:This subpackage provides tools for support of all platforms. 2024-02-21T22:40:14.492 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-02-21T22:40:14.492 INFO:teuthology.task.kernel:Updating grub on smithi142 to boot 5.14.0-419.el9.x86_64 2024-02-21T22:40:14.492 DEBUG:teuthology.orchestra.run.smithi142:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-02-21T22:40:15.118 INFO:teuthology.orchestra.run.smithi142.stderr:Generating grub configuration file ... 2024-02-21T22:40:16.517 INFO:teuthology.orchestra.run.smithi142.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-02-21T22:40:16.552 INFO:teuthology.orchestra.run.smithi142.stderr:done 2024-02-21T22:40:16.555 DEBUG:teuthology.orchestra.run.smithi142:> mktemp 2024-02-21T22:40:16.571 INFO:teuthology.orchestra.run.smithi142.stdout:/tmp/tmp.YUiC90UIF5 2024-02-21T22:40:16.572 DEBUG:teuthology.orchestra.run.smithi142:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.YUiC90UIF5 2024-02-21T22:40:16.640 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 0666 /tmp/tmp.YUiC90UIF5 2024-02-21T22:40:16.775 DEBUG:teuthology.orchestra.remote:smithi142:/tmp/tmp.YUiC90UIF5 is 6KB 2024-02-21T22:40:16.823 DEBUG:teuthology.orchestra.run.smithi142:> rm -fr /tmp/tmp.YUiC90UIF5 2024-02-21T22:40:16.837 DEBUG:teuthology.orchestra.run.smithi142:> sudo /bin/ls /boot/loader/entries || true 2024-02-21T22:40:16.902 INFO:teuthology.orchestra.run.smithi142.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-02-21T22:40:16.902 INFO:teuthology.orchestra.run.smithi142.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-02-21T22:40:16.902 INFO:teuthology.orchestra.run.smithi142.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-02-21T22:40:16.902 INFO:teuthology.orchestra.run.smithi142.stdout:15949e3c88704300882482eddfd7baae-5.14.0-419.el9.x86_64.conf 2024-02-21T22:40:16.903 DEBUG:teuthology.orchestra.run.smithi142:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-419.el9.x86_64 2024-02-21T22:40:17.049 DEBUG:teuthology.orchestra.run.smithi142:> sudo shutdown -r now 2024-02-21T22:40:40.527 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-02-21T22:40:40.527 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi116.front.sepia.ceph.com' 2024-02-21T22:40:40.528 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-21T22:40:47.059 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2024-02-21T22:40:47.059 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi142.front.sepia.ceph.com' 2024-02-21T22:40:47.060 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-21T22:40:58.940 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.116 2024-02-21T22:41:05.596 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.142 2024-02-21T22:41:07.944 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi116.front.sepia.ceph.com' 2024-02-21T22:41:07.945 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-21T22:41:11.008 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.116 2024-02-21T22:41:14.598 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi142.front.sepia.ceph.com' 2024-02-21T22:41:14.598 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-21T22:41:23.016 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi116.front.sepia.ceph.com' 2024-02-21T22:41:23.017 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-21T22:41:41.436 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.116 2024-02-21T22:41:56.452 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi116.front.sepia.ceph.com' 2024-02-21T22:41:56.453 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-21T22:41:56.839 DEBUG:teuthology.orchestra.run.smithi116:> true 2024-02-21T22:41:57.319 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi116.front.sepia.ceph.com' 2024-02-21T22:41:57.319 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "5.14.0-419.el9.x86_64"... 2024-02-21T22:41:57.319 DEBUG:teuthology.orchestra.run.smithi116:> uname -r 2024-02-21T22:41:57.333 INFO:teuthology.orchestra.run.smithi116.stdout:5.14.0-419.el9.x86_64 2024-02-21T22:41:57.333 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-419.el9.x86_64 vs 5.14.0-419.el9.x86_64 2024-02-21T22:41:57.333 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-02-21T22:41:57.333 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-02-21T22:41:58.334 DEBUG:teuthology.parallel:result is None 2024-02-21T22:42:14.600 DEBUG:teuthology.orchestra.remote:timed out 2024-02-21T22:42:26.601 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi142.front.sepia.ceph.com' 2024-02-21T22:42:26.602 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-21T22:42:27.035 DEBUG:teuthology.orchestra.run.smithi142:> true 2024-02-21T22:42:27.412 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi142.front.sepia.ceph.com' 2024-02-21T22:42:27.412 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "5.14.0-419.el9.x86_64"... 2024-02-21T22:42:27.412 DEBUG:teuthology.orchestra.run.smithi142:> uname -r 2024-02-21T22:42:27.468 INFO:teuthology.orchestra.run.smithi142.stdout:5.14.0-419.el9.x86_64 2024-02-21T22:42:27.468 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-419.el9.x86_64 vs 5.14.0-419.el9.x86_64 2024-02-21T22:42:27.469 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-02-21T22:42:27.469 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-02-21T22:42:28.470 DEBUG:teuthology.parallel:result is None 2024-02-21T22:42:28.470 INFO:teuthology.run_tasks:Running task internal.base... 2024-02-21T22:42:28.482 INFO:teuthology.task.internal:Creating test directory... 2024-02-21T22:42:28.482 DEBUG:teuthology.orchestra.run.smithi116:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-02-21T22:42:28.485 DEBUG:teuthology.orchestra.run.smithi142:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-02-21T22:42:28.502 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-02-21T22:42:28.542 INFO:teuthology.run_tasks:Running task internal.archive... 2024-02-21T22:42:28.549 INFO:teuthology.task.internal:Creating archive directory... 2024-02-21T22:42:28.549 DEBUG:teuthology.orchestra.run.smithi116:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-02-21T22:42:28.552 DEBUG:teuthology.orchestra.run.smithi142:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-02-21T22:42:28.592 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-02-21T22:42:28.601 INFO:teuthology.task.internal:Enabling coredump saving... 2024-02-21T22:42:28.601 DEBUG:teuthology.orchestra.run.smithi116:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-02-21T22:42:28.625 DEBUG:teuthology.orchestra.run.smithi142:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-02-21T22:42:28.708 INFO:teuthology.orchestra.run.smithi142.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-21T22:42:28.712 INFO:teuthology.orchestra.run.smithi116.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-21T22:42:28.744 INFO:teuthology.orchestra.run.smithi142.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-21T22:42:28.744 INFO:teuthology.orchestra.run.smithi116.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-21T22:42:28.746 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-02-21T22:42:28.754 INFO:teuthology.task.internal:Configuring sudo... 2024-02-21T22:42:28.754 DEBUG:teuthology.orchestra.run.smithi116:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-02-21T22:42:28.756 DEBUG:teuthology.orchestra.run.smithi142:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-02-21T22:42:28.785 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-02-21T22:42:28.794 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-02-21T22:42:28.795 DEBUG:teuthology.orchestra.run.smithi116:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-02-21T22:42:28.827 DEBUG:teuthology.orchestra.run.smithi142:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-02-21T22:42:28.843 DEBUG:teuthology.orchestra.run.smithi116:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-21T22:42:28.925 DEBUG:teuthology.orchestra.run.smithi116:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-21T22:42:28.973 DEBUG:teuthology.orchestra.run.smithi116:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-21T22:42:29.055 DEBUG:teuthology.orchestra.run.smithi116:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-21T22:42:29.098 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-02-21T22:42:29.098 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-02-21T22:42:29.165 DEBUG:teuthology.orchestra.run.smithi142:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-21T22:42:29.207 DEBUG:teuthology.orchestra.run.smithi142:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-21T22:42:29.260 DEBUG:teuthology.orchestra.run.smithi142:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-21T22:42:29.343 DEBUG:teuthology.orchestra.run.smithi142:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-21T22:42:29.386 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-02-21T22:42:29.386 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-02-21T22:42:29.454 DEBUG:teuthology.orchestra.run.smithi116:> sudo service rsyslog restart 2024-02-21T22:42:29.456 DEBUG:teuthology.orchestra.run.smithi142:> sudo service rsyslog restart 2024-02-21T22:42:29.508 INFO:teuthology.orchestra.run.smithi116.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-02-21T22:42:29.536 INFO:teuthology.orchestra.run.smithi142.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-02-21T22:42:29.949 INFO:teuthology.run_tasks:Running task internal.timer... 2024-02-21T22:42:29.957 INFO:teuthology.task.internal:Starting timer... 2024-02-21T22:42:29.958 INFO:teuthology.run_tasks:Running task pcp... 2024-02-21T22:42:30.003 INFO:teuthology.run_tasks:Running task selinux... 2024-02-21T22:42:30.011 DEBUG:teuthology.orchestra.run.smithi116:> sudo service auditd rotate 2024-02-21T22:42:30.065 INFO:teuthology.orchestra.run.smithi116.stdout:Rotating logs: 2024-02-21T22:42:30.067 DEBUG:teuthology.orchestra.run.smithi142:> sudo service auditd rotate 2024-02-21T22:42:30.124 INFO:teuthology.orchestra.run.smithi142.stdout:Rotating logs: 2024-02-21T22:42:30.126 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-02-21T22:42:30.126 DEBUG:teuthology.orchestra.run.smithi116:> /usr/sbin/getenforce 2024-02-21T22:42:30.149 INFO:teuthology.orchestra.run.smithi116.stdout:Permissive 2024-02-21T22:42:30.150 DEBUG:teuthology.orchestra.run.smithi142:> /usr/sbin/getenforce 2024-02-21T22:42:30.174 INFO:teuthology.orchestra.run.smithi142.stdout:Permissive 2024-02-21T22:42:30.174 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi116.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi142.front.sepia.ceph.com': 'permissive'} 2024-02-21T22:42:30.174 DEBUG:teuthology.orchestra.run.smithi116:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-02-21T22:42:30.218 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-21T22:42:30.218 DEBUG:teuthology.orchestra.run.smithi142:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-02-21T22:42:30.246 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-21T22:42:30.246 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-02-21T22:42:30.247 DEBUG:teuthology.orchestra.run.smithi116:> sudo /usr/sbin/setenforce permissive 2024-02-21T22:42:30.294 DEBUG:teuthology.orchestra.run.smithi142:> sudo /usr/sbin/setenforce permissive 2024-02-21T22:42:30.326 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-02-21T22:42:30.335 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-02-21T22:42:30.381 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-02-21T22:42:30.383 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi116.front.sepia.ceph.com,smithi142.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-02-21T22:49:30.154 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi116.front.sepia.ceph.com'), Remote(name='ubuntu@smithi142.front.sepia.ceph.com')] 2024-02-21T22:49:30.156 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi116.front.sepia.ceph.com' 2024-02-21T22:49:30.157 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-21T22:49:30.255 DEBUG:teuthology.orchestra.run.smithi116:> true 2024-02-21T22:49:30.341 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi116.front.sepia.ceph.com' 2024-02-21T22:49:30.342 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi142.front.sepia.ceph.com' 2024-02-21T22:49:30.343 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-21T22:49:30.445 DEBUG:teuthology.orchestra.run.smithi142:> true 2024-02-21T22:49:30.527 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi142.front.sepia.ceph.com' 2024-02-21T22:49:30.528 INFO:teuthology.run_tasks:Running task clock... 2024-02-21T22:49:30.540 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-02-21T22:49:30.540 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-02-21T22:49:30.541 DEBUG:teuthology.orchestra.run.smithi116:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-21T22:49:30.543 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-02-21T22:49:30.543 DEBUG:teuthology.orchestra.run.smithi142:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-21T22:49:30.571 INFO:teuthology.orchestra.run.smithi116.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-02-21T22:49:30.588 INFO:teuthology.orchestra.run.smithi116.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-02-21T22:49:30.601 INFO:teuthology.orchestra.run.smithi142.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-02-21T22:49:30.617 INFO:teuthology.orchestra.run.smithi116.stderr:sudo: ntpd: command not found 2024-02-21T22:49:30.619 INFO:teuthology.orchestra.run.smithi142.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-02-21T22:49:30.630 INFO:teuthology.orchestra.run.smithi116.stdout:506 Cannot talk to daemon 2024-02-21T22:49:30.646 INFO:teuthology.orchestra.run.smithi116.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-02-21T22:49:30.649 INFO:teuthology.orchestra.run.smithi142.stderr:sudo: ntpd: command not found 2024-02-21T22:49:30.662 INFO:teuthology.orchestra.run.smithi116.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-02-21T22:49:30.663 INFO:teuthology.orchestra.run.smithi142.stdout:506 Cannot talk to daemon 2024-02-21T22:49:30.680 INFO:teuthology.orchestra.run.smithi142.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-02-21T22:49:30.697 INFO:teuthology.orchestra.run.smithi142.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-02-21T22:49:30.715 INFO:teuthology.orchestra.run.smithi116.stderr:bash: line 1: ntpq: command not found 2024-02-21T22:49:30.718 INFO:teuthology.orchestra.run.smithi116.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-02-21T22:49:30.718 INFO:teuthology.orchestra.run.smithi116.stdout:=============================================================================== 2024-02-21T22:49:30.718 INFO:teuthology.orchestra.run.smithi116.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-21T22:49:30.719 INFO:teuthology.orchestra.run.smithi116.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-21T22:49:30.719 INFO:teuthology.orchestra.run.smithi116.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-21T22:49:30.719 INFO:teuthology.orchestra.run.smithi116.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-21T22:49:30.756 INFO:teuthology.orchestra.run.smithi142.stderr:bash: line 1: ntpq: command not found 2024-02-21T22:49:30.760 INFO:teuthology.orchestra.run.smithi142.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-02-21T22:49:30.760 INFO:teuthology.orchestra.run.smithi142.stdout:=============================================================================== 2024-02-21T22:49:30.760 INFO:teuthology.orchestra.run.smithi142.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-21T22:49:30.760 INFO:teuthology.orchestra.run.smithi142.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-21T22:49:30.760 INFO:teuthology.orchestra.run.smithi142.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-21T22:49:30.760 INFO:teuthology.orchestra.run.smithi142.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-21T22:49:30.760 INFO:teuthology.run_tasks:Running task install... 2024-02-21T22:49:30.768 DEBUG:teuthology.task.install:project ceph 2024-02-21T22:49:30.769 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '3bfc837d7b45ce8e095d92fa9c342964cea5e95f'}} 2024-02-21T22:49:30.769 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '3bfc837d7b45ce8e095d92fa9c342964cea5e95f'} 2024-02-21T22:49:30.769 INFO:teuthology.task.install:Using flavor: default 2024-02-21T22:49:30.775 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-02-21T22:49:30.775 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-02-21T22:49:30.775 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '3bfc837d7b45ce8e095d92fa9c342964cea5e95f', 'tag': None, 'wait_for_package': False} 2024-02-21T22:49:30.776 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3bfc837d7b45ce8e095d92fa9c342964cea5e95f 2024-02-21T22:49:30.778 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '3bfc837d7b45ce8e095d92fa9c342964cea5e95f', 'tag': None, 'wait_for_package': False} 2024-02-21T22:49:30.778 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3bfc837d7b45ce8e095d92fa9c342964cea5e95f 2024-02-21T22:49:30.924 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-lusov-qdb/3bfc837d7b45ce8e095d92fa9c342964cea5e95f/centos/9/flavors/default/ 2024-02-21T22:49:30.925 INFO:teuthology.task.install.rpm:Package version is 19.0.0-1643.g3bfc837d 2024-02-21T22:49:30.928 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-lusov-qdb/3bfc837d7b45ce8e095d92fa9c342964cea5e95f/centos/9/flavors/default/ 2024-02-21T22:49:30.928 INFO:teuthology.task.install.rpm:Package version is 19.0.0-1643.g3bfc837d 2024-02-21T22:49:31.232 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-lusov-qdb/3bfc837d7b45ce8e095d92fa9c342964cea5e95f/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-lusov-qdb/3bfc837d7b45ce8e095d92fa9c342964cea5e95f/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-lusov-qdb/3bfc837d7b45ce8e095d92fa9c342964cea5e95f/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-02-21T22:49:31.232 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-02-21T22:49:31.232 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-02-21T22:49:31.239 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-lusov-qdb/3bfc837d7b45ce8e095d92fa9c342964cea5e95f/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-lusov-qdb/3bfc837d7b45ce8e095d92fa9c342964cea5e95f/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-lusov-qdb/3bfc837d7b45ce8e095d92fa9c342964cea5e95f/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-02-21T22:49:31.240 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-02-21T22:49:31.240 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-02-21T22:49:31.261 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-02-21T22:49:31.261 DEBUG:teuthology.orchestra.run.smithi116:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/3bfc837d7b45ce8e095d92fa9c342964cea5e95f/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-02-21T22:49:31.268 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-02-21T22:49:31.269 DEBUG:teuthology.orchestra.run.smithi142:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/3bfc837d7b45ce8e095d92fa9c342964cea5e95f/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-02-21T22:49:31.330 DEBUG:teuthology.orchestra.run.smithi116:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-02-21T22:49:31.338 DEBUG:teuthology.orchestra.run.smithi142:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-02-21T22:49:31.411 DEBUG:teuthology.orchestra.run.smithi116:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-02-21T22:49:31.419 DEBUG:teuthology.orchestra.run.smithi142:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-02-21T22:49:31.478 INFO:teuthology.orchestra.run.smithi116.stdout:check_obsoletes = 1 2024-02-21T22:49:31.480 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum clean all 2024-02-21T22:49:31.487 INFO:teuthology.orchestra.run.smithi142.stdout:check_obsoletes = 1 2024-02-21T22:49:31.488 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum clean all 2024-02-21T22:49:31.720 INFO:teuthology.orchestra.run.smithi116.stdout:74 files removed 2024-02-21T22:49:31.747 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-02-21T22:49:31.748 INFO:teuthology.orchestra.run.smithi142.stdout:74 files removed 2024-02-21T22:49:31.778 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-02-21T22:49:33.160 INFO:teuthology.orchestra.run.smithi116.stdout:ceph packages for x86_64 76 kB/s | 83 kB 00:01 2024-02-21T22:49:33.199 INFO:teuthology.orchestra.run.smithi142.stdout:ceph packages for x86_64 75 kB/s | 83 kB 00:01 2024-02-21T22:49:33.967 INFO:teuthology.orchestra.run.smithi142.stdout:ceph noarch packages 14 kB/s | 10 kB 00:00 2024-02-21T22:49:33.994 INFO:teuthology.orchestra.run.smithi116.stdout:ceph noarch packages 13 kB/s | 10 kB 00:00 2024-02-21T22:49:34.609 INFO:teuthology.orchestra.run.smithi142.stdout:ceph source packages 3.1 kB/s | 1.9 kB 00:00 2024-02-21T22:49:34.736 INFO:teuthology.orchestra.run.smithi116.stdout:ceph source packages 2.7 kB/s | 1.9 kB 00:00 2024-02-21T22:49:35.178 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS-9 - AppStream 15 MB/s | 8.1 MB 00:00 2024-02-21T22:49:35.305 INFO:teuthology.orchestra.run.smithi116.stdout:CentOS-9 - AppStream 15 MB/s | 8.1 MB 00:00 2024-02-21T22:49:36.947 INFO:teuthology.orchestra.run.smithi116.stdout:CentOS-9 - BaseOS 8.3 MB/s | 2.5 MB 00:00 2024-02-21T22:49:37.070 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS-9 - BaseOS 4.4 MB/s | 2.5 MB 00:00 2024-02-21T22:49:38.071 INFO:teuthology.orchestra.run.smithi116.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.0 MB 00:00 2024-02-21T22:49:46.734 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 9 - BaseOS 889 kB/s | 8.0 MB 00:09 2024-02-21T22:50:00.736 INFO:teuthology.orchestra.run.smithi116.stdout:CentOS Stream 9 - AppStream 908 kB/s | 19 MB 00:21 2024-02-21T22:50:09.583 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 9 - AppStream 901 kB/s | 19 MB 00:21 2024-02-21T22:50:12.486 INFO:teuthology.orchestra.run.smithi116.stdout:CentOS Stream 9 - CRB 760 kB/s | 6.1 MB 00:08 2024-02-21T22:50:13.683 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 9 - CRB 13 MB/s | 6.1 MB 00:00 2024-02-21T22:50:14.170 INFO:teuthology.orchestra.run.smithi116.stdout:CentOS Stream 9 - Extras packages 46 kB/s | 15 kB 00:00 2024-02-21T22:50:15.109 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 9 - Extras packages 63 kB/s | 15 kB 00:00 2024-02-21T22:50:16.780 INFO:teuthology.orchestra.run.smithi142.stdout:Extra Packages for Enterprise Linux 13 MB/s | 20 MB 00:01 2024-02-21T22:50:17.363 INFO:teuthology.orchestra.run.smithi116.stdout:Extra Packages for Enterprise Linux 6.7 MB/s | 20 MB 00:03 2024-02-21T22:50:21.894 INFO:teuthology.orchestra.run.smithi142.stdout:lab-extras 14 kB/s | 1.7 kB 00:00 2024-02-21T22:50:22.430 INFO:teuthology.orchestra.run.smithi116.stdout:lab-extras 43 kB/s | 1.7 kB 00:00 2024-02-21T22:50:24.455 INFO:teuthology.orchestra.run.smithi142.stderr:Modular dependency problems: 2024-02-21T22:50:24.455 INFO:teuthology.orchestra.run.smithi142.stderr: 2024-02-21T22:50:24.455 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 1: conflicting requests 2024-02-21T22:50:24.456 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240219154654:20125149.x86_64 from CentOS-AppStream 2024-02-21T22:50:24.456 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 2: conflicting requests 2024-02-21T22:50:24.456 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-21T22:50:24.456 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 3: conflicting requests 2024-02-21T22:50:24.456 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-21T22:50:24.456 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 4: conflicting requests 2024-02-21T22:50:24.456 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-21T22:50:24.457 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 5: conflicting requests 2024-02-21T22:50:24.457 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-21T22:50:24.457 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 6: conflicting requests 2024-02-21T22:50:24.457 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-21T22:50:24.457 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 7: conflicting requests 2024-02-21T22:50:24.457 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-21T22:50:24.457 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 8: conflicting requests 2024-02-21T22:50:24.457 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-21T22:50:24.457 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 9: conflicting requests 2024-02-21T22:50:24.457 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-21T22:50:24.457 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 10: conflicting requests 2024-02-21T22:50:24.457 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-21T22:50:24.457 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 11: conflicting requests 2024-02-21T22:50:24.458 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-21T22:50:24.458 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 12: conflicting requests 2024-02-21T22:50:24.458 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-21T22:50:24.458 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 13: conflicting requests 2024-02-21T22:50:24.458 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-21T22:50:24.458 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 14: conflicting requests 2024-02-21T22:50:24.458 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-21T22:50:24.458 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 15: conflicting requests 2024-02-21T22:50:24.458 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-21T22:50:24.458 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 16: conflicting requests 2024-02-21T22:50:24.458 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-21T22:50:24.458 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 17: conflicting requests 2024-02-21T22:50:24.459 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-21T22:50:24.459 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 18: conflicting requests 2024-02-21T22:50:24.459 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-21T22:50:24.459 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 19: conflicting requests 2024-02-21T22:50:24.459 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-21T22:50:24.459 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 20: conflicting requests 2024-02-21T22:50:24.459 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-21T22:50:24.459 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 21: conflicting requests 2024-02-21T22:50:24.459 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-21T22:50:24.459 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 22: conflicting requests 2024-02-21T22:50:24.460 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-21T22:50:24.460 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 23: conflicting requests 2024-02-21T22:50:24.460 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-21T22:50:24.460 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 24: conflicting requests 2024-02-21T22:50:24.460 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-21T22:50:24.460 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 25: conflicting requests 2024-02-21T22:50:24.460 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-21T22:50:24.460 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 26: conflicting requests 2024-02-21T22:50:24.460 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-21T22:50:24.460 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 27: conflicting requests 2024-02-21T22:50:24.461 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-21T22:50:24.461 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 28: conflicting requests 2024-02-21T22:50:24.461 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-21T22:50:24.461 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 29: conflicting requests 2024-02-21T22:50:24.461 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-21T22:50:24.461 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 30: conflicting requests 2024-02-21T22:50:24.461 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-21T22:50:24.461 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 31: conflicting requests 2024-02-21T22:50:24.461 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-21T22:50:24.461 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 32: conflicting requests 2024-02-21T22:50:24.461 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-21T22:50:24.461 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 33: conflicting requests 2024-02-21T22:50:24.461 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-21T22:50:24.462 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 34: conflicting requests 2024-02-21T22:50:24.462 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-21T22:50:24.462 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 35: conflicting requests 2024-02-21T22:50:24.462 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240203221207:9edba152.x86_64 from CentOS-AppStream 2024-02-21T22:50:24.462 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 36: conflicting requests 2024-02-21T22:50:24.462 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-21T22:50:24.462 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-21T22:50:24.462 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-21T22:50:24.462 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 37: cannot install the best candidate for the job 2024-02-21T22:50:24.462 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-21T22:50:24.462 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-21T22:50:24.462 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-21T22:50:24.462 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-21T22:50:24.463 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 38: conflicting requests 2024-02-21T22:50:24.463 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-21T22:50:24.463 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-21T22:50:24.463 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-21T22:50:24.463 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-21T22:50:24.463 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-21T22:50:24.463 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-21T22:50:24.463 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 39: cannot install the best candidate for the job 2024-02-21T22:50:24.463 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-21T22:50:24.463 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-21T22:50:24.463 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-21T22:50:24.463 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-21T22:50:24.463 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 40: cannot install the best candidate for the job 2024-02-21T22:50:24.463 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-21T22:50:24.464 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-21T22:50:24.464 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-21T22:50:24.464 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-21T22:50:24.464 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 41: cannot install the best candidate for the job 2024-02-21T22:50:24.464 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-21T22:50:24.464 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-21T22:50:24.464 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-21T22:50:24.464 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-21T22:50:24.464 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 42: cannot install the best candidate for the job 2024-02-21T22:50:24.464 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-21T22:50:24.464 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-21T22:50:24.464 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-21T22:50:24.464 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-21T22:50:24.465 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 43: cannot install the best candidate for the job 2024-02-21T22:50:24.465 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-21T22:50:24.465 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-21T22:50:24.465 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-21T22:50:24.465 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-21T22:50:24.465 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 44: cannot install the best candidate for the job 2024-02-21T22:50:24.465 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-21T22:50:24.465 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-21T22:50:24.465 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-21T22:50:24.465 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-21T22:50:24.906 INFO:teuthology.orchestra.run.smithi142.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-02-21T22:50:24.907 INFO:teuthology.orchestra.run.smithi142.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-02-21T22:50:24.920 INFO:teuthology.orchestra.run.smithi142.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2024-02-21T22:50:24.921 INFO:teuthology.orchestra.run.smithi142.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-02-21T22:50:24.922 INFO:teuthology.orchestra.run.smithi142.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2024-02-21T22:50:24.924 INFO:teuthology.orchestra.run.smithi142.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2024-02-21T22:50:24.925 INFO:teuthology.orchestra.run.smithi142.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-02-21T22:50:24.929 INFO:teuthology.orchestra.run.smithi142.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2024-02-21T22:50:24.930 INFO:teuthology.orchestra.run.smithi142.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2024-02-21T22:50:25.019 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-02-21T22:50:25.038 INFO:teuthology.orchestra.run.smithi142.stdout:========================================================================================= 2024-02-21T22:50:25.038 INFO:teuthology.orchestra.run.smithi142.stdout: Package Arch Version Repository Size 2024-02-21T22:50:25.038 INFO:teuthology.orchestra.run.smithi142.stdout:========================================================================================= 2024-02-21T22:50:25.038 INFO:teuthology.orchestra.run.smithi142.stdout:Installing: 2024-02-21T22:50:25.039 INFO:teuthology.orchestra.run.smithi142.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-02-21T22:50:25.039 INFO:teuthology.orchestra.run.smithi142.stdout: ceph x86_64 2:19.0.0-1643.g3bfc837d.el9 ceph 6.6 k 2024-02-21T22:50:25.039 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-base x86_64 2:19.0.0-1643.g3bfc837d.el9 ceph 5.3 M 2024-02-21T22:50:25.039 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-fuse x86_64 2:19.0.0-1643.g3bfc837d.el9 ceph 889 k 2024-02-21T22:50:25.039 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-1643.g3bfc837d.el9 ceph 145 k 2024-02-21T22:50:25.039 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr x86_64 2:19.0.0-1643.g3bfc837d.el9 ceph 1.5 M 2024-02-21T22:50:25.039 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-cephadm noarch 2:19.0.0-1643.g3bfc837d.el9 ceph-noarch 138 k 2024-02-21T22:50:25.039 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-dashboard noarch 2:19.0.0-1643.g3bfc837d.el9 ceph-noarch 1.8 M 2024-02-21T22:50:25.039 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-1643.g3bfc837d.el9 ceph-noarch 7.4 M 2024-02-21T22:50:25.039 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-rook noarch 2:19.0.0-1643.g3bfc837d.el9 ceph-noarch 49 k 2024-02-21T22:50:25.039 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-radosgw x86_64 2:19.0.0-1643.g3bfc837d.el9 ceph 9.8 M 2024-02-21T22:50:25.039 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-test x86_64 2:19.0.0-1643.g3bfc837d.el9 ceph 47 M 2024-02-21T22:50:25.039 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-volume noarch 2:19.0.0-1643.g3bfc837d.el9 ceph-noarch 264 k 2024-02-21T22:50:25.039 INFO:teuthology.orchestra.run.smithi142.stdout: cephadm noarch 2:19.0.0-1643.g3bfc837d.el9 ceph-noarch 748 k 2024-02-21T22:50:25.040 INFO:teuthology.orchestra.run.smithi142.stdout: cephfs-mirror x86_64 2:19.0.0-1643.g3bfc837d.el9 ceph 220 k 2024-02-21T22:50:25.040 INFO:teuthology.orchestra.run.smithi142.stdout: cephfs-shell x86_64 2:19.0.0-1643.g3bfc837d.el9 ceph 27 k 2024-02-21T22:50:25.040 INFO:teuthology.orchestra.run.smithi142.stdout: cephfs-top noarch 2:19.0.0-1643.g3bfc837d.el9 ceph-noarch 18 k 2024-02-21T22:50:25.040 INFO:teuthology.orchestra.run.smithi142.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-02-21T22:50:25.040 INFO:teuthology.orchestra.run.smithi142.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-02-21T22:50:25.040 INFO:teuthology.orchestra.run.smithi142.stdout: libaio-devel x86_64 0.3.112-1.el8 CentOS-BaseOS 18 k 2024-02-21T22:50:25.040 INFO:teuthology.orchestra.run.smithi142.stdout: libcephfs-devel x86_64 2:19.0.0-1643.g3bfc837d.el9 ceph 31 k 2024-02-21T22:50:25.040 INFO:teuthology.orchestra.run.smithi142.stdout: libcephfs2 x86_64 2:19.0.0-1643.g3bfc837d.el9 ceph 745 k 2024-02-21T22:50:25.040 INFO:teuthology.orchestra.run.smithi142.stdout: librados-devel x86_64 2:19.0.0-1643.g3bfc837d.el9 ceph 127 k 2024-02-21T22:50:25.040 INFO:teuthology.orchestra.run.smithi142.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-02-21T22:50:25.040 INFO:teuthology.orchestra.run.smithi142.stdout: libuuid-devel x86_64 2.37.4-15.el9 appstream 26 k 2024-02-21T22:50:25.040 INFO:teuthology.orchestra.run.smithi142.stdout: openssl-devel x86_64 1:3.0.7-25.el9 appstream 4.1 M 2024-02-21T22:50:25.040 INFO:teuthology.orchestra.run.smithi142.stdout: postgresql x86_64 13.11-1.el9 appstream 1.6 M 2024-02-21T22:50:25.041 INFO:teuthology.orchestra.run.smithi142.stdout: postgresql-contrib x86_64 13.11-1.el9 appstream 905 k 2024-02-21T22:50:25.041 INFO:teuthology.orchestra.run.smithi142.stdout: postgresql-server x86_64 13.11-1.el9 appstream 5.7 M 2024-02-21T22:50:25.041 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cephfs x86_64 2:19.0.0-1643.g3bfc837d.el9 ceph 161 k 2024-02-21T22:50:25.041 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rados x86_64 2:19.0.0-1643.g3bfc837d.el9 ceph 321 k 2024-02-21T22:50:25.041 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rbd x86_64 2:19.0.0-1643.g3bfc837d.el9 ceph 298 k 2024-02-21T22:50:25.041 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rgw x86_64 2:19.0.0-1643.g3bfc837d.el9 ceph 100 k 2024-02-21T22:50:25.041 INFO:teuthology.orchestra.run.smithi142.stdout: rbd-fuse x86_64 2:19.0.0-1643.g3bfc837d.el9 ceph 85 k 2024-02-21T22:50:25.042 INFO:teuthology.orchestra.run.smithi142.stdout: rbd-mirror x86_64 2:19.0.0-1643.g3bfc837d.el9 ceph 3.1 M 2024-02-21T22:50:25.042 INFO:teuthology.orchestra.run.smithi142.stdout: rbd-nbd x86_64 2:19.0.0-1643.g3bfc837d.el9 ceph 170 k 2024-02-21T22:50:25.042 INFO:teuthology.orchestra.run.smithi142.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-02-21T22:50:25.042 INFO:teuthology.orchestra.run.smithi142.stdout:Upgrading: 2024-02-21T22:50:25.042 INFO:teuthology.orchestra.run.smithi142.stdout: NetworkManager x86_64 1:1.45.91-1.el9 baseos 2.3 M 2024-02-21T22:50:25.042 INFO:teuthology.orchestra.run.smithi142.stdout: NetworkManager-libnm x86_64 1:1.45.91-1.el9 baseos 1.8 M 2024-02-21T22:50:25.042 INFO:teuthology.orchestra.run.smithi142.stdout: NetworkManager-team x86_64 1:1.45.91-1.el9 baseos 42 k 2024-02-21T22:50:25.042 INFO:teuthology.orchestra.run.smithi142.stdout: NetworkManager-tui x86_64 1:1.45.91-1.el9 baseos 247 k 2024-02-21T22:50:25.042 INFO:teuthology.orchestra.run.smithi142.stdout: acl x86_64 2.3.1-4.el9 baseos 71 k 2024-02-21T22:50:25.042 INFO:teuthology.orchestra.run.smithi142.stdout: elfutils-debuginfod-client x86_64 0.190-2.el9 baseos 36 k 2024-02-21T22:50:25.042 INFO:teuthology.orchestra.run.smithi142.stdout: elfutils-libelf x86_64 0.190-2.el9 baseos 192 k 2024-02-21T22:50:25.042 INFO:teuthology.orchestra.run.smithi142.stdout: elfutils-libs x86_64 0.190-2.el9 baseos 256 k 2024-02-21T22:50:25.043 INFO:teuthology.orchestra.run.smithi142.stdout: libacl x86_64 2.3.1-4.el9 baseos 23 k 2024-02-21T22:50:25.043 INFO:teuthology.orchestra.run.smithi142.stdout: libacl-devel x86_64 2.3.1-4.el9 appstream 74 k 2024-02-21T22:50:25.043 INFO:teuthology.orchestra.run.smithi142.stdout: librados2 x86_64 2:19.0.0-1643.g3bfc837d.el9 ceph 3.4 M 2024-02-21T22:50:25.043 INFO:teuthology.orchestra.run.smithi142.stdout: librbd1 x86_64 2:19.0.0-1643.g3bfc837d.el9 ceph 3.1 M 2024-02-21T22:50:25.043 INFO:teuthology.orchestra.run.smithi142.stdout: openssl x86_64 1:3.0.7-25.el9 baseos 1.2 M 2024-02-21T22:50:25.043 INFO:teuthology.orchestra.run.smithi142.stdout: openssl-libs x86_64 1:3.0.7-25.el9 baseos 2.2 M 2024-02-21T22:50:25.043 INFO:teuthology.orchestra.run.smithi142.stdout: xfsdump x86_64 3.1.12-4.el9 baseos 323 k 2024-02-21T22:50:25.043 INFO:teuthology.orchestra.run.smithi142.stdout: xfsprogs x86_64 6.3.0-1.el9 baseos 1.1 M 2024-02-21T22:50:25.043 INFO:teuthology.orchestra.run.smithi142.stdout:Installing dependencies: 2024-02-21T22:50:25.043 INFO:teuthology.orchestra.run.smithi142.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-02-21T22:50:25.043 INFO:teuthology.orchestra.run.smithi142.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-02-21T22:50:25.043 INFO:teuthology.orchestra.run.smithi142.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-02-21T22:50:25.043 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-common x86_64 2:19.0.0-1643.g3bfc837d.el9 ceph 20 M 2024-02-21T22:50:25.044 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-grafana-dashboards noarch 2:19.0.0-1643.g3bfc837d.el9 ceph-noarch 31 k 2024-02-21T22:50:25.044 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mds x86_64 2:19.0.0-1643.g3bfc837d.el9 ceph 2.3 M 2024-02-21T22:50:25.044 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-modules-core noarch 2:19.0.0-1643.g3bfc837d.el9 ceph-noarch 248 k 2024-02-21T22:50:25.044 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mon x86_64 2:19.0.0-1643.g3bfc837d.el9 ceph 4.7 M 2024-02-21T22:50:25.044 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-osd x86_64 2:19.0.0-1643.g3bfc837d.el9 ceph 17 M 2024-02-21T22:50:25.044 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-prometheus-alerts noarch 2:19.0.0-1643.g3bfc837d.el9 ceph-noarch 15 k 2024-02-21T22:50:25.044 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-selinux x86_64 2:19.0.0-1643.g3bfc837d.el9 ceph 25 k 2024-02-21T22:50:25.044 INFO:teuthology.orchestra.run.smithi142.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-02-21T22:50:25.044 INFO:teuthology.orchestra.run.smithi142.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-02-21T22:50:25.044 INFO:teuthology.orchestra.run.smithi142.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-02-21T22:50:25.044 INFO:teuthology.orchestra.run.smithi142.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-02-21T22:50:25.044 INFO:teuthology.orchestra.run.smithi142.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-02-21T22:50:25.044 INFO:teuthology.orchestra.run.smithi142.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-02-21T22:50:25.044 INFO:teuthology.orchestra.run.smithi142.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-02-21T22:50:25.045 INFO:teuthology.orchestra.run.smithi142.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-02-21T22:50:25.045 INFO:teuthology.orchestra.run.smithi142.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-02-21T22:50:25.045 INFO:teuthology.orchestra.run.smithi142.stdout: libcephsqlite x86_64 2:19.0.0-1643.g3bfc837d.el9 ceph 163 k 2024-02-21T22:50:25.045 INFO:teuthology.orchestra.run.smithi142.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-02-21T22:50:25.045 INFO:teuthology.orchestra.run.smithi142.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-02-21T22:50:25.045 INFO:teuthology.orchestra.run.smithi142.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-02-21T22:50:25.045 INFO:teuthology.orchestra.run.smithi142.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-02-21T22:50:25.045 INFO:teuthology.orchestra.run.smithi142.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-02-21T22:50:25.045 INFO:teuthology.orchestra.run.smithi142.stdout: libradosstriper1 x86_64 2:19.0.0-1643.g3bfc837d.el9 ceph 502 k 2024-02-21T22:50:25.045 INFO:teuthology.orchestra.run.smithi142.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-02-21T22:50:25.045 INFO:teuthology.orchestra.run.smithi142.stdout: librgw2 x86_64 2:19.0.0-1643.g3bfc837d.el9 ceph 5.1 M 2024-02-21T22:50:25.045 INFO:teuthology.orchestra.run.smithi142.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-02-21T22:50:25.045 INFO:teuthology.orchestra.run.smithi142.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-02-21T22:50:25.045 INFO:teuthology.orchestra.run.smithi142.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-02-21T22:50:25.045 INFO:teuthology.orchestra.run.smithi142.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-02-21T22:50:25.046 INFO:teuthology.orchestra.run.smithi142.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-02-21T22:50:25.046 INFO:teuthology.orchestra.run.smithi142.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-02-21T22:50:25.046 INFO:teuthology.orchestra.run.smithi142.stdout: oniguruma x86_64 6.9.6-1.el9.5 baseos 218 k 2024-02-21T22:50:25.046 INFO:teuthology.orchestra.run.smithi142.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-02-21T22:50:25.046 INFO:teuthology.orchestra.run.smithi142.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-02-21T22:50:25.046 INFO:teuthology.orchestra.run.smithi142.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-02-21T22:50:25.046 INFO:teuthology.orchestra.run.smithi142.stdout: postgresql-private-libs x86_64 13.11-1.el9 appstream 135 k 2024-02-21T22:50:25.046 INFO:teuthology.orchestra.run.smithi142.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-02-21T22:50:25.046 INFO:teuthology.orchestra.run.smithi142.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-02-21T22:50:25.046 INFO:teuthology.orchestra.run.smithi142.stdout: python3-asyncssh noarch 2.13.2-4.el9 epel 548 k 2024-02-21T22:50:25.046 INFO:teuthology.orchestra.run.smithi142.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-02-21T22:50:25.046 INFO:teuthology.orchestra.run.smithi142.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-02-21T22:50:25.046 INFO:teuthology.orchestra.run.smithi142.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-02-21T22:50:25.046 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-02-21T22:50:25.047 INFO:teuthology.orchestra.run.smithi142.stdout: python3-ceph-argparse x86_64 2:19.0.0-1643.g3bfc837d.el9 ceph 45 k 2024-02-21T22:50:25.047 INFO:teuthology.orchestra.run.smithi142.stdout: python3-ceph-common x86_64 2:19.0.0-1643.g3bfc837d.el9 ceph 131 k 2024-02-21T22:50:25.047 INFO:teuthology.orchestra.run.smithi142.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-02-21T22:50:25.047 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-02-21T22:50:25.047 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-02-21T22:50:25.047 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-02-21T22:50:25.047 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-02-21T22:50:25.047 INFO:teuthology.orchestra.run.smithi142.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-02-21T22:50:25.047 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-02-21T22:50:25.047 INFO:teuthology.orchestra.run.smithi142.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-02-21T22:50:25.047 INFO:teuthology.orchestra.run.smithi142.stdout: python3-google-auth noarch 1:2.27.0-1.el9 epel 203 k 2024-02-21T22:50:25.047 INFO:teuthology.orchestra.run.smithi142.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-02-21T22:50:25.047 INFO:teuthology.orchestra.run.smithi142.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-02-21T22:50:25.047 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-02-21T22:50:25.048 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-02-21T22:50:25.048 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-02-21T22:50:25.048 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-02-21T22:50:25.048 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-02-21T22:50:25.048 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-02-21T22:50:25.048 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-02-21T22:50:25.048 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-02-21T22:50:25.048 INFO:teuthology.orchestra.run.smithi142.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-02-21T22:50:25.048 INFO:teuthology.orchestra.run.smithi142.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-02-21T22:50:25.048 INFO:teuthology.orchestra.run.smithi142.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-02-21T22:50:25.048 INFO:teuthology.orchestra.run.smithi142.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-02-21T22:50:25.048 INFO:teuthology.orchestra.run.smithi142.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-02-21T22:50:25.048 INFO:teuthology.orchestra.run.smithi142.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-02-21T22:50:25.048 INFO:teuthology.orchestra.run.smithi142.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-02-21T22:50:25.049 INFO:teuthology.orchestra.run.smithi142.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-02-21T22:50:25.049 INFO:teuthology.orchestra.run.smithi142.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-02-21T22:50:25.049 INFO:teuthology.orchestra.run.smithi142.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-02-21T22:50:25.049 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-02-21T22:50:25.049 INFO:teuthology.orchestra.run.smithi142.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-02-21T22:50:25.049 INFO:teuthology.orchestra.run.smithi142.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-02-21T22:50:25.049 INFO:teuthology.orchestra.run.smithi142.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-02-21T22:50:25.049 INFO:teuthology.orchestra.run.smithi142.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-02-21T22:50:25.049 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-02-21T22:50:25.049 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-02-21T22:50:25.049 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-02-21T22:50:25.049 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-02-21T22:50:25.049 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-02-21T22:50:25.049 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-02-21T22:50:25.050 INFO:teuthology.orchestra.run.smithi142.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-02-21T22:50:25.050 INFO:teuthology.orchestra.run.smithi142.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-02-21T22:50:25.050 INFO:teuthology.orchestra.run.smithi142.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-02-21T22:50:25.050 INFO:teuthology.orchestra.run.smithi142.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-02-21T22:50:25.050 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-02-21T22:50:25.050 INFO:teuthology.orchestra.run.smithi142.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-02-21T22:50:25.050 INFO:teuthology.orchestra.run.smithi142.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-02-21T22:50:25.050 INFO:teuthology.orchestra.run.smithi142.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-02-21T22:50:25.050 INFO:teuthology.orchestra.run.smithi142.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-02-21T22:50:25.050 INFO:teuthology.orchestra.run.smithi142.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-02-21T22:50:25.050 INFO:teuthology.orchestra.run.smithi142.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-02-21T22:50:25.050 INFO:teuthology.orchestra.run.smithi142.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-02-21T22:50:25.050 INFO:teuthology.orchestra.run.smithi142.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-02-21T22:50:25.050 INFO:teuthology.orchestra.run.smithi142.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-02-21T22:50:25.051 INFO:teuthology.orchestra.run.smithi142.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-02-21T22:50:25.051 INFO:teuthology.orchestra.run.smithi142.stdout: qatlib x86_64 23.11.0-1.el9 appstream 216 k 2024-02-21T22:50:25.051 INFO:teuthology.orchestra.run.smithi142.stdout: qatzip-libs x86_64 1.1.2-2.el9 appstream 44 k 2024-02-21T22:50:25.051 INFO:teuthology.orchestra.run.smithi142.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-02-21T22:50:25.051 INFO:teuthology.orchestra.run.smithi142.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-02-21T22:50:25.051 INFO:teuthology.orchestra.run.smithi142.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-02-21T22:50:25.051 INFO:teuthology.orchestra.run.smithi142.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-02-21T22:50:25.051 INFO:teuthology.orchestra.run.smithi142.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-02-21T22:50:25.052 INFO:teuthology.orchestra.run.smithi142.stdout: zlib-devel x86_64 1.2.11-40.el9 appstream 45 k 2024-02-21T22:50:25.052 INFO:teuthology.orchestra.run.smithi142.stdout:Installing weak dependencies: 2024-02-21T22:50:25.052 INFO:teuthology.orchestra.run.smithi142.stdout: qatlib-service x86_64 23.11.0-1.el9 appstream 35 k 2024-02-21T22:50:25.052 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-21T22:50:25.052 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2024-02-21T22:50:25.052 INFO:teuthology.orchestra.run.smithi142.stdout:========================================================================================= 2024-02-21T22:50:25.052 INFO:teuthology.orchestra.run.smithi142.stdout:Install 150 Packages 2024-02-21T22:50:25.052 INFO:teuthology.orchestra.run.smithi142.stdout:Upgrade 16 Packages 2024-02-21T22:50:25.052 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-21T22:50:25.053 INFO:teuthology.orchestra.run.smithi116.stderr:Modular dependency problems: 2024-02-21T22:50:25.053 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-02-21T22:50:25.053 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 1: conflicting requests 2024-02-21T22:50:25.053 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240219154654:20125149.x86_64 from CentOS-AppStream 2024-02-21T22:50:25.053 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 2: conflicting requests 2024-02-21T22:50:25.053 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-21T22:50:25.054 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 3: conflicting requests 2024-02-21T22:50:25.054 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-21T22:50:25.054 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 4: conflicting requests 2024-02-21T22:50:25.054 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-21T22:50:25.054 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 5: conflicting requests 2024-02-21T22:50:25.054 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-21T22:50:25.054 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 6: conflicting requests 2024-02-21T22:50:25.054 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-21T22:50:25.054 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 7: conflicting requests 2024-02-21T22:50:25.054 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-21T22:50:25.054 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 8: conflicting requests 2024-02-21T22:50:25.054 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-21T22:50:25.054 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 9: conflicting requests 2024-02-21T22:50:25.054 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-21T22:50:25.054 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 10: conflicting requests 2024-02-21T22:50:25.055 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-21T22:50:25.055 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 11: conflicting requests 2024-02-21T22:50:25.055 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-21T22:50:25.055 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 12: conflicting requests 2024-02-21T22:50:25.055 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-21T22:50:25.055 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 13: conflicting requests 2024-02-21T22:50:25.055 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-21T22:50:25.055 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 14: conflicting requests 2024-02-21T22:50:25.055 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-21T22:50:25.055 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 15: conflicting requests 2024-02-21T22:50:25.055 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-21T22:50:25.055 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 16: conflicting requests 2024-02-21T22:50:25.055 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-21T22:50:25.055 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 17: conflicting requests 2024-02-21T22:50:25.056 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-21T22:50:25.056 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 18: conflicting requests 2024-02-21T22:50:25.056 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-21T22:50:25.056 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 19: conflicting requests 2024-02-21T22:50:25.056 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-21T22:50:25.056 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 20: conflicting requests 2024-02-21T22:50:25.056 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-21T22:50:25.056 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 21: conflicting requests 2024-02-21T22:50:25.056 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-21T22:50:25.056 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 22: conflicting requests 2024-02-21T22:50:25.056 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-21T22:50:25.056 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 23: conflicting requests 2024-02-21T22:50:25.056 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-21T22:50:25.056 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 24: conflicting requests 2024-02-21T22:50:25.057 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-21T22:50:25.057 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 25: conflicting requests 2024-02-21T22:50:25.057 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-21T22:50:25.057 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 26: conflicting requests 2024-02-21T22:50:25.057 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-21T22:50:25.057 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 27: conflicting requests 2024-02-21T22:50:25.057 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-21T22:50:25.057 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 28: conflicting requests 2024-02-21T22:50:25.057 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-21T22:50:25.057 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 29: conflicting requests 2024-02-21T22:50:25.057 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-21T22:50:25.057 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 30: conflicting requests 2024-02-21T22:50:25.057 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-21T22:50:25.057 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 31: conflicting requests 2024-02-21T22:50:25.057 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-21T22:50:25.058 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 32: conflicting requests 2024-02-21T22:50:25.058 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-21T22:50:25.058 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 33: conflicting requests 2024-02-21T22:50:25.058 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-21T22:50:25.058 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 34: conflicting requests 2024-02-21T22:50:25.058 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-21T22:50:25.058 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 35: conflicting requests 2024-02-21T22:50:25.058 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240203221207:9edba152.x86_64 from CentOS-AppStream 2024-02-21T22:50:25.058 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 36: conflicting requests 2024-02-21T22:50:25.058 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-21T22:50:25.058 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-21T22:50:25.059 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-21T22:50:25.059 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 37: cannot install the best candidate for the job 2024-02-21T22:50:25.059 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-21T22:50:25.059 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-21T22:50:25.059 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-21T22:50:25.059 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-21T22:50:25.059 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 38: conflicting requests 2024-02-21T22:50:25.059 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-21T22:50:25.059 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-21T22:50:25.059 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-21T22:50:25.059 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-21T22:50:25.059 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-21T22:50:25.059 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-21T22:50:25.060 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 39: cannot install the best candidate for the job 2024-02-21T22:50:25.060 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-21T22:50:25.060 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-21T22:50:25.060 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-21T22:50:25.061 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-21T22:50:25.061 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 40: cannot install the best candidate for the job 2024-02-21T22:50:25.061 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-21T22:50:25.061 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-21T22:50:25.061 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-21T22:50:25.061 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-21T22:50:25.061 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 41: cannot install the best candidate for the job 2024-02-21T22:50:25.062 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-21T22:50:25.062 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-21T22:50:25.062 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-21T22:50:25.062 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-21T22:50:25.062 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 42: cannot install the best candidate for the job 2024-02-21T22:50:25.062 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-21T22:50:25.062 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-21T22:50:25.062 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-21T22:50:25.062 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-21T22:50:25.062 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 43: cannot install the best candidate for the job 2024-02-21T22:50:25.063 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-21T22:50:25.063 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-21T22:50:25.063 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-21T22:50:25.063 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-21T22:50:25.063 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 44: cannot install the best candidate for the job 2024-02-21T22:50:25.063 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-21T22:50:25.063 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-21T22:50:25.063 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-21T22:50:25.063 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-21T22:50:25.063 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 222 M 2024-02-21T22:50:25.064 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2024-02-21T22:50:25.494 INFO:teuthology.orchestra.run.smithi116.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-02-21T22:50:25.495 INFO:teuthology.orchestra.run.smithi116.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-02-21T22:50:25.508 INFO:teuthology.orchestra.run.smithi116.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2024-02-21T22:50:25.509 INFO:teuthology.orchestra.run.smithi116.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-02-21T22:50:25.510 INFO:teuthology.orchestra.run.smithi116.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2024-02-21T22:50:25.511 INFO:teuthology.orchestra.run.smithi116.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2024-02-21T22:50:25.512 INFO:teuthology.orchestra.run.smithi116.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-02-21T22:50:25.516 INFO:teuthology.orchestra.run.smithi116.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2024-02-21T22:50:25.517 INFO:teuthology.orchestra.run.smithi116.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2024-02-21T22:50:25.536 INFO:teuthology.orchestra.run.smithi142.stdout:(1/166): ceph-19.0.0-1643.g3bfc837d.el9.x86_64. 43 kB/s | 6.6 kB 00:00 2024-02-21T22:50:25.605 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2024-02-21T22:50:25.626 INFO:teuthology.orchestra.run.smithi116.stdout:========================================================================================= 2024-02-21T22:50:25.626 INFO:teuthology.orchestra.run.smithi116.stdout: Package Arch Version Repository Size 2024-02-21T22:50:25.627 INFO:teuthology.orchestra.run.smithi116.stdout:========================================================================================= 2024-02-21T22:50:25.627 INFO:teuthology.orchestra.run.smithi116.stdout:Installing: 2024-02-21T22:50:25.627 INFO:teuthology.orchestra.run.smithi116.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-02-21T22:50:25.627 INFO:teuthology.orchestra.run.smithi116.stdout: ceph x86_64 2:19.0.0-1643.g3bfc837d.el9 ceph 6.6 k 2024-02-21T22:50:25.627 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-base x86_64 2:19.0.0-1643.g3bfc837d.el9 ceph 5.3 M 2024-02-21T22:50:25.628 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-fuse x86_64 2:19.0.0-1643.g3bfc837d.el9 ceph 889 k 2024-02-21T22:50:25.628 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-1643.g3bfc837d.el9 ceph 145 k 2024-02-21T22:50:25.628 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr x86_64 2:19.0.0-1643.g3bfc837d.el9 ceph 1.5 M 2024-02-21T22:50:25.628 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-cephadm noarch 2:19.0.0-1643.g3bfc837d.el9 ceph-noarch 138 k 2024-02-21T22:50:25.629 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-dashboard noarch 2:19.0.0-1643.g3bfc837d.el9 ceph-noarch 1.8 M 2024-02-21T22:50:25.629 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-1643.g3bfc837d.el9 ceph-noarch 7.4 M 2024-02-21T22:50:25.629 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-rook noarch 2:19.0.0-1643.g3bfc837d.el9 ceph-noarch 49 k 2024-02-21T22:50:25.629 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-radosgw x86_64 2:19.0.0-1643.g3bfc837d.el9 ceph 9.8 M 2024-02-21T22:50:25.629 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-test x86_64 2:19.0.0-1643.g3bfc837d.el9 ceph 47 M 2024-02-21T22:50:25.629 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-volume noarch 2:19.0.0-1643.g3bfc837d.el9 ceph-noarch 264 k 2024-02-21T22:50:25.630 INFO:teuthology.orchestra.run.smithi116.stdout: cephadm noarch 2:19.0.0-1643.g3bfc837d.el9 ceph-noarch 748 k 2024-02-21T22:50:25.630 INFO:teuthology.orchestra.run.smithi116.stdout: cephfs-mirror x86_64 2:19.0.0-1643.g3bfc837d.el9 ceph 220 k 2024-02-21T22:50:25.630 INFO:teuthology.orchestra.run.smithi116.stdout: cephfs-shell x86_64 2:19.0.0-1643.g3bfc837d.el9 ceph 27 k 2024-02-21T22:50:25.630 INFO:teuthology.orchestra.run.smithi116.stdout: cephfs-top noarch 2:19.0.0-1643.g3bfc837d.el9 ceph-noarch 18 k 2024-02-21T22:50:25.630 INFO:teuthology.orchestra.run.smithi116.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-02-21T22:50:25.630 INFO:teuthology.orchestra.run.smithi116.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-02-21T22:50:25.631 INFO:teuthology.orchestra.run.smithi116.stdout: libaio-devel x86_64 0.3.112-1.el8 CentOS-BaseOS 18 k 2024-02-21T22:50:25.631 INFO:teuthology.orchestra.run.smithi116.stdout: libcephfs-devel x86_64 2:19.0.0-1643.g3bfc837d.el9 ceph 31 k 2024-02-21T22:50:25.631 INFO:teuthology.orchestra.run.smithi116.stdout: libcephfs2 x86_64 2:19.0.0-1643.g3bfc837d.el9 ceph 745 k 2024-02-21T22:50:25.631 INFO:teuthology.orchestra.run.smithi116.stdout: librados-devel x86_64 2:19.0.0-1643.g3bfc837d.el9 ceph 127 k 2024-02-21T22:50:25.631 INFO:teuthology.orchestra.run.smithi116.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-02-21T22:50:25.631 INFO:teuthology.orchestra.run.smithi116.stdout: libuuid-devel x86_64 2.37.4-15.el9 appstream 26 k 2024-02-21T22:50:25.632 INFO:teuthology.orchestra.run.smithi116.stdout: openssl-devel x86_64 1:3.0.7-25.el9 appstream 4.1 M 2024-02-21T22:50:25.632 INFO:teuthology.orchestra.run.smithi116.stdout: postgresql x86_64 13.11-1.el9 appstream 1.6 M 2024-02-21T22:50:25.632 INFO:teuthology.orchestra.run.smithi116.stdout: postgresql-contrib x86_64 13.11-1.el9 appstream 905 k 2024-02-21T22:50:25.632 INFO:teuthology.orchestra.run.smithi116.stdout: postgresql-server x86_64 13.11-1.el9 appstream 5.7 M 2024-02-21T22:50:25.632 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cephfs x86_64 2:19.0.0-1643.g3bfc837d.el9 ceph 161 k 2024-02-21T22:50:25.633 INFO:teuthology.orchestra.run.smithi116.stdout: python3-rados x86_64 2:19.0.0-1643.g3bfc837d.el9 ceph 321 k 2024-02-21T22:50:25.633 INFO:teuthology.orchestra.run.smithi116.stdout: python3-rbd x86_64 2:19.0.0-1643.g3bfc837d.el9 ceph 298 k 2024-02-21T22:50:25.633 INFO:teuthology.orchestra.run.smithi116.stdout: python3-rgw x86_64 2:19.0.0-1643.g3bfc837d.el9 ceph 100 k 2024-02-21T22:50:25.633 INFO:teuthology.orchestra.run.smithi116.stdout: rbd-fuse x86_64 2:19.0.0-1643.g3bfc837d.el9 ceph 85 k 2024-02-21T22:50:25.633 INFO:teuthology.orchestra.run.smithi116.stdout: rbd-mirror x86_64 2:19.0.0-1643.g3bfc837d.el9 ceph 3.1 M 2024-02-21T22:50:25.633 INFO:teuthology.orchestra.run.smithi116.stdout: rbd-nbd x86_64 2:19.0.0-1643.g3bfc837d.el9 ceph 170 k 2024-02-21T22:50:25.633 INFO:teuthology.orchestra.run.smithi116.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-02-21T22:50:25.633 INFO:teuthology.orchestra.run.smithi116.stdout:Upgrading: 2024-02-21T22:50:25.634 INFO:teuthology.orchestra.run.smithi116.stdout: NetworkManager x86_64 1:1.45.91-1.el9 baseos 2.3 M 2024-02-21T22:50:25.634 INFO:teuthology.orchestra.run.smithi116.stdout: NetworkManager-libnm x86_64 1:1.45.91-1.el9 baseos 1.8 M 2024-02-21T22:50:25.634 INFO:teuthology.orchestra.run.smithi116.stdout: NetworkManager-team x86_64 1:1.45.91-1.el9 baseos 42 k 2024-02-21T22:50:25.634 INFO:teuthology.orchestra.run.smithi116.stdout: NetworkManager-tui x86_64 1:1.45.91-1.el9 baseos 247 k 2024-02-21T22:50:25.634 INFO:teuthology.orchestra.run.smithi116.stdout: acl x86_64 2.3.1-4.el9 baseos 71 k 2024-02-21T22:50:25.634 INFO:teuthology.orchestra.run.smithi116.stdout: elfutils-debuginfod-client x86_64 0.190-2.el9 baseos 36 k 2024-02-21T22:50:25.634 INFO:teuthology.orchestra.run.smithi116.stdout: elfutils-libelf x86_64 0.190-2.el9 baseos 192 k 2024-02-21T22:50:25.634 INFO:teuthology.orchestra.run.smithi116.stdout: elfutils-libs x86_64 0.190-2.el9 baseos 256 k 2024-02-21T22:50:25.635 INFO:teuthology.orchestra.run.smithi116.stdout: libacl x86_64 2.3.1-4.el9 baseos 23 k 2024-02-21T22:50:25.635 INFO:teuthology.orchestra.run.smithi116.stdout: libacl-devel x86_64 2.3.1-4.el9 appstream 74 k 2024-02-21T22:50:25.635 INFO:teuthology.orchestra.run.smithi116.stdout: librados2 x86_64 2:19.0.0-1643.g3bfc837d.el9 ceph 3.4 M 2024-02-21T22:50:25.635 INFO:teuthology.orchestra.run.smithi116.stdout: librbd1 x86_64 2:19.0.0-1643.g3bfc837d.el9 ceph 3.1 M 2024-02-21T22:50:25.635 INFO:teuthology.orchestra.run.smithi116.stdout: openssl x86_64 1:3.0.7-25.el9 baseos 1.2 M 2024-02-21T22:50:25.635 INFO:teuthology.orchestra.run.smithi116.stdout: openssl-libs x86_64 1:3.0.7-25.el9 baseos 2.2 M 2024-02-21T22:50:25.635 INFO:teuthology.orchestra.run.smithi116.stdout: xfsdump x86_64 3.1.12-4.el9 baseos 323 k 2024-02-21T22:50:25.635 INFO:teuthology.orchestra.run.smithi116.stdout: xfsprogs x86_64 6.3.0-1.el9 baseos 1.1 M 2024-02-21T22:50:25.636 INFO:teuthology.orchestra.run.smithi116.stdout:Installing dependencies: 2024-02-21T22:50:25.636 INFO:teuthology.orchestra.run.smithi116.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-02-21T22:50:25.636 INFO:teuthology.orchestra.run.smithi116.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-02-21T22:50:25.636 INFO:teuthology.orchestra.run.smithi116.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-02-21T22:50:25.636 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-common x86_64 2:19.0.0-1643.g3bfc837d.el9 ceph 20 M 2024-02-21T22:50:25.636 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-grafana-dashboards noarch 2:19.0.0-1643.g3bfc837d.el9 ceph-noarch 31 k 2024-02-21T22:50:25.636 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mds x86_64 2:19.0.0-1643.g3bfc837d.el9 ceph 2.3 M 2024-02-21T22:50:25.636 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-modules-core noarch 2:19.0.0-1643.g3bfc837d.el9 ceph-noarch 248 k 2024-02-21T22:50:25.637 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mon x86_64 2:19.0.0-1643.g3bfc837d.el9 ceph 4.7 M 2024-02-21T22:50:25.637 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-osd x86_64 2:19.0.0-1643.g3bfc837d.el9 ceph 17 M 2024-02-21T22:50:25.637 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-prometheus-alerts noarch 2:19.0.0-1643.g3bfc837d.el9 ceph-noarch 15 k 2024-02-21T22:50:25.637 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-selinux x86_64 2:19.0.0-1643.g3bfc837d.el9 ceph 25 k 2024-02-21T22:50:25.637 INFO:teuthology.orchestra.run.smithi116.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-02-21T22:50:25.637 INFO:teuthology.orchestra.run.smithi116.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-02-21T22:50:25.637 INFO:teuthology.orchestra.run.smithi116.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-02-21T22:50:25.637 INFO:teuthology.orchestra.run.smithi116.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-02-21T22:50:25.637 INFO:teuthology.orchestra.run.smithi116.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-02-21T22:50:25.637 INFO:teuthology.orchestra.run.smithi116.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-02-21T22:50:25.638 INFO:teuthology.orchestra.run.smithi116.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-02-21T22:50:25.638 INFO:teuthology.orchestra.run.smithi116.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-02-21T22:50:25.638 INFO:teuthology.orchestra.run.smithi116.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-02-21T22:50:25.638 INFO:teuthology.orchestra.run.smithi116.stdout: libcephsqlite x86_64 2:19.0.0-1643.g3bfc837d.el9 ceph 163 k 2024-02-21T22:50:25.638 INFO:teuthology.orchestra.run.smithi116.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-02-21T22:50:25.638 INFO:teuthology.orchestra.run.smithi116.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-02-21T22:50:25.638 INFO:teuthology.orchestra.run.smithi116.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-02-21T22:50:25.638 INFO:teuthology.orchestra.run.smithi116.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-02-21T22:50:25.638 INFO:teuthology.orchestra.run.smithi116.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-02-21T22:50:25.638 INFO:teuthology.orchestra.run.smithi116.stdout: libradosstriper1 x86_64 2:19.0.0-1643.g3bfc837d.el9 ceph 502 k 2024-02-21T22:50:25.638 INFO:teuthology.orchestra.run.smithi116.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-02-21T22:50:25.638 INFO:teuthology.orchestra.run.smithi116.stdout: librgw2 x86_64 2:19.0.0-1643.g3bfc837d.el9 ceph 5.1 M 2024-02-21T22:50:25.638 INFO:teuthology.orchestra.run.smithi116.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-02-21T22:50:25.638 INFO:teuthology.orchestra.run.smithi116.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-02-21T22:50:25.639 INFO:teuthology.orchestra.run.smithi116.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-02-21T22:50:25.639 INFO:teuthology.orchestra.run.smithi116.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-02-21T22:50:25.639 INFO:teuthology.orchestra.run.smithi116.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-02-21T22:50:25.639 INFO:teuthology.orchestra.run.smithi116.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-02-21T22:50:25.639 INFO:teuthology.orchestra.run.smithi116.stdout: oniguruma x86_64 6.9.6-1.el9.5 baseos 218 k 2024-02-21T22:50:25.639 INFO:teuthology.orchestra.run.smithi116.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-02-21T22:50:25.639 INFO:teuthology.orchestra.run.smithi116.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-02-21T22:50:25.639 INFO:teuthology.orchestra.run.smithi116.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-02-21T22:50:25.639 INFO:teuthology.orchestra.run.smithi116.stdout: postgresql-private-libs x86_64 13.11-1.el9 appstream 135 k 2024-02-21T22:50:25.639 INFO:teuthology.orchestra.run.smithi116.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-02-21T22:50:25.639 INFO:teuthology.orchestra.run.smithi116.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-02-21T22:50:25.639 INFO:teuthology.orchestra.run.smithi116.stdout: python3-asyncssh noarch 2.13.2-4.el9 epel 548 k 2024-02-21T22:50:25.639 INFO:teuthology.orchestra.run.smithi116.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-02-21T22:50:25.639 INFO:teuthology.orchestra.run.smithi116.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-02-21T22:50:25.640 INFO:teuthology.orchestra.run.smithi116.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-02-21T22:50:25.640 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-02-21T22:50:25.640 INFO:teuthology.orchestra.run.smithi116.stdout: python3-ceph-argparse x86_64 2:19.0.0-1643.g3bfc837d.el9 ceph 45 k 2024-02-21T22:50:25.640 INFO:teuthology.orchestra.run.smithi116.stdout: python3-ceph-common x86_64 2:19.0.0-1643.g3bfc837d.el9 ceph 131 k 2024-02-21T22:50:25.640 INFO:teuthology.orchestra.run.smithi116.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-02-21T22:50:25.640 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-02-21T22:50:25.640 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-02-21T22:50:25.640 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-02-21T22:50:25.640 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-02-21T22:50:25.640 INFO:teuthology.orchestra.run.smithi116.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-02-21T22:50:25.640 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-02-21T22:50:25.640 INFO:teuthology.orchestra.run.smithi116.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-02-21T22:50:25.640 INFO:teuthology.orchestra.run.smithi116.stdout: python3-google-auth noarch 1:2.27.0-1.el9 epel 203 k 2024-02-21T22:50:25.641 INFO:teuthology.orchestra.run.smithi116.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-02-21T22:50:25.641 INFO:teuthology.orchestra.run.smithi116.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-02-21T22:50:25.641 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-02-21T22:50:25.641 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-02-21T22:50:25.641 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-02-21T22:50:25.641 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-02-21T22:50:25.641 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-02-21T22:50:25.641 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-02-21T22:50:25.641 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-02-21T22:50:25.641 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-02-21T22:50:25.641 INFO:teuthology.orchestra.run.smithi116.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-02-21T22:50:25.641 INFO:teuthology.orchestra.run.smithi116.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-02-21T22:50:25.641 INFO:teuthology.orchestra.run.smithi116.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-02-21T22:50:25.641 INFO:teuthology.orchestra.run.smithi116.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-02-21T22:50:25.641 INFO:teuthology.orchestra.run.smithi116.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-02-21T22:50:25.642 INFO:teuthology.orchestra.run.smithi116.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-02-21T22:50:25.642 INFO:teuthology.orchestra.run.smithi116.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-02-21T22:50:25.642 INFO:teuthology.orchestra.run.smithi116.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-02-21T22:50:25.642 INFO:teuthology.orchestra.run.smithi116.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-02-21T22:50:25.642 INFO:teuthology.orchestra.run.smithi116.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-02-21T22:50:25.642 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-02-21T22:50:25.642 INFO:teuthology.orchestra.run.smithi116.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-02-21T22:50:25.642 INFO:teuthology.orchestra.run.smithi116.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-02-21T22:50:25.642 INFO:teuthology.orchestra.run.smithi116.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-02-21T22:50:25.642 INFO:teuthology.orchestra.run.smithi116.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-02-21T22:50:25.642 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-02-21T22:50:25.642 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-02-21T22:50:25.642 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-02-21T22:50:25.642 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-02-21T22:50:25.643 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-02-21T22:50:25.643 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-02-21T22:50:25.643 INFO:teuthology.orchestra.run.smithi116.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-02-21T22:50:25.643 INFO:teuthology.orchestra.run.smithi116.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-02-21T22:50:25.643 INFO:teuthology.orchestra.run.smithi116.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-02-21T22:50:25.643 INFO:teuthology.orchestra.run.smithi116.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-02-21T22:50:25.643 INFO:teuthology.orchestra.run.smithi116.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-02-21T22:50:25.643 INFO:teuthology.orchestra.run.smithi116.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-02-21T22:50:25.643 INFO:teuthology.orchestra.run.smithi116.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-02-21T22:50:25.643 INFO:teuthology.orchestra.run.smithi116.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-02-21T22:50:25.643 INFO:teuthology.orchestra.run.smithi116.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-02-21T22:50:25.644 INFO:teuthology.orchestra.run.smithi116.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-02-21T22:50:25.644 INFO:teuthology.orchestra.run.smithi116.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-02-21T22:50:25.644 INFO:teuthology.orchestra.run.smithi116.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-02-21T22:50:25.644 INFO:teuthology.orchestra.run.smithi116.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-02-21T22:50:25.644 INFO:teuthology.orchestra.run.smithi116.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-02-21T22:50:25.644 INFO:teuthology.orchestra.run.smithi116.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-02-21T22:50:25.644 INFO:teuthology.orchestra.run.smithi116.stdout: qatlib x86_64 23.11.0-1.el9 appstream 216 k 2024-02-21T22:50:25.644 INFO:teuthology.orchestra.run.smithi116.stdout: qatzip-libs x86_64 1.1.2-2.el9 appstream 44 k 2024-02-21T22:50:25.644 INFO:teuthology.orchestra.run.smithi116.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-02-21T22:50:25.644 INFO:teuthology.orchestra.run.smithi116.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-02-21T22:50:25.644 INFO:teuthology.orchestra.run.smithi116.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-02-21T22:50:25.644 INFO:teuthology.orchestra.run.smithi116.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-02-21T22:50:25.644 INFO:teuthology.orchestra.run.smithi116.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-02-21T22:50:25.644 INFO:teuthology.orchestra.run.smithi116.stdout: zlib-devel x86_64 1.2.11-40.el9 appstream 45 k 2024-02-21T22:50:25.645 INFO:teuthology.orchestra.run.smithi116.stdout:Installing weak dependencies: 2024-02-21T22:50:25.645 INFO:teuthology.orchestra.run.smithi116.stdout: qatlib-service x86_64 23.11.0-1.el9 appstream 35 k 2024-02-21T22:50:25.645 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-02-21T22:50:25.645 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction Summary 2024-02-21T22:50:25.645 INFO:teuthology.orchestra.run.smithi116.stdout:========================================================================================= 2024-02-21T22:50:25.645 INFO:teuthology.orchestra.run.smithi116.stdout:Install 150 Packages 2024-02-21T22:50:25.645 INFO:teuthology.orchestra.run.smithi116.stdout:Upgrade 16 Packages 2024-02-21T22:50:25.645 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-02-21T22:50:25.646 INFO:teuthology.orchestra.run.smithi116.stdout:Total download size: 222 M 2024-02-21T22:50:25.646 INFO:teuthology.orchestra.run.smithi116.stdout:Downloading Packages: 2024-02-21T22:50:25.778 INFO:teuthology.orchestra.run.smithi142.stdout:(2/166): ceph-fuse-19.0.0-1643.g3bfc837d.el9.x8 3.6 MB/s | 889 kB 00:00 2024-02-21T22:50:25.828 INFO:teuthology.orchestra.run.smithi142.stdout:(3/166): ceph-immutable-object-cache-19.0.0-164 2.8 MB/s | 145 kB 00:00 2024-02-21T22:50:26.188 INFO:teuthology.orchestra.run.smithi142.stdout:(4/166): ceph-mds-19.0.0-1643.g3bfc837d.el9.x86 6.4 MB/s | 2.3 MB 00:00 2024-02-21T22:50:26.262 INFO:teuthology.orchestra.run.smithi142.stdout:(5/166): ceph-base-19.0.0-1643.g3bfc837d.el9.x8 6.1 MB/s | 5.3 MB 00:00 2024-02-21T22:50:26.446 INFO:teuthology.orchestra.run.smithi142.stdout:(6/166): ceph-mgr-19.0.0-1643.g3bfc837d.el9.x86 5.8 MB/s | 1.5 MB 00:00 2024-02-21T22:50:26.804 INFO:teuthology.orchestra.run.smithi142.stdout:(7/166): ceph-mon-19.0.0-1643.g3bfc837d.el9.x86 8.6 MB/s | 4.7 MB 00:00 2024-02-21T22:50:26.823 INFO:teuthology.orchestra.run.smithi116.stdout:(1/166): ceph-19.0.0-1643.g3bfc837d.el9.x86_64. 18 kB/s | 6.6 kB 00:00 2024-02-21T22:50:27.755 INFO:teuthology.orchestra.run.smithi142.stdout:(8/166): ceph-common-19.0.0-1643.g3bfc837d.el9. 8.6 MB/s | 20 MB 00:02 2024-02-21T22:50:27.814 INFO:teuthology.orchestra.run.smithi142.stdout:(9/166): ceph-selinux-19.0.0-1643.g3bfc837d.el9 434 kB/s | 25 kB 00:00 2024-02-21T22:50:28.030 INFO:teuthology.orchestra.run.smithi142.stdout:(10/166): ceph-radosgw-19.0.0-1643.g3bfc837d.el 8.0 MB/s | 9.8 MB 00:01 2024-02-21T22:50:28.114 INFO:teuthology.orchestra.run.smithi142.stdout:(11/166): cephfs-mirror-19.0.0-1643.g3bfc837d.e 2.6 MB/s | 220 kB 00:00 2024-02-21T22:50:28.189 INFO:teuthology.orchestra.run.smithi142.stdout:(12/166): cephfs-shell-19.0.0-1643.g3bfc837d.el 362 kB/s | 27 kB 00:00 2024-02-21T22:50:28.231 INFO:teuthology.orchestra.run.smithi116.stdout:(2/166): ceph-fuse-19.0.0-1643.g3bfc837d.el9.x8 631 kB/s | 889 kB 00:01 2024-02-21T22:50:28.264 INFO:teuthology.orchestra.run.smithi142.stdout:(13/166): libcephfs-devel-19.0.0-1643.g3bfc837d 417 kB/s | 31 kB 00:00 2024-02-21T22:50:28.424 INFO:teuthology.orchestra.run.smithi142.stdout:(14/166): libcephfs2-19.0.0-1643.g3bfc837d.el9. 4.6 MB/s | 745 kB 00:00 2024-02-21T22:50:28.482 INFO:teuthology.orchestra.run.smithi116.stdout:(3/166): ceph-immutable-object-cache-19.0.0-164 581 kB/s | 145 kB 00:00 2024-02-21T22:50:28.506 INFO:teuthology.orchestra.run.smithi142.stdout:(15/166): libcephsqlite-19.0.0-1643.g3bfc837d.e 1.9 MB/s | 163 kB 00:00 2024-02-21T22:50:28.598 INFO:teuthology.orchestra.run.smithi142.stdout:(16/166): librados-devel-19.0.0-1643.g3bfc837d. 1.3 MB/s | 127 kB 00:00 2024-02-21T22:50:28.607 INFO:teuthology.orchestra.run.smithi116.stdout:(4/166): ceph-base-19.0.0-1643.g3bfc837d.el9.x8 2.5 MB/s | 5.3 MB 00:02 2024-02-21T22:50:28.790 INFO:teuthology.orchestra.run.smithi142.stdout:(17/166): ceph-osd-19.0.0-1643.g3bfc837d.el9.x8 7.2 MB/s | 17 MB 00:02 2024-02-21T22:50:28.824 INFO:teuthology.orchestra.run.smithi142.stdout:(18/166): libradosstriper1-19.0.0-1643.g3bfc837 2.2 MB/s | 502 kB 00:00 2024-02-21T22:50:28.907 INFO:teuthology.orchestra.run.smithi142.stdout:(19/166): python3-ceph-argparse-19.0.0-1643.g3b 542 kB/s | 45 kB 00:00 2024-02-21T22:50:28.991 INFO:teuthology.orchestra.run.smithi142.stdout:(20/166): python3-ceph-common-19.0.0-1643.g3bfc 1.5 MB/s | 131 kB 00:00 2024-02-21T22:50:29.075 INFO:teuthology.orchestra.run.smithi142.stdout:(21/166): python3-cephfs-19.0.0-1643.g3bfc837d. 1.9 MB/s | 161 kB 00:00 2024-02-21T22:50:29.090 INFO:teuthology.orchestra.run.smithi116.stdout:(5/166): ceph-mgr-19.0.0-1643.g3bfc837d.el9.x86 3.1 MB/s | 1.5 MB 00:00 2024-02-21T22:50:29.158 INFO:teuthology.orchestra.run.smithi142.stdout:(22/166): python3-rados-19.0.0-1643.g3bfc837d.e 3.8 MB/s | 321 kB 00:00 2024-02-21T22:50:29.250 INFO:teuthology.orchestra.run.smithi142.stdout:(23/166): python3-rbd-19.0.0-1643.g3bfc837d.el9 3.2 MB/s | 298 kB 00:00 2024-02-21T22:50:29.334 INFO:teuthology.orchestra.run.smithi142.stdout:(24/166): python3-rgw-19.0.0-1643.g3bfc837d.el9 1.2 MB/s | 100 kB 00:00 2024-02-21T22:50:29.417 INFO:teuthology.orchestra.run.smithi142.stdout:(25/166): rbd-fuse-19.0.0-1643.g3bfc837d.el9.x8 1.0 MB/s | 85 kB 00:00 2024-02-21T22:50:29.484 INFO:teuthology.orchestra.run.smithi142.stdout:(26/166): librgw2-19.0.0-1643.g3bfc837d.el9.x86 7.4 MB/s | 5.1 MB 00:00 2024-02-21T22:50:29.576 INFO:teuthology.orchestra.run.smithi142.stdout:(27/166): rbd-nbd-19.0.0-1643.g3bfc837d.el9.x86 1.8 MB/s | 170 kB 00:00 2024-02-21T22:50:29.660 INFO:teuthology.orchestra.run.smithi142.stdout:(28/166): ceph-grafana-dashboards-19.0.0-1643.g 378 kB/s | 31 kB 00:00 2024-02-21T22:50:29.752 INFO:teuthology.orchestra.run.smithi142.stdout:(29/166): ceph-mgr-cephadm-19.0.0-1643.g3bfc837 1.5 MB/s | 138 kB 00:00 2024-02-21T22:50:29.835 INFO:teuthology.orchestra.run.smithi142.stdout:(30/166): rbd-mirror-19.0.0-1643.g3bfc837d.el9. 7.4 MB/s | 3.1 MB 00:00 2024-02-21T22:50:30.077 INFO:teuthology.orchestra.run.smithi142.stdout:(31/166): ceph-mgr-dashboard-19.0.0-1643.g3bfc8 5.5 MB/s | 1.8 MB 00:00 2024-02-21T22:50:30.177 INFO:teuthology.orchestra.run.smithi142.stdout:(32/166): ceph-mgr-modules-core-19.0.0-1643.g3b 2.4 MB/s | 248 kB 00:00 2024-02-21T22:50:30.269 INFO:teuthology.orchestra.run.smithi142.stdout:(33/166): ceph-mgr-rook-19.0.0-1643.g3bfc837d.e 538 kB/s | 49 kB 00:00 2024-02-21T22:50:30.362 INFO:teuthology.orchestra.run.smithi142.stdout:(34/166): ceph-prometheus-alerts-19.0.0-1643.g3 167 kB/s | 15 kB 00:00 2024-02-21T22:50:30.470 INFO:teuthology.orchestra.run.smithi142.stdout:(35/166): ceph-volume-19.0.0-1643.g3bfc837d.el9 2.4 MB/s | 264 kB 00:00 2024-02-21T22:50:30.654 INFO:teuthology.orchestra.run.smithi142.stdout:(36/166): cephadm-19.0.0-1643.g3bfc837d.el9.noa 4.0 MB/s | 748 kB 00:00 2024-02-21T22:50:30.766 INFO:teuthology.orchestra.run.smithi116.stdout:(6/166): ceph-mon-19.0.0-1643.g3bfc837d.el9.x86 2.8 MB/s | 4.7 MB 00:01 2024-02-21T22:50:30.796 INFO:teuthology.orchestra.run.smithi142.stdout:(37/166): ceph-mgr-diskprediction-local-19.0.0- 7.7 MB/s | 7.4 MB 00:00 2024-02-21T22:50:30.846 INFO:teuthology.orchestra.run.smithi142.stdout:(38/166): cephfs-top-19.0.0-1643.g3bfc837d.el9. 95 kB/s | 18 kB 00:00 2024-02-21T22:50:30.930 INFO:teuthology.orchestra.run.smithi142.stdout:(39/166): libaio-devel-0.3.112-1.el8.x86_64.rpm 132 kB/s | 18 kB 00:00 2024-02-21T22:50:30.955 INFO:teuthology.orchestra.run.smithi142.stdout:(40/166): fuse-2.9.9-15.el9.x86_64.rpm 741 kB/s | 80 kB 00:00 2024-02-21T22:50:31.014 INFO:teuthology.orchestra.run.smithi142.stdout:(41/166): jq-1.6-16.el9.x86_64.rpm 2.2 MB/s | 187 kB 00:00 2024-02-21T22:50:31.015 INFO:teuthology.orchestra.run.smithi116.stdout:(7/166): ceph-mds-19.0.0-1643.g3bfc837d.el9.x86 933 kB/s | 2.3 MB 00:02 2024-02-21T22:50:31.064 INFO:teuthology.orchestra.run.smithi142.stdout:(42/166): libgfortran-11.4.1-3.el9.x86_64.rpm 7.2 MB/s | 803 kB 00:00 2024-02-21T22:50:31.114 INFO:teuthology.orchestra.run.smithi142.stdout:(43/166): libquadmath-11.4.1-3.el9.x86_64.rpm 1.9 MB/s | 195 kB 00:00 2024-02-21T22:50:31.165 INFO:teuthology.orchestra.run.smithi142.stdout:(44/166): oniguruma-6.9.6-1.el9.5.x86_64.rpm 2.1 MB/s | 218 kB 00:00 2024-02-21T22:50:31.223 INFO:teuthology.orchestra.run.smithi142.stdout:(45/166): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.3 MB/s | 253 kB 00:00 2024-02-21T22:50:31.632 INFO:teuthology.orchestra.run.smithi142.stdout:(46/166): ceph-test-19.0.0-1643.g3bfc837d.el9.x 12 MB/s | 47 MB 00:03 2024-02-21T22:50:31.699 INFO:teuthology.orchestra.run.smithi142.stdout:(47/166): python3-cryptography-36.0.1-4.el9.x86 2.3 MB/s | 1.2 MB 00:00 2024-02-21T22:50:31.724 INFO:teuthology.orchestra.run.smithi142.stdout:(48/166): python3-ply-3.11-14.el9.noarch.rpm 213 kB/s | 106 kB 00:00 2024-02-21T22:50:31.749 INFO:teuthology.orchestra.run.smithi142.stdout:(49/166): python3-pycparser-2.20-6.el9.noarch.r 1.1 MB/s | 135 kB 00:00 2024-02-21T22:50:31.791 INFO:teuthology.orchestra.run.smithi142.stdout:(50/166): python3-requests-2.25.1-8.el9.noarch. 1.3 MB/s | 125 kB 00:00 2024-02-21T22:50:31.833 INFO:teuthology.orchestra.run.smithi142.stdout:(51/166): python3-urllib3-1.26.5-5.el9.noarch.r 1.9 MB/s | 215 kB 00:00 2024-02-21T22:50:32.016 INFO:teuthology.orchestra.run.smithi142.stdout:(52/166): automake-1.16.2-8.el9.noarch.rpm 2.5 MB/s | 689 kB 00:00 2024-02-21T22:50:32.042 INFO:teuthology.orchestra.run.smithi142.stdout:(53/166): boost-program-options-1.75.0-8.el9.x8 512 kB/s | 107 kB 00:00 2024-02-21T22:50:32.075 INFO:teuthology.orchestra.run.smithi142.stdout:(54/166): elfutils-libelf-devel-0.190-2.el9.x86 367 kB/s | 21 kB 00:00 2024-02-21T22:50:32.134 INFO:teuthology.orchestra.run.smithi142.stdout:(55/166): flexiblas-3.0.4-8.el9.x86_64.rpm 559 kB/s | 33 kB 00:00 2024-02-21T22:50:32.167 INFO:teuthology.orchestra.run.smithi142.stdout:(56/166): bison-3.7.4-5.el9.x86_64.rpm 2.4 MB/s | 943 kB 00:00 2024-02-21T22:50:32.193 INFO:teuthology.orchestra.run.smithi142.stdout:(57/166): flex-2.6.4-9.el9.x86_64.rpm 2.0 MB/s | 313 kB 00:00 2024-02-21T22:50:32.227 INFO:teuthology.orchestra.run.smithi142.stdout:(58/166): flexiblas-openblas-openmp-3.0.4-8.el9 311 kB/s | 18 kB 00:00 2024-02-21T22:50:32.252 INFO:teuthology.orchestra.run.smithi142.stdout:(59/166): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.7 MB/s | 160 kB 00:00 2024-02-21T22:50:32.285 INFO:teuthology.orchestra.run.smithi142.stdout:(60/166): librabbitmq-0.11.0-7.el9.x86_64.rpm 773 kB/s | 45 kB 00:00 2024-02-21T22:50:32.335 INFO:teuthology.orchestra.run.smithi142.stdout:(61/166): flexiblas-netlib-3.0.4-8.el9.x86_64.r 15 MB/s | 3.0 MB 00:00 2024-02-21T22:50:32.369 INFO:teuthology.orchestra.run.smithi142.stdout:(62/166): libtool-2.4.6-45.el9.x86_64.rpm 6.8 MB/s | 582 kB 00:00 2024-02-21T22:50:32.394 INFO:teuthology.orchestra.run.smithi142.stdout:(63/166): libuuid-devel-2.37.4-15.el9.x86_64.rp 437 kB/s | 26 kB 00:00 2024-02-21T22:50:32.428 INFO:teuthology.orchestra.run.smithi142.stdout:(64/166): librdkafka-1.6.1-102.el9.x86_64.rpm 3.7 MB/s | 662 kB 00:00 2024-02-21T22:50:32.453 INFO:teuthology.orchestra.run.smithi142.stdout:(65/166): libzstd-devel-1.5.1-2.el9.x86_64.rpm 567 kB/s | 47 kB 00:00 2024-02-21T22:50:32.479 INFO:teuthology.orchestra.run.smithi142.stdout:(66/166): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.4 MB/s | 292 kB 00:00 2024-02-21T22:50:32.504 INFO:teuthology.orchestra.run.smithi142.stdout:(67/166): lua-5.4.4-4.el9.x86_64.rpm 2.4 MB/s | 188 kB 00:00 2024-02-21T22:50:32.537 INFO:teuthology.orchestra.run.smithi142.stdout:(68/166): openblas-0.3.21-2.el9.x86_64.rpm 421 kB/s | 35 kB 00:00 2024-02-21T22:50:32.640 INFO:teuthology.orchestra.run.smithi142.stdout:(69/166): postgresql-13.11-1.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-02-21T22:50:32.733 INFO:teuthology.orchestra.run.smithi142.stdout:(70/166): openssl-devel-3.0.7-25.el9.x86_64.rpm 18 MB/s | 4.1 MB 00:00 2024-02-21T22:50:32.799 INFO:teuthology.orchestra.run.smithi142.stdout:(71/166): openblas-openmp-0.3.21-2.el9.x86_64.r 15 MB/s | 4.7 MB 00:00 2024-02-21T22:50:32.824 INFO:teuthology.orchestra.run.smithi142.stdout:(72/166): postgresql-private-libs-13.11-1.el9.x 1.4 MB/s | 135 kB 00:00 2024-02-21T22:50:32.857 INFO:teuthology.orchestra.run.smithi142.stdout:(73/166): postgresql-contrib-13.11-1.el9.x86_64 4.1 MB/s | 905 kB 00:00 2024-02-21T22:50:32.874 INFO:teuthology.orchestra.run.smithi116.stdout:(8/166): ceph-common-19.0.0-1643.g3bfc837d.el9. 3.2 MB/s | 20 MB 00:06 2024-02-21T22:50:32.950 INFO:teuthology.orchestra.run.smithi142.stdout:(74/166): protobuf-3.14.0-13.el9.x86_64.rpm 8.1 MB/s | 1.0 MB 00:00 2024-02-21T22:50:32.983 INFO:teuthology.orchestra.run.smithi142.stdout:(75/166): python3-attrs-20.3.0-7.el9.noarch.rpm 698 kB/s | 87 kB 00:00 2024-02-21T22:50:33.041 INFO:teuthology.orchestra.run.smithi116.stdout:(9/166): ceph-osd-19.0.0-1643.g3bfc837d.el9.x86 7.4 MB/s | 17 MB 00:02 2024-02-21T22:50:33.066 INFO:teuthology.orchestra.run.smithi116.stdout:(10/166): ceph-selinux-19.0.0-1643.g3bfc837d.el 131 kB/s | 25 kB 00:00 2024-02-21T22:50:33.083 INFO:teuthology.orchestra.run.smithi142.stdout:(76/166): python3-devel-3.9.17-2.el9.x86_64.rpm 2.4 MB/s | 245 kB 00:00 2024-02-21T22:50:33.140 INFO:teuthology.orchestra.run.smithi116.stdout:(11/166): cephfs-mirror-19.0.0-1643.g3bfc837d.e 3.2 MB/s | 220 kB 00:00 2024-02-21T22:50:33.175 INFO:teuthology.orchestra.run.smithi142.stdout:(77/166): postgresql-server-13.11-1.el9.x86_64. 15 MB/s | 5.7 MB 00:00 2024-02-21T22:50:33.183 INFO:teuthology.orchestra.run.smithi116.stdout:(12/166): cephfs-shell-19.0.0-1643.g3bfc837d.el 542 kB/s | 27 kB 00:00 2024-02-21T22:50:33.234 INFO:teuthology.orchestra.run.smithi116.stdout:(13/166): libcephfs-devel-19.0.0-1643.g3bfc837d 626 kB/s | 31 kB 00:00 2024-02-21T22:50:33.234 INFO:teuthology.orchestra.run.smithi142.stdout:(78/166): python3-jsonpatch-1.21-16.el9.noarch. 441 kB/s | 26 kB 00:00 2024-02-21T22:50:33.292 INFO:teuthology.orchestra.run.smithi142.stdout:(79/166): python3-jsonpointer-2.0-4.el9.noarch. 327 kB/s | 19 kB 00:00 2024-02-21T22:50:33.351 INFO:teuthology.orchestra.run.smithi142.stdout:(80/166): python3-mako-1.1.4-6.el9.noarch.rpm 2.9 MB/s | 172 kB 00:00 2024-02-21T22:50:33.376 INFO:teuthology.orchestra.run.smithi142.stdout:(81/166): python3-jinja2-2.11.3-5.el9.noarch.rp 847 kB/s | 248 kB 00:00 2024-02-21T22:50:33.401 INFO:teuthology.orchestra.run.smithi116.stdout:(14/166): libcephfs2-19.0.0-1643.g3bfc837d.el9. 4.4 MB/s | 745 kB 00:00 2024-02-21T22:50:33.410 INFO:teuthology.orchestra.run.smithi142.stdout:(82/166): python3-markupsafe-1.1.1-12.el9.x86_6 593 kB/s | 35 kB 00:00 2024-02-21T22:50:33.442 INFO:teuthology.orchestra.run.smithi116.stdout:(15/166): libcephsqlite-19.0.0-1643.g3bfc837d.e 3.8 MB/s | 163 kB 00:00 2024-02-21T22:50:33.469 INFO:teuthology.orchestra.run.smithi142.stdout:(83/166): python3-numpy-f2py-1.20.1-5.el9.x86_6 4.2 MB/s | 250 kB 00:00 2024-02-21T22:50:33.493 INFO:teuthology.orchestra.run.smithi116.stdout:(16/166): librados-devel-19.0.0-1643.g3bfc837d. 2.5 MB/s | 127 kB 00:00 2024-02-21T22:50:33.544 INFO:teuthology.orchestra.run.smithi142.stdout:(84/166): python3-oauthlib-3.1.1-5.el9.noarch.r 2.9 MB/s | 222 kB 00:00 2024-02-21T22:50:33.593 INFO:teuthology.orchestra.run.smithi116.stdout:(17/166): libradosstriper1-19.0.0-1643.g3bfc837 4.9 MB/s | 502 kB 00:00 2024-02-21T22:50:33.619 INFO:teuthology.orchestra.run.smithi142.stdout:(85/166): python3-babel-2.9.1-2.el9.noarch.rpm 8.9 MB/s | 6.0 MB 00:00 2024-02-21T22:50:33.644 INFO:teuthology.orchestra.run.smithi142.stdout:(86/166): python3-packaging-20.9-5.el9.noarch.r 771 kB/s | 77 kB 00:00 2024-02-21T22:50:33.711 INFO:teuthology.orchestra.run.smithi142.stdout:(87/166): python3-numpy-1.20.1-5.el9.x86_64.rpm 15 MB/s | 5.1 MB 00:00 2024-02-21T22:50:33.736 INFO:teuthology.orchestra.run.smithi142.stdout:(88/166): python3-prettytable-0.7.2-27.el9.noar 361 kB/s | 42 kB 00:00 2024-02-21T22:50:33.770 INFO:teuthology.orchestra.run.smithi142.stdout:(89/166): python3-protobuf-3.14.0-13.el9.noarch 2.1 MB/s | 269 kB 00:00 2024-02-21T22:50:33.795 INFO:teuthology.orchestra.run.smithi142.stdout:(90/166): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.9 MB/s | 159 kB 00:00 2024-02-21T22:50:33.821 INFO:teuthology.orchestra.run.smithi142.stdout:(91/166): python3-pyasn1-modules-0.4.8-6.el9.no 3.2 MB/s | 279 kB 00:00 2024-02-21T22:50:33.846 INFO:teuthology.orchestra.run.smithi142.stdout:(92/166): python3-pytz-2021.1-5.el9.noarch.rpm 674 kB/s | 51 kB 00:00 2024-02-21T22:50:33.871 INFO:teuthology.orchestra.run.smithi142.stdout:(93/166): python3-requests-oauthlib-1.3.0-12.el 711 kB/s | 54 kB 00:00 2024-02-21T22:50:33.913 INFO:teuthology.orchestra.run.smithi142.stdout:(94/166): python3-toml-0.10.2-6.el9.noarch.rpm 625 kB/s | 42 kB 00:00 2024-02-21T22:50:33.938 INFO:teuthology.orchestra.run.smithi142.stdout:(95/166): python3-wcwidth-0.2.5-8.el9.noarch.rp 659 kB/s | 44 kB 00:00 2024-02-21T22:50:33.972 INFO:teuthology.orchestra.run.smithi142.stdout:(96/166): qatlib-23.11.0-1.el9.x86_64.rpm 3.6 MB/s | 216 kB 00:00 2024-02-21T22:50:33.997 INFO:teuthology.orchestra.run.smithi142.stdout:(97/166): qatlib-service-23.11.0-1.el9.x86_64.r 596 kB/s | 35 kB 00:00 2024-02-21T22:50:34.039 INFO:teuthology.orchestra.run.smithi142.stdout:(98/166): qatzip-libs-1.1.2-2.el9.x86_64.rpm 667 kB/s | 44 kB 00:00 2024-02-21T22:50:34.065 INFO:teuthology.orchestra.run.smithi142.stdout:(99/166): socat-1.7.4.1-5.el9.x86_64.rpm 4.4 MB/s | 305 kB 00:00 2024-02-21T22:50:34.090 INFO:teuthology.orchestra.run.smithi142.stdout:(100/166): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-02-21T22:50:34.124 INFO:teuthology.orchestra.run.smithi142.stdout:(101/166): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 1.6 MB/s | 94 kB 00:00 2024-02-21T22:50:34.149 INFO:teuthology.orchestra.run.smithi142.stdout:(102/166): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.1 MB/s | 64 kB 00:00 2024-02-21T22:50:34.174 INFO:teuthology.orchestra.run.smithi142.stdout:(103/166): zlib-devel-1.2.11-40.el9.x86_64.rpm 899 kB/s | 45 kB 00:00 2024-02-21T22:50:34.233 INFO:teuthology.orchestra.run.smithi142.stdout:(104/166): lua-devel-5.4.4-4.el9.x86_64.rpm 267 kB/s | 22 kB 00:00 2024-02-21T22:50:34.235 INFO:teuthology.orchestra.run.smithi116.stdout:(18/166): librgw2-19.0.0-1643.g3bfc837d.el9.x86 8.0 MB/s | 5.1 MB 00:00 2024-02-21T22:50:34.285 INFO:teuthology.orchestra.run.smithi116.stdout:(19/166): python3-ceph-argparse-19.0.0-1643.g3b 907 kB/s | 45 kB 00:00 2024-02-21T22:50:34.335 INFO:teuthology.orchestra.run.smithi116.stdout:(20/166): python3-ceph-common-19.0.0-1643.g3bfc 2.6 MB/s | 131 kB 00:00 2024-02-21T22:50:34.400 INFO:teuthology.orchestra.run.smithi142.stdout:(105/166): python3-scipy-1.6.2-8.el9.x86_64.rpm 28 MB/s | 16 MB 00:00 2024-02-21T22:50:34.419 INFO:teuthology.orchestra.run.smithi116.stdout:(21/166): python3-cephfs-19.0.0-1643.g3bfc837d. 1.9 MB/s | 161 kB 00:00 2024-02-21T22:50:34.486 INFO:teuthology.orchestra.run.smithi116.stdout:(22/166): python3-rados-19.0.0-1643.g3bfc837d.e 4.7 MB/s | 321 kB 00:00 2024-02-21T22:50:34.558 INFO:teuthology.orchestra.run.smithi142.stdout:(106/166): gperftools-libs-2.9.1-2.el9.x86_64.r 1.9 MB/s | 309 kB 00:00 2024-02-21T22:50:34.561 INFO:teuthology.orchestra.run.smithi116.stdout:(23/166): python3-rbd-19.0.0-1643.g3bfc837d.el9 3.9 MB/s | 298 kB 00:00 2024-02-21T22:50:34.583 INFO:teuthology.orchestra.run.smithi142.stdout:(107/166): abseil-cpp-20211102.0-3.el9.x86_64.r 1.5 MB/s | 548 kB 00:00 2024-02-21T22:50:34.612 INFO:teuthology.orchestra.run.smithi116.stdout:(24/166): python3-rgw-19.0.0-1643.g3bfc837d.el9 2.0 MB/s | 100 kB 00:00 2024-02-21T22:50:34.617 INFO:teuthology.orchestra.run.smithi142.stdout:(108/166): protobuf-compiler-3.14.0-13.el9.x86_ 1.9 MB/s | 863 kB 00:00 2024-02-21T22:50:34.634 INFO:teuthology.orchestra.run.smithi142.stdout:(109/166): grpc-data-1.46.7-10.el9.noarch.rpm 258 kB/s | 19 kB 00:00 2024-02-21T22:50:34.662 INFO:teuthology.orchestra.run.smithi116.stdout:(25/166): rbd-fuse-19.0.0-1643.g3bfc837d.el9.x8 1.7 MB/s | 85 kB 00:00 2024-02-21T22:50:34.668 INFO:teuthology.orchestra.run.smithi142.stdout:(110/166): libarrow-doc-9.0.0-10.el9.noarch.rpm 784 kB/s | 26 kB 00:00 2024-02-21T22:50:34.710 INFO:teuthology.orchestra.run.smithi142.stdout:(111/166): libunwind-1.6.2-1.el9.x86_64.rpm 1.6 MB/s | 67 kB 00:00 2024-02-21T22:50:34.726 INFO:teuthology.orchestra.run.smithi142.stdout:(112/166): liboath-2.6.7-2.el9.x86_64.rpm 529 kB/s | 49 kB 00:00 2024-02-21T22:50:34.810 INFO:teuthology.orchestra.run.smithi142.stdout:(113/166): libarrow-9.0.0-10.el9.x86_64.rpm 20 MB/s | 4.4 MB 00:00 2024-02-21T22:50:34.835 INFO:teuthology.orchestra.run.smithi142.stdout:(114/166): luarocks-3.9.2-1.el9.noarch.rpm 1.2 MB/s | 151 kB 00:00 2024-02-21T22:50:34.869 INFO:teuthology.orchestra.run.smithi142.stdout:(115/166): python3-asyncssh-2.13.2-4.el9.noarch 9.2 MB/s | 548 kB 00:00 2024-02-21T22:50:34.894 INFO:teuthology.orchestra.run.smithi142.stdout:(116/166): python3-bcrypt-3.2.2-1.el9.x86_64.rp 741 kB/s | 43 kB 00:00 2024-02-21T22:50:34.929 INFO:teuthology.orchestra.run.smithi142.stdout:(117/166): python3-cachetools-4.2.4-1.el9.noarc 544 kB/s | 32 kB 00:00 2024-02-21T22:50:34.953 INFO:teuthology.orchestra.run.smithi142.stdout:(118/166): python3-certifi-2021.10.8-2.el9.noar 257 kB/s | 15 kB 00:00 2024-02-21T22:50:34.978 INFO:teuthology.orchestra.run.smithi142.stdout:(119/166): python3-cheroot-8.6.0-4.el9.noarch.r 3.4 MB/s | 172 kB 00:00 2024-02-21T22:50:35.020 INFO:teuthology.orchestra.run.smithi142.stdout:(120/166): parquet-libs-9.0.0-10.el9.x86_64.rpm 2.8 MB/s | 838 kB 00:00 2024-02-21T22:50:35.021 INFO:teuthology.orchestra.run.smithi116.stdout:(26/166): ceph-radosgw-19.0.0-1643.g3bfc837d.el 2.4 MB/s | 9.8 MB 00:04 2024-02-21T22:50:35.046 INFO:teuthology.orchestra.run.smithi142.stdout:(121/166): python3-cherrypy-18.6.1-2.el9.noarch 3.8 MB/s | 358 kB 00:00 2024-02-21T22:50:35.071 INFO:teuthology.orchestra.run.smithi142.stdout:(122/166): python3-colorama-0.4.4-12.el9.noarch 705 kB/s | 35 kB 00:00 2024-02-21T22:50:35.096 INFO:teuthology.orchestra.run.smithi142.stdout:(123/166): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.5 MB/s | 303 kB 00:00 2024-02-21T22:50:35.112 INFO:teuthology.orchestra.run.smithi116.stdout:(27/166): rbd-mirror-19.0.0-1643.g3bfc837d.el9. 6.9 MB/s | 3.1 MB 00:00 2024-02-21T22:50:35.121 INFO:teuthology.orchestra.run.smithi142.stdout:(124/166): python3-google-auth-2.27.0-1.el9.noa 2.6 MB/s | 203 kB 00:00 2024-02-21T22:50:35.147 INFO:teuthology.orchestra.run.smithi142.stdout:(125/166): python3-grpcio-tools-1.46.7-10.el9.x 2.8 MB/s | 144 kB 00:00 2024-02-21T22:50:35.154 INFO:teuthology.orchestra.run.smithi116.stdout:(28/166): ceph-grafana-dashboards-19.0.0-1643.g 758 kB/s | 31 kB 00:00 2024-02-21T22:50:35.172 INFO:teuthology.orchestra.run.smithi142.stdout:(126/166): python3-jaraco-8.2.1-3.el9.noarch.rp 213 kB/s | 11 kB 00:00 2024-02-21T22:50:35.180 INFO:teuthology.orchestra.run.smithi116.stdout:(29/166): rbd-nbd-19.0.0-1643.g3bfc837d.el9.x86 1.1 MB/s | 170 kB 00:00 2024-02-21T22:50:35.197 INFO:teuthology.orchestra.run.smithi142.stdout:(127/166): python3-jaraco-classes-3.2.1-5.el9.n 353 kB/s | 18 kB 00:00 2024-02-21T22:50:35.205 INFO:teuthology.orchestra.run.smithi116.stdout:(30/166): ceph-mgr-cephadm-19.0.0-1643.g3bfc837 2.7 MB/s | 138 kB 00:00 2024-02-21T22:50:35.222 INFO:teuthology.orchestra.run.smithi142.stdout:(128/166): python3-jaraco-collections-3.0.0-8.e 462 kB/s | 23 kB 00:00 2024-02-21T22:50:35.256 INFO:teuthology.orchestra.run.smithi142.stdout:(129/166): python3-jaraco-functools-3.5.0-2.el9 332 kB/s | 19 kB 00:00 2024-02-21T22:50:35.281 INFO:teuthology.orchestra.run.smithi142.stdout:(130/166): python3-jaraco-text-3.2.0-6.el9.noar 335 kB/s | 20 kB 00:00 2024-02-21T22:50:35.323 INFO:teuthology.orchestra.run.smithi142.stdout:(131/166): python3-kubernetes-26.1.0-2.el9.noar 15 MB/s | 1.0 MB 00:00 2024-02-21T22:50:35.349 INFO:teuthology.orchestra.run.smithi142.stdout:(132/166): python3-logutils-0.3.5-21.el9.noarch 693 kB/s | 46 kB 00:00 2024-02-21T22:50:35.374 INFO:teuthology.orchestra.run.smithi142.stdout:(133/166): python3-more-itertools-8.12.0-2.el9. 1.5 MB/s | 79 kB 00:00 2024-02-21T22:50:35.399 INFO:teuthology.orchestra.run.smithi142.stdout:(134/166): python3-natsort-7.1.1-5.el9.noarch.r 1.1 MB/s | 58 kB 00:00 2024-02-21T22:50:35.425 INFO:teuthology.orchestra.run.smithi142.stdout:(135/166): python3-pecan-1.4.2-3.el9.noarch.rpm 5.3 MB/s | 272 kB 00:00 2024-02-21T22:50:35.466 INFO:teuthology.orchestra.run.smithi142.stdout:(136/166): python3-portend-3.1.0-2.el9.noarch.r 246 kB/s | 16 kB 00:00 2024-02-21T22:50:35.508 INFO:teuthology.orchestra.run.smithi142.stdout:(137/166): python3-grpcio-1.46.7-10.el9.x86_64. 4.7 MB/s | 2.0 MB 00:00 2024-02-21T22:50:35.534 INFO:teuthology.orchestra.run.smithi142.stdout:(138/166): python3-pyOpenSSL-21.0.0-1.el9.noarc 828 kB/s | 90 kB 00:00 2024-02-21T22:50:35.559 INFO:teuthology.orchestra.run.smithi142.stdout:(139/166): python3-pyperclip-1.8.2-2.el9.noarch 306 kB/s | 28 kB 00:00 2024-02-21T22:50:35.584 INFO:teuthology.orchestra.run.smithi142.stdout:(140/166): python3-repoze-lru-0.7-16.el9.noarch 615 kB/s | 31 kB 00:00 2024-02-21T22:50:35.609 INFO:teuthology.orchestra.run.smithi142.stdout:(141/166): python3-rsa-4.9-2.el9.noarch.rpm 1.2 MB/s | 59 kB 00:00 2024-02-21T22:50:35.635 INFO:teuthology.orchestra.run.smithi142.stdout:(142/166): python3-tempora-5.0.0-2.el9.noarch.r 714 kB/s | 36 kB 00:00 2024-02-21T22:50:35.660 INFO:teuthology.orchestra.run.smithi142.stdout:(143/166): python3-routes-2.5.1-5.el9.noarch.rp 1.5 MB/s | 188 kB 00:00 2024-02-21T22:50:35.680 INFO:teuthology.orchestra.run.smithi116.stdout:(31/166): ceph-mgr-dashboard-19.0.0-1643.g3bfc8 3.6 MB/s | 1.8 MB 00:00 2024-02-21T22:50:35.685 INFO:teuthology.orchestra.run.smithi142.stdout:(144/166): python3-typing-extensions-4.4.0-2.el 678 kB/s | 51 kB 00:00 2024-02-21T22:50:35.711 INFO:teuthology.orchestra.run.smithi142.stdout:(145/166): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-02-21T22:50:35.736 INFO:teuthology.orchestra.run.smithi142.stdout:(146/166): python3-webob-1.8.7-6.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-02-21T22:50:35.761 INFO:teuthology.orchestra.run.smithi142.stdout:(147/166): python3-zc-lockfile-2.0-10.el9.noarc 399 kB/s | 20 kB 00:00 2024-02-21T22:50:35.786 INFO:teuthology.orchestra.run.smithi142.stdout:(148/166): re2-20211101-3.el9.x86_64.rpm 3.7 MB/s | 192 kB 00:00 2024-02-21T22:50:35.789 INFO:teuthology.orchestra.run.smithi116.stdout:(32/166): ceph-mgr-modules-core-19.0.0-1643.g3b 2.2 MB/s | 248 kB 00:00 2024-02-21T22:50:35.812 INFO:teuthology.orchestra.run.smithi142.stdout:(149/166): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-02-21T22:50:35.856 INFO:teuthology.orchestra.run.smithi116.stdout:(33/166): ceph-mgr-rook-19.0.0-1643.g3bfc837d.e 743 kB/s | 49 kB 00:00 2024-02-21T22:50:35.912 INFO:teuthology.orchestra.run.smithi142.stdout:(150/166): thrift-0.15.0-2.el9.x86_64.rpm 11 MB/s | 1.6 MB 00:00 2024-02-21T22:50:35.923 INFO:teuthology.orchestra.run.smithi116.stdout:(34/166): ceph-prometheus-alerts-19.0.0-1643.g3 230 kB/s | 15 kB 00:00 2024-02-21T22:50:36.062 INFO:teuthology.orchestra.run.smithi142.stdout:(151/166): NetworkManager-1.45.91-1.el9.x86_64. 15 MB/s | 2.3 MB 00:00 2024-02-21T22:50:36.065 INFO:teuthology.orchestra.run.smithi116.stdout:(35/166): ceph-volume-19.0.0-1643.g3bfc837d.el9 1.8 MB/s | 264 kB 00:00 2024-02-21T22:50:36.156 INFO:teuthology.orchestra.run.smithi116.stdout:(36/166): ceph-mgr-diskprediction-local-19.0.0- 7.8 MB/s | 7.4 MB 00:00 2024-02-21T22:50:36.196 INFO:teuthology.orchestra.run.smithi142.stdout:(152/166): NetworkManager-libnm-1.45.91-1.el9.x 14 MB/s | 1.8 MB 00:00 2024-02-21T22:50:36.232 INFO:teuthology.orchestra.run.smithi116.stdout:(37/166): cephfs-top-19.0.0-1643.g3bfc837d.el9. 244 kB/s | 18 kB 00:00 2024-02-21T22:50:36.254 INFO:teuthology.orchestra.run.smithi142.stdout:(153/166): NetworkManager-team-1.45.91-1.el9.x8 729 kB/s | 42 kB 00:00 2024-02-21T22:50:36.305 INFO:teuthology.orchestra.run.smithi142.stdout:(154/166): librbd1-19.0.0-1643.g3bfc837d.el9.x8 6.4 MB/s | 3.1 MB 00:00 2024-02-21T22:50:36.315 INFO:teuthology.orchestra.run.smithi116.stdout:(38/166): libaio-devel-0.3.112-1.el8.x86_64.rpm 211 kB/s | 18 kB 00:00 2024-02-21T22:50:36.363 INFO:teuthology.orchestra.run.smithi142.stdout:(155/166): librados2-19.0.0-1643.g3bfc837d.el9. 5.9 MB/s | 3.4 MB 00:00 2024-02-21T22:50:36.407 INFO:teuthology.orchestra.run.smithi116.stdout:(39/166): cephadm-19.0.0-1643.g3bfc837d.el9.noa 2.1 MB/s | 748 kB 00:00 2024-02-21T22:50:36.415 INFO:teuthology.orchestra.run.smithi142.stdout:(156/166): acl-2.3.1-4.el9.x86_64.rpm 660 kB/s | 71 kB 00:00 2024-02-21T22:50:36.439 INFO:teuthology.orchestra.run.smithi142.stdout:(157/166): elfutils-debuginfod-client-0.190-2.e 486 kB/s | 36 kB 00:00 2024-02-21T22:50:36.464 INFO:teuthology.orchestra.run.smithi142.stdout:(158/166): NetworkManager-tui-1.45.91-1.el9.x86 1.2 MB/s | 247 kB 00:00 2024-02-21T22:50:36.491 INFO:teuthology.orchestra.run.smithi116.stdout:(40/166): fuse-2.9.9-15.el9.x86_64.rpm 459 kB/s | 80 kB 00:00 2024-02-21T22:50:36.514 INFO:teuthology.orchestra.run.smithi142.stdout:(159/166): elfutils-libelf-0.190-2.el9.x86_64.r 1.9 MB/s | 192 kB 00:00 2024-02-21T22:50:36.548 INFO:teuthology.orchestra.run.smithi142.stdout:(160/166): libacl-2.3.1-4.el9.x86_64.rpm 275 kB/s | 23 kB 00:00 2024-02-21T22:50:36.574 INFO:teuthology.orchestra.run.smithi142.stdout:(161/166): elfutils-libs-0.190-2.el9.x86_64.rpm 1.9 MB/s | 256 kB 00:00 2024-02-21T22:50:36.616 INFO:teuthology.orchestra.run.smithi116.stdout:(41/166): jq-1.6-16.el9.x86_64.rpm 898 kB/s | 187 kB 00:00 2024-02-21T22:50:36.642 INFO:teuthology.orchestra.run.smithi116.stdout:(42/166): libgfortran-11.4.1-3.el9.x86_64.rpm 5.2 MB/s | 803 kB 00:00 2024-02-21T22:50:36.657 INFO:teuthology.orchestra.run.smithi142.stdout:(162/166): xfsdump-3.1.12-4.el9.x86_64.rpm 3.8 MB/s | 323 kB 00:00 2024-02-21T22:50:36.675 INFO:teuthology.orchestra.run.smithi116.stdout:(43/166): libquadmath-11.4.1-3.el9.x86_64.rpm 3.3 MB/s | 195 kB 00:00 2024-02-21T22:50:36.699 INFO:teuthology.orchestra.run.smithi142.stdout:(163/166): openssl-3.0.7-25.el9.x86_64.rpm 6.6 MB/s | 1.2 MB 00:00 2024-02-21T22:50:36.700 INFO:teuthology.orchestra.run.smithi116.stdout:(44/166): oniguruma-6.9.6-1.el9.5.x86_64.rpm 3.6 MB/s | 218 kB 00:00 2024-02-21T22:50:36.734 INFO:teuthology.orchestra.run.smithi116.stdout:(45/166): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.2 MB/s | 253 kB 00:00 2024-02-21T22:50:36.760 INFO:teuthology.orchestra.run.smithi142.stdout:(164/166): openssl-libs-3.0.7-25.el9.x86_64.rpm 10 MB/s | 2.2 MB 00:00 2024-02-21T22:50:36.801 INFO:teuthology.orchestra.run.smithi116.stdout:(46/166): python3-cryptography-36.0.1-4.el9.x86 12 MB/s | 1.2 MB 00:00 2024-02-21T22:50:36.826 INFO:teuthology.orchestra.run.smithi116.stdout:(47/166): python3-ply-3.11-14.el9.noarch.rpm 1.1 MB/s | 106 kB 00:00 2024-02-21T22:50:36.827 INFO:teuthology.orchestra.run.smithi142.stdout:(165/166): libacl-devel-2.3.1-4.el9.x86_64.rpm 582 kB/s | 74 kB 00:00 2024-02-21T22:50:36.860 INFO:teuthology.orchestra.run.smithi116.stdout:(48/166): python3-pycparser-2.20-6.el9.noarch.r 2.3 MB/s | 135 kB 00:00 2024-02-21T22:50:36.860 INFO:teuthology.orchestra.run.smithi142.stdout:(166/166): xfsprogs-6.3.0-1.el9.x86_64.rpm 5.3 MB/s | 1.1 MB 00:00 2024-02-21T22:50:36.863 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2024-02-21T22:50:36.863 INFO:teuthology.orchestra.run.smithi142.stdout:Total 19 MB/s | 222 MB 00:11 2024-02-21T22:50:36.885 INFO:teuthology.orchestra.run.smithi116.stdout:(49/166): python3-requests-2.25.1-8.el9.noarch. 2.1 MB/s | 125 kB 00:00 2024-02-21T22:50:36.919 INFO:teuthology.orchestra.run.smithi116.stdout:(50/166): python3-urllib3-1.26.5-5.el9.noarch.r 3.6 MB/s | 215 kB 00:00 2024-02-21T22:50:36.978 INFO:teuthology.orchestra.run.smithi116.stdout:(51/166): automake-1.16.2-8.el9.noarch.rpm 7.3 MB/s | 689 kB 00:00 2024-02-21T22:50:37.011 INFO:teuthology.orchestra.run.smithi116.stdout:(52/166): bison-3.7.4-5.el9.x86_64.rpm 10 MB/s | 943 kB 00:00 2024-02-21T22:50:37.037 INFO:teuthology.orchestra.run.smithi116.stdout:(53/166): boost-program-options-1.75.0-8.el9.x8 1.8 MB/s | 107 kB 00:00 2024-02-21T22:50:37.063 INFO:teuthology.orchestra.run.smithi116.stdout:(54/166): elfutils-libelf-devel-0.190-2.el9.x86 427 kB/s | 21 kB 00:00 2024-02-21T22:50:37.095 INFO:teuthology.orchestra.run.smithi116.stdout:(55/166): flex-2.6.4-9.el9.x86_64.rpm 5.2 MB/s | 313 kB 00:00 2024-02-21T22:50:37.121 INFO:teuthology.orchestra.run.smithi116.stdout:(56/166): flexiblas-3.0.4-8.el9.x86_64.rpm 558 kB/s | 33 kB 00:00 2024-02-21T22:50:37.180 INFO:teuthology.orchestra.run.smithi116.stdout:(57/166): flexiblas-openblas-openmp-3.0.4-8.el9 313 kB/s | 18 kB 00:00 2024-02-21T22:50:37.240 INFO:teuthology.orchestra.run.smithi116.stdout:(58/166): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.7 MB/s | 160 kB 00:00 2024-02-21T22:50:37.288 INFO:teuthology.orchestra.run.smithi116.stdout:(59/166): librabbitmq-0.11.0-7.el9.x86_64.rpm 904 kB/s | 45 kB 00:00 2024-02-21T22:50:37.372 INFO:teuthology.orchestra.run.smithi116.stdout:(60/166): flexiblas-netlib-3.0.4-8.el9.x86_64.r 11 MB/s | 3.0 MB 00:00 2024-02-21T22:50:37.405 INFO:teuthology.orchestra.run.smithi116.stdout:(61/166): librdkafka-1.6.1-102.el9.x86_64.rpm 5.5 MB/s | 662 kB 00:00 2024-02-21T22:50:37.814 INFO:teuthology.orchestra.run.smithi116.stdout:(62/166): ceph-test-19.0.0-1643.g3bfc837d.el9.x 9.9 MB/s | 47 MB 00:04 2024-02-21T22:50:37.839 INFO:teuthology.orchestra.run.smithi116.stdout:(63/166): libuuid-devel-2.37.4-15.el9.x86_64.rp 59 kB/s | 26 kB 00:00 2024-02-21T22:50:37.865 INFO:teuthology.orchestra.run.smithi116.stdout:(64/166): libtool-2.4.6-45.el9.x86_64.rpm 1.2 MB/s | 582 kB 00:00 2024-02-21T22:50:37.898 INFO:teuthology.orchestra.run.smithi116.stdout:(65/166): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.9 MB/s | 292 kB 00:00 2024-02-21T22:50:37.948 INFO:teuthology.orchestra.run.smithi116.stdout:(66/166): lua-5.4.4-4.el9.x86_64.rpm 2.2 MB/s | 188 kB 00:00 2024-02-21T22:50:37.974 INFO:teuthology.orchestra.run.smithi116.stdout:(67/166): openblas-0.3.21-2.el9.x86_64.rpm 469 kB/s | 35 kB 00:00 2024-02-21T22:50:37.999 INFO:teuthology.orchestra.run.smithi116.stdout:(68/166): libzstd-devel-1.5.1-2.el9.x86_64.rpm 257 kB/s | 47 kB 00:00 2024-02-21T22:50:38.066 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2024-02-21T22:50:38.174 INFO:teuthology.orchestra.run.smithi116.stdout:(69/166): openssl-devel-3.0.7-25.el9.x86_64.rpm 21 MB/s | 4.1 MB 00:00 2024-02-21T22:50:38.259 INFO:teuthology.orchestra.run.smithi116.stdout:(70/166): postgresql-contrib-13.11-1.el9.x86_64 11 MB/s | 905 kB 00:00 2024-02-21T22:50:38.317 INFO:teuthology.orchestra.run.smithi116.stdout:(71/166): postgresql-private-libs-13.11-1.el9.x 2.3 MB/s | 135 kB 00:00 2024-02-21T22:50:38.363 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2024-02-21T22:50:38.363 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2024-02-21T22:50:38.417 INFO:teuthology.orchestra.run.smithi116.stdout:(72/166): openblas-openmp-0.3.21-2.el9.x86_64.r 10 MB/s | 4.7 MB 00:00 2024-02-21T22:50:38.600 INFO:teuthology.orchestra.run.smithi116.stdout:(73/166): postgresql-13.11-1.el9.x86_64.rpm 2.6 MB/s | 1.6 MB 00:00 2024-02-21T22:50:38.676 INFO:teuthology.orchestra.run.smithi116.stdout:(74/166): postgresql-server-13.11-1.el9.x86_64. 16 MB/s | 5.7 MB 00:00 2024-02-21T22:50:38.701 INFO:teuthology.orchestra.run.smithi116.stdout:(75/166): python3-attrs-20.3.0-7.el9.noarch.rpm 876 kB/s | 87 kB 00:00 2024-02-21T22:50:38.735 INFO:teuthology.orchestra.run.smithi116.stdout:(76/166): protobuf-3.14.0-13.el9.x86_64.rpm 3.2 MB/s | 1.0 MB 00:00 2024-02-21T22:50:38.760 INFO:teuthology.orchestra.run.smithi116.stdout:(77/166): python3-devel-3.9.17-2.el9.x86_64.rpm 4.1 MB/s | 245 kB 00:00 2024-02-21T22:50:38.793 INFO:teuthology.orchestra.run.smithi116.stdout:(78/166): python3-jinja2-2.11.3-5.el9.noarch.rp 4.2 MB/s | 248 kB 00:00 2024-02-21T22:50:38.819 INFO:teuthology.orchestra.run.smithi116.stdout:(79/166): python3-jsonpatch-1.21-16.el9.noarch. 437 kB/s | 26 kB 00:00 2024-02-21T22:50:38.852 INFO:teuthology.orchestra.run.smithi116.stdout:(80/166): python3-jsonpointer-2.0-4.el9.noarch. 326 kB/s | 19 kB 00:00 2024-02-21T22:50:38.878 INFO:teuthology.orchestra.run.smithi116.stdout:(81/166): python3-mako-1.1.4-6.el9.noarch.rpm 2.9 MB/s | 172 kB 00:00 2024-02-21T22:50:38.911 INFO:teuthology.orchestra.run.smithi116.stdout:(82/166): python3-markupsafe-1.1.1-12.el9.x86_6 595 kB/s | 35 kB 00:00 2024-02-21T22:50:38.986 INFO:teuthology.orchestra.run.smithi116.stdout:(83/166): python3-numpy-f2py-1.20.1-5.el9.x86_6 3.3 MB/s | 250 kB 00:00 2024-02-21T22:50:39.062 INFO:teuthology.orchestra.run.smithi116.stdout:(84/166): python3-numpy-1.20.1-5.el9.x86_64.rpm 28 MB/s | 5.1 MB 00:00 2024-02-21T22:50:39.087 INFO:teuthology.orchestra.run.smithi116.stdout:(85/166): python3-oauthlib-3.1.1-5.el9.noarch.r 2.2 MB/s | 222 kB 00:00 2024-02-21T22:50:39.121 INFO:teuthology.orchestra.run.smithi116.stdout:(86/166): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 77 kB 00:00 2024-02-21T22:50:39.147 INFO:teuthology.orchestra.run.smithi116.stdout:(87/166): python3-prettytable-0.7.2-27.el9.noar 720 kB/s | 42 kB 00:00 2024-02-21T22:50:39.180 INFO:teuthology.orchestra.run.smithi116.stdout:(88/166): python3-protobuf-3.14.0-13.el9.noarch 4.5 MB/s | 269 kB 00:00 2024-02-21T22:50:39.222 INFO:teuthology.orchestra.run.smithi116.stdout:(89/166): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.1 MB/s | 159 kB 00:00 2024-02-21T22:50:39.247 INFO:teuthology.orchestra.run.smithi116.stdout:(90/166): python3-pyasn1-modules-0.4.8-6.el9.no 4.1 MB/s | 279 kB 00:00 2024-02-21T22:50:39.283 INFO:teuthology.orchestra.run.smithi116.stdout:(91/166): python3-pytz-2021.1-5.el9.noarch.rpm 872 kB/s | 51 kB 00:00 2024-02-21T22:50:39.306 INFO:teuthology.orchestra.run.smithi116.stdout:(92/166): python3-requests-oauthlib-1.3.0-12.el 915 kB/s | 54 kB 00:00 2024-02-21T22:50:39.364 INFO:teuthology.orchestra.run.smithi116.stdout:(93/166): python3-toml-0.10.2-6.el9.noarch.rpm 714 kB/s | 42 kB 00:00 2024-02-21T22:50:39.415 INFO:teuthology.orchestra.run.smithi116.stdout:(94/166): python3-wcwidth-0.2.5-8.el9.noarch.rp 882 kB/s | 44 kB 00:00 2024-02-21T22:50:39.482 INFO:teuthology.orchestra.run.smithi116.stdout:(95/166): qatlib-23.11.0-1.el9.x86_64.rpm 3.2 MB/s | 216 kB 00:00 2024-02-21T22:50:39.540 INFO:teuthology.orchestra.run.smithi116.stdout:(96/166): qatlib-service-23.11.0-1.el9.x86_64.r 598 kB/s | 35 kB 00:00 2024-02-21T22:50:39.591 INFO:teuthology.orchestra.run.smithi116.stdout:(97/166): qatzip-libs-1.1.2-2.el9.x86_64.rpm 895 kB/s | 44 kB 00:00 2024-02-21T22:50:39.666 INFO:teuthology.orchestra.run.smithi116.stdout:(98/166): python3-babel-2.9.1-2.el9.noarch.rpm 6.0 MB/s | 6.0 MB 00:00 2024-02-21T22:50:39.691 INFO:teuthology.orchestra.run.smithi116.stdout:(99/166): socat-1.7.4.1-5.el9.x86_64.rpm 3.0 MB/s | 305 kB 00:00 2024-02-21T22:50:39.716 INFO:teuthology.orchestra.run.smithi116.stdout:(100/166): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-02-21T22:50:39.750 INFO:teuthology.orchestra.run.smithi116.stdout:(101/166): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 1.6 MB/s | 94 kB 00:00 2024-02-21T22:50:39.767 INFO:teuthology.orchestra.run.smithi116.stdout:(102/166): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-02-21T22:50:39.800 INFO:teuthology.orchestra.run.smithi116.stdout:(103/166): zlib-devel-1.2.11-40.el9.x86_64.rpm 902 kB/s | 45 kB 00:00 2024-02-21T22:50:39.817 INFO:teuthology.orchestra.run.smithi116.stdout:(104/166): lua-devel-5.4.4-4.el9.x86_64.rpm 444 kB/s | 22 kB 00:00 2024-02-21T22:50:39.884 INFO:teuthology.orchestra.run.smithi116.stdout:(105/166): protobuf-compiler-3.14.0-13.el9.x86_ 10 MB/s | 863 kB 00:00 2024-02-21T22:50:40.260 INFO:teuthology.orchestra.run.smithi116.stdout:(106/166): python3-scipy-1.6.2-8.el9.x86_64.rpm 17 MB/s | 16 MB 00:00 2024-02-21T22:50:40.489 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2024-02-21T22:50:40.489 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2024-02-21T22:50:40.535 INFO:teuthology.orchestra.run.smithi116.stdout:(107/166): abseil-cpp-20211102.0-3.el9.x86_64.r 764 kB/s | 548 kB 00:00 2024-02-21T22:50:40.560 INFO:teuthology.orchestra.run.smithi116.stdout:(108/166): grpc-data-1.46.7-10.el9.noarch.rpm 65 kB/s | 19 kB 00:00 2024-02-21T22:50:40.594 INFO:teuthology.orchestra.run.smithi116.stdout:(109/166): gperftools-libs-2.9.1-2.el9.x86_64.r 435 kB/s | 309 kB 00:00 2024-02-21T22:50:40.669 INFO:teuthology.orchestra.run.smithi116.stdout:(110/166): libarrow-doc-9.0.0-10.el9.noarch.rpm 239 kB/s | 26 kB 00:00 2024-02-21T22:50:40.786 INFO:teuthology.orchestra.run.smithi116.stdout:(111/166): libunwind-1.6.2-1.el9.x86_64.rpm 577 kB/s | 67 kB 00:00 2024-02-21T22:50:40.811 INFO:teuthology.orchestra.run.smithi116.stdout:(112/166): liboath-2.6.7-2.el9.x86_64.rpm 223 kB/s | 49 kB 00:00 2024-02-21T22:50:40.920 INFO:teuthology.orchestra.run.smithi116.stdout:(113/166): libarrow-9.0.0-10.el9.x86_64.rpm 11 MB/s | 4.4 MB 00:00 2024-02-21T22:50:40.945 INFO:teuthology.orchestra.run.smithi116.stdout:(114/166): luarocks-3.9.2-1.el9.noarch.rpm 953 kB/s | 151 kB 00:00 2024-02-21T22:50:41.054 INFO:teuthology.orchestra.run.smithi116.stdout:(115/166): python3-asyncssh-2.13.2-4.el9.noarch 4.0 MB/s | 548 kB 00:00 2024-02-21T22:50:41.079 INFO:teuthology.orchestra.run.smithi116.stdout:(116/166): python3-bcrypt-3.2.2-1.el9.x86_64.rp 325 kB/s | 43 kB 00:00 2024-02-21T22:50:41.154 INFO:teuthology.orchestra.run.smithi116.stdout:(117/166): python3-cachetools-4.2.4-1.el9.noarc 321 kB/s | 32 kB 00:00 2024-02-21T22:50:41.188 INFO:teuthology.orchestra.run.smithi116.stdout:(118/166): parquet-libs-9.0.0-10.el9.x86_64.rpm 2.2 MB/s | 838 kB 00:00 2024-02-21T22:50:41.213 INFO:teuthology.orchestra.run.smithi116.stdout:(119/166): python3-certifi-2021.10.8-2.el9.noar 112 kB/s | 15 kB 00:00 2024-02-21T22:50:41.263 INFO:teuthology.orchestra.run.smithi116.stdout:(120/166): python3-cheroot-8.6.0-4.el9.noarch.r 1.5 MB/s | 172 kB 00:00 2024-02-21T22:50:41.297 INFO:teuthology.orchestra.run.smithi116.stdout:(121/166): python3-cherrypy-18.6.1-2.el9.noarch 3.2 MB/s | 358 kB 00:00 2024-02-21T22:50:41.364 INFO:teuthology.orchestra.run.smithi116.stdout:(122/166): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.0 MB/s | 303 kB 00:00 2024-02-21T22:50:41.389 INFO:teuthology.orchestra.run.smithi116.stdout:(123/166): python3-colorama-0.4.4-12.el9.noarch 281 kB/s | 35 kB 00:00 2024-02-21T22:50:41.415 INFO:teuthology.orchestra.run.smithi116.stdout:(124/166): python3-google-auth-2.27.0-1.el9.noa 1.7 MB/s | 203 kB 00:00 2024-02-21T22:50:41.498 INFO:teuthology.orchestra.run.smithi116.stdout:(125/166): python3-grpcio-tools-1.46.7-10.el9.x 1.3 MB/s | 144 kB 00:00 2024-02-21T22:50:41.523 INFO:teuthology.orchestra.run.smithi116.stdout:(126/166): python3-jaraco-8.2.1-3.el9.noarch.rp 98 kB/s | 11 kB 00:00 2024-02-21T22:50:41.574 INFO:teuthology.orchestra.run.smithi116.stdout:(127/166): python3-grpcio-1.46.7-10.el9.x86_64. 9.7 MB/s | 2.0 MB 00:00 2024-02-21T22:50:41.599 INFO:teuthology.orchestra.run.smithi116.stdout:(128/166): python3-jaraco-classes-3.2.1-5.el9.n 176 kB/s | 18 kB 00:00 2024-02-21T22:50:41.632 INFO:teuthology.orchestra.run.smithi116.stdout:(129/166): python3-jaraco-collections-3.0.0-8.e 213 kB/s | 23 kB 00:00 2024-02-21T22:50:41.674 INFO:teuthology.orchestra.run.smithi116.stdout:(130/166): python3-jaraco-functools-3.5.0-2.el9 193 kB/s | 19 kB 00:00 2024-02-21T22:50:41.700 INFO:teuthology.orchestra.run.smithi116.stdout:(131/166): python3-jaraco-text-3.2.0-6.el9.noar 195 kB/s | 20 kB 00:00 2024-02-21T22:50:41.775 INFO:teuthology.orchestra.run.smithi116.stdout:(132/166): python3-logutils-0.3.5-21.el9.noarch 461 kB/s | 46 kB 00:00 2024-02-21T22:50:41.800 INFO:teuthology.orchestra.run.smithi116.stdout:(133/166): python3-more-itertools-8.12.0-2.el9. 786 kB/s | 79 kB 00:00 2024-02-21T22:50:41.834 INFO:teuthology.orchestra.run.smithi116.stdout:(134/166): python3-kubernetes-26.1.0-2.el9.noar 5.1 MB/s | 1.0 MB 00:00 2024-02-21T22:50:41.876 INFO:teuthology.orchestra.run.smithi116.stdout:(135/166): python3-natsort-7.1.1-5.el9.noarch.r 574 kB/s | 58 kB 00:00 2024-02-21T22:50:41.909 INFO:teuthology.orchestra.run.smithi116.stdout:(136/166): python3-pecan-1.4.2-3.el9.noarch.rpm 2.4 MB/s | 272 kB 00:00 2024-02-21T22:50:41.943 INFO:teuthology.orchestra.run.smithi116.stdout:(137/166): python3-portend-3.1.0-2.el9.noarch.r 151 kB/s | 16 kB 00:00 2024-02-21T22:50:41.976 INFO:teuthology.orchestra.run.smithi116.stdout:(138/166): python3-pyOpenSSL-21.0.0-1.el9.noarc 896 kB/s | 90 kB 00:00 2024-02-21T22:50:42.035 INFO:teuthology.orchestra.run.smithi116.stdout:(139/166): python3-pyperclip-1.8.2-2.el9.noarch 225 kB/s | 28 kB 00:00 2024-02-21T22:50:42.060 INFO:teuthology.orchestra.run.smithi116.stdout:(140/166): python3-repoze-lru-0.7-16.el9.noarch 263 kB/s | 31 kB 00:00 2024-02-21T22:50:42.086 INFO:teuthology.orchestra.run.smithi116.stdout:(141/166): python3-routes-2.5.1-5.el9.noarch.rp 1.7 MB/s | 188 kB 00:00 2024-02-21T22:50:42.128 INFO:teuthology.orchestra.run.smithi116.stdout:(142/166): python3-rsa-4.9-2.el9.noarch.rpm 639 kB/s | 59 kB 00:00 2024-02-21T22:50:42.161 INFO:teuthology.orchestra.run.smithi116.stdout:(143/166): python3-tempora-5.0.0-2.el9.noarch.r 355 kB/s | 36 kB 00:00 2024-02-21T22:50:42.178 INFO:teuthology.orchestra.run.smithi116.stdout:(144/166): python3-typing-extensions-4.4.0-2.el 554 kB/s | 51 kB 00:00 2024-02-21T22:50:42.237 INFO:teuthology.orchestra.run.smithi116.stdout:(145/166): python3-webob-1.8.7-6.el9.noarch.rpm 2.1 MB/s | 230 kB 00:00 2024-02-21T22:50:42.270 INFO:teuthology.orchestra.run.smithi116.stdout:(146/166): python3-websocket-client-1.2.3-2.el9 825 kB/s | 90 kB 00:00 2024-02-21T22:50:42.305 INFO:teuthology.orchestra.run.smithi116.stdout:(147/166): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-02-21T22:50:42.338 INFO:teuthology.orchestra.run.smithi116.stdout:(148/166): python3-zc-lockfile-2.0-10.el9.noarc 199 kB/s | 20 kB 00:00 2024-02-21T22:50:42.380 INFO:teuthology.orchestra.run.smithi116.stdout:(149/166): re2-20211101-3.el9.x86_64.rpm 1.7 MB/s | 192 kB 00:00 2024-02-21T22:50:42.446 INFO:teuthology.orchestra.run.smithi116.stdout:(150/166): thrift-0.15.0-2.el9.x86_64.rpm 11 MB/s | 1.6 MB 00:00 2024-02-21T22:50:42.705 INFO:teuthology.orchestra.run.smithi116.stdout:(151/166): librbd1-19.0.0-1643.g3bfc837d.el9.x8 9.6 MB/s | 3.1 MB 00:00 2024-02-21T22:50:42.789 INFO:teuthology.orchestra.run.smithi116.stdout:(152/166): NetworkManager-1.45.91-1.el9.x86_64. 6.6 MB/s | 2.3 MB 00:00 2024-02-21T22:50:42.847 INFO:teuthology.orchestra.run.smithi116.stdout:(153/166): NetworkManager-team-1.45.91-1.el9.x8 730 kB/s | 42 kB 00:00 2024-02-21T22:50:42.914 INFO:teuthology.orchestra.run.smithi116.stdout:(154/166): NetworkManager-tui-1.45.91-1.el9.x86 3.6 MB/s | 247 kB 00:00 2024-02-21T22:50:42.975 INFO:teuthology.orchestra.run.smithi116.stdout:(155/166): acl-2.3.1-4.el9.x86_64.rpm 1.2 MB/s | 71 kB 00:00 2024-02-21T22:50:43.031 INFO:teuthology.orchestra.run.smithi116.stdout:(156/166): elfutils-debuginfod-client-0.190-2.e 625 kB/s | 36 kB 00:00 2024-02-21T22:50:43.074 INFO:teuthology.orchestra.run.smithi116.stdout:(157/166): NetworkManager-libnm-1.45.91-1.el9.x 4.9 MB/s | 1.8 MB 00:00 2024-02-21T22:50:43.099 INFO:teuthology.orchestra.run.smithi116.stdout:(158/166): elfutils-libelf-0.190-2.el9.x86_64.r 2.8 MB/s | 192 kB 00:00 2024-02-21T22:50:43.132 INFO:teuthology.orchestra.run.smithi116.stdout:(159/166): elfutils-libs-0.190-2.el9.x86_64.rpm 4.3 MB/s | 256 kB 00:00 2024-02-21T22:50:43.157 INFO:teuthology.orchestra.run.smithi116.stdout:(160/166): libacl-2.3.1-4.el9.x86_64.rpm 394 kB/s | 23 kB 00:00 2024-02-21T22:50:43.258 INFO:teuthology.orchestra.run.smithi116.stdout:(161/166): openssl-libs-3.0.7-25.el9.x86_64.rpm 22 MB/s | 2.2 MB 00:00 2024-02-21T22:50:43.291 INFO:teuthology.orchestra.run.smithi116.stdout:(162/166): openssl-3.0.7-25.el9.x86_64.rpm 7.6 MB/s | 1.2 MB 00:00 2024-02-21T22:50:43.325 INFO:teuthology.orchestra.run.smithi116.stdout:(163/166): xfsdump-3.1.12-4.el9.x86_64.rpm 4.7 MB/s | 323 kB 00:00 2024-02-21T22:50:43.392 INFO:teuthology.orchestra.run.smithi116.stdout:(164/166): xfsprogs-6.3.0-1.el9.x86_64.rpm 11 MB/s | 1.1 MB 00:00 2024-02-21T22:50:43.417 INFO:teuthology.orchestra.run.smithi116.stdout:(165/166): libacl-devel-2.3.1-4.el9.x86_64.rpm 808 kB/s | 74 kB 00:00 2024-02-21T22:50:43.526 INFO:teuthology.orchestra.run.smithi116.stdout:(166/166): librados2-19.0.0-1643.g3bfc837d.el9. 2.8 MB/s | 3.4 MB 00:01 2024-02-21T22:50:43.529 INFO:teuthology.orchestra.run.smithi116.stdout:-------------------------------------------------------------------------------- 2024-02-21T22:50:43.530 INFO:teuthology.orchestra.run.smithi116.stdout:Total 12 MB/s | 222 MB 00:17 2024-02-21T22:50:44.786 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction check 2024-02-21T22:50:45.086 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction check succeeded. 2024-02-21T22:50:45.086 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction test 2024-02-21T22:50:47.177 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2024-02-21T22:50:47.184 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction test succeeded. 2024-02-21T22:50:47.185 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction 2024-02-21T22:50:47.306 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : openssl-libs-1:3.0.7-25.el9.x86_64 1/182 2024-02-21T22:50:47.351 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/182 2024-02-21T22:50:47.407 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/182 2024-02-21T22:50:47.431 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/182 2024-02-21T22:50:47.457 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/182 2024-02-21T22:50:47.510 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/182 2024-02-21T22:50:47.844 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/182 2024-02-21T22:50:47.899 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : librados2-2:19.0.0-1643.g3bfc837d.el9.x86_64 8/182 2024-02-21T22:50:48.005 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: librados2-2:19.0.0-1643.g3bfc837d.el9.x86_64 8/182 2024-02-21T22:50:48.034 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libcephfs2-2:19.0.0-1643.g3bfc837d.el9.x86_64 9/182 2024-02-21T22:50:48.125 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: libcephfs2-2:19.0.0-1643.g3bfc837d.el9.x86_64 9/182 2024-02-21T22:50:48.164 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-rados-2:19.0.0-1643.g3bfc837d.el9.x86_64 10/182 2024-02-21T22:50:48.254 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 11/182 2024-02-21T22:50:48.354 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : xfsprogs-6.3.0-1.el9.x86_64 12/182 2024-02-21T22:50:48.528 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : elfutils-libelf-0.190-2.el9.x86_64 13/182 2024-02-21T22:50:48.580 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : postgresql-13.11-1.el9.x86_64 14/182 2024-02-21T22:50:48.607 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libcephsqlite-2:19.0.0-1643.g3bfc837d.el9.x86_64 15/182 2024-02-21T22:50:48.711 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: libcephsqlite-2:19.0.0-1643.g3bfc837d.el9.x86_64 15/182 2024-02-21T22:50:48.733 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libradosstriper1-2:19.0.0-1643.g3bfc837d.el9.x86 16/182 2024-02-21T22:50:48.821 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: libradosstriper1-2:19.0.0-1643.g3bfc837d.el9.x86 16/182 2024-02-21T22:50:48.843 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : qatlib-service-23.11.0-1.el9.x86_64 17/182 2024-02-21T22:50:48.858 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: qatlib-service-23.11.0-1.el9.x86_64 17/182 2024-02-21T22:50:49.009 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: qatlib-23.11.0-1.el9.x86_64 18/182 2024-02-21T22:50:49.039 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : qatlib-23.11.0-1.el9.x86_64 18/182 2024-02-21T22:50:49.237 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 19/182 2024-02-21T22:50:49.377 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : NetworkManager-libnm-1:1.45.91-1.el9.x86_64 20/182 2024-02-21T22:50:49.442 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: NetworkManager-libnm-1:1.45.91-1.el9.x86_64 20/182 2024-02-21T22:50:49.562 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: NetworkManager-1:1.45.91-1.el9.x86_64 21/182 2024-02-21T22:50:49.610 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : NetworkManager-1:1.45.91-1.el9.x86_64 21/182 2024-02-21T22:50:49.838 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: NetworkManager-1:1.45.91-1.el9.x86_64 21/182 2024-02-21T22:50:49.941 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : re2-1:20211101-3.el9.x86_64 22/182 2024-02-21T22:50:50.035 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 23/182 2024-02-21T22:50:50.074 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 24/182 2024-02-21T22:50:50.100 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : liboath-2.6.7-2.el9.x86_64 25/182 2024-02-21T22:50:50.173 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 26/182 2024-02-21T22:50:50.207 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 27/182 2024-02-21T22:50:50.254 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 28/182 2024-02-21T22:50:50.292 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 29/182 2024-02-21T22:50:50.319 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : lua-5.4.4-4.el9.x86_64 30/182 2024-02-21T22:50:50.387 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 31/182 2024-02-21T22:50:50.441 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 32/182 2024-02-21T22:50:50.473 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 33/182 2024-02-21T22:50:50.508 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 34/182 2024-02-21T22:50:50.582 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 35/182 2024-02-21T22:50:50.618 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-ceph-common-2:19.0.0-1643.g3bfc837d.el9. 36/182 2024-02-21T22:50:50.662 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-ceph-argparse-2:19.0.0-1643.g3bfc837d.el 37/182 2024-02-21T22:50:50.690 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-cephfs-2:19.0.0-1643.g3bfc837d.el9.x86_6 38/182 2024-02-21T22:50:50.759 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 39/182 2024-02-21T22:50:50.805 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : luarocks-3.9.2-1.el9.noarch 40/182 2024-02-21T22:50:50.879 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 41/182 2024-02-21T22:50:51.013 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 42/182 2024-02-21T22:50:51.065 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 43/182 2024-02-21T22:50:51.590 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-rsa-4.9-2.el9.noarch 44/182 2024-02-21T22:50:51.661 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 45/182 2024-02-21T22:50:51.689 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 46/182 2024-02-21T22:50:51.719 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : qatzip-libs-1.1.2-2.el9.x86_64 47/182 2024-02-21T22:50:51.759 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : elfutils-libs-0.190-2.el9.x86_64 48/182 2024-02-21T22:50:51.797 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : librados-devel-2:19.0.0-1643.g3bfc837d.el9.x86_6 49/182 2024-02-21T22:50:51.838 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 50/182 2024-02-21T22:50:51.972 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 51/182 2024-02-21T22:50:52.032 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : openssl-1:3.0.7-25.el9.x86_64 52/182 2024-02-21T22:50:52.087 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 53/182 2024-02-21T22:50:52.160 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 54/182 2024-02-21T22:50:52.192 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 55/182 2024-02-21T22:50:52.228 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 56/182 2024-02-21T22:50:52.275 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 57/182 2024-02-21T22:50:52.311 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 58/182 2024-02-21T22:50:52.409 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 59/182 2024-02-21T22:50:52.580 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 60/182 2024-02-21T22:50:52.889 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 61/182 2024-02-21T22:50:53.103 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 62/182 2024-02-21T22:50:53.141 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 63/182 2024-02-21T22:50:53.183 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 64/182 2024-02-21T22:50:53.279 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 65/182 2024-02-21T22:50:53.332 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-google-auth-1:2.27.0-1.el9.noarch 66/182 2024-02-21T22:50:53.382 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 67/182 2024-02-21T22:50:53.408 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 68/182 2024-02-21T22:50:53.422 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 69/182 2024-02-21T22:50:53.505 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 70/182 2024-02-21T22:50:53.630 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 71/182 2024-02-21T22:50:53.670 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 72/182 2024-02-21T22:50:53.700 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 73/182 2024-02-21T22:50:53.729 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 74/182 2024-02-21T22:50:53.772 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : uuid-1.6.2-55.el9.x86_64 75/182 2024-02-21T22:50:53.803 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 76/182 2024-02-21T22:50:53.833 INFO:teuthology.orchestra.run.smithi116.stdout: Preparing : 1/1 2024-02-21T22:50:53.833 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 77/182 2024-02-21T22:50:53.868 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 78/182 2024-02-21T22:50:53.901 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 79/182 2024-02-21T22:50:53.929 INFO:teuthology.orchestra.run.smithi116.stdout: Upgrading : openssl-libs-1:3.0.7-25.el9.x86_64 1/182 2024-02-21T22:50:53.942 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 80/182 2024-02-21T22:50:53.973 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/182 2024-02-21T22:50:53.977 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 81/182 2024-02-21T22:50:54.031 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/182 2024-02-21T22:50:54.064 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 82/182 2024-02-21T22:50:54.071 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/182 2024-02-21T22:50:54.097 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/182 2024-02-21T22:50:54.108 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 83/182 2024-02-21T22:50:54.138 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 84/182 2024-02-21T22:50:54.147 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/182 2024-02-21T22:50:54.177 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 85/182 2024-02-21T22:50:54.275 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-packaging-20.9-5.el9.noarch 86/182 2024-02-21T22:50:54.324 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 87/182 2024-02-21T22:50:54.476 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/182 2024-02-21T22:50:54.523 INFO:teuthology.orchestra.run.smithi116.stdout: Upgrading : librados2-2:19.0.0-1643.g3bfc837d.el9.x86_64 8/182 2024-02-21T22:50:54.645 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: librados2-2:19.0.0-1643.g3bfc837d.el9.x86_64 8/182 2024-02-21T22:50:54.674 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libcephfs2-2:19.0.0-1643.g3bfc837d.el9.x86_64 9/182 2024-02-21T22:50:54.766 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: libcephfs2-2:19.0.0-1643.g3bfc837d.el9.x86_64 9/182 2024-02-21T22:50:54.797 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-rados-2:19.0.0-1643.g3bfc837d.el9.x86_64 10/182 2024-02-21T22:50:54.880 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 11/182 2024-02-21T22:50:54.982 INFO:teuthology.orchestra.run.smithi116.stdout: Upgrading : xfsprogs-6.3.0-1.el9.x86_64 12/182 2024-02-21T22:50:55.051 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 88/182 2024-02-21T22:50:55.095 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 89/182 2024-02-21T22:50:55.129 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 90/182 2024-02-21T22:50:55.155 INFO:teuthology.orchestra.run.smithi116.stdout: Upgrading : elfutils-libelf-0.190-2.el9.x86_64 13/182 2024-02-21T22:50:55.208 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : postgresql-13.11-1.el9.x86_64 14/182 2024-02-21T22:50:55.228 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 91/182 2024-02-21T22:50:55.236 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libcephsqlite-2:19.0.0-1643.g3bfc837d.el9.x86_64 15/182 2024-02-21T22:50:55.278 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 92/182 2024-02-21T22:50:55.340 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: libcephsqlite-2:19.0.0-1643.g3bfc837d.el9.x86_64 15/182 2024-02-21T22:50:55.362 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libradosstriper1-2:19.0.0-1643.g3bfc837d.el9.x86 16/182 2024-02-21T22:50:55.375 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 93/182 2024-02-21T22:50:55.425 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: libradosstriper1-2:19.0.0-1643.g3bfc837d.el9.x86 16/182 2024-02-21T22:50:55.454 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : qatlib-service-23.11.0-1.el9.x86_64 17/182 2024-02-21T22:50:55.457 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 94/182 2024-02-21T22:50:55.471 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: qatlib-service-23.11.0-1.el9.x86_64 17/182 2024-02-21T22:50:55.622 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: qatlib-23.11.0-1.el9.x86_64 18/182 2024-02-21T22:50:55.634 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : openblas-0.3.21-2.el9.x86_64 95/182 2024-02-21T22:50:55.651 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : qatlib-23.11.0-1.el9.x86_64 18/182 2024-02-21T22:50:55.670 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 96/182 2024-02-21T22:50:55.755 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 97/182 2024-02-21T22:50:55.826 INFO:teuthology.orchestra.run.smithi116.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 19/182 2024-02-21T22:50:56.003 INFO:teuthology.orchestra.run.smithi116.stdout: Upgrading : NetworkManager-libnm-1:1.45.91-1.el9.x86_64 20/182 2024-02-21T22:50:56.347 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: NetworkManager-libnm-1:1.45.91-1.el9.x86_64 20/182 2024-02-21T22:50:56.408 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 98/182 2024-02-21T22:50:56.448 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: NetworkManager-1:1.45.91-1.el9.x86_64 21/182 2024-02-21T22:50:56.519 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 99/182 2024-02-21T22:50:56.540 INFO:teuthology.orchestra.run.smithi116.stdout: Upgrading : NetworkManager-1:1.45.91-1.el9.x86_64 21/182 2024-02-21T22:50:56.759 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: NetworkManager-1:1.45.91-1.el9.x86_64 21/182 2024-02-21T22:50:56.872 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : re2-1:20211101-3.el9.x86_64 22/182 2024-02-21T22:50:56.964 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 23/182 2024-02-21T22:50:56.996 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 24/182 2024-02-21T22:50:57.038 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : liboath-2.6.7-2.el9.x86_64 25/182 2024-02-21T22:50:57.111 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 26/182 2024-02-21T22:50:57.145 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 27/182 2024-02-21T22:50:57.196 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 28/182 2024-02-21T22:50:57.229 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 29/182 2024-02-21T22:50:57.257 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : lua-5.4.4-4.el9.x86_64 30/182 2024-02-21T22:50:57.326 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 31/182 2024-02-21T22:50:57.379 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 32/182 2024-02-21T22:50:57.410 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 33/182 2024-02-21T22:50:57.445 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 34/182 2024-02-21T22:50:57.520 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 35/182 2024-02-21T22:50:57.556 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-ceph-common-2:19.0.0-1643.g3bfc837d.el9. 36/182 2024-02-21T22:50:57.591 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-ceph-argparse-2:19.0.0-1643.g3bfc837d.el 37/182 2024-02-21T22:50:57.619 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-cephfs-2:19.0.0-1643.g3bfc837d.el9.x86_6 38/182 2024-02-21T22:50:57.688 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 39/182 2024-02-21T22:50:57.734 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : luarocks-3.9.2-1.el9.noarch 40/182 2024-02-21T22:50:57.777 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 100/182 2024-02-21T22:50:57.808 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 41/182 2024-02-21T22:50:57.859 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 101/182 2024-02-21T22:50:57.879 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 102/182 2024-02-21T22:50:57.903 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libuuid-devel-2.37.4-15.el9.x86_64 103/182 2024-02-21T22:50:57.943 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 42/182 2024-02-21T22:50:57.994 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 43/182 2024-02-21T22:50:58.217 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 104/182 2024-02-21T22:50:58.250 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : librbd1-2:19.0.0-1643.g3bfc837d.el9.x86_64 105/182 2024-02-21T22:50:58.340 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: librbd1-2:19.0.0-1643.g3bfc837d.el9.x86_64 105/182 2024-02-21T22:50:58.371 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-rbd-2:19.0.0-1643.g3bfc837d.el9.x86_64 106/182 2024-02-21T22:50:58.408 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 107/182 2024-02-21T22:50:58.525 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-rsa-4.9-2.el9.noarch 44/182 2024-02-21T22:50:58.626 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 45/182 2024-02-21T22:50:58.653 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 46/182 2024-02-21T22:50:58.683 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : qatzip-libs-1.1.2-2.el9.x86_64 47/182 2024-02-21T22:50:58.723 INFO:teuthology.orchestra.run.smithi116.stdout: Upgrading : elfutils-libs-0.190-2.el9.x86_64 48/182 2024-02-21T22:50:58.761 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : librados-devel-2:19.0.0-1643.g3bfc837d.el9.x86_6 49/182 2024-02-21T22:50:58.802 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 50/182 2024-02-21T22:50:58.859 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 108/182 2024-02-21T22:50:58.886 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : librgw2-2:19.0.0-1643.g3bfc837d.el9.x86_64 109/182 2024-02-21T22:50:58.957 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: librgw2-2:19.0.0-1643.g3bfc837d.el9.x86_64 109/182 2024-02-21T22:50:58.980 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-rgw-2:19.0.0-1643.g3bfc837d.el9.x86_64 110/182 2024-02-21T22:50:59.026 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 51/182 2024-02-21T22:50:59.097 INFO:teuthology.orchestra.run.smithi116.stdout: Upgrading : openssl-1:3.0.7-25.el9.x86_64 52/182 2024-02-21T22:50:59.153 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 53/182 2024-02-21T22:50:59.225 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 54/182 2024-02-21T22:50:59.256 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 55/182 2024-02-21T22:50:59.293 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 56/182 2024-02-21T22:50:59.340 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 57/182 2024-02-21T22:50:59.375 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 58/182 2024-02-21T22:50:59.418 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 59/182 2024-02-21T22:50:59.460 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 60/182 2024-02-21T22:50:59.594 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 61/182 2024-02-21T22:50:59.632 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 62/182 2024-02-21T22:50:59.662 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 63/182 2024-02-21T22:50:59.704 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 64/182 2024-02-21T22:50:59.798 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 65/182 2024-02-21T22:50:59.829 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-google-auth-1:2.27.0-1.el9.noarch 66/182 2024-02-21T22:50:59.870 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 67/182 2024-02-21T22:50:59.903 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 68/182 2024-02-21T22:50:59.927 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 69/182 2024-02-21T22:51:00.005 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 70/182 2024-02-21T22:51:00.153 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 71/182 2024-02-21T22:51:00.193 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 72/182 2024-02-21T22:51:00.221 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 73/182 2024-02-21T22:51:00.261 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 74/182 2024-02-21T22:51:00.302 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : uuid-1.6.2-55.el9.x86_64 75/182 2024-02-21T22:51:00.334 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 76/182 2024-02-21T22:51:00.364 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 77/182 2024-02-21T22:51:00.398 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 78/182 2024-02-21T22:51:00.432 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 79/182 2024-02-21T22:51:00.473 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 80/182 2024-02-21T22:51:00.499 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 81/182 2024-02-21T22:51:00.586 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 82/182 2024-02-21T22:51:00.629 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 83/182 2024-02-21T22:51:00.661 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 84/182 2024-02-21T22:51:00.708 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 85/182 2024-02-21T22:51:00.807 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-packaging-20.9-5.el9.noarch 86/182 2024-02-21T22:51:00.854 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 87/182 2024-02-21T22:51:01.240 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-common-2:19.0.0-1643.g3bfc837d.el9.x86_64 111/182 2024-02-21T22:51:01.284 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-common-2:19.0.0-1643.g3bfc837d.el9.x86_64 111/182 2024-02-21T22:51:01.594 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 88/182 2024-02-21T22:51:01.643 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 89/182 2024-02-21T22:51:01.676 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 90/182 2024-02-21T22:51:01.774 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 91/182 2024-02-21T22:51:01.826 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 92/182 2024-02-21T22:51:01.834 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-common-2:19.0.0-1643.g3bfc837d.el9.x86_64 111/182 2024-02-21T22:51:01.871 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-base-2:19.0.0-1643.g3bfc837d.el9.x86_64 112/182 2024-02-21T22:51:01.913 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 93/182 2024-02-21T22:51:01.958 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-base-2:19.0.0-1643.g3bfc837d.el9.x86_64 112/182 2024-02-21T22:51:01.958 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-02-21T22:51:01.959 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-02-21T22:51:01.959 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-21T22:51:01.979 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 94/182 2024-02-21T22:51:02.005 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-selinux-2:19.0.0-1643.g3bfc837d.el9.x86_64 113/182 2024-02-21T22:51:02.157 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : openblas-0.3.21-2.el9.x86_64 95/182 2024-02-21T22:51:02.185 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 96/182 2024-02-21T22:51:02.267 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 97/182 2024-02-21T22:51:02.923 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 98/182 2024-02-21T22:51:03.044 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 99/182 2024-02-21T22:51:04.316 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 100/182 2024-02-21T22:51:04.397 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 101/182 2024-02-21T22:51:04.425 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 102/182 2024-02-21T22:51:04.458 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libuuid-devel-2.37.4-15.el9.x86_64 103/182 2024-02-21T22:51:04.771 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 104/182 2024-02-21T22:51:04.796 INFO:teuthology.orchestra.run.smithi116.stdout: Upgrading : librbd1-2:19.0.0-1643.g3bfc837d.el9.x86_64 105/182 2024-02-21T22:51:04.886 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: librbd1-2:19.0.0-1643.g3bfc837d.el9.x86_64 105/182 2024-02-21T22:51:04.917 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-rbd-2:19.0.0-1643.g3bfc837d.el9.x86_64 106/182 2024-02-21T22:51:04.962 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 107/182 2024-02-21T22:51:05.418 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 108/182 2024-02-21T22:51:05.457 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : librgw2-2:19.0.0-1643.g3bfc837d.el9.x86_64 109/182 2024-02-21T22:51:05.536 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: librgw2-2:19.0.0-1643.g3bfc837d.el9.x86_64 109/182 2024-02-21T22:51:05.567 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-rgw-2:19.0.0-1643.g3bfc837d.el9.x86_64 110/182 2024-02-21T22:51:07.785 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-common-2:19.0.0-1643.g3bfc837d.el9.x86_64 111/182 2024-02-21T22:51:07.822 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-common-2:19.0.0-1643.g3bfc837d.el9.x86_64 111/182 2024-02-21T22:51:08.369 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-common-2:19.0.0-1643.g3bfc837d.el9.x86_64 111/182 2024-02-21T22:51:08.408 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-base-2:19.0.0-1643.g3bfc837d.el9.x86_64 112/182 2024-02-21T22:51:08.503 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-base-2:19.0.0-1643.g3bfc837d.el9.x86_64 112/182 2024-02-21T22:51:08.503 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-02-21T22:51:08.503 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-02-21T22:51:08.503 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-02-21T22:51:08.543 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-selinux-2:19.0.0-1643.g3bfc837d.el9.x86_64 113/182 2024-02-21T22:51:13.512 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-selinux-2:19.0.0-1643.g3bfc837d.el9.x86_64 113/182 2024-02-21T22:51:13.513 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /sys 2024-02-21T22:51:13.513 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /proc 2024-02-21T22:51:13.513 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /mnt 2024-02-21T22:51:13.513 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /var/tmp 2024-02-21T22:51:13.513 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /home 2024-02-21T22:51:13.513 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /root 2024-02-21T22:51:13.513 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /tmp 2024-02-21T22:51:13.513 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-21T22:51:13.675 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-volume-2:19.0.0-1643.g3bfc837d.el9.noarch 114/182 2024-02-21T22:51:13.689 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-volume-2:19.0.0-1643.g3bfc837d.el9.noarch 114/182 2024-02-21T22:51:13.690 INFO:teuthology.orchestra.run.smithi142.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-21T22:51:13.690 INFO:teuthology.orchestra.run.smithi142.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-02-21T22:51:13.690 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-21T22:51:15.169 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-osd-2:19.0.0-1643.g3bfc837d.el9.x86_64 115/182 2024-02-21T22:51:15.195 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-osd-2:19.0.0-1643.g3bfc837d.el9.x86_64 115/182 2024-02-21T22:51:15.195 INFO:teuthology.orchestra.run.smithi142.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-21T22:51:15.195 INFO:teuthology.orchestra.run.smithi142.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-02-21T22:51:15.195 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-02-21T22:51:15.195 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-02-21T22:51:15.195 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-21T22:51:15.420 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mds-2:19.0.0-1643.g3bfc837d.el9.x86_64 116/182 2024-02-21T22:51:15.442 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mds-2:19.0.0-1643.g3bfc837d.el9.x86_64 116/182 2024-02-21T22:51:15.442 INFO:teuthology.orchestra.run.smithi142.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-21T22:51:15.442 INFO:teuthology.orchestra.run.smithi142.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-02-21T22:51:15.442 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-02-21T22:51:15.442 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-02-21T22:51:15.442 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-21T22:51:15.887 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mon-2:19.0.0-1643.g3bfc837d.el9.x86_64 117/182 2024-02-21T22:51:15.910 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mon-2:19.0.0-1643.g3bfc837d.el9.x86_64 117/182 2024-02-21T22:51:15.910 INFO:teuthology.orchestra.run.smithi142.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-21T22:51:15.910 INFO:teuthology.orchestra.run.smithi142.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-02-21T22:51:15.910 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-02-21T22:51:15.910 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-02-21T22:51:15.910 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-21T22:51:16.009 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : automake-1.16.2-8.el9.noarch 118/182 2024-02-21T22:51:16.058 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-ply-3.11-14.el9.noarch 119/182 2024-02-21T22:51:16.114 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 120/182 2024-02-21T22:51:16.297 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 121/182 2024-02-21T22:51:16.346 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 122/182 2024-02-21T22:51:16.417 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 123/182 2024-02-21T22:51:16.529 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 124/182 2024-02-21T22:51:16.669 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 125/182 2024-02-21T22:51:16.704 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-asyncssh-2.13.2-4.el9.noarch 126/182 2024-02-21T22:51:16.746 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 127/182 2024-02-21T22:51:16.778 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 128/182 2024-02-21T22:51:16.813 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : jq-1.6-16.el9.x86_64 129/182 2024-02-21T22:51:16.840 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : fuse-2.9.9-15.el9.x86_64 130/182 2024-02-21T22:51:17.250 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: cephadm-2:19.0.0-1643.g3bfc837d.el9.noarch 131/182 2024-02-21T22:51:17.281 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : cephadm-2:19.0.0-1643.g3bfc837d.el9.noarch 131/182 2024-02-21T22:51:17.312 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-1643.g3bfc837d.e 132/182 2024-02-21T22:51:17.372 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-1643.g3bfc837d. 133/182 2024-02-21T22:51:17.396 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-1643.g3bfc837d.el9.noa 134/182 2024-02-21T22:51:17.622 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-1643.g3bfc837d.el9.noa 134/182 2024-02-21T22:51:17.654 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-1643.g3bfc837d.el9.n 135/182 2024-02-21T22:51:18.621 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-1643.g3bfc837d.el9.n 135/182 2024-02-21T22:51:18.647 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-1643.g3bf 136/182 2024-02-21T22:51:18.746 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-1643.g3bf 136/182 2024-02-21T22:51:18.911 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-1643.g3bfc837d.el 137/182 2024-02-21T22:51:18.932 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mgr-2:19.0.0-1643.g3bfc837d.el9.x86_64 138/182 2024-02-21T22:51:18.954 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mgr-2:19.0.0-1643.g3bfc837d.el9.x86_64 138/182 2024-02-21T22:51:18.954 INFO:teuthology.orchestra.run.smithi142.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-21T22:51:18.954 INFO:teuthology.orchestra.run.smithi142.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-02-21T22:51:18.955 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-02-21T22:51:18.955 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-02-21T22:51:18.955 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-21T22:51:18.999 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mgr-rook-2:19.0.0-1643.g3bfc837d.el9.noarch 139/182 2024-02-21T22:51:19.010 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-1643.g3bfc837d.el9.noarch 139/182 2024-02-21T22:51:19.109 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-2:19.0.0-1643.g3bfc837d.el9.x86_64 140/182 2024-02-21T22:51:20.051 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-selinux-2:19.0.0-1643.g3bfc837d.el9.x86_64 113/182 2024-02-21T22:51:20.052 INFO:teuthology.orchestra.run.smithi116.stdout:skipping the directory /sys 2024-02-21T22:51:20.052 INFO:teuthology.orchestra.run.smithi116.stdout:skipping the directory /proc 2024-02-21T22:51:20.052 INFO:teuthology.orchestra.run.smithi116.stdout:skipping the directory /mnt 2024-02-21T22:51:20.052 INFO:teuthology.orchestra.run.smithi116.stdout:skipping the directory /var/tmp 2024-02-21T22:51:20.052 INFO:teuthology.orchestra.run.smithi116.stdout:skipping the directory /home 2024-02-21T22:51:20.052 INFO:teuthology.orchestra.run.smithi116.stdout:skipping the directory /root 2024-02-21T22:51:20.052 INFO:teuthology.orchestra.run.smithi116.stdout:skipping the directory /tmp 2024-02-21T22:51:20.052 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-02-21T22:51:20.228 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-volume-2:19.0.0-1643.g3bfc837d.el9.noarch 114/182 2024-02-21T22:51:20.243 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-volume-2:19.0.0-1643.g3bfc837d.el9.noarch 114/182 2024-02-21T22:51:20.244 INFO:teuthology.orchestra.run.smithi116.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-21T22:51:20.244 INFO:teuthology.orchestra.run.smithi116.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-02-21T22:51:20.244 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-02-21T22:51:21.749 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-osd-2:19.0.0-1643.g3bfc837d.el9.x86_64 115/182 2024-02-21T22:51:21.774 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-osd-2:19.0.0-1643.g3bfc837d.el9.x86_64 115/182 2024-02-21T22:51:21.774 INFO:teuthology.orchestra.run.smithi116.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-21T22:51:21.774 INFO:teuthology.orchestra.run.smithi116.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-02-21T22:51:21.774 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-02-21T22:51:21.775 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-02-21T22:51:21.775 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-02-21T22:51:21.999 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-mds-2:19.0.0-1643.g3bfc837d.el9.x86_64 116/182 2024-02-21T22:51:22.022 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-mds-2:19.0.0-1643.g3bfc837d.el9.x86_64 116/182 2024-02-21T22:51:22.022 INFO:teuthology.orchestra.run.smithi116.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-21T22:51:22.022 INFO:teuthology.orchestra.run.smithi116.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-02-21T22:51:22.022 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-02-21T22:51:22.022 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-02-21T22:51:22.022 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-02-21T22:51:22.467 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-mon-2:19.0.0-1643.g3bfc837d.el9.x86_64 117/182 2024-02-21T22:51:22.489 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-mon-2:19.0.0-1643.g3bfc837d.el9.x86_64 117/182 2024-02-21T22:51:22.489 INFO:teuthology.orchestra.run.smithi116.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-21T22:51:22.490 INFO:teuthology.orchestra.run.smithi116.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-02-21T22:51:22.490 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-02-21T22:51:22.490 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-02-21T22:51:22.490 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-02-21T22:51:22.597 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : automake-1.16.2-8.el9.noarch 118/182 2024-02-21T22:51:22.654 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-ply-3.11-14.el9.noarch 119/182 2024-02-21T22:51:22.710 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 120/182 2024-02-21T22:51:22.895 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 121/182 2024-02-21T22:51:22.942 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 122/182 2024-02-21T22:51:23.011 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 123/182 2024-02-21T22:51:23.108 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 124/182 2024-02-21T22:51:23.248 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 125/182 2024-02-21T22:51:23.284 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-asyncssh-2.13.2-4.el9.noarch 126/182 2024-02-21T22:51:23.316 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 127/182 2024-02-21T22:51:23.349 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 128/182 2024-02-21T22:51:23.392 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : jq-1.6-16.el9.x86_64 129/182 2024-02-21T22:51:23.420 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : fuse-2.9.9-15.el9.x86_64 130/182 2024-02-21T22:51:23.536 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-fuse-2:19.0.0-1643.g3bfc837d.el9.x86_64 141/182 2024-02-21T22:51:23.611 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-test-2:19.0.0-1643.g3bfc837d.el9.x86_64 142/182 2024-02-21T22:51:23.869 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: cephadm-2:19.0.0-1643.g3bfc837d.el9.noarch 131/182 2024-02-21T22:51:23.902 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : cephadm-2:19.0.0-1643.g3bfc837d.el9.noarch 131/182 2024-02-21T22:51:23.924 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-1643.g3bfc837d.e 132/182 2024-02-21T22:51:23.976 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-1643.g3bfc837d. 133/182 2024-02-21T22:51:24.000 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-1643.g3bfc837d.el9.noa 134/182 2024-02-21T22:51:24.229 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-1643.g3bfc837d.el9.noa 134/182 2024-02-21T22:51:24.259 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-1643.g3bfc837d.el9.n 135/182 2024-02-21T22:51:24.471 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libtool-2.4.6-45.el9.x86_64 143/182 2024-02-21T22:51:24.497 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-radosgw-2:19.0.0-1643.g3bfc837d.el9.x86_64 144/182 2024-02-21T22:51:24.520 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-1643.g3bfc837d.el9.x86_64 144/182 2024-02-21T22:51:24.520 INFO:teuthology.orchestra.run.smithi142.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-21T22:51:24.520 INFO:teuthology.orchestra.run.smithi142.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-02-21T22:51:24.520 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-02-21T22:51:24.520 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-02-21T22:51:24.521 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-21T22:51:24.564 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-1643.g3bfc8 145/182 2024-02-21T22:51:24.586 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-1643.g3bfc8 145/182 2024-02-21T22:51:24.586 INFO:teuthology.orchestra.run.smithi142.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-21T22:51:24.586 INFO:teuthology.orchestra.run.smithi142.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-02-21T22:51:24.586 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-21T22:51:24.632 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : cephfs-mirror-2:19.0.0-1643.g3bfc837d.el9.x86_64 146/182 2024-02-21T22:51:24.654 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-1643.g3bfc837d.el9.x86_64 146/182 2024-02-21T22:51:24.654 INFO:teuthology.orchestra.run.smithi142.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-21T22:51:24.654 INFO:teuthology.orchestra.run.smithi142.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-02-21T22:51:24.654 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-02-21T22:51:24.654 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-02-21T22:51:24.654 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-21T22:51:24.957 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : rbd-mirror-2:19.0.0-1643.g3bfc837d.el9.x86_64 147/182 2024-02-21T22:51:24.979 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: rbd-mirror-2:19.0.0-1643.g3bfc837d.el9.x86_64 147/182 2024-02-21T22:51:24.979 INFO:teuthology.orchestra.run.smithi142.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-21T22:51:24.980 INFO:teuthology.orchestra.run.smithi142.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-02-21T22:51:24.980 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-02-21T22:51:24.980 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-02-21T22:51:24.980 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-21T22:51:25.040 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : rbd-fuse-2:19.0.0-1643.g3bfc837d.el9.x86_64 148/182 2024-02-21T22:51:25.081 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : rbd-nbd-2:19.0.0-1643.g3bfc837d.el9.x86_64 149/182 2024-02-21T22:51:25.113 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 150/182 2024-02-21T22:51:25.140 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 151/182 2024-02-21T22:51:25.223 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-1643.g3bfc837d.el9.n 135/182 2024-02-21T22:51:25.259 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-1643.g3bf 136/182 2024-02-21T22:51:25.325 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : cephfs-shell-2:19.0.0-1643.g3bfc837d.el9.x86_64 152/182 2024-02-21T22:51:25.360 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-1643.g3bf 136/182 2024-02-21T22:51:25.362 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 153/182 2024-02-21T22:51:25.395 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libcephfs-devel-2:19.0.0-1643.g3bfc837d.el9.x86_ 154/182 2024-02-21T22:51:25.418 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el9.x86_64 155/182 2024-02-21T22:51:25.448 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : NetworkManager-team-1:1.45.91-1.el9.x86_64 156/182 2024-02-21T22:51:25.515 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : NetworkManager-tui-1:1.45.91-1.el9.x86_64 157/182 2024-02-21T22:51:25.521 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-1643.g3bfc837d.el 137/182 2024-02-21T22:51:25.553 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-mgr-2:19.0.0-1643.g3bfc837d.el9.x86_64 138/182 2024-02-21T22:51:25.577 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-mgr-2:19.0.0-1643.g3bfc837d.el9.x86_64 138/182 2024-02-21T22:51:25.577 INFO:teuthology.orchestra.run.smithi116.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-21T22:51:25.577 INFO:teuthology.orchestra.run.smithi116.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-02-21T22:51:25.577 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-02-21T22:51:25.577 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-02-21T22:51:25.577 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-02-21T22:51:25.580 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 158/182 2024-02-21T22:51:25.605 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 159/182 2024-02-21T22:51:25.620 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-mgr-rook-2:19.0.0-1643.g3bfc837d.el9.noarch 139/182 2024-02-21T22:51:25.632 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-1643.g3bfc837d.el9.noarch 139/182 2024-02-21T22:51:25.737 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-2:19.0.0-1643.g3bfc837d.el9.x86_64 140/182 2024-02-21T22:51:26.176 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 160/182 2024-02-21T22:51:26.219 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 160/182 2024-02-21T22:51:26.260 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 160/182 2024-02-21T22:51:26.317 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 161/182 2024-02-21T22:51:27.132 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : cephfs-top-2:19.0.0-1643.g3bfc837d.el9.noarch 162/182 2024-02-21T22:51:27.232 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : openssl-devel-1:3.0.7-25.el9.x86_64 163/182 2024-02-21T22:51:27.320 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : flex-2.6.4-9.el9.x86_64 164/182 2024-02-21T22:51:27.352 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : bison-3.7.4-5.el9.x86_64 165/182 2024-02-21T22:51:27.377 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 166/182 2024-02-21T22:51:27.402 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 167/182 2024-02-21T22:51:27.427 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 168/182 2024-02-21T22:51:27.455 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 169/182 2024-02-21T22:51:27.455 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 170/182 2024-02-21T22:51:27.541 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 170/182 2024-02-21T22:51:27.581 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 171/182 2024-02-21T22:51:27.613 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 172/182 2024-02-21T22:51:27.639 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 173/182 2024-02-21T22:51:27.673 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 174/182 2024-02-21T22:51:27.673 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 175/182 2024-02-21T22:51:27.749 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 175/182 2024-02-21T22:51:27.774 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 176/182 2024-02-21T22:51:27.780 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 177/182 2024-02-21T22:51:27.780 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 177/182 2024-02-21T22:51:27.959 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 177/182 2024-02-21T22:51:27.959 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 178/182 2024-02-21T22:51:28.043 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 178/182 2024-02-21T22:51:28.067 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 179/182 2024-02-21T22:51:28.095 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 180/182 2024-02-21T22:51:28.127 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : xfsprogs-5.19.0-4.el9.x86_64 181/182 2024-02-21T22:51:28.184 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 182/182 2024-02-21T22:51:30.137 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-fuse-2:19.0.0-1643.g3bfc837d.el9.x86_64 141/182 2024-02-21T22:51:30.200 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-test-2:19.0.0-1643.g3bfc837d.el9.x86_64 142/182 2024-02-21T22:51:31.047 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libtool-2.4.6-45.el9.x86_64 143/182 2024-02-21T22:51:31.077 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-radosgw-2:19.0.0-1643.g3bfc837d.el9.x86_64 144/182 2024-02-21T22:51:31.100 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-1643.g3bfc837d.el9.x86_64 144/182 2024-02-21T22:51:31.100 INFO:teuthology.orchestra.run.smithi116.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-21T22:51:31.100 INFO:teuthology.orchestra.run.smithi116.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-02-21T22:51:31.100 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-02-21T22:51:31.100 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-02-21T22:51:31.100 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-02-21T22:51:31.144 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-1643.g3bfc8 145/182 2024-02-21T22:51:31.166 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-1643.g3bfc8 145/182 2024-02-21T22:51:31.166 INFO:teuthology.orchestra.run.smithi116.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-21T22:51:31.167 INFO:teuthology.orchestra.run.smithi116.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-02-21T22:51:31.167 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-02-21T22:51:31.211 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : cephfs-mirror-2:19.0.0-1643.g3bfc837d.el9.x86_64 146/182 2024-02-21T22:51:31.234 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-1643.g3bfc837d.el9.x86_64 146/182 2024-02-21T22:51:31.234 INFO:teuthology.orchestra.run.smithi116.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-21T22:51:31.234 INFO:teuthology.orchestra.run.smithi116.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-02-21T22:51:31.234 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-02-21T22:51:31.234 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-02-21T22:51:31.234 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-02-21T22:51:31.539 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : rbd-mirror-2:19.0.0-1643.g3bfc837d.el9.x86_64 147/182 2024-02-21T22:51:31.560 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: rbd-mirror-2:19.0.0-1643.g3bfc837d.el9.x86_64 147/182 2024-02-21T22:51:31.560 INFO:teuthology.orchestra.run.smithi116.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-21T22:51:31.560 INFO:teuthology.orchestra.run.smithi116.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-02-21T22:51:31.560 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-02-21T22:51:31.560 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-02-21T22:51:31.560 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-02-21T22:51:31.611 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : rbd-fuse-2:19.0.0-1643.g3bfc837d.el9.x86_64 148/182 2024-02-21T22:51:31.652 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : rbd-nbd-2:19.0.0-1643.g3bfc837d.el9.x86_64 149/182 2024-02-21T22:51:31.685 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 150/182 2024-02-21T22:51:31.703 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 151/182 2024-02-21T22:51:31.884 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : cephfs-shell-2:19.0.0-1643.g3bfc837d.el9.x86_64 152/182 2024-02-21T22:51:31.925 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 153/182 2024-02-21T22:51:31.958 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libcephfs-devel-2:19.0.0-1643.g3bfc837d.el9.x86_ 154/182 2024-02-21T22:51:31.998 INFO:teuthology.orchestra.run.smithi116.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el9.x86_64 155/182 2024-02-21T22:51:32.028 INFO:teuthology.orchestra.run.smithi116.stdout: Upgrading : NetworkManager-team-1:1.45.91-1.el9.x86_64 156/182 2024-02-21T22:51:32.085 INFO:teuthology.orchestra.run.smithi116.stdout: Upgrading : NetworkManager-tui-1:1.45.91-1.el9.x86_64 157/182 2024-02-21T22:51:32.160 INFO:teuthology.orchestra.run.smithi116.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 158/182 2024-02-21T22:51:32.201 INFO:teuthology.orchestra.run.smithi116.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 159/182 2024-02-21T22:51:32.762 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 160/182 2024-02-21T22:51:32.799 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 160/182 2024-02-21T22:51:32.832 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 160/182 2024-02-21T22:51:32.888 INFO:teuthology.orchestra.run.smithi116.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 161/182 2024-02-21T22:51:33.401 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: elfutils-libelf-0.189-3.el9.x86_64 182/182 2024-02-21T22:51:33.401 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-2:19.0.0-1643.g3bfc837d.el9.x86_64 1/182 2024-02-21T22:51:33.401 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-base-2:19.0.0-1643.g3bfc837d.el9.x86_64 2/182 2024-02-21T22:51:33.401 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-common-2:19.0.0-1643.g3bfc837d.el9.x86_64 3/182 2024-02-21T22:51:33.401 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-fuse-2:19.0.0-1643.g3bfc837d.el9.x86_64 4/182 2024-02-21T22:51:33.401 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-1643.g3bfc8 5/182 2024-02-21T22:51:33.401 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mds-2:19.0.0-1643.g3bfc837d.el9.x86_64 6/182 2024-02-21T22:51:33.401 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mgr-2:19.0.0-1643.g3bfc837d.el9.x86_64 7/182 2024-02-21T22:51:33.401 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mon-2:19.0.0-1643.g3bfc837d.el9.x86_64 8/182 2024-02-21T22:51:33.401 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-osd-2:19.0.0-1643.g3bfc837d.el9.x86_64 9/182 2024-02-21T22:51:33.401 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-radosgw-2:19.0.0-1643.g3bfc837d.el9.x86_64 10/182 2024-02-21T22:51:33.401 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-selinux-2:19.0.0-1643.g3bfc837d.el9.x86_64 11/182 2024-02-21T22:51:33.402 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-test-2:19.0.0-1643.g3bfc837d.el9.x86_64 12/182 2024-02-21T22:51:33.402 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : cephfs-mirror-2:19.0.0-1643.g3bfc837d.el9.x86_64 13/182 2024-02-21T22:51:33.402 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : cephfs-shell-2:19.0.0-1643.g3bfc837d.el9.x86_64 14/182 2024-02-21T22:51:33.402 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libcephfs-devel-2:19.0.0-1643.g3bfc837d.el9.x86_ 15/182 2024-02-21T22:51:33.402 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libcephfs2-2:19.0.0-1643.g3bfc837d.el9.x86_64 16/182 2024-02-21T22:51:33.402 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libcephsqlite-2:19.0.0-1643.g3bfc837d.el9.x86_64 17/182 2024-02-21T22:51:33.402 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librados-devel-2:19.0.0-1643.g3bfc837d.el9.x86_6 18/182 2024-02-21T22:51:33.402 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libradosstriper1-2:19.0.0-1643.g3bfc837d.el9.x86 19/182 2024-02-21T22:51:33.402 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librgw2-2:19.0.0-1643.g3bfc837d.el9.x86_64 20/182 2024-02-21T22:51:33.402 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-ceph-argparse-2:19.0.0-1643.g3bfc837d.el 21/182 2024-02-21T22:51:33.402 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-ceph-common-2:19.0.0-1643.g3bfc837d.el9. 22/182 2024-02-21T22:51:33.402 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-cephfs-2:19.0.0-1643.g3bfc837d.el9.x86_6 23/182 2024-02-21T22:51:33.402 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-rados-2:19.0.0-1643.g3bfc837d.el9.x86_64 24/182 2024-02-21T22:51:33.403 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-rbd-2:19.0.0-1643.g3bfc837d.el9.x86_64 25/182 2024-02-21T22:51:33.403 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-rgw-2:19.0.0-1643.g3bfc837d.el9.x86_64 26/182 2024-02-21T22:51:33.403 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : rbd-fuse-2:19.0.0-1643.g3bfc837d.el9.x86_64 27/182 2024-02-21T22:51:33.403 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : rbd-mirror-2:19.0.0-1643.g3bfc837d.el9.x86_64 28/182 2024-02-21T22:51:33.403 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : rbd-nbd-2:19.0.0-1643.g3bfc837d.el9.x86_64 29/182 2024-02-21T22:51:33.403 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-1643.g3bfc837d. 30/182 2024-02-21T22:51:33.403 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-1643.g3bfc837d.el9.noa 31/182 2024-02-21T22:51:33.403 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-1643.g3bfc837d.el9.n 32/182 2024-02-21T22:51:33.403 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-1643.g3bf 33/182 2024-02-21T22:51:33.403 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-1643.g3bfc837d.el 34/182 2024-02-21T22:51:33.403 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mgr-rook-2:19.0.0-1643.g3bfc837d.el9.noarch 35/182 2024-02-21T22:51:33.403 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-1643.g3bfc837d.e 36/182 2024-02-21T22:51:33.403 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-volume-2:19.0.0-1643.g3bfc837d.el9.noarch 37/182 2024-02-21T22:51:33.403 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : cephadm-2:19.0.0-1643.g3bfc837d.el9.noarch 38/182 2024-02-21T22:51:33.403 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : cephfs-top-2:19.0.0-1643.g3bfc837d.el9.noarch 39/182 2024-02-21T22:51:33.404 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 40/182 2024-02-21T22:51:33.404 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 41/182 2024-02-21T22:51:33.404 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : jq-1.6-16.el9.x86_64 42/182 2024-02-21T22:51:33.404 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 43/182 2024-02-21T22:51:33.404 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 44/182 2024-02-21T22:51:33.404 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 45/182 2024-02-21T22:51:33.404 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 46/182 2024-02-21T22:51:33.404 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 47/182 2024-02-21T22:51:33.404 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-ply-3.11-14.el9.noarch 48/182 2024-02-21T22:51:33.404 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 49/182 2024-02-21T22:51:33.404 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 50/182 2024-02-21T22:51:33.404 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 51/182 2024-02-21T22:51:33.404 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : automake-1.16.2-8.el9.noarch 52/182 2024-02-21T22:51:33.404 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : bison-3.7.4-5.el9.x86_64 53/182 2024-02-21T22:51:33.405 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 54/182 2024-02-21T22:51:33.405 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 55/182 2024-02-21T22:51:33.405 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : flex-2.6.4-9.el9.x86_64 56/182 2024-02-21T22:51:33.405 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 57/182 2024-02-21T22:51:33.405 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 58/182 2024-02-21T22:51:33.405 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 59/182 2024-02-21T22:51:33.405 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 60/182 2024-02-21T22:51:33.405 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 61/182 2024-02-21T22:51:33.405 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 62/182 2024-02-21T22:51:33.405 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 63/182 2024-02-21T22:51:33.405 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libuuid-devel-2.37.4-15.el9.x86_64 64/182 2024-02-21T22:51:33.405 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 65/182 2024-02-21T22:51:33.405 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 66/182 2024-02-21T22:51:33.405 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : lua-5.4.4-4.el9.x86_64 67/182 2024-02-21T22:51:33.405 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 68/182 2024-02-21T22:51:33.406 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 69/182 2024-02-21T22:51:33.406 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : openssl-devel-1:3.0.7-25.el9.x86_64 70/182 2024-02-21T22:51:33.406 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : postgresql-13.11-1.el9.x86_64 71/182 2024-02-21T22:51:33.406 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 72/182 2024-02-21T22:51:33.406 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 73/182 2024-02-21T22:51:33.406 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 74/182 2024-02-21T22:51:33.406 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 75/182 2024-02-21T22:51:33.406 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 76/182 2024-02-21T22:51:33.406 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 77/182 2024-02-21T22:51:33.406 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 78/182 2024-02-21T22:51:33.406 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 79/182 2024-02-21T22:51:33.406 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/182 2024-02-21T22:51:33.406 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/182 2024-02-21T22:51:33.406 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/182 2024-02-21T22:51:33.407 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/182 2024-02-21T22:51:33.407 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/182 2024-02-21T22:51:33.407 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/182 2024-02-21T22:51:33.407 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/182 2024-02-21T22:51:33.407 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/182 2024-02-21T22:51:33.407 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/182 2024-02-21T22:51:33.407 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/182 2024-02-21T22:51:33.407 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/182 2024-02-21T22:51:33.407 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/182 2024-02-21T22:51:33.407 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/182 2024-02-21T22:51:33.407 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/182 2024-02-21T22:51:33.407 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/182 2024-02-21T22:51:33.407 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/182 2024-02-21T22:51:33.407 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/182 2024-02-21T22:51:33.407 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : qatlib-23.11.0-1.el9.x86_64 97/182 2024-02-21T22:51:33.408 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : qatlib-service-23.11.0-1.el9.x86_64 98/182 2024-02-21T22:51:33.408 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : qatzip-libs-1.1.2-2.el9.x86_64 99/182 2024-02-21T22:51:33.408 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 100/182 2024-02-21T22:51:33.408 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/182 2024-02-21T22:51:33.408 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 102/182 2024-02-21T22:51:33.408 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/182 2024-02-21T22:51:33.408 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 104/182 2024-02-21T22:51:33.408 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/182 2024-02-21T22:51:33.408 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/182 2024-02-21T22:51:33.408 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/182 2024-02-21T22:51:33.408 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 108/182 2024-02-21T22:51:33.408 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/182 2024-02-21T22:51:33.408 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 110/182 2024-02-21T22:51:33.409 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 111/182 2024-02-21T22:51:33.409 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/182 2024-02-21T22:51:33.409 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/182 2024-02-21T22:51:33.409 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 114/182 2024-02-21T22:51:33.409 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 115/182 2024-02-21T22:51:33.409 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-asyncssh-2.13.2-4.el9.noarch 116/182 2024-02-21T22:51:33.409 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/182 2024-02-21T22:51:33.409 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/182 2024-02-21T22:51:33.409 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 119/182 2024-02-21T22:51:33.409 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/182 2024-02-21T22:51:33.409 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/182 2024-02-21T22:51:33.409 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/182 2024-02-21T22:51:33.409 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 123/182 2024-02-21T22:51:33.409 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-google-auth-1:2.27.0-1.el9.noarch 124/182 2024-02-21T22:51:33.410 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 125/182 2024-02-21T22:51:33.410 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 126/182 2024-02-21T22:51:33.410 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 127/182 2024-02-21T22:51:33.410 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 128/182 2024-02-21T22:51:33.410 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 129/182 2024-02-21T22:51:33.410 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 130/182 2024-02-21T22:51:33.410 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 131/182 2024-02-21T22:51:33.410 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 132/182 2024-02-21T22:51:33.410 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 133/182 2024-02-21T22:51:33.410 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 134/182 2024-02-21T22:51:33.410 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 135/182 2024-02-21T22:51:33.410 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 136/182 2024-02-21T22:51:33.410 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 137/182 2024-02-21T22:51:33.410 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 138/182 2024-02-21T22:51:33.411 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 139/182 2024-02-21T22:51:33.411 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 140/182 2024-02-21T22:51:33.411 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 141/182 2024-02-21T22:51:33.411 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 142/182 2024-02-21T22:51:33.411 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 143/182 2024-02-21T22:51:33.411 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 144/182 2024-02-21T22:51:33.411 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 145/182 2024-02-21T22:51:33.411 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 146/182 2024-02-21T22:51:33.411 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 147/182 2024-02-21T22:51:33.411 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 148/182 2024-02-21T22:51:33.411 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : re2-1:20211101-3.el9.x86_64 149/182 2024-02-21T22:51:33.411 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 150/182 2024-02-21T22:51:33.411 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librados2-2:19.0.0-1643.g3bfc837d.el9.x86_64 151/182 2024-02-21T22:51:33.411 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 152/182 2024-02-21T22:51:33.411 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librbd1-2:19.0.0-1643.g3bfc837d.el9.x86_64 153/182 2024-02-21T22:51:33.412 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 154/182 2024-02-21T22:51:33.412 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : NetworkManager-1:1.45.91-1.el9.x86_64 155/182 2024-02-21T22:51:33.412 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 156/182 2024-02-21T22:51:33.412 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : NetworkManager-libnm-1:1.45.91-1.el9.x86_64 157/182 2024-02-21T22:51:33.412 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 158/182 2024-02-21T22:51:33.412 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : NetworkManager-team-1:1.45.91-1.el9.x86_64 159/182 2024-02-21T22:51:33.412 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 160/182 2024-02-21T22:51:33.412 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : NetworkManager-tui-1:1.45.91-1.el9.x86_64 161/182 2024-02-21T22:51:33.412 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 162/182 2024-02-21T22:51:33.412 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : acl-2.3.1-4.el9.x86_64 163/182 2024-02-21T22:51:33.412 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : acl-2.3.1-3.el9.x86_64 164/182 2024-02-21T22:51:33.412 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 165/182 2024-02-21T22:51:33.412 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 166/182 2024-02-21T22:51:33.412 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 167/182 2024-02-21T22:51:33.413 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 168/182 2024-02-21T22:51:33.413 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 169/182 2024-02-21T22:51:33.413 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 170/182 2024-02-21T22:51:33.413 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 171/182 2024-02-21T22:51:33.413 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 172/182 2024-02-21T22:51:33.413 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : openssl-1:3.0.7-25.el9.x86_64 173/182 2024-02-21T22:51:33.413 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 174/182 2024-02-21T22:51:33.413 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : openssl-libs-1:3.0.7-25.el9.x86_64 175/182 2024-02-21T22:51:33.413 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 176/182 2024-02-21T22:51:33.413 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 177/182 2024-02-21T22:51:33.413 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 178/182 2024-02-21T22:51:33.413 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 179/182 2024-02-21T22:51:33.413 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 180/182 2024-02-21T22:51:33.413 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 181/182 2024-02-21T22:51:33.707 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : cephfs-top-2:19.0.0-1643.g3bfc837d.el9.noarch 162/182 2024-02-21T22:51:33.795 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : openssl-devel-1:3.0.7-25.el9.x86_64 163/182 2024-02-21T22:51:33.884 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : flex-2.6.4-9.el9.x86_64 164/182 2024-02-21T22:51:33.915 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : bison-3.7.4-5.el9.x86_64 165/182 2024-02-21T22:51:33.940 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 166/182 2024-02-21T22:51:33.965 INFO:teuthology.orchestra.run.smithi116.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 167/182 2024-02-21T22:51:33.991 INFO:teuthology.orchestra.run.smithi116.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 168/182 2024-02-21T22:51:34.017 INFO:teuthology.orchestra.run.smithi116.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 169/182 2024-02-21T22:51:34.017 INFO:teuthology.orchestra.run.smithi116.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 170/182 2024-02-21T22:51:34.088 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 170/182 2024-02-21T22:51:34.126 INFO:teuthology.orchestra.run.smithi116.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 171/182 2024-02-21T22:51:34.151 INFO:teuthology.orchestra.run.smithi116.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 172/182 2024-02-21T22:51:34.177 INFO:teuthology.orchestra.run.smithi116.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 173/182 2024-02-21T22:51:34.202 INFO:teuthology.orchestra.run.smithi116.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 174/182 2024-02-21T22:51:34.202 INFO:teuthology.orchestra.run.smithi116.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 175/182 2024-02-21T22:51:34.288 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 175/182 2024-02-21T22:51:34.313 INFO:teuthology.orchestra.run.smithi116.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 176/182 2024-02-21T22:51:34.319 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 177/182 2024-02-21T22:51:34.320 INFO:teuthology.orchestra.run.smithi116.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 177/182 2024-02-21T22:51:34.508 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 177/182 2024-02-21T22:51:34.508 INFO:teuthology.orchestra.run.smithi116.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 178/182 2024-02-21T22:51:34.583 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 178/182 2024-02-21T22:51:34.607 INFO:teuthology.orchestra.run.smithi116.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 179/182 2024-02-21T22:51:34.635 INFO:teuthology.orchestra.run.smithi116.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 180/182 2024-02-21T22:51:34.667 INFO:teuthology.orchestra.run.smithi116.stdout: Cleanup : xfsprogs-5.19.0-4.el9.x86_64 181/182 2024-02-21T22:51:34.732 INFO:teuthology.orchestra.run.smithi116.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 182/182 2024-02-21T22:51:36.438 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 182/182 2024-02-21T22:51:36.439 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-21T22:51:36.439 INFO:teuthology.orchestra.run.smithi142.stdout:Upgraded: 2024-02-21T22:51:36.439 INFO:teuthology.orchestra.run.smithi142.stdout: NetworkManager-1:1.45.91-1.el9.x86_64 2024-02-21T22:51:36.439 INFO:teuthology.orchestra.run.smithi142.stdout: NetworkManager-libnm-1:1.45.91-1.el9.x86_64 2024-02-21T22:51:36.439 INFO:teuthology.orchestra.run.smithi142.stdout: NetworkManager-team-1:1.45.91-1.el9.x86_64 2024-02-21T22:51:36.439 INFO:teuthology.orchestra.run.smithi142.stdout: NetworkManager-tui-1:1.45.91-1.el9.x86_64 2024-02-21T22:51:36.439 INFO:teuthology.orchestra.run.smithi142.stdout: acl-2.3.1-4.el9.x86_64 2024-02-21T22:51:36.439 INFO:teuthology.orchestra.run.smithi142.stdout: elfutils-debuginfod-client-0.190-2.el9.x86_64 2024-02-21T22:51:36.439 INFO:teuthology.orchestra.run.smithi142.stdout: elfutils-libelf-0.190-2.el9.x86_64 2024-02-21T22:51:36.439 INFO:teuthology.orchestra.run.smithi142.stdout: elfutils-libs-0.190-2.el9.x86_64 2024-02-21T22:51:36.439 INFO:teuthology.orchestra.run.smithi142.stdout: libacl-2.3.1-4.el9.x86_64 2024-02-21T22:51:36.439 INFO:teuthology.orchestra.run.smithi142.stdout: libacl-devel-2.3.1-4.el9.x86_64 2024-02-21T22:51:36.439 INFO:teuthology.orchestra.run.smithi142.stdout: librados2-2:19.0.0-1643.g3bfc837d.el9.x86_64 2024-02-21T22:51:36.439 INFO:teuthology.orchestra.run.smithi142.stdout: librbd1-2:19.0.0-1643.g3bfc837d.el9.x86_64 2024-02-21T22:51:36.440 INFO:teuthology.orchestra.run.smithi142.stdout: openssl-1:3.0.7-25.el9.x86_64 2024-02-21T22:51:36.440 INFO:teuthology.orchestra.run.smithi142.stdout: openssl-libs-1:3.0.7-25.el9.x86_64 2024-02-21T22:51:36.440 INFO:teuthology.orchestra.run.smithi142.stdout: xfsdump-3.1.12-4.el9.x86_64 2024-02-21T22:51:36.440 INFO:teuthology.orchestra.run.smithi142.stdout: xfsprogs-6.3.0-1.el9.x86_64 2024-02-21T22:51:36.440 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2024-02-21T22:51:36.440 INFO:teuthology.orchestra.run.smithi142.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-02-21T22:51:36.440 INFO:teuthology.orchestra.run.smithi142.stdout: automake-1.16.2-8.el9.noarch 2024-02-21T22:51:36.440 INFO:teuthology.orchestra.run.smithi142.stdout: bison-3.7.4-5.el9.x86_64 2024-02-21T22:51:36.440 INFO:teuthology.orchestra.run.smithi142.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-02-21T22:51:36.440 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-2:19.0.0-1643.g3bfc837d.el9.x86_64 2024-02-21T22:51:36.440 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-base-2:19.0.0-1643.g3bfc837d.el9.x86_64 2024-02-21T22:51:36.440 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-common-2:19.0.0-1643.g3bfc837d.el9.x86_64 2024-02-21T22:51:36.440 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-fuse-2:19.0.0-1643.g3bfc837d.el9.x86_64 2024-02-21T22:51:36.441 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-grafana-dashboards-2:19.0.0-1643.g3bfc837d.el9.noarch 2024-02-21T22:51:36.441 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-immutable-object-cache-2:19.0.0-1643.g3bfc837d.el9.x86_64 2024-02-21T22:51:36.441 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mds-2:19.0.0-1643.g3bfc837d.el9.x86_64 2024-02-21T22:51:36.441 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-2:19.0.0-1643.g3bfc837d.el9.x86_64 2024-02-21T22:51:36.441 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-cephadm-2:19.0.0-1643.g3bfc837d.el9.noarch 2024-02-21T22:51:36.441 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-dashboard-2:19.0.0-1643.g3bfc837d.el9.noarch 2024-02-21T22:51:36.441 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-diskprediction-local-2:19.0.0-1643.g3bfc837d.el9.noarch 2024-02-21T22:51:36.441 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-modules-core-2:19.0.0-1643.g3bfc837d.el9.noarch 2024-02-21T22:51:36.441 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-rook-2:19.0.0-1643.g3bfc837d.el9.noarch 2024-02-21T22:51:36.441 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mon-2:19.0.0-1643.g3bfc837d.el9.x86_64 2024-02-21T22:51:36.441 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-osd-2:19.0.0-1643.g3bfc837d.el9.x86_64 2024-02-21T22:51:36.441 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-prometheus-alerts-2:19.0.0-1643.g3bfc837d.el9.noarch 2024-02-21T22:51:36.442 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-radosgw-2:19.0.0-1643.g3bfc837d.el9.x86_64 2024-02-21T22:51:36.442 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-selinux-2:19.0.0-1643.g3bfc837d.el9.x86_64 2024-02-21T22:51:36.442 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-test-2:19.0.0-1643.g3bfc837d.el9.x86_64 2024-02-21T22:51:36.442 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-volume-2:19.0.0-1643.g3bfc837d.el9.noarch 2024-02-21T22:51:36.442 INFO:teuthology.orchestra.run.smithi142.stdout: cephadm-2:19.0.0-1643.g3bfc837d.el9.noarch 2024-02-21T22:51:36.442 INFO:teuthology.orchestra.run.smithi142.stdout: cephfs-mirror-2:19.0.0-1643.g3bfc837d.el9.x86_64 2024-02-21T22:51:36.442 INFO:teuthology.orchestra.run.smithi142.stdout: cephfs-shell-2:19.0.0-1643.g3bfc837d.el9.x86_64 2024-02-21T22:51:36.442 INFO:teuthology.orchestra.run.smithi142.stdout: cephfs-top-2:19.0.0-1643.g3bfc837d.el9.noarch 2024-02-21T22:51:36.442 INFO:teuthology.orchestra.run.smithi142.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-02-21T22:51:36.442 INFO:teuthology.orchestra.run.smithi142.stdout: flex-2.6.4-9.el9.x86_64 2024-02-21T22:51:36.442 INFO:teuthology.orchestra.run.smithi142.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-02-21T22:51:36.442 INFO:teuthology.orchestra.run.smithi142.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-02-21T22:51:36.442 INFO:teuthology.orchestra.run.smithi142.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-02-21T22:51:36.442 INFO:teuthology.orchestra.run.smithi142.stdout: fuse-2.9.9-15.el9.x86_64 2024-02-21T22:51:36.443 INFO:teuthology.orchestra.run.smithi142.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-02-21T22:51:36.443 INFO:teuthology.orchestra.run.smithi142.stdout: grpc-data-1.46.7-10.el9.noarch 2024-02-21T22:51:36.443 INFO:teuthology.orchestra.run.smithi142.stdout: jq-1.6-16.el9.x86_64 2024-02-21T22:51:36.443 INFO:teuthology.orchestra.run.smithi142.stdout: libaio-devel-0.3.112-1.el8.x86_64 2024-02-21T22:51:36.443 INFO:teuthology.orchestra.run.smithi142.stdout: libarrow-9.0.0-10.el9.x86_64 2024-02-21T22:51:36.443 INFO:teuthology.orchestra.run.smithi142.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-02-21T22:51:36.443 INFO:teuthology.orchestra.run.smithi142.stdout: libcephfs-devel-2:19.0.0-1643.g3bfc837d.el9.x86_64 2024-02-21T22:51:36.443 INFO:teuthology.orchestra.run.smithi142.stdout: libcephfs2-2:19.0.0-1643.g3bfc837d.el9.x86_64 2024-02-21T22:51:36.443 INFO:teuthology.orchestra.run.smithi142.stdout: libcephsqlite-2:19.0.0-1643.g3bfc837d.el9.x86_64 2024-02-21T22:51:36.443 INFO:teuthology.orchestra.run.smithi142.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-02-21T22:51:36.443 INFO:teuthology.orchestra.run.smithi142.stdout: liboath-2.6.7-2.el9.x86_64 2024-02-21T22:51:36.443 INFO:teuthology.orchestra.run.smithi142.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-02-21T22:51:36.443 INFO:teuthology.orchestra.run.smithi142.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-02-21T22:51:36.443 INFO:teuthology.orchestra.run.smithi142.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-02-21T22:51:36.444 INFO:teuthology.orchestra.run.smithi142.stdout: librados-devel-2:19.0.0-1643.g3bfc837d.el9.x86_64 2024-02-21T22:51:36.444 INFO:teuthology.orchestra.run.smithi142.stdout: libradosstriper1-2:19.0.0-1643.g3bfc837d.el9.x86_64 2024-02-21T22:51:36.444 INFO:teuthology.orchestra.run.smithi142.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-02-21T22:51:36.444 INFO:teuthology.orchestra.run.smithi142.stdout: librgw2-2:19.0.0-1643.g3bfc837d.el9.x86_64 2024-02-21T22:51:36.444 INFO:teuthology.orchestra.run.smithi142.stdout: libtool-2.4.6-45.el9.x86_64 2024-02-21T22:51:36.444 INFO:teuthology.orchestra.run.smithi142.stdout: libunwind-1.6.2-1.el9.x86_64 2024-02-21T22:51:36.444 INFO:teuthology.orchestra.run.smithi142.stdout: libuuid-devel-2.37.4-15.el9.x86_64 2024-02-21T22:51:36.444 INFO:teuthology.orchestra.run.smithi142.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-02-21T22:51:36.444 INFO:teuthology.orchestra.run.smithi142.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-02-21T22:51:36.444 INFO:teuthology.orchestra.run.smithi142.stdout: lua-5.4.4-4.el9.x86_64 2024-02-21T22:51:36.445 INFO:teuthology.orchestra.run.smithi142.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-02-21T22:51:36.445 INFO:teuthology.orchestra.run.smithi142.stdout: luarocks-3.9.2-1.el9.noarch 2024-02-21T22:51:36.445 INFO:teuthology.orchestra.run.smithi142.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-02-21T22:51:36.445 INFO:teuthology.orchestra.run.smithi142.stdout: openblas-0.3.21-2.el9.x86_64 2024-02-21T22:51:36.445 INFO:teuthology.orchestra.run.smithi142.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-02-21T22:51:36.445 INFO:teuthology.orchestra.run.smithi142.stdout: openssl-devel-1:3.0.7-25.el9.x86_64 2024-02-21T22:51:36.445 INFO:teuthology.orchestra.run.smithi142.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-02-21T22:51:36.445 INFO:teuthology.orchestra.run.smithi142.stdout: postgresql-13.11-1.el9.x86_64 2024-02-21T22:51:36.445 INFO:teuthology.orchestra.run.smithi142.stdout: postgresql-contrib-13.11-1.el9.x86_64 2024-02-21T22:51:36.445 INFO:teuthology.orchestra.run.smithi142.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2024-02-21T22:51:36.445 INFO:teuthology.orchestra.run.smithi142.stdout: postgresql-server-13.11-1.el9.x86_64 2024-02-21T22:51:36.445 INFO:teuthology.orchestra.run.smithi142.stdout: protobuf-3.14.0-13.el9.x86_64 2024-02-21T22:51:36.445 INFO:teuthology.orchestra.run.smithi142.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-02-21T22:51:36.445 INFO:teuthology.orchestra.run.smithi142.stdout: python3-asyncssh-2.13.2-4.el9.noarch 2024-02-21T22:51:36.446 INFO:teuthology.orchestra.run.smithi142.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-02-21T22:51:36.446 INFO:teuthology.orchestra.run.smithi142.stdout: python3-babel-2.9.1-2.el9.noarch 2024-02-21T22:51:36.446 INFO:teuthology.orchestra.run.smithi142.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-02-21T22:51:36.446 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-02-21T22:51:36.446 INFO:teuthology.orchestra.run.smithi142.stdout: python3-ceph-argparse-2:19.0.0-1643.g3bfc837d.el9.x86_64 2024-02-21T22:51:36.446 INFO:teuthology.orchestra.run.smithi142.stdout: python3-ceph-common-2:19.0.0-1643.g3bfc837d.el9.x86_64 2024-02-21T22:51:36.446 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cephfs-2:19.0.0-1643.g3bfc837d.el9.x86_64 2024-02-21T22:51:36.446 INFO:teuthology.orchestra.run.smithi142.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-02-21T22:51:36.446 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-02-21T22:51:36.446 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-02-21T22:51:36.446 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-02-21T22:51:36.446 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-02-21T22:51:36.446 INFO:teuthology.orchestra.run.smithi142.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-02-21T22:51:36.446 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-02-21T22:51:36.447 INFO:teuthology.orchestra.run.smithi142.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-02-21T22:51:36.447 INFO:teuthology.orchestra.run.smithi142.stdout: python3-google-auth-1:2.27.0-1.el9.noarch 2024-02-21T22:51:36.447 INFO:teuthology.orchestra.run.smithi142.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-02-21T22:51:36.447 INFO:teuthology.orchestra.run.smithi142.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-02-21T22:51:36.447 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-02-21T22:51:36.447 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-02-21T22:51:36.447 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-02-21T22:51:36.447 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-02-21T22:51:36.447 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-02-21T22:51:36.447 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-02-21T22:51:36.447 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-02-21T22:51:36.447 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-02-21T22:51:36.447 INFO:teuthology.orchestra.run.smithi142.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-02-21T22:51:36.447 INFO:teuthology.orchestra.run.smithi142.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-02-21T22:51:36.448 INFO:teuthology.orchestra.run.smithi142.stdout: python3-mako-1.1.4-6.el9.noarch 2024-02-21T22:51:36.448 INFO:teuthology.orchestra.run.smithi142.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-02-21T22:51:36.448 INFO:teuthology.orchestra.run.smithi142.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-02-21T22:51:36.448 INFO:teuthology.orchestra.run.smithi142.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-02-21T22:51:36.448 INFO:teuthology.orchestra.run.smithi142.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-02-21T22:51:36.448 INFO:teuthology.orchestra.run.smithi142.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-02-21T22:51:36.448 INFO:teuthology.orchestra.run.smithi142.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-02-21T22:51:36.448 INFO:teuthology.orchestra.run.smithi142.stdout: python3-packaging-20.9-5.el9.noarch 2024-02-21T22:51:36.448 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-02-21T22:51:36.448 INFO:teuthology.orchestra.run.smithi142.stdout: python3-ply-3.11-14.el9.noarch 2024-02-21T22:51:36.448 INFO:teuthology.orchestra.run.smithi142.stdout: python3-portend-3.1.0-2.el9.noarch 2024-02-21T22:51:36.448 INFO:teuthology.orchestra.run.smithi142.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-02-21T22:51:36.448 INFO:teuthology.orchestra.run.smithi142.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-02-21T22:51:36.449 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-02-21T22:51:36.449 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-02-21T22:51:36.449 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-02-21T22:51:36.449 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pycparser-2.20-6.el9.noarch 2024-02-21T22:51:36.449 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-02-21T22:51:36.449 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pytz-2021.1-5.el9.noarch 2024-02-21T22:51:36.449 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rados-2:19.0.0-1643.g3bfc837d.el9.x86_64 2024-02-21T22:51:36.449 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rbd-2:19.0.0-1643.g3bfc837d.el9.x86_64 2024-02-21T22:51:36.449 INFO:teuthology.orchestra.run.smithi142.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-02-21T22:51:36.449 INFO:teuthology.orchestra.run.smithi142.stdout: python3-requests-2.25.1-8.el9.noarch 2024-02-21T22:51:36.449 INFO:teuthology.orchestra.run.smithi142.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-02-21T22:51:36.449 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rgw-2:19.0.0-1643.g3bfc837d.el9.x86_64 2024-02-21T22:51:36.449 INFO:teuthology.orchestra.run.smithi142.stdout: python3-routes-2.5.1-5.el9.noarch 2024-02-21T22:51:36.450 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rsa-4.9-2.el9.noarch 2024-02-21T22:51:36.450 INFO:teuthology.orchestra.run.smithi142.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-02-21T22:51:36.450 INFO:teuthology.orchestra.run.smithi142.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-02-21T22:51:36.450 INFO:teuthology.orchestra.run.smithi142.stdout: python3-toml-0.10.2-6.el9.noarch 2024-02-21T22:51:36.450 INFO:teuthology.orchestra.run.smithi142.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-02-21T22:51:36.450 INFO:teuthology.orchestra.run.smithi142.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-02-21T22:51:36.450 INFO:teuthology.orchestra.run.smithi142.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-02-21T22:51:36.450 INFO:teuthology.orchestra.run.smithi142.stdout: python3-webob-1.8.7-6.el9.noarch 2024-02-21T22:51:36.450 INFO:teuthology.orchestra.run.smithi142.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-02-21T22:51:36.450 INFO:teuthology.orchestra.run.smithi142.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-02-21T22:51:36.450 INFO:teuthology.orchestra.run.smithi142.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-02-21T22:51:36.450 INFO:teuthology.orchestra.run.smithi142.stdout: qatlib-23.11.0-1.el9.x86_64 2024-02-21T22:51:36.450 INFO:teuthology.orchestra.run.smithi142.stdout: qatlib-service-23.11.0-1.el9.x86_64 2024-02-21T22:51:36.451 INFO:teuthology.orchestra.run.smithi142.stdout: qatzip-libs-1.1.2-2.el9.x86_64 2024-02-21T22:51:36.451 INFO:teuthology.orchestra.run.smithi142.stdout: rbd-fuse-2:19.0.0-1643.g3bfc837d.el9.x86_64 2024-02-21T22:51:36.451 INFO:teuthology.orchestra.run.smithi142.stdout: rbd-mirror-2:19.0.0-1643.g3bfc837d.el9.x86_64 2024-02-21T22:51:36.451 INFO:teuthology.orchestra.run.smithi142.stdout: rbd-nbd-2:19.0.0-1643.g3bfc837d.el9.x86_64 2024-02-21T22:51:36.451 INFO:teuthology.orchestra.run.smithi142.stdout: re2-1:20211101-3.el9.x86_64 2024-02-21T22:51:36.451 INFO:teuthology.orchestra.run.smithi142.stdout: socat-1.7.4.1-5.el9.x86_64 2024-02-21T22:51:36.451 INFO:teuthology.orchestra.run.smithi142.stdout: thrift-0.15.0-2.el9.x86_64 2024-02-21T22:51:36.451 INFO:teuthology.orchestra.run.smithi142.stdout: uuid-1.6.2-55.el9.x86_64 2024-02-21T22:51:36.451 INFO:teuthology.orchestra.run.smithi142.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-02-21T22:51:36.451 INFO:teuthology.orchestra.run.smithi142.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-02-21T22:51:36.452 INFO:teuthology.orchestra.run.smithi142.stdout: zlib-devel-1.2.11-40.el9.x86_64 2024-02-21T22:51:36.453 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-21T22:51:36.453 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-02-21T22:51:36.956 DEBUG:teuthology.parallel:result is None 2024-02-21T22:51:39.617 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: elfutils-libelf-0.189-3.el9.x86_64 182/182 2024-02-21T22:51:39.617 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-2:19.0.0-1643.g3bfc837d.el9.x86_64 1/182 2024-02-21T22:51:39.618 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-base-2:19.0.0-1643.g3bfc837d.el9.x86_64 2/182 2024-02-21T22:51:39.618 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-common-2:19.0.0-1643.g3bfc837d.el9.x86_64 3/182 2024-02-21T22:51:39.618 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-fuse-2:19.0.0-1643.g3bfc837d.el9.x86_64 4/182 2024-02-21T22:51:39.618 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-1643.g3bfc8 5/182 2024-02-21T22:51:39.618 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-mds-2:19.0.0-1643.g3bfc837d.el9.x86_64 6/182 2024-02-21T22:51:39.618 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-mgr-2:19.0.0-1643.g3bfc837d.el9.x86_64 7/182 2024-02-21T22:51:39.618 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-mon-2:19.0.0-1643.g3bfc837d.el9.x86_64 8/182 2024-02-21T22:51:39.618 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-osd-2:19.0.0-1643.g3bfc837d.el9.x86_64 9/182 2024-02-21T22:51:39.618 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-radosgw-2:19.0.0-1643.g3bfc837d.el9.x86_64 10/182 2024-02-21T22:51:39.618 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-selinux-2:19.0.0-1643.g3bfc837d.el9.x86_64 11/182 2024-02-21T22:51:39.618 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-test-2:19.0.0-1643.g3bfc837d.el9.x86_64 12/182 2024-02-21T22:51:39.618 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : cephfs-mirror-2:19.0.0-1643.g3bfc837d.el9.x86_64 13/182 2024-02-21T22:51:39.618 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : cephfs-shell-2:19.0.0-1643.g3bfc837d.el9.x86_64 14/182 2024-02-21T22:51:39.618 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libcephfs-devel-2:19.0.0-1643.g3bfc837d.el9.x86_ 15/182 2024-02-21T22:51:39.619 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libcephfs2-2:19.0.0-1643.g3bfc837d.el9.x86_64 16/182 2024-02-21T22:51:39.619 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libcephsqlite-2:19.0.0-1643.g3bfc837d.el9.x86_64 17/182 2024-02-21T22:51:39.619 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : librados-devel-2:19.0.0-1643.g3bfc837d.el9.x86_6 18/182 2024-02-21T22:51:39.619 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libradosstriper1-2:19.0.0-1643.g3bfc837d.el9.x86 19/182 2024-02-21T22:51:39.619 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : librgw2-2:19.0.0-1643.g3bfc837d.el9.x86_64 20/182 2024-02-21T22:51:39.619 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-ceph-argparse-2:19.0.0-1643.g3bfc837d.el 21/182 2024-02-21T22:51:39.619 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-ceph-common-2:19.0.0-1643.g3bfc837d.el9. 22/182 2024-02-21T22:51:39.619 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-cephfs-2:19.0.0-1643.g3bfc837d.el9.x86_6 23/182 2024-02-21T22:51:39.619 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-rados-2:19.0.0-1643.g3bfc837d.el9.x86_64 24/182 2024-02-21T22:51:39.619 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-rbd-2:19.0.0-1643.g3bfc837d.el9.x86_64 25/182 2024-02-21T22:51:39.619 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-rgw-2:19.0.0-1643.g3bfc837d.el9.x86_64 26/182 2024-02-21T22:51:39.619 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : rbd-fuse-2:19.0.0-1643.g3bfc837d.el9.x86_64 27/182 2024-02-21T22:51:39.619 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : rbd-mirror-2:19.0.0-1643.g3bfc837d.el9.x86_64 28/182 2024-02-21T22:51:39.619 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : rbd-nbd-2:19.0.0-1643.g3bfc837d.el9.x86_64 29/182 2024-02-21T22:51:39.636 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-1643.g3bfc837d. 30/182 2024-02-21T22:51:39.636 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-1643.g3bfc837d.el9.noa 31/182 2024-02-21T22:51:39.636 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-1643.g3bfc837d.el9.n 32/182 2024-02-21T22:51:39.636 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-1643.g3bf 33/182 2024-02-21T22:51:39.636 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-1643.g3bfc837d.el 34/182 2024-02-21T22:51:39.636 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-mgr-rook-2:19.0.0-1643.g3bfc837d.el9.noarch 35/182 2024-02-21T22:51:39.636 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-1643.g3bfc837d.e 36/182 2024-02-21T22:51:39.636 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-volume-2:19.0.0-1643.g3bfc837d.el9.noarch 37/182 2024-02-21T22:51:39.636 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : cephadm-2:19.0.0-1643.g3bfc837d.el9.noarch 38/182 2024-02-21T22:51:39.637 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : cephfs-top-2:19.0.0-1643.g3bfc837d.el9.noarch 39/182 2024-02-21T22:51:39.637 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 40/182 2024-02-21T22:51:39.637 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 41/182 2024-02-21T22:51:39.637 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : jq-1.6-16.el9.x86_64 42/182 2024-02-21T22:51:39.637 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 43/182 2024-02-21T22:51:39.637 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 44/182 2024-02-21T22:51:39.637 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 45/182 2024-02-21T22:51:39.637 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 46/182 2024-02-21T22:51:39.637 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 47/182 2024-02-21T22:51:39.637 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-ply-3.11-14.el9.noarch 48/182 2024-02-21T22:51:39.637 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 49/182 2024-02-21T22:51:39.637 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 50/182 2024-02-21T22:51:39.637 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 51/182 2024-02-21T22:51:39.637 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : automake-1.16.2-8.el9.noarch 52/182 2024-02-21T22:51:39.637 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : bison-3.7.4-5.el9.x86_64 53/182 2024-02-21T22:51:39.638 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 54/182 2024-02-21T22:51:39.638 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 55/182 2024-02-21T22:51:39.638 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : flex-2.6.4-9.el9.x86_64 56/182 2024-02-21T22:51:39.638 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 57/182 2024-02-21T22:51:39.638 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 58/182 2024-02-21T22:51:39.638 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 59/182 2024-02-21T22:51:39.638 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 60/182 2024-02-21T22:51:39.638 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 61/182 2024-02-21T22:51:39.638 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 62/182 2024-02-21T22:51:39.638 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 63/182 2024-02-21T22:51:39.638 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libuuid-devel-2.37.4-15.el9.x86_64 64/182 2024-02-21T22:51:39.638 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 65/182 2024-02-21T22:51:39.638 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 66/182 2024-02-21T22:51:39.639 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : lua-5.4.4-4.el9.x86_64 67/182 2024-02-21T22:51:39.639 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 68/182 2024-02-21T22:51:39.639 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 69/182 2024-02-21T22:51:39.639 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : openssl-devel-1:3.0.7-25.el9.x86_64 70/182 2024-02-21T22:51:39.639 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : postgresql-13.11-1.el9.x86_64 71/182 2024-02-21T22:51:39.639 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 72/182 2024-02-21T22:51:39.639 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 73/182 2024-02-21T22:51:39.639 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 74/182 2024-02-21T22:51:39.639 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 75/182 2024-02-21T22:51:39.639 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 76/182 2024-02-21T22:51:39.639 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 77/182 2024-02-21T22:51:39.639 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 78/182 2024-02-21T22:51:39.639 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 79/182 2024-02-21T22:51:39.639 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/182 2024-02-21T22:51:39.639 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/182 2024-02-21T22:51:39.640 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/182 2024-02-21T22:51:39.640 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/182 2024-02-21T22:51:39.640 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/182 2024-02-21T22:51:39.640 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/182 2024-02-21T22:51:39.640 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/182 2024-02-21T22:51:39.640 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/182 2024-02-21T22:51:39.640 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/182 2024-02-21T22:51:39.640 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/182 2024-02-21T22:51:39.640 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/182 2024-02-21T22:51:39.640 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/182 2024-02-21T22:51:39.640 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/182 2024-02-21T22:51:39.640 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/182 2024-02-21T22:51:39.640 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/182 2024-02-21T22:51:39.640 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/182 2024-02-21T22:51:39.640 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/182 2024-02-21T22:51:39.641 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : qatlib-23.11.0-1.el9.x86_64 97/182 2024-02-21T22:51:39.641 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : qatlib-service-23.11.0-1.el9.x86_64 98/182 2024-02-21T22:51:39.641 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : qatzip-libs-1.1.2-2.el9.x86_64 99/182 2024-02-21T22:51:39.641 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 100/182 2024-02-21T22:51:39.641 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/182 2024-02-21T22:51:39.641 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 102/182 2024-02-21T22:51:39.641 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/182 2024-02-21T22:51:39.641 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 104/182 2024-02-21T22:51:39.641 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/182 2024-02-21T22:51:39.641 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/182 2024-02-21T22:51:39.641 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/182 2024-02-21T22:51:39.641 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 108/182 2024-02-21T22:51:39.641 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/182 2024-02-21T22:51:39.641 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 110/182 2024-02-21T22:51:39.642 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 111/182 2024-02-21T22:51:39.642 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/182 2024-02-21T22:51:39.642 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/182 2024-02-21T22:51:39.642 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 114/182 2024-02-21T22:51:39.642 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 115/182 2024-02-21T22:51:39.642 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-asyncssh-2.13.2-4.el9.noarch 116/182 2024-02-21T22:51:39.642 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/182 2024-02-21T22:51:39.642 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/182 2024-02-21T22:51:39.642 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 119/182 2024-02-21T22:51:39.642 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/182 2024-02-21T22:51:39.642 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/182 2024-02-21T22:51:39.642 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/182 2024-02-21T22:51:39.642 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 123/182 2024-02-21T22:51:39.642 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-google-auth-1:2.27.0-1.el9.noarch 124/182 2024-02-21T22:51:39.642 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 125/182 2024-02-21T22:51:39.643 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 126/182 2024-02-21T22:51:39.643 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 127/182 2024-02-21T22:51:39.643 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 128/182 2024-02-21T22:51:39.643 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 129/182 2024-02-21T22:51:39.643 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 130/182 2024-02-21T22:51:39.643 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 131/182 2024-02-21T22:51:39.643 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 132/182 2024-02-21T22:51:39.643 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 133/182 2024-02-21T22:51:39.643 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 134/182 2024-02-21T22:51:39.643 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 135/182 2024-02-21T22:51:39.643 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 136/182 2024-02-21T22:51:39.643 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 137/182 2024-02-21T22:51:39.643 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 138/182 2024-02-21T22:51:39.643 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 139/182 2024-02-21T22:51:39.643 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 140/182 2024-02-21T22:51:39.644 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 141/182 2024-02-21T22:51:39.644 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 142/182 2024-02-21T22:51:39.644 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 143/182 2024-02-21T22:51:39.644 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 144/182 2024-02-21T22:51:39.644 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 145/182 2024-02-21T22:51:39.644 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 146/182 2024-02-21T22:51:39.644 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 147/182 2024-02-21T22:51:39.644 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 148/182 2024-02-21T22:51:39.644 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : re2-1:20211101-3.el9.x86_64 149/182 2024-02-21T22:51:39.644 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 150/182 2024-02-21T22:51:39.644 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : librados2-2:19.0.0-1643.g3bfc837d.el9.x86_64 151/182 2024-02-21T22:51:39.644 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 152/182 2024-02-21T22:51:39.644 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : librbd1-2:19.0.0-1643.g3bfc837d.el9.x86_64 153/182 2024-02-21T22:51:39.645 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 154/182 2024-02-21T22:51:39.645 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : NetworkManager-1:1.45.91-1.el9.x86_64 155/182 2024-02-21T22:51:39.645 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 156/182 2024-02-21T22:51:39.645 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : NetworkManager-libnm-1:1.45.91-1.el9.x86_64 157/182 2024-02-21T22:51:39.645 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 158/182 2024-02-21T22:51:39.645 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : NetworkManager-team-1:1.45.91-1.el9.x86_64 159/182 2024-02-21T22:51:39.645 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 160/182 2024-02-21T22:51:39.645 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : NetworkManager-tui-1:1.45.91-1.el9.x86_64 161/182 2024-02-21T22:51:39.645 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 162/182 2024-02-21T22:51:39.645 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : acl-2.3.1-4.el9.x86_64 163/182 2024-02-21T22:51:39.645 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : acl-2.3.1-3.el9.x86_64 164/182 2024-02-21T22:51:39.645 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 165/182 2024-02-21T22:51:39.645 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 166/182 2024-02-21T22:51:39.646 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 167/182 2024-02-21T22:51:39.646 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 168/182 2024-02-21T22:51:39.646 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 169/182 2024-02-21T22:51:39.646 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 170/182 2024-02-21T22:51:39.646 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 171/182 2024-02-21T22:51:39.646 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 172/182 2024-02-21T22:51:39.646 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : openssl-1:3.0.7-25.el9.x86_64 173/182 2024-02-21T22:51:39.646 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 174/182 2024-02-21T22:51:39.646 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : openssl-libs-1:3.0.7-25.el9.x86_64 175/182 2024-02-21T22:51:39.646 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 176/182 2024-02-21T22:51:39.646 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 177/182 2024-02-21T22:51:39.646 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 178/182 2024-02-21T22:51:39.646 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 179/182 2024-02-21T22:51:39.647 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 180/182 2024-02-21T22:51:39.647 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 181/182 2024-02-21T22:51:42.490 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 182/182 2024-02-21T22:51:42.491 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-02-21T22:51:42.491 INFO:teuthology.orchestra.run.smithi116.stdout:Upgraded: 2024-02-21T22:51:42.491 INFO:teuthology.orchestra.run.smithi116.stdout: NetworkManager-1:1.45.91-1.el9.x86_64 2024-02-21T22:51:42.491 INFO:teuthology.orchestra.run.smithi116.stdout: NetworkManager-libnm-1:1.45.91-1.el9.x86_64 2024-02-21T22:51:42.491 INFO:teuthology.orchestra.run.smithi116.stdout: NetworkManager-team-1:1.45.91-1.el9.x86_64 2024-02-21T22:51:42.491 INFO:teuthology.orchestra.run.smithi116.stdout: NetworkManager-tui-1:1.45.91-1.el9.x86_64 2024-02-21T22:51:42.491 INFO:teuthology.orchestra.run.smithi116.stdout: acl-2.3.1-4.el9.x86_64 2024-02-21T22:51:42.491 INFO:teuthology.orchestra.run.smithi116.stdout: elfutils-debuginfod-client-0.190-2.el9.x86_64 2024-02-21T22:51:42.491 INFO:teuthology.orchestra.run.smithi116.stdout: elfutils-libelf-0.190-2.el9.x86_64 2024-02-21T22:51:42.491 INFO:teuthology.orchestra.run.smithi116.stdout: elfutils-libs-0.190-2.el9.x86_64 2024-02-21T22:51:42.491 INFO:teuthology.orchestra.run.smithi116.stdout: libacl-2.3.1-4.el9.x86_64 2024-02-21T22:51:42.491 INFO:teuthology.orchestra.run.smithi116.stdout: libacl-devel-2.3.1-4.el9.x86_64 2024-02-21T22:51:42.491 INFO:teuthology.orchestra.run.smithi116.stdout: librados2-2:19.0.0-1643.g3bfc837d.el9.x86_64 2024-02-21T22:51:42.492 INFO:teuthology.orchestra.run.smithi116.stdout: librbd1-2:19.0.0-1643.g3bfc837d.el9.x86_64 2024-02-21T22:51:42.492 INFO:teuthology.orchestra.run.smithi116.stdout: openssl-1:3.0.7-25.el9.x86_64 2024-02-21T22:51:42.492 INFO:teuthology.orchestra.run.smithi116.stdout: openssl-libs-1:3.0.7-25.el9.x86_64 2024-02-21T22:51:42.492 INFO:teuthology.orchestra.run.smithi116.stdout: xfsdump-3.1.12-4.el9.x86_64 2024-02-21T22:51:42.492 INFO:teuthology.orchestra.run.smithi116.stdout: xfsprogs-6.3.0-1.el9.x86_64 2024-02-21T22:51:42.492 INFO:teuthology.orchestra.run.smithi116.stdout:Installed: 2024-02-21T22:51:42.492 INFO:teuthology.orchestra.run.smithi116.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-02-21T22:51:42.492 INFO:teuthology.orchestra.run.smithi116.stdout: automake-1.16.2-8.el9.noarch 2024-02-21T22:51:42.492 INFO:teuthology.orchestra.run.smithi116.stdout: bison-3.7.4-5.el9.x86_64 2024-02-21T22:51:42.492 INFO:teuthology.orchestra.run.smithi116.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-02-21T22:51:42.492 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-2:19.0.0-1643.g3bfc837d.el9.x86_64 2024-02-21T22:51:42.492 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-base-2:19.0.0-1643.g3bfc837d.el9.x86_64 2024-02-21T22:51:42.492 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-common-2:19.0.0-1643.g3bfc837d.el9.x86_64 2024-02-21T22:51:42.492 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-fuse-2:19.0.0-1643.g3bfc837d.el9.x86_64 2024-02-21T22:51:42.493 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-grafana-dashboards-2:19.0.0-1643.g3bfc837d.el9.noarch 2024-02-21T22:51:42.493 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-immutable-object-cache-2:19.0.0-1643.g3bfc837d.el9.x86_64 2024-02-21T22:51:42.493 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mds-2:19.0.0-1643.g3bfc837d.el9.x86_64 2024-02-21T22:51:42.493 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-2:19.0.0-1643.g3bfc837d.el9.x86_64 2024-02-21T22:51:42.493 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-cephadm-2:19.0.0-1643.g3bfc837d.el9.noarch 2024-02-21T22:51:42.493 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-dashboard-2:19.0.0-1643.g3bfc837d.el9.noarch 2024-02-21T22:51:42.493 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-diskprediction-local-2:19.0.0-1643.g3bfc837d.el9.noarch 2024-02-21T22:51:42.493 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-modules-core-2:19.0.0-1643.g3bfc837d.el9.noarch 2024-02-21T22:51:42.493 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-rook-2:19.0.0-1643.g3bfc837d.el9.noarch 2024-02-21T22:51:42.493 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mon-2:19.0.0-1643.g3bfc837d.el9.x86_64 2024-02-21T22:51:42.493 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-osd-2:19.0.0-1643.g3bfc837d.el9.x86_64 2024-02-21T22:51:42.493 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-prometheus-alerts-2:19.0.0-1643.g3bfc837d.el9.noarch 2024-02-21T22:51:42.493 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-radosgw-2:19.0.0-1643.g3bfc837d.el9.x86_64 2024-02-21T22:51:42.493 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-selinux-2:19.0.0-1643.g3bfc837d.el9.x86_64 2024-02-21T22:51:42.494 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-test-2:19.0.0-1643.g3bfc837d.el9.x86_64 2024-02-21T22:51:42.494 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-volume-2:19.0.0-1643.g3bfc837d.el9.noarch 2024-02-21T22:51:42.494 INFO:teuthology.orchestra.run.smithi116.stdout: cephadm-2:19.0.0-1643.g3bfc837d.el9.noarch 2024-02-21T22:51:42.494 INFO:teuthology.orchestra.run.smithi116.stdout: cephfs-mirror-2:19.0.0-1643.g3bfc837d.el9.x86_64 2024-02-21T22:51:42.494 INFO:teuthology.orchestra.run.smithi116.stdout: cephfs-shell-2:19.0.0-1643.g3bfc837d.el9.x86_64 2024-02-21T22:51:42.494 INFO:teuthology.orchestra.run.smithi116.stdout: cephfs-top-2:19.0.0-1643.g3bfc837d.el9.noarch 2024-02-21T22:51:42.494 INFO:teuthology.orchestra.run.smithi116.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-02-21T22:51:42.494 INFO:teuthology.orchestra.run.smithi116.stdout: flex-2.6.4-9.el9.x86_64 2024-02-21T22:51:42.494 INFO:teuthology.orchestra.run.smithi116.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-02-21T22:51:42.494 INFO:teuthology.orchestra.run.smithi116.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-02-21T22:51:42.494 INFO:teuthology.orchestra.run.smithi116.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-02-21T22:51:42.494 INFO:teuthology.orchestra.run.smithi116.stdout: fuse-2.9.9-15.el9.x86_64 2024-02-21T22:51:42.494 INFO:teuthology.orchestra.run.smithi116.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-02-21T22:51:42.495 INFO:teuthology.orchestra.run.smithi116.stdout: grpc-data-1.46.7-10.el9.noarch 2024-02-21T22:51:42.495 INFO:teuthology.orchestra.run.smithi116.stdout: jq-1.6-16.el9.x86_64 2024-02-21T22:51:42.495 INFO:teuthology.orchestra.run.smithi116.stdout: libaio-devel-0.3.112-1.el8.x86_64 2024-02-21T22:51:42.495 INFO:teuthology.orchestra.run.smithi116.stdout: libarrow-9.0.0-10.el9.x86_64 2024-02-21T22:51:42.495 INFO:teuthology.orchestra.run.smithi116.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-02-21T22:51:42.495 INFO:teuthology.orchestra.run.smithi116.stdout: libcephfs-devel-2:19.0.0-1643.g3bfc837d.el9.x86_64 2024-02-21T22:51:42.495 INFO:teuthology.orchestra.run.smithi116.stdout: libcephfs2-2:19.0.0-1643.g3bfc837d.el9.x86_64 2024-02-21T22:51:42.495 INFO:teuthology.orchestra.run.smithi116.stdout: libcephsqlite-2:19.0.0-1643.g3bfc837d.el9.x86_64 2024-02-21T22:51:42.495 INFO:teuthology.orchestra.run.smithi116.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-02-21T22:51:42.495 INFO:teuthology.orchestra.run.smithi116.stdout: liboath-2.6.7-2.el9.x86_64 2024-02-21T22:51:42.495 INFO:teuthology.orchestra.run.smithi116.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-02-21T22:51:42.495 INFO:teuthology.orchestra.run.smithi116.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-02-21T22:51:42.495 INFO:teuthology.orchestra.run.smithi116.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-02-21T22:51:42.496 INFO:teuthology.orchestra.run.smithi116.stdout: librados-devel-2:19.0.0-1643.g3bfc837d.el9.x86_64 2024-02-21T22:51:42.496 INFO:teuthology.orchestra.run.smithi116.stdout: libradosstriper1-2:19.0.0-1643.g3bfc837d.el9.x86_64 2024-02-21T22:51:42.496 INFO:teuthology.orchestra.run.smithi116.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-02-21T22:51:42.496 INFO:teuthology.orchestra.run.smithi116.stdout: librgw2-2:19.0.0-1643.g3bfc837d.el9.x86_64 2024-02-21T22:51:42.496 INFO:teuthology.orchestra.run.smithi116.stdout: libtool-2.4.6-45.el9.x86_64 2024-02-21T22:51:42.496 INFO:teuthology.orchestra.run.smithi116.stdout: libunwind-1.6.2-1.el9.x86_64 2024-02-21T22:51:42.496 INFO:teuthology.orchestra.run.smithi116.stdout: libuuid-devel-2.37.4-15.el9.x86_64 2024-02-21T22:51:42.496 INFO:teuthology.orchestra.run.smithi116.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-02-21T22:51:42.496 INFO:teuthology.orchestra.run.smithi116.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-02-21T22:51:42.496 INFO:teuthology.orchestra.run.smithi116.stdout: lua-5.4.4-4.el9.x86_64 2024-02-21T22:51:42.496 INFO:teuthology.orchestra.run.smithi116.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-02-21T22:51:42.496 INFO:teuthology.orchestra.run.smithi116.stdout: luarocks-3.9.2-1.el9.noarch 2024-02-21T22:51:42.496 INFO:teuthology.orchestra.run.smithi116.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-02-21T22:51:42.496 INFO:teuthology.orchestra.run.smithi116.stdout: openblas-0.3.21-2.el9.x86_64 2024-02-21T22:51:42.497 INFO:teuthology.orchestra.run.smithi116.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-02-21T22:51:42.497 INFO:teuthology.orchestra.run.smithi116.stdout: openssl-devel-1:3.0.7-25.el9.x86_64 2024-02-21T22:51:42.497 INFO:teuthology.orchestra.run.smithi116.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-02-21T22:51:42.497 INFO:teuthology.orchestra.run.smithi116.stdout: postgresql-13.11-1.el9.x86_64 2024-02-21T22:51:42.497 INFO:teuthology.orchestra.run.smithi116.stdout: postgresql-contrib-13.11-1.el9.x86_64 2024-02-21T22:51:42.497 INFO:teuthology.orchestra.run.smithi116.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2024-02-21T22:51:42.497 INFO:teuthology.orchestra.run.smithi116.stdout: postgresql-server-13.11-1.el9.x86_64 2024-02-21T22:51:42.497 INFO:teuthology.orchestra.run.smithi116.stdout: protobuf-3.14.0-13.el9.x86_64 2024-02-21T22:51:42.497 INFO:teuthology.orchestra.run.smithi116.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-02-21T22:51:42.497 INFO:teuthology.orchestra.run.smithi116.stdout: python3-asyncssh-2.13.2-4.el9.noarch 2024-02-21T22:51:42.497 INFO:teuthology.orchestra.run.smithi116.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-02-21T22:51:42.497 INFO:teuthology.orchestra.run.smithi116.stdout: python3-babel-2.9.1-2.el9.noarch 2024-02-21T22:51:42.497 INFO:teuthology.orchestra.run.smithi116.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-02-21T22:51:42.497 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-02-21T22:51:42.498 INFO:teuthology.orchestra.run.smithi116.stdout: python3-ceph-argparse-2:19.0.0-1643.g3bfc837d.el9.x86_64 2024-02-21T22:51:42.498 INFO:teuthology.orchestra.run.smithi116.stdout: python3-ceph-common-2:19.0.0-1643.g3bfc837d.el9.x86_64 2024-02-21T22:51:42.498 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cephfs-2:19.0.0-1643.g3bfc837d.el9.x86_64 2024-02-21T22:51:42.498 INFO:teuthology.orchestra.run.smithi116.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-02-21T22:51:42.498 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-02-21T22:51:42.498 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-02-21T22:51:42.498 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-02-21T22:51:42.498 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-02-21T22:51:42.498 INFO:teuthology.orchestra.run.smithi116.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-02-21T22:51:42.498 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-02-21T22:51:42.498 INFO:teuthology.orchestra.run.smithi116.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-02-21T22:51:42.498 INFO:teuthology.orchestra.run.smithi116.stdout: python3-google-auth-1:2.27.0-1.el9.noarch 2024-02-21T22:51:42.498 INFO:teuthology.orchestra.run.smithi116.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-02-21T22:51:42.498 INFO:teuthology.orchestra.run.smithi116.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-02-21T22:51:42.499 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-02-21T22:51:42.499 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-02-21T22:51:42.499 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-02-21T22:51:42.499 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-02-21T22:51:42.499 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-02-21T22:51:42.499 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-02-21T22:51:42.499 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-02-21T22:51:42.499 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-02-21T22:51:42.499 INFO:teuthology.orchestra.run.smithi116.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-02-21T22:51:42.499 INFO:teuthology.orchestra.run.smithi116.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-02-21T22:51:42.499 INFO:teuthology.orchestra.run.smithi116.stdout: python3-mako-1.1.4-6.el9.noarch 2024-02-21T22:51:42.499 INFO:teuthology.orchestra.run.smithi116.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-02-21T22:51:42.499 INFO:teuthology.orchestra.run.smithi116.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-02-21T22:51:42.499 INFO:teuthology.orchestra.run.smithi116.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-02-21T22:51:42.500 INFO:teuthology.orchestra.run.smithi116.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-02-21T22:51:42.500 INFO:teuthology.orchestra.run.smithi116.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-02-21T22:51:42.500 INFO:teuthology.orchestra.run.smithi116.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-02-21T22:51:42.500 INFO:teuthology.orchestra.run.smithi116.stdout: python3-packaging-20.9-5.el9.noarch 2024-02-21T22:51:42.500 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-02-21T22:51:42.500 INFO:teuthology.orchestra.run.smithi116.stdout: python3-ply-3.11-14.el9.noarch 2024-02-21T22:51:42.500 INFO:teuthology.orchestra.run.smithi116.stdout: python3-portend-3.1.0-2.el9.noarch 2024-02-21T22:51:42.500 INFO:teuthology.orchestra.run.smithi116.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-02-21T22:51:42.500 INFO:teuthology.orchestra.run.smithi116.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-02-21T22:51:42.500 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-02-21T22:51:42.500 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-02-21T22:51:42.500 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-02-21T22:51:42.500 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pycparser-2.20-6.el9.noarch 2024-02-21T22:51:42.501 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-02-21T22:51:42.501 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pytz-2021.1-5.el9.noarch 2024-02-21T22:51:42.501 INFO:teuthology.orchestra.run.smithi116.stdout: python3-rados-2:19.0.0-1643.g3bfc837d.el9.x86_64 2024-02-21T22:51:42.501 INFO:teuthology.orchestra.run.smithi116.stdout: python3-rbd-2:19.0.0-1643.g3bfc837d.el9.x86_64 2024-02-21T22:51:42.501 INFO:teuthology.orchestra.run.smithi116.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-02-21T22:51:42.501 INFO:teuthology.orchestra.run.smithi116.stdout: python3-requests-2.25.1-8.el9.noarch 2024-02-21T22:51:42.501 INFO:teuthology.orchestra.run.smithi116.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-02-21T22:51:42.501 INFO:teuthology.orchestra.run.smithi116.stdout: python3-rgw-2:19.0.0-1643.g3bfc837d.el9.x86_64 2024-02-21T22:51:42.501 INFO:teuthology.orchestra.run.smithi116.stdout: python3-routes-2.5.1-5.el9.noarch 2024-02-21T22:51:42.501 INFO:teuthology.orchestra.run.smithi116.stdout: python3-rsa-4.9-2.el9.noarch 2024-02-21T22:51:42.501 INFO:teuthology.orchestra.run.smithi116.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-02-21T22:51:42.501 INFO:teuthology.orchestra.run.smithi116.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-02-21T22:51:42.501 INFO:teuthology.orchestra.run.smithi116.stdout: python3-toml-0.10.2-6.el9.noarch 2024-02-21T22:51:42.502 INFO:teuthology.orchestra.run.smithi116.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-02-21T22:51:42.502 INFO:teuthology.orchestra.run.smithi116.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-02-21T22:51:42.502 INFO:teuthology.orchestra.run.smithi116.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-02-21T22:51:42.502 INFO:teuthology.orchestra.run.smithi116.stdout: python3-webob-1.8.7-6.el9.noarch 2024-02-21T22:51:42.502 INFO:teuthology.orchestra.run.smithi116.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-02-21T22:51:42.502 INFO:teuthology.orchestra.run.smithi116.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-02-21T22:51:42.502 INFO:teuthology.orchestra.run.smithi116.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-02-21T22:51:42.502 INFO:teuthology.orchestra.run.smithi116.stdout: qatlib-23.11.0-1.el9.x86_64 2024-02-21T22:51:42.502 INFO:teuthology.orchestra.run.smithi116.stdout: qatlib-service-23.11.0-1.el9.x86_64 2024-02-21T22:51:42.502 INFO:teuthology.orchestra.run.smithi116.stdout: qatzip-libs-1.1.2-2.el9.x86_64 2024-02-21T22:51:42.502 INFO:teuthology.orchestra.run.smithi116.stdout: rbd-fuse-2:19.0.0-1643.g3bfc837d.el9.x86_64 2024-02-21T22:51:42.502 INFO:teuthology.orchestra.run.smithi116.stdout: rbd-mirror-2:19.0.0-1643.g3bfc837d.el9.x86_64 2024-02-21T22:51:42.502 INFO:teuthology.orchestra.run.smithi116.stdout: rbd-nbd-2:19.0.0-1643.g3bfc837d.el9.x86_64 2024-02-21T22:51:42.503 INFO:teuthology.orchestra.run.smithi116.stdout: re2-1:20211101-3.el9.x86_64 2024-02-21T22:51:42.503 INFO:teuthology.orchestra.run.smithi116.stdout: socat-1.7.4.1-5.el9.x86_64 2024-02-21T22:51:42.503 INFO:teuthology.orchestra.run.smithi116.stdout: thrift-0.15.0-2.el9.x86_64 2024-02-21T22:51:42.503 INFO:teuthology.orchestra.run.smithi116.stdout: uuid-1.6.2-55.el9.x86_64 2024-02-21T22:51:42.503 INFO:teuthology.orchestra.run.smithi116.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-02-21T22:51:42.503 INFO:teuthology.orchestra.run.smithi116.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-02-21T22:51:42.503 INFO:teuthology.orchestra.run.smithi116.stdout: zlib-devel-1.2.11-40.el9.x86_64 2024-02-21T22:51:42.503 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-02-21T22:51:42.503 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2024-02-21T22:51:42.971 DEBUG:teuthology.parallel:result is None 2024-02-21T22:51:42.971 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3bfc837d7b45ce8e095d92fa9c342964cea5e95f 2024-02-21T22:51:43.120 DEBUG:teuthology.orchestra.run.smithi116:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-02-21T22:51:43.143 INFO:teuthology.orchestra.run.smithi116.stdout:19.0.0-1643.g3bfc837d.el9 2024-02-21T22:51:43.143 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-1643.g3bfc837d.el9 2024-02-21T22:51:43.144 INFO:teuthology.task.install:The correct ceph version 19.0.0-1643.g3bfc837d is installed. 2024-02-21T22:51:43.145 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3bfc837d7b45ce8e095d92fa9c342964cea5e95f 2024-02-21T22:51:43.289 DEBUG:teuthology.orchestra.run.smithi142:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-02-21T22:51:43.315 INFO:teuthology.orchestra.run.smithi142.stdout:19.0.0-1643.g3bfc837d.el9 2024-02-21T22:51:43.315 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-1643.g3bfc837d.el9 2024-02-21T22:51:43.316 INFO:teuthology.task.install:The correct ceph version 19.0.0-1643.g3bfc837d is installed. 2024-02-21T22:51:43.317 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-02-21T22:51:43.318 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-02-21T22:51:43.318 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-02-21T22:51:43.348 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-02-21T22:51:43.349 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-02-21T22:51:43.389 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-02-21T22:51:43.390 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-02-21T22:51:43.390 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd of=/usr/bin/daemon-helper 2024-02-21T22:51:43.417 DEBUG:teuthology.orchestra.run.smithi116:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-02-21T22:51:43.485 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-02-21T22:51:43.485 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/usr/bin/daemon-helper 2024-02-21T22:51:43.514 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-02-21T22:51:43.583 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-02-21T22:51:43.584 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-02-21T22:51:43.584 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd of=/usr/bin/adjust-ulimits 2024-02-21T22:51:43.610 DEBUG:teuthology.orchestra.run.smithi116:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-02-21T22:51:43.677 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-02-21T22:51:43.678 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/usr/bin/adjust-ulimits 2024-02-21T22:51:43.707 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-02-21T22:51:43.775 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-02-21T22:51:43.775 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-02-21T22:51:43.775 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd of=/usr/bin/stdin-killer 2024-02-21T22:51:43.802 DEBUG:teuthology.orchestra.run.smithi116:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-02-21T22:51:43.870 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-02-21T22:51:43.870 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/usr/bin/stdin-killer 2024-02-21T22:51:43.897 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-02-21T22:51:43.965 INFO:teuthology.run_tasks:Running task ceph... 2024-02-21T22:51:44.075 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-02-21T22:51:44.075 DEBUG:teuthology.orchestra.run.smithi116:> sudo chmod 777 /var/log/ceph 2024-02-21T22:51:44.078 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 777 /var/log/ceph 2024-02-21T22:51:44.105 INFO:tasks.ceph:Disabling ceph logrotate... 2024-02-21T22:51:44.105 DEBUG:teuthology.orchestra.run.smithi116:> sudo rm -f -- /etc/logrotate.d/ceph 2024-02-21T22:51:44.149 DEBUG:teuthology.orchestra.run.smithi142:> sudo rm -f -- /etc/logrotate.d/ceph 2024-02-21T22:51:44.175 INFO:tasks.ceph:Creating extra log directories... 2024-02-21T22:51:44.175 DEBUG:teuthology.orchestra.run.smithi116:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-02-21T22:51:44.216 DEBUG:teuthology.orchestra.run.smithi142:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-02-21T22:51:44.249 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-02-21T22:51:44.249 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-02-21T22:51:44.249 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-02-21T22:51:44.250 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-02-21T22:51:44.250 DEBUG:teuthology.orchestra.run.smithi116:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-02-21T22:51:44.296 DEBUG:teuthology.orchestra.run.smithi116:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-02-21T22:51:44.413 DEBUG:teuthology.orchestra.run.smithi116:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-02-21T22:51:44.442 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-02-21T22:51:44.442 DEBUG:teuthology.orchestra.run.smithi142:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-02-21T22:51:44.457 DEBUG:teuthology.orchestra.run.smithi142:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-02-21T22:51:44.576 DEBUG:teuthology.orchestra.run.smithi142:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-02-21T22:51:44.613 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-02-21T22:51:44.613 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-02-21T22:51:44.613 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/leonidus-2024-02-21_22:31:03-fs-wip-lusov-qdb-distro-default-smithi/7569994', 'branch': 'wip-lusov-qdb', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} subvol_versions/create_subvol_version_v1 tasks/xfstests-dev}', 'email': None, 'first_in_suite': False, 'job_id': '7569994', 'kernel': {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'leonidus-2024-02-21_22:31:03-fs-wip-lusov-qdb-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-lusov-qdb'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '3bfc837d7b45ce8e095d92fa9c342964cea5e95f'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '3bfc837d7b45ce8e095d92fa9c342964cea5e95f'}}, 'kclient': {'syntax': 'v2'}, 'subvolume_version': 1, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-lusov-qdb', 'sha1': '3bfc837d7b45ce8e095d92fa9c342964cea5e95f'}}, 'owner': 'scheduled_leonidus@teuthology', 'priority': 80, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 6562, 'sha1': '3bfc837d7b45ce8e095d92fa9c342964cea5e95f', 'sleep_before_teardown': 0, 'subset': '111/10000', 'suite': 'fs', 'suite_branch': 'wip-lusov-qdb', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_3bfc837d7b45ce8e095d92fa9c342964cea5e95f/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '3bfc837d7b45ce8e095d92fa9c342964cea5e95f', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi116.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKSYPdxFnYUkLRhg2JtiX1Zh5vfjR56FP+IfctDddmogYEscSQau+lo7M8WnEmFUldp0gBrzWER2oPOVT4f43bc=', 'smithi142.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAObk+c0UTDo0O7FrphxqiW/noBoV3ao4Z+yYnKrmwK36r+iZ9qGOrFRurPgUxgH1MK7gk7y6SlrFCFjeovIrYc='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '3bfc837d7b45ce8e095d92fa9c342964cea5e95f'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '3bfc837d7b45ce8e095d92fa9c342964cea5e95f', 'cluster': 'ceph'}}, {'kclient': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.tests_from_xfstests_dev']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': 'b1dac5519c57c269ea98a22fb7729016a1d0e4d2', 'timestamp': '2024-02-21_22:31:03', 'tube': 'smithi', 'user': 'leonidus', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-02-21T22:51:44.614 DEBUG:teuthology.orchestra.run.smithi116:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-02-21T22:51:44.616 DEBUG:teuthology.orchestra.run.smithi142:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-02-21T22:51:44.659 DEBUG:teuthology.orchestra.run.smithi116:> sudo install -d -m0777 -- /var/run/ceph 2024-02-21T22:51:44.672 DEBUG:teuthology.orchestra.run.smithi142:> sudo install -d -m0777 -- /var/run/ceph 2024-02-21T22:51:44.727 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-02-21T22:51:44.727 DEBUG:teuthology.orchestra.run.smithi116:> dd if=/scratch_devs of=/dev/stdout 2024-02-21T22:51:44.753 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-02-21T22:51:44.753 DEBUG:teuthology.orchestra.run.smithi116:> stat /dev/vg_nvme/lv_1 2024-02-21T22:51:44.807 INFO:teuthology.orchestra.run.smithi116.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-02-21T22:51:44.807 INFO:teuthology.orchestra.run.smithi116.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-21T22:51:44.807 INFO:teuthology.orchestra.run.smithi116.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-02-21T22:51:44.808 INFO:teuthology.orchestra.run.smithi116.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-21T22:51:44.808 INFO:teuthology.orchestra.run.smithi116.stdout:Context: system_u:object_r:device_t:s0 2024-02-21T22:51:44.808 INFO:teuthology.orchestra.run.smithi116.stdout:Access: 2024-02-21 22:51:35.080685255 +0000 2024-02-21T22:51:44.808 INFO:teuthology.orchestra.run.smithi116.stdout:Modify: 2024-02-21 22:48:34.418023824 +0000 2024-02-21T22:51:44.808 INFO:teuthology.orchestra.run.smithi116.stdout:Change: 2024-02-21 22:48:34.418023824 +0000 2024-02-21T22:51:44.808 INFO:teuthology.orchestra.run.smithi116.stdout: Birth: 2024-02-21 22:48:34.418023824 +0000 2024-02-21T22:51:44.808 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-02-21T22:51:44.873 INFO:teuthology.orchestra.run.smithi116.stderr:1+0 records in 2024-02-21T22:51:44.873 INFO:teuthology.orchestra.run.smithi116.stderr:1+0 records out 2024-02-21T22:51:44.873 INFO:teuthology.orchestra.run.smithi116.stderr:512 bytes copied, 0.000256042 s, 2.0 MB/s 2024-02-21T22:51:44.874 DEBUG:teuthology.orchestra.run.smithi116:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-02-21T22:51:44.931 DEBUG:teuthology.orchestra.run.smithi116:> stat /dev/vg_nvme/lv_2 2024-02-21T22:51:44.986 INFO:teuthology.orchestra.run.smithi116.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-02-21T22:51:44.986 INFO:teuthology.orchestra.run.smithi116.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-21T22:51:44.986 INFO:teuthology.orchestra.run.smithi116.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-02-21T22:51:44.986 INFO:teuthology.orchestra.run.smithi116.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-21T22:51:44.987 INFO:teuthology.orchestra.run.smithi116.stdout:Context: system_u:object_r:device_t:s0 2024-02-21T22:51:44.987 INFO:teuthology.orchestra.run.smithi116.stdout:Access: 2024-02-21 22:51:35.081685239 +0000 2024-02-21T22:51:44.987 INFO:teuthology.orchestra.run.smithi116.stdout:Modify: 2024-02-21 22:48:34.770018165 +0000 2024-02-21T22:51:44.987 INFO:teuthology.orchestra.run.smithi116.stdout:Change: 2024-02-21 22:48:34.770018165 +0000 2024-02-21T22:51:44.987 INFO:teuthology.orchestra.run.smithi116.stdout: Birth: 2024-02-21 22:48:34.770018165 +0000 2024-02-21T22:51:44.987 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-02-21T22:51:45.052 INFO:teuthology.orchestra.run.smithi116.stderr:1+0 records in 2024-02-21T22:51:45.052 INFO:teuthology.orchestra.run.smithi116.stderr:1+0 records out 2024-02-21T22:51:45.052 INFO:teuthology.orchestra.run.smithi116.stderr:512 bytes copied, 0.00023612 s, 2.2 MB/s 2024-02-21T22:51:45.053 DEBUG:teuthology.orchestra.run.smithi116:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-02-21T22:51:45.110 DEBUG:teuthology.orchestra.run.smithi116:> stat /dev/vg_nvme/lv_3 2024-02-21T22:51:45.164 INFO:teuthology.orchestra.run.smithi116.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-02-21T22:51:45.164 INFO:teuthology.orchestra.run.smithi116.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-21T22:51:45.164 INFO:teuthology.orchestra.run.smithi116.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-02-21T22:51:45.164 INFO:teuthology.orchestra.run.smithi116.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-21T22:51:45.165 INFO:teuthology.orchestra.run.smithi116.stdout:Context: system_u:object_r:device_t:s0 2024-02-21T22:51:45.165 INFO:teuthology.orchestra.run.smithi116.stdout:Access: 2024-02-21 22:51:35.081685239 +0000 2024-02-21T22:51:45.165 INFO:teuthology.orchestra.run.smithi116.stdout:Modify: 2024-02-21 22:48:35.119012555 +0000 2024-02-21T22:51:45.165 INFO:teuthology.orchestra.run.smithi116.stdout:Change: 2024-02-21 22:48:35.119012555 +0000 2024-02-21T22:51:45.165 INFO:teuthology.orchestra.run.smithi116.stdout: Birth: 2024-02-21 22:48:35.119012555 +0000 2024-02-21T22:51:45.165 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-02-21T22:51:45.230 INFO:teuthology.orchestra.run.smithi116.stderr:1+0 records in 2024-02-21T22:51:45.230 INFO:teuthology.orchestra.run.smithi116.stderr:1+0 records out 2024-02-21T22:51:45.230 INFO:teuthology.orchestra.run.smithi116.stderr:512 bytes copied, 0.000199328 s, 2.6 MB/s 2024-02-21T22:51:45.231 DEBUG:teuthology.orchestra.run.smithi116:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-02-21T22:51:45.287 DEBUG:teuthology.orchestra.run.smithi116:> stat /dev/vg_nvme/lv_4 2024-02-21T22:51:45.341 INFO:teuthology.orchestra.run.smithi116.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-02-21T22:51:45.341 INFO:teuthology.orchestra.run.smithi116.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-21T22:51:45.341 INFO:teuthology.orchestra.run.smithi116.stdout:Device: 5h/5d Inode: 725 Links: 1 2024-02-21T22:51:45.342 INFO:teuthology.orchestra.run.smithi116.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-21T22:51:45.342 INFO:teuthology.orchestra.run.smithi116.stdout:Context: system_u:object_r:device_t:s0 2024-02-21T22:51:45.342 INFO:teuthology.orchestra.run.smithi116.stdout:Access: 2024-02-21 22:51:35.082685224 +0000 2024-02-21T22:51:45.342 INFO:teuthology.orchestra.run.smithi116.stdout:Modify: 2024-02-21 22:48:35.449007250 +0000 2024-02-21T22:51:45.342 INFO:teuthology.orchestra.run.smithi116.stdout:Change: 2024-02-21 22:48:35.449007250 +0000 2024-02-21T22:51:45.342 INFO:teuthology.orchestra.run.smithi116.stdout: Birth: 2024-02-21 22:48:35.449007250 +0000 2024-02-21T22:51:45.342 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-02-21T22:51:45.407 INFO:teuthology.orchestra.run.smithi116.stderr:1+0 records in 2024-02-21T22:51:45.407 INFO:teuthology.orchestra.run.smithi116.stderr:1+0 records out 2024-02-21T22:51:45.407 INFO:teuthology.orchestra.run.smithi116.stderr:512 bytes copied, 0.000182939 s, 2.8 MB/s 2024-02-21T22:51:45.408 DEBUG:teuthology.orchestra.run.smithi116:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-02-21T22:51:45.464 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-02-21T22:51:45.464 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-02-21T22:51:45.464 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/scratch_devs of=/dev/stdout 2024-02-21T22:51:45.483 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-02-21T22:51:45.483 DEBUG:teuthology.orchestra.run.smithi142:> stat /dev/vg_nvme/lv_1 2024-02-21T22:51:45.539 INFO:teuthology.orchestra.run.smithi142.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-02-21T22:51:45.540 INFO:teuthology.orchestra.run.smithi142.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-21T22:51:45.540 INFO:teuthology.orchestra.run.smithi142.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-02-21T22:51:45.540 INFO:teuthology.orchestra.run.smithi142.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-21T22:51:45.540 INFO:teuthology.orchestra.run.smithi142.stdout:Context: system_u:object_r:device_t:s0 2024-02-21T22:51:45.540 INFO:teuthology.orchestra.run.smithi142.stdout:Access: 2024-02-21 22:51:28.563794585 +0000 2024-02-21T22:51:45.540 INFO:teuthology.orchestra.run.smithi142.stdout:Modify: 2024-02-21 22:46:59.944762764 +0000 2024-02-21T22:51:45.540 INFO:teuthology.orchestra.run.smithi142.stdout:Change: 2024-02-21 22:46:59.944762764 +0000 2024-02-21T22:51:45.540 INFO:teuthology.orchestra.run.smithi142.stdout: Birth: 2024-02-21 22:46:59.944762764 +0000 2024-02-21T22:51:45.540 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-02-21T22:51:45.607 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records in 2024-02-21T22:51:45.608 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records out 2024-02-21T22:51:45.608 INFO:teuthology.orchestra.run.smithi142.stderr:512 bytes copied, 0.000217592 s, 2.4 MB/s 2024-02-21T22:51:45.609 DEBUG:teuthology.orchestra.run.smithi142:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-02-21T22:51:45.666 DEBUG:teuthology.orchestra.run.smithi142:> stat /dev/vg_nvme/lv_2 2024-02-21T22:51:45.723 INFO:teuthology.orchestra.run.smithi142.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-02-21T22:51:45.723 INFO:teuthology.orchestra.run.smithi142.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-21T22:51:45.723 INFO:teuthology.orchestra.run.smithi142.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-02-21T22:51:45.723 INFO:teuthology.orchestra.run.smithi142.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-21T22:51:45.723 INFO:teuthology.orchestra.run.smithi142.stdout:Context: system_u:object_r:device_t:s0 2024-02-21T22:51:45.723 INFO:teuthology.orchestra.run.smithi142.stdout:Access: 2024-02-21 22:51:28.564794567 +0000 2024-02-21T22:51:45.723 INFO:teuthology.orchestra.run.smithi142.stdout:Modify: 2024-02-21 22:47:00.298756139 +0000 2024-02-21T22:51:45.724 INFO:teuthology.orchestra.run.smithi142.stdout:Change: 2024-02-21 22:47:00.298756139 +0000 2024-02-21T22:51:45.724 INFO:teuthology.orchestra.run.smithi142.stdout: Birth: 2024-02-21 22:47:00.298756139 +0000 2024-02-21T22:51:45.724 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-02-21T22:51:45.790 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records in 2024-02-21T22:51:45.790 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records out 2024-02-21T22:51:45.790 INFO:teuthology.orchestra.run.smithi142.stderr:512 bytes copied, 0.000211112 s, 2.4 MB/s 2024-02-21T22:51:45.792 DEBUG:teuthology.orchestra.run.smithi142:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-02-21T22:51:45.848 DEBUG:teuthology.orchestra.run.smithi142:> stat /dev/vg_nvme/lv_3 2024-02-21T22:51:45.904 INFO:teuthology.orchestra.run.smithi142.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-02-21T22:51:45.904 INFO:teuthology.orchestra.run.smithi142.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-21T22:51:45.905 INFO:teuthology.orchestra.run.smithi142.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-02-21T22:51:45.905 INFO:teuthology.orchestra.run.smithi142.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-21T22:51:45.905 INFO:teuthology.orchestra.run.smithi142.stdout:Context: system_u:object_r:device_t:s0 2024-02-21T22:51:45.905 INFO:teuthology.orchestra.run.smithi142.stdout:Access: 2024-02-21 22:51:28.564794567 +0000 2024-02-21T22:51:45.905 INFO:teuthology.orchestra.run.smithi142.stdout:Modify: 2024-02-21 22:47:00.955743842 +0000 2024-02-21T22:51:45.905 INFO:teuthology.orchestra.run.smithi142.stdout:Change: 2024-02-21 22:47:00.955743842 +0000 2024-02-21T22:51:45.905 INFO:teuthology.orchestra.run.smithi142.stdout: Birth: 2024-02-21 22:47:00.955743842 +0000 2024-02-21T22:51:45.905 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-02-21T22:51:45.970 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records in 2024-02-21T22:51:45.971 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records out 2024-02-21T22:51:45.971 INFO:teuthology.orchestra.run.smithi142.stderr:512 bytes copied, 0.000172414 s, 3.0 MB/s 2024-02-21T22:51:45.972 DEBUG:teuthology.orchestra.run.smithi142:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-02-21T22:51:46.028 DEBUG:teuthology.orchestra.run.smithi142:> stat /dev/vg_nvme/lv_4 2024-02-21T22:51:46.085 INFO:teuthology.orchestra.run.smithi142.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-02-21T22:51:46.086 INFO:teuthology.orchestra.run.smithi142.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-21T22:51:46.086 INFO:teuthology.orchestra.run.smithi142.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-02-21T22:51:46.086 INFO:teuthology.orchestra.run.smithi142.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-21T22:51:46.086 INFO:teuthology.orchestra.run.smithi142.stdout:Context: system_u:object_r:device_t:s0 2024-02-21T22:51:46.086 INFO:teuthology.orchestra.run.smithi142.stdout:Access: 2024-02-21 22:51:28.564794567 +0000 2024-02-21T22:51:46.086 INFO:teuthology.orchestra.run.smithi142.stdout:Modify: 2024-02-21 22:47:01.305737291 +0000 2024-02-21T22:51:46.086 INFO:teuthology.orchestra.run.smithi142.stdout:Change: 2024-02-21 22:47:01.305737291 +0000 2024-02-21T22:51:46.086 INFO:teuthology.orchestra.run.smithi142.stdout: Birth: 2024-02-21 22:47:01.305737291 +0000 2024-02-21T22:51:46.087 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-02-21T22:51:46.151 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records in 2024-02-21T22:51:46.151 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records out 2024-02-21T22:51:46.151 INFO:teuthology.orchestra.run.smithi142.stderr:512 bytes copied, 0.000203137 s, 2.5 MB/s 2024-02-21T22:51:46.153 DEBUG:teuthology.orchestra.run.smithi142:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-02-21T22:51:46.208 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-02-21T22:51:46.208 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi116.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi142.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-02-21T22:51:46.208 INFO:tasks.ceph:Generating config... 2024-02-21T22:51:46.210 INFO:tasks.ceph:[client] client mount timeout = 600 2024-02-21T22:51:46.210 INFO:tasks.ceph:[client] debug client = 20 2024-02-21T22:51:46.210 INFO:tasks.ceph:[client] debug ms = 1 2024-02-21T22:51:46.210 INFO:tasks.ceph:[client] pid file = 2024-02-21T22:51:46.210 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-02-21T22:51:46.210 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-02-21T22:51:46.210 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-02-21T22:51:46.210 INFO:tasks.ceph:[mds] debug mds = 20 2024-02-21T22:51:46.210 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-02-21T22:51:46.210 INFO:tasks.ceph:[mds] debug ms = 1 2024-02-21T22:51:46.210 INFO:tasks.ceph:[mds] mds debug frag = True 2024-02-21T22:51:46.211 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-02-21T22:51:46.211 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-02-21T22:51:46.211 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-02-21T22:51:46.211 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-02-21T22:51:46.211 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-02-21T22:51:46.211 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-02-21T22:51:46.211 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-02-21T22:51:46.211 INFO:tasks.ceph:[mgr] debug ms = 1 2024-02-21T22:51:46.211 INFO:tasks.ceph:[mon] debug mon = 20 2024-02-21T22:51:46.211 INFO:tasks.ceph:[mon] debug ms = 1 2024-02-21T22:51:46.211 INFO:tasks.ceph:[mon] debug paxos = 20 2024-02-21T22:51:46.211 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-02-21T22:51:46.211 INFO:tasks.ceph:[osd] bdev async discard = True 2024-02-21T22:51:46.211 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-02-21T22:51:46.211 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-02-21T22:51:46.212 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-02-21T22:51:46.212 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-02-21T22:51:46.212 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-02-21T22:51:46.212 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-02-21T22:51:46.212 INFO:tasks.ceph:[osd] debug ms = 1 2024-02-21T22:51:46.212 INFO:tasks.ceph:[osd] debug osd = 20 2024-02-21T22:51:46.212 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-02-21T22:51:46.212 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-02-21T22:51:46.212 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-02-21T22:51:46.212 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-02-21T22:51:46.212 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-02-21T22:51:46.212 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-02-21T22:51:46.212 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-02-21T22:51:46.213 INFO:tasks.ceph:Setting up mon.a... 2024-02-21T22:51:46.213 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-02-21T22:51:46.261 INFO:teuthology.orchestra.run.smithi116.stdout:creating /etc/ceph/ceph.keyring 2024-02-21T22:51:46.264 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-02-21T22:51:46.309 DEBUG:teuthology.orchestra.run.smithi116:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-02-21T22:51:46.336 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.116'), ('mon.b', '172.21.15.142'), ('mon.c', '[v2:172.21.15.142:3301,v1:172.21.15.142:6790]')] 2024-02-21T22:51:46.337 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.116,172.21.15.142,[v2:172.21.15.142:3301,v1:172.21.15.142:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-02-21T22:51:46.338 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-02-21T22:51:46.338 DEBUG:teuthology.orchestra.run.smithi116:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-02-21T22:51:46.391 DEBUG:teuthology.orchestra.run.smithi116:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.116 --add b 172.21.15.142 --addv c '[v2:172.21.15.142:3301,v1:172.21.15.142:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-02-21T22:51:46.479 INFO:teuthology.orchestra.run.smithi116.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-02-21T22:51:46.479 INFO:teuthology.orchestra.run.smithi116.stdout:monmaptool: generated fsid 7c298660-5f63-4b5c-a800-58c5be9a8445 2024-02-21T22:51:46.479 INFO:teuthology.orchestra.run.smithi116.stdout:setting min_mon_release = quincy 2024-02-21T22:51:46.479 INFO:teuthology.orchestra.run.smithi116.stdout:epoch 0 2024-02-21T22:51:46.479 INFO:teuthology.orchestra.run.smithi116.stdout:fsid 7c298660-5f63-4b5c-a800-58c5be9a8445 2024-02-21T22:51:46.479 INFO:teuthology.orchestra.run.smithi116.stdout:last_changed 2024-02-21T22:51:46.486810+0000 2024-02-21T22:51:46.479 INFO:teuthology.orchestra.run.smithi116.stdout:created 2024-02-21T22:51:46.486810+0000 2024-02-21T22:51:46.479 INFO:teuthology.orchestra.run.smithi116.stdout:min_mon_release 17 (quincy) 2024-02-21T22:51:46.479 INFO:teuthology.orchestra.run.smithi116.stdout:election_strategy: 1 2024-02-21T22:51:46.480 INFO:teuthology.orchestra.run.smithi116.stdout:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-02-21T22:51:46.480 INFO:teuthology.orchestra.run.smithi116.stdout:1: [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] mon.b 2024-02-21T22:51:46.480 INFO:teuthology.orchestra.run.smithi116.stdout:2: [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] mon.c 2024-02-21T22:51:46.480 INFO:teuthology.orchestra.run.smithi116.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-02-21T22:51:46.484 DEBUG:teuthology.orchestra.run.smithi116:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-02-21T22:51:46.499 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 7c298660-5f63-4b5c-a800-58c5be9a8445... 2024-02-21T22:51:46.500 DEBUG:teuthology.orchestra.run.smithi116:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-02-21T22:51:46.542 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-02-21T22:51:46.590 INFO:teuthology.orchestra.run.smithi116.stdout:[global] 2024-02-21T22:51:46.590 INFO:teuthology.orchestra.run.smithi116.stdout: chdir = "" 2024-02-21T22:51:46.590 INFO:teuthology.orchestra.run.smithi116.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-02-21T22:51:46.590 INFO:teuthology.orchestra.run.smithi116.stdout: auth supported = cephx 2024-02-21T22:51:46.590 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-02-21T22:51:46.590 INFO:teuthology.orchestra.run.smithi116.stdout: filestore xattr use omap = true 2024-02-21T22:51:46.590 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-02-21T22:51:46.590 INFO:teuthology.orchestra.run.smithi116.stdout: mon clock drift allowed = 1.000 2024-02-21T22:51:46.590 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-02-21T22:51:46.590 INFO:teuthology.orchestra.run.smithi116.stdout: osd crush chooseleaf type = 0 2024-02-21T22:51:46.591 INFO:teuthology.orchestra.run.smithi116.stdout: auth debug = true 2024-02-21T22:51:46.591 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-02-21T22:51:46.591 INFO:teuthology.orchestra.run.smithi116.stdout: ms die on old message = true 2024-02-21T22:51:46.591 INFO:teuthology.orchestra.run.smithi116.stdout: ms die on bug = true 2024-02-21T22:51:46.591 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-02-21T22:51:46.591 INFO:teuthology.orchestra.run.smithi116.stdout: mon max pg per osd = 10000 # >= luminous 2024-02-21T22:51:46.591 INFO:teuthology.orchestra.run.smithi116.stdout: mon pg warn max object skew = 0 2024-02-21T22:51:46.591 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-02-21T22:51:46.591 INFO:teuthology.orchestra.run.smithi116.stdout: # disable pg_autoscaler by default for new pools 2024-02-21T22:51:46.591 INFO:teuthology.orchestra.run.smithi116.stdout: osd_pool_default_pg_autoscale_mode = off 2024-02-21T22:51:46.591 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-02-21T22:51:46.591 INFO:teuthology.orchestra.run.smithi116.stdout: osd pool default size = 2 2024-02-21T22:51:46.591 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-02-21T22:51:46.592 INFO:teuthology.orchestra.run.smithi116.stdout: mon osd allow primary affinity = true 2024-02-21T22:51:46.592 INFO:teuthology.orchestra.run.smithi116.stdout: mon osd allow pg remap = true 2024-02-21T22:51:46.592 INFO:teuthology.orchestra.run.smithi116.stdout: mon warn on legacy crush tunables = false 2024-02-21T22:51:46.592 INFO:teuthology.orchestra.run.smithi116.stdout: mon warn on crush straw calc version zero = false 2024-02-21T22:51:46.592 INFO:teuthology.orchestra.run.smithi116.stdout: mon warn on no sortbitwise = false 2024-02-21T22:51:46.592 INFO:teuthology.orchestra.run.smithi116.stdout: mon warn on osd down out interval zero = false 2024-02-21T22:51:46.592 INFO:teuthology.orchestra.run.smithi116.stdout: mon warn on too few osds = false 2024-02-21T22:51:46.592 INFO:teuthology.orchestra.run.smithi116.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-02-21T22:51:46.592 INFO:teuthology.orchestra.run.smithi116.stdout: mon_warn_on_pool_no_redundancy = false 2024-02-21T22:51:46.592 INFO:teuthology.orchestra.run.smithi116.stdout: mon_allow_pool_size_one = true 2024-02-21T22:51:46.592 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-02-21T22:51:46.592 INFO:teuthology.orchestra.run.smithi116.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-02-21T22:51:46.592 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-02-21T22:51:46.593 INFO:teuthology.orchestra.run.smithi116.stdout: osd default data pool replay window = 5 2024-02-21T22:51:46.593 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-02-21T22:51:46.593 INFO:teuthology.orchestra.run.smithi116.stdout: mon allow pool delete = true 2024-02-21T22:51:46.593 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-02-21T22:51:46.593 INFO:teuthology.orchestra.run.smithi116.stdout: mon cluster log file level = debug 2024-02-21T22:51:46.593 INFO:teuthology.orchestra.run.smithi116.stdout: debug asserts on shutdown = true 2024-02-21T22:51:46.593 INFO:teuthology.orchestra.run.smithi116.stdout: mon health detail to clog = false 2024-02-21T22:51:46.593 INFO:teuthology.orchestra.run.smithi116.stdout: mon host = "172.21.15.116,172.21.15.142,[v2:172.21.15.142:3301,v1:172.21.15.142:6790]" 2024-02-21T22:51:46.593 INFO:teuthology.orchestra.run.smithi116.stdout: ms die on skipped message = False 2024-02-21T22:51:46.593 INFO:teuthology.orchestra.run.smithi116.stdout: fsid = 7c298660-5f63-4b5c-a800-58c5be9a8445 2024-02-21T22:51:46.593 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-02-21T22:51:46.593 INFO:teuthology.orchestra.run.smithi116.stdout:[osd] 2024-02-21T22:51:46.593 INFO:teuthology.orchestra.run.smithi116.stdout: osd journal size = 100 2024-02-21T22:51:46.594 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-02-21T22:51:46.594 INFO:teuthology.orchestra.run.smithi116.stdout: osd scrub load threshold = 5.0 2024-02-21T22:51:46.594 INFO:teuthology.orchestra.run.smithi116.stdout: osd scrub max interval = 600 2024-02-21T22:51:46.594 INFO:teuthology.orchestra.run.smithi116.stdout: osd mclock profile = high_recovery_ops 2024-02-21T22:51:46.594 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-02-21T22:51:46.594 INFO:teuthology.orchestra.run.smithi116.stdout: osd recover clone overlap = true 2024-02-21T22:51:46.594 INFO:teuthology.orchestra.run.smithi116.stdout: osd recovery max chunk = 1048576 2024-02-21T22:51:46.594 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-02-21T22:51:46.594 INFO:teuthology.orchestra.run.smithi116.stdout: osd debug shutdown = true 2024-02-21T22:51:46.594 INFO:teuthology.orchestra.run.smithi116.stdout: osd debug op order = true 2024-02-21T22:51:46.594 INFO:teuthology.orchestra.run.smithi116.stdout: osd debug verify stray on activate = true 2024-02-21T22:51:46.594 INFO:teuthology.orchestra.run.smithi116.stdout: osd debug trim objects = true 2024-02-21T22:51:46.594 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-02-21T22:51:46.595 INFO:teuthology.orchestra.run.smithi116.stdout: osd open classes on start = true 2024-02-21T22:51:46.595 INFO:teuthology.orchestra.run.smithi116.stdout: osd debug pg log writeout = true 2024-02-21T22:51:46.595 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-02-21T22:51:46.595 INFO:teuthology.orchestra.run.smithi116.stdout: osd deep scrub update digest min age = 30 2024-02-21T22:51:46.595 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-02-21T22:51:46.595 INFO:teuthology.orchestra.run.smithi116.stdout: osd map max advance = 10 2024-02-21T22:51:46.595 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-02-21T22:51:46.595 INFO:teuthology.orchestra.run.smithi116.stdout: journal zero on create = true 2024-02-21T22:51:46.595 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-02-21T22:51:46.595 INFO:teuthology.orchestra.run.smithi116.stdout: filestore ondisk finisher threads = 3 2024-02-21T22:51:46.595 INFO:teuthology.orchestra.run.smithi116.stdout: filestore apply finisher threads = 3 2024-02-21T22:51:46.595 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-02-21T22:51:46.595 INFO:teuthology.orchestra.run.smithi116.stdout: bdev debug aio = true 2024-02-21T22:51:46.596 INFO:teuthology.orchestra.run.smithi116.stdout: osd debug misdirected ops = true 2024-02-21T22:51:46.596 INFO:teuthology.orchestra.run.smithi116.stdout: bdev async discard = True 2024-02-21T22:51:46.596 INFO:teuthology.orchestra.run.smithi116.stdout: bdev enable discard = True 2024-02-21T22:51:46.596 INFO:teuthology.orchestra.run.smithi116.stdout: bluestore allocator = bitmap 2024-02-21T22:51:46.596 INFO:teuthology.orchestra.run.smithi116.stdout: bluestore block size = 96636764160 2024-02-21T22:51:46.596 INFO:teuthology.orchestra.run.smithi116.stdout: bluestore fsck on mount = True 2024-02-21T22:51:46.596 INFO:teuthology.orchestra.run.smithi116.stdout: debug bluefs = 1/20 2024-02-21T22:51:46.596 INFO:teuthology.orchestra.run.smithi116.stdout: debug bluestore = 1/20 2024-02-21T22:51:46.596 INFO:teuthology.orchestra.run.smithi116.stdout: debug ms = 1 2024-02-21T22:51:46.596 INFO:teuthology.orchestra.run.smithi116.stdout: debug osd = 20 2024-02-21T22:51:46.596 INFO:teuthology.orchestra.run.smithi116.stdout: debug rocksdb = 4/10 2024-02-21T22:51:46.596 INFO:teuthology.orchestra.run.smithi116.stdout: mon osd backfillfull_ratio = 0.85 2024-02-21T22:51:46.597 INFO:teuthology.orchestra.run.smithi116.stdout: mon osd full ratio = 0.9 2024-02-21T22:51:46.597 INFO:teuthology.orchestra.run.smithi116.stdout: mon osd nearfull ratio = 0.8 2024-02-21T22:51:46.597 INFO:teuthology.orchestra.run.smithi116.stdout: osd failsafe full ratio = 0.95 2024-02-21T22:51:46.597 INFO:teuthology.orchestra.run.smithi116.stdout: osd objectstore = bluestore 2024-02-21T22:51:46.597 INFO:teuthology.orchestra.run.smithi116.stdout: osd op complaint time = 180 2024-02-21T22:51:46.597 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-02-21T22:51:46.597 INFO:teuthology.orchestra.run.smithi116.stdout:[mgr] 2024-02-21T22:51:46.597 INFO:teuthology.orchestra.run.smithi116.stdout: debug ms = 1 2024-02-21T22:51:46.597 INFO:teuthology.orchestra.run.smithi116.stdout: debug mgr = 20 2024-02-21T22:51:46.597 INFO:teuthology.orchestra.run.smithi116.stdout: debug mon = 20 2024-02-21T22:51:46.597 INFO:teuthology.orchestra.run.smithi116.stdout: debug auth = 20 2024-02-21T22:51:46.597 INFO:teuthology.orchestra.run.smithi116.stdout: mon reweight min pgs per osd = 4 2024-02-21T22:51:46.597 INFO:teuthology.orchestra.run.smithi116.stdout: mon reweight min bytes per osd = 10 2024-02-21T22:51:46.598 INFO:teuthology.orchestra.run.smithi116.stdout: mgr/telemetry/nag = false 2024-02-21T22:51:46.598 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-02-21T22:51:46.598 INFO:teuthology.orchestra.run.smithi116.stdout:[mon] 2024-02-21T22:51:46.598 INFO:teuthology.orchestra.run.smithi116.stdout: debug ms = 1 2024-02-21T22:51:46.598 INFO:teuthology.orchestra.run.smithi116.stdout: debug mon = 20 2024-02-21T22:51:46.598 INFO:teuthology.orchestra.run.smithi116.stdout: debug paxos = 20 2024-02-21T22:51:46.598 INFO:teuthology.orchestra.run.smithi116.stdout: debug auth = 20 2024-02-21T22:51:46.598 INFO:teuthology.orchestra.run.smithi116.stdout: mon data avail warn = 5 2024-02-21T22:51:46.598 INFO:teuthology.orchestra.run.smithi116.stdout: mon mgr mkfs grace = 240 2024-02-21T22:51:46.598 INFO:teuthology.orchestra.run.smithi116.stdout: mon reweight min pgs per osd = 4 2024-02-21T22:51:46.598 INFO:teuthology.orchestra.run.smithi116.stdout: mon osd reporter subtree level = osd 2024-02-21T22:51:46.598 INFO:teuthology.orchestra.run.smithi116.stdout: mon osd prime pg temp = true 2024-02-21T22:51:46.598 INFO:teuthology.orchestra.run.smithi116.stdout: mon reweight min bytes per osd = 10 2024-02-21T22:51:46.599 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-02-21T22:51:46.599 INFO:teuthology.orchestra.run.smithi116.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-02-21T22:51:46.599 INFO:teuthology.orchestra.run.smithi116.stdout: auth mon ticket ttl = 660 # 11m 2024-02-21T22:51:46.599 INFO:teuthology.orchestra.run.smithi116.stdout: auth service ticket ttl = 240 # 4m 2024-02-21T22:51:46.599 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-02-21T22:51:46.599 INFO:teuthology.orchestra.run.smithi116.stdout: # don't complain about insecure global_id in the test suite 2024-02-21T22:51:46.599 INFO:teuthology.orchestra.run.smithi116.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-02-21T22:51:46.599 INFO:teuthology.orchestra.run.smithi116.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-02-21T22:51:46.599 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-02-21T22:51:46.599 INFO:teuthology.orchestra.run.smithi116.stdout: # 1m isn't quite enough 2024-02-21T22:51:46.599 INFO:teuthology.orchestra.run.smithi116.stdout: mon_down_mkfs_grace = 2m 2024-02-21T22:51:46.599 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-02-21T22:51:46.599 INFO:teuthology.orchestra.run.smithi116.stdout: mon_warn_on_filestore_osds = false 2024-02-21T22:51:46.599 INFO:teuthology.orchestra.run.smithi116.stdout: mon op complaint time = 120 2024-02-21T22:51:46.600 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-02-21T22:51:46.600 INFO:teuthology.orchestra.run.smithi116.stdout:[client] 2024-02-21T22:51:46.600 INFO:teuthology.orchestra.run.smithi116.stdout: rgw cache enabled = true 2024-02-21T22:51:46.600 INFO:teuthology.orchestra.run.smithi116.stdout: rgw enable ops log = true 2024-02-21T22:51:46.600 INFO:teuthology.orchestra.run.smithi116.stdout: rgw enable usage log = true 2024-02-21T22:51:46.600 INFO:teuthology.orchestra.run.smithi116.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-02-21T22:51:46.600 INFO:teuthology.orchestra.run.smithi116.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-02-21T22:51:46.600 INFO:teuthology.orchestra.run.smithi116.stdout: client mount timeout = 600 2024-02-21T22:51:46.600 INFO:teuthology.orchestra.run.smithi116.stdout: debug client = 20 2024-02-21T22:51:46.600 INFO:teuthology.orchestra.run.smithi116.stdout: debug ms = 1 2024-02-21T22:51:46.600 INFO:teuthology.orchestra.run.smithi116.stdout: pid file = "" 2024-02-21T22:51:46.600 INFO:teuthology.orchestra.run.smithi116.stdout: rados mon op timeout = 900 2024-02-21T22:51:46.601 INFO:teuthology.orchestra.run.smithi116.stdout: rados osd op timeout = 900 2024-02-21T22:51:46.601 INFO:teuthology.orchestra.run.smithi116.stdout:[mon.a] 2024-02-21T22:51:46.601 INFO:teuthology.orchestra.run.smithi116.stdout:[mon.b] 2024-02-21T22:51:46.601 INFO:teuthology.orchestra.run.smithi116.stdout:[mon.c] 2024-02-21T22:51:46.601 INFO:teuthology.orchestra.run.smithi116.stdout:[mds.a] 2024-02-21T22:51:46.601 INFO:teuthology.orchestra.run.smithi116.stdout:[mds.c] 2024-02-21T22:51:46.601 INFO:teuthology.orchestra.run.smithi116.stdout:[mds.b] 2024-02-21T22:51:46.601 INFO:teuthology.orchestra.run.smithi116.stdout:[mds.d] 2024-02-21T22:51:46.601 INFO:teuthology.orchestra.run.smithi116.stdout:[mds] 2024-02-21T22:51:46.601 INFO:teuthology.orchestra.run.smithi116.stdout: debug mds = 20 2024-02-21T22:51:46.601 INFO:teuthology.orchestra.run.smithi116.stdout: debug mds balancer = 20 2024-02-21T22:51:46.601 INFO:teuthology.orchestra.run.smithi116.stdout: debug ms = 1 2024-02-21T22:51:46.601 INFO:teuthology.orchestra.run.smithi116.stdout: mds debug frag = True 2024-02-21T22:51:46.602 INFO:teuthology.orchestra.run.smithi116.stdout: mds debug scatterstat = True 2024-02-21T22:51:46.602 INFO:teuthology.orchestra.run.smithi116.stdout: mds op complaint time = 180 2024-02-21T22:51:46.602 INFO:teuthology.orchestra.run.smithi116.stdout: mds verify scatter = True 2024-02-21T22:51:46.602 INFO:teuthology.orchestra.run.smithi116.stdout: osd op complaint time = 180 2024-02-21T22:51:46.602 INFO:teuthology.orchestra.run.smithi116.stdout: rados mon op timeout = 900 2024-02-21T22:51:46.602 INFO:teuthology.orchestra.run.smithi116.stdout: rados osd op timeout = 900 2024-02-21T22:51:46.602 INFO:teuthology.orchestra.run.smithi142.stdout:[global] 2024-02-21T22:51:46.603 INFO:teuthology.orchestra.run.smithi142.stdout: chdir = "" 2024-02-21T22:51:46.603 INFO:teuthology.orchestra.run.smithi142.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-02-21T22:51:46.603 INFO:teuthology.orchestra.run.smithi142.stdout: auth supported = cephx 2024-02-21T22:51:46.603 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-21T22:51:46.603 INFO:teuthology.orchestra.run.smithi142.stdout: filestore xattr use omap = true 2024-02-21T22:51:46.603 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-21T22:51:46.603 INFO:teuthology.orchestra.run.smithi142.stdout: mon clock drift allowed = 1.000 2024-02-21T22:51:46.603 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-21T22:51:46.603 INFO:teuthology.orchestra.run.smithi142.stdout: osd crush chooseleaf type = 0 2024-02-21T22:51:46.603 INFO:teuthology.orchestra.run.smithi142.stdout: auth debug = true 2024-02-21T22:51:46.603 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-21T22:51:46.603 INFO:teuthology.orchestra.run.smithi142.stdout: ms die on old message = true 2024-02-21T22:51:46.604 INFO:teuthology.orchestra.run.smithi142.stdout: ms die on bug = true 2024-02-21T22:51:46.604 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-21T22:51:46.604 INFO:teuthology.orchestra.run.smithi142.stdout: mon max pg per osd = 10000 # >= luminous 2024-02-21T22:51:46.604 INFO:teuthology.orchestra.run.smithi142.stdout: mon pg warn max object skew = 0 2024-02-21T22:51:46.604 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-21T22:51:46.604 INFO:teuthology.orchestra.run.smithi142.stdout: # disable pg_autoscaler by default for new pools 2024-02-21T22:51:46.604 INFO:teuthology.orchestra.run.smithi142.stdout: osd_pool_default_pg_autoscale_mode = off 2024-02-21T22:51:46.604 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-21T22:51:46.604 INFO:teuthology.orchestra.run.smithi142.stdout: osd pool default size = 2 2024-02-21T22:51:46.604 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-21T22:51:46.604 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd allow primary affinity = true 2024-02-21T22:51:46.604 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd allow pg remap = true 2024-02-21T22:51:46.605 INFO:teuthology.orchestra.run.smithi142.stdout: mon warn on legacy crush tunables = false 2024-02-21T22:51:46.605 INFO:teuthology.orchestra.run.smithi142.stdout: mon warn on crush straw calc version zero = false 2024-02-21T22:51:46.605 INFO:teuthology.orchestra.run.smithi142.stdout: mon warn on no sortbitwise = false 2024-02-21T22:51:46.605 INFO:teuthology.orchestra.run.smithi142.stdout: mon warn on osd down out interval zero = false 2024-02-21T22:51:46.605 INFO:teuthology.orchestra.run.smithi142.stdout: mon warn on too few osds = false 2024-02-21T22:51:46.605 INFO:teuthology.orchestra.run.smithi142.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-02-21T22:51:46.605 INFO:teuthology.orchestra.run.smithi142.stdout: mon_warn_on_pool_no_redundancy = false 2024-02-21T22:51:46.605 INFO:teuthology.orchestra.run.smithi142.stdout: mon_allow_pool_size_one = true 2024-02-21T22:51:46.605 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-21T22:51:46.605 INFO:teuthology.orchestra.run.smithi142.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-02-21T22:51:46.605 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-21T22:51:46.605 INFO:teuthology.orchestra.run.smithi142.stdout: osd default data pool replay window = 5 2024-02-21T22:51:46.606 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-21T22:51:46.606 INFO:teuthology.orchestra.run.smithi142.stdout: mon allow pool delete = true 2024-02-21T22:51:46.606 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-21T22:51:46.606 INFO:teuthology.orchestra.run.smithi142.stdout: mon cluster log file level = debug 2024-02-21T22:51:46.606 INFO:teuthology.orchestra.run.smithi142.stdout: debug asserts on shutdown = true 2024-02-21T22:51:46.606 INFO:teuthology.orchestra.run.smithi142.stdout: mon health detail to clog = false 2024-02-21T22:51:46.606 INFO:teuthology.orchestra.run.smithi142.stdout: mon host = "172.21.15.116,172.21.15.142,[v2:172.21.15.142:3301,v1:172.21.15.142:6790]" 2024-02-21T22:51:46.606 INFO:teuthology.orchestra.run.smithi142.stdout: ms die on skipped message = False 2024-02-21T22:51:46.606 INFO:teuthology.orchestra.run.smithi142.stdout: fsid = 7c298660-5f63-4b5c-a800-58c5be9a8445 2024-02-21T22:51:46.606 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-21T22:51:46.607 INFO:teuthology.orchestra.run.smithi142.stdout:[osd] 2024-02-21T22:51:46.607 INFO:teuthology.orchestra.run.smithi142.stdout: osd journal size = 100 2024-02-21T22:51:46.607 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-21T22:51:46.607 INFO:teuthology.orchestra.run.smithi142.stdout: osd scrub load threshold = 5.0 2024-02-21T22:51:46.607 INFO:teuthology.orchestra.run.smithi142.stdout: osd scrub max interval = 600 2024-02-21T22:51:46.607 INFO:teuthology.orchestra.run.smithi142.stdout: osd mclock profile = high_recovery_ops 2024-02-21T22:51:46.607 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-21T22:51:46.607 INFO:teuthology.orchestra.run.smithi142.stdout: osd recover clone overlap = true 2024-02-21T22:51:46.607 INFO:teuthology.orchestra.run.smithi142.stdout: osd recovery max chunk = 1048576 2024-02-21T22:51:46.607 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-21T22:51:46.607 INFO:teuthology.orchestra.run.smithi142.stdout: osd debug shutdown = true 2024-02-21T22:51:46.608 INFO:teuthology.orchestra.run.smithi142.stdout: osd debug op order = true 2024-02-21T22:51:46.608 INFO:teuthology.orchestra.run.smithi142.stdout: osd debug verify stray on activate = true 2024-02-21T22:51:46.608 INFO:teuthology.orchestra.run.smithi142.stdout: osd debug trim objects = true 2024-02-21T22:51:46.608 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-21T22:51:46.608 INFO:teuthology.orchestra.run.smithi142.stdout: osd open classes on start = true 2024-02-21T22:51:46.608 INFO:teuthology.orchestra.run.smithi142.stdout: osd debug pg log writeout = true 2024-02-21T22:51:46.608 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-21T22:51:46.608 INFO:teuthology.orchestra.run.smithi142.stdout: osd deep scrub update digest min age = 30 2024-02-21T22:51:46.608 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-21T22:51:46.608 INFO:teuthology.orchestra.run.smithi142.stdout: osd map max advance = 10 2024-02-21T22:51:46.608 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-21T22:51:46.608 INFO:teuthology.orchestra.run.smithi142.stdout: journal zero on create = true 2024-02-21T22:51:46.609 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-21T22:51:46.609 INFO:teuthology.orchestra.run.smithi142.stdout: filestore ondisk finisher threads = 3 2024-02-21T22:51:46.609 INFO:teuthology.orchestra.run.smithi142.stdout: filestore apply finisher threads = 3 2024-02-21T22:51:46.609 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-21T22:51:46.609 INFO:teuthology.orchestra.run.smithi142.stdout: bdev debug aio = true 2024-02-21T22:51:46.609 INFO:teuthology.orchestra.run.smithi142.stdout: osd debug misdirected ops = true 2024-02-21T22:51:46.609 INFO:teuthology.orchestra.run.smithi142.stdout: bdev async discard = True 2024-02-21T22:51:46.609 INFO:teuthology.orchestra.run.smithi142.stdout: bdev enable discard = True 2024-02-21T22:51:46.609 INFO:teuthology.orchestra.run.smithi142.stdout: bluestore allocator = bitmap 2024-02-21T22:51:46.609 INFO:teuthology.orchestra.run.smithi142.stdout: bluestore block size = 96636764160 2024-02-21T22:51:46.609 INFO:teuthology.orchestra.run.smithi142.stdout: bluestore fsck on mount = True 2024-02-21T22:51:46.609 INFO:teuthology.orchestra.run.smithi142.stdout: debug bluefs = 1/20 2024-02-21T22:51:46.609 INFO:teuthology.orchestra.run.smithi142.stdout: debug bluestore = 1/20 2024-02-21T22:51:46.610 INFO:teuthology.orchestra.run.smithi142.stdout: debug ms = 1 2024-02-21T22:51:46.610 INFO:teuthology.orchestra.run.smithi142.stdout: debug osd = 20 2024-02-21T22:51:46.610 INFO:teuthology.orchestra.run.smithi142.stdout: debug rocksdb = 4/10 2024-02-21T22:51:46.610 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd backfillfull_ratio = 0.85 2024-02-21T22:51:46.610 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd full ratio = 0.9 2024-02-21T22:51:46.610 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd nearfull ratio = 0.8 2024-02-21T22:51:46.610 INFO:teuthology.orchestra.run.smithi142.stdout: osd failsafe full ratio = 0.95 2024-02-21T22:51:46.610 INFO:teuthology.orchestra.run.smithi142.stdout: osd objectstore = bluestore 2024-02-21T22:51:46.610 INFO:teuthology.orchestra.run.smithi142.stdout: osd op complaint time = 180 2024-02-21T22:51:46.610 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-21T22:51:46.610 INFO:teuthology.orchestra.run.smithi142.stdout:[mgr] 2024-02-21T22:51:46.610 INFO:teuthology.orchestra.run.smithi142.stdout: debug ms = 1 2024-02-21T22:51:46.610 INFO:teuthology.orchestra.run.smithi142.stdout: debug mgr = 20 2024-02-21T22:51:46.611 INFO:teuthology.orchestra.run.smithi142.stdout: debug mon = 20 2024-02-21T22:51:46.611 INFO:teuthology.orchestra.run.smithi142.stdout: debug auth = 20 2024-02-21T22:51:46.611 INFO:teuthology.orchestra.run.smithi142.stdout: mon reweight min pgs per osd = 4 2024-02-21T22:51:46.611 INFO:teuthology.orchestra.run.smithi142.stdout: mon reweight min bytes per osd = 10 2024-02-21T22:51:46.611 INFO:teuthology.orchestra.run.smithi142.stdout: mgr/telemetry/nag = false 2024-02-21T22:51:46.611 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-21T22:51:46.611 INFO:teuthology.orchestra.run.smithi142.stdout:[mon] 2024-02-21T22:51:46.611 INFO:teuthology.orchestra.run.smithi142.stdout: debug ms = 1 2024-02-21T22:51:46.611 INFO:teuthology.orchestra.run.smithi142.stdout: debug mon = 20 2024-02-21T22:51:46.611 INFO:teuthology.orchestra.run.smithi142.stdout: debug paxos = 20 2024-02-21T22:51:46.611 INFO:teuthology.orchestra.run.smithi142.stdout: debug auth = 20 2024-02-21T22:51:46.611 INFO:teuthology.orchestra.run.smithi142.stdout: mon data avail warn = 5 2024-02-21T22:51:46.612 INFO:teuthology.orchestra.run.smithi142.stdout: mon mgr mkfs grace = 240 2024-02-21T22:51:46.612 INFO:teuthology.orchestra.run.smithi142.stdout: mon reweight min pgs per osd = 4 2024-02-21T22:51:46.612 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd reporter subtree level = osd 2024-02-21T22:51:46.612 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd prime pg temp = true 2024-02-21T22:51:46.612 INFO:teuthology.orchestra.run.smithi142.stdout: mon reweight min bytes per osd = 10 2024-02-21T22:51:46.612 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-21T22:51:46.612 INFO:teuthology.orchestra.run.smithi142.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-02-21T22:51:46.612 INFO:teuthology.orchestra.run.smithi142.stdout: auth mon ticket ttl = 660 # 11m 2024-02-21T22:51:46.612 INFO:teuthology.orchestra.run.smithi142.stdout: auth service ticket ttl = 240 # 4m 2024-02-21T22:51:46.612 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-21T22:51:46.612 INFO:teuthology.orchestra.run.smithi142.stdout: # don't complain about insecure global_id in the test suite 2024-02-21T22:51:46.612 INFO:teuthology.orchestra.run.smithi142.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-02-21T22:51:46.612 INFO:teuthology.orchestra.run.smithi142.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-02-21T22:51:46.613 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-21T22:51:46.613 INFO:teuthology.orchestra.run.smithi142.stdout: # 1m isn't quite enough 2024-02-21T22:51:46.613 INFO:teuthology.orchestra.run.smithi142.stdout: mon_down_mkfs_grace = 2m 2024-02-21T22:51:46.613 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-21T22:51:46.613 INFO:teuthology.orchestra.run.smithi142.stdout: mon_warn_on_filestore_osds = false 2024-02-21T22:51:46.613 INFO:teuthology.orchestra.run.smithi142.stdout: mon op complaint time = 120 2024-02-21T22:51:46.613 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-21T22:51:46.613 INFO:teuthology.orchestra.run.smithi142.stdout:[client] 2024-02-21T22:51:46.613 INFO:teuthology.orchestra.run.smithi142.stdout: rgw cache enabled = true 2024-02-21T22:51:46.613 INFO:teuthology.orchestra.run.smithi142.stdout: rgw enable ops log = true 2024-02-21T22:51:46.613 INFO:teuthology.orchestra.run.smithi142.stdout: rgw enable usage log = true 2024-02-21T22:51:46.613 INFO:teuthology.orchestra.run.smithi142.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-02-21T22:51:46.613 INFO:teuthology.orchestra.run.smithi142.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-02-21T22:51:46.614 INFO:teuthology.orchestra.run.smithi142.stdout: client mount timeout = 600 2024-02-21T22:51:46.614 INFO:teuthology.orchestra.run.smithi142.stdout: debug client = 20 2024-02-21T22:51:46.614 INFO:teuthology.orchestra.run.smithi142.stdout: debug ms = 1 2024-02-21T22:51:46.614 INFO:teuthology.orchestra.run.smithi142.stdout: pid file = "" 2024-02-21T22:51:46.614 INFO:teuthology.orchestra.run.smithi142.stdout: rados mon op timeout = 900 2024-02-21T22:51:46.614 INFO:teuthology.orchestra.run.smithi142.stdout: rados osd op timeout = 900 2024-02-21T22:51:46.614 INFO:teuthology.orchestra.run.smithi142.stdout:[mon.a] 2024-02-21T22:51:46.614 INFO:teuthology.orchestra.run.smithi142.stdout:[mon.b] 2024-02-21T22:51:46.614 INFO:teuthology.orchestra.run.smithi142.stdout:[mon.c] 2024-02-21T22:51:46.614 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.a] 2024-02-21T22:51:46.614 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.c] 2024-02-21T22:51:46.614 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.b] 2024-02-21T22:51:46.614 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.d] 2024-02-21T22:51:46.615 INFO:teuthology.orchestra.run.smithi142.stdout:[mds] 2024-02-21T22:51:46.615 INFO:teuthology.orchestra.run.smithi142.stdout: debug mds = 20 2024-02-21T22:51:46.615 INFO:teuthology.orchestra.run.smithi142.stdout: debug mds balancer = 20 2024-02-21T22:51:46.615 INFO:teuthology.orchestra.run.smithi142.stdout: debug ms = 1 2024-02-21T22:51:46.615 INFO:teuthology.orchestra.run.smithi142.stdout: mds debug frag = True 2024-02-21T22:51:46.615 INFO:teuthology.orchestra.run.smithi142.stdout: mds debug scatterstat = True 2024-02-21T22:51:46.615 INFO:teuthology.orchestra.run.smithi142.stdout: mds op complaint time = 180 2024-02-21T22:51:46.615 INFO:teuthology.orchestra.run.smithi142.stdout: mds verify scatter = True 2024-02-21T22:51:46.615 INFO:teuthology.orchestra.run.smithi142.stdout: osd op complaint time = 180 2024-02-21T22:51:46.615 INFO:teuthology.orchestra.run.smithi142.stdout: rados mon op timeout = 900 2024-02-21T22:51:46.615 INFO:teuthology.orchestra.run.smithi142.stdout: rados osd op timeout = 900 2024-02-21T22:51:46.617 INFO:tasks.ceph:Creating admin key on mon.a... 2024-02-21T22:51:46.617 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-02-21T22:51:46.713 INFO:tasks.ceph:Copying monmap to all nodes... 2024-02-21T22:51:46.713 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-02-21T22:51:46.713 DEBUG:teuthology.orchestra.run.smithi116:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-02-21T22:51:46.728 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-02-21T22:51:46.728 DEBUG:teuthology.orchestra.run.smithi116:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-02-21T22:51:46.783 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi116.front.sepia.ceph.com 2024-02-21T22:51:46.784 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-02-21T22:51:46.784 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd of=/etc/ceph/ceph.keyring 2024-02-21T22:51:46.784 DEBUG:teuthology.orchestra.run.smithi116:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-02-21T22:51:46.862 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-02-21T22:51:46.863 DEBUG:teuthology.orchestra.run.smithi116:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-02-21T22:51:46.917 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi142.front.sepia.ceph.com 2024-02-21T22:51:46.917 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-02-21T22:51:46.917 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/etc/ceph/ceph.keyring 2024-02-21T22:51:46.917 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-02-21T22:51:46.957 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-02-21T22:51:46.957 DEBUG:teuthology.orchestra.run.smithi142:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-02-21T22:51:47.012 INFO:tasks.ceph:Setting up mon nodes... 2024-02-21T22:51:47.013 INFO:tasks.ceph:Setting up mgr nodes... 2024-02-21T22:51:47.013 DEBUG:teuthology.orchestra.run.smithi116:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-02-21T22:51:47.069 INFO:teuthology.orchestra.run.smithi116.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-02-21T22:51:47.071 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-02-21T22:51:47.139 INFO:teuthology.orchestra.run.smithi142.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-02-21T22:51:47.141 INFO:tasks.ceph:Setting up mds nodes... 2024-02-21T22:51:47.141 DEBUG:teuthology.orchestra.run.smithi116:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-02-21T22:51:47.195 INFO:teuthology.orchestra.run.smithi116.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-02-21T22:51:47.198 DEBUG:teuthology.orchestra.run.smithi116:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-02-21T22:51:47.224 DEBUG:teuthology.orchestra.run.smithi116:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-02-21T22:51:47.319 INFO:teuthology.orchestra.run.smithi116.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-02-21T22:51:47.322 DEBUG:teuthology.orchestra.run.smithi116:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-02-21T22:51:47.349 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-02-21T22:51:47.404 INFO:teuthology.orchestra.run.smithi142.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-02-21T22:51:47.406 DEBUG:teuthology.orchestra.run.smithi142:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-02-21T22:51:47.433 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-02-21T22:51:47.527 INFO:teuthology.orchestra.run.smithi142.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-02-21T22:51:47.530 DEBUG:teuthology.orchestra.run.smithi142:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-02-21T22:51:47.556 INFO:tasks.ceph_client:Setting up client nodes... 2024-02-21T22:51:47.557 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-02-21T22:51:47.599 INFO:teuthology.orchestra.run.smithi116.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-02-21T22:51:47.614 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-02-21T22:51:47.697 INFO:teuthology.orchestra.run.smithi116.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-02-21T22:51:47.712 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-02-21T22:51:47.754 INFO:teuthology.orchestra.run.smithi142.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-02-21T22:51:47.769 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-02-21T22:51:47.852 INFO:teuthology.orchestra.run.smithi142.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-02-21T22:51:47.867 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-02-21T22:51:47.867 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi116.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi142.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-02-21T22:51:47.867 DEBUG:teuthology.orchestra.run.smithi116:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-02-21T22:51:47.894 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-02-21T22:51:47.894 INFO:tasks.ceph:role: osd.0 2024-02-21T22:51:47.894 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi116.front.sepia.ceph.com 2024-02-21T22:51:47.894 DEBUG:teuthology.orchestra.run.smithi116:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-02-21T22:51:47.968 INFO:teuthology.orchestra.run.smithi116.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-02-21T22:51:47.969 INFO:teuthology.orchestra.run.smithi116.stdout: = sectsz=512 attr=2, projid32bit=1 2024-02-21T22:51:47.969 INFO:teuthology.orchestra.run.smithi116.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-02-21T22:51:47.969 INFO:teuthology.orchestra.run.smithi116.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-02-21T22:51:47.969 INFO:teuthology.orchestra.run.smithi116.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-02-21T22:51:47.969 INFO:teuthology.orchestra.run.smithi116.stdout: = sunit=0 swidth=0 blks 2024-02-21T22:51:47.969 INFO:teuthology.orchestra.run.smithi116.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-02-21T22:51:47.969 INFO:teuthology.orchestra.run.smithi116.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-02-21T22:51:47.969 INFO:teuthology.orchestra.run.smithi116.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-02-21T22:51:47.969 INFO:teuthology.orchestra.run.smithi116.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-02-21T22:51:48.461 INFO:teuthology.orchestra.run.smithi116.stdout:Discarding blocks...Done. 2024-02-21T22:51:48.463 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi116.front.sepia.ceph.com -o noatime 2024-02-21T22:51:48.463 DEBUG:teuthology.orchestra.run.smithi116:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-02-21T22:51:48.578 DEBUG:teuthology.orchestra.run.smithi116:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-02-21T22:51:48.612 DEBUG:teuthology.orchestra.run.smithi116:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-02-21T22:51:48.680 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-02-21T22:51:48.680 INFO:tasks.ceph:role: osd.1 2024-02-21T22:51:48.680 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi116.front.sepia.ceph.com 2024-02-21T22:51:48.680 DEBUG:teuthology.orchestra.run.smithi116:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-02-21T22:51:48.754 INFO:teuthology.orchestra.run.smithi116.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-02-21T22:51:48.754 INFO:teuthology.orchestra.run.smithi116.stdout: = sectsz=512 attr=2, projid32bit=1 2024-02-21T22:51:48.755 INFO:teuthology.orchestra.run.smithi116.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-02-21T22:51:48.755 INFO:teuthology.orchestra.run.smithi116.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-02-21T22:51:48.755 INFO:teuthology.orchestra.run.smithi116.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-02-21T22:51:48.755 INFO:teuthology.orchestra.run.smithi116.stdout: = sunit=0 swidth=0 blks 2024-02-21T22:51:48.755 INFO:teuthology.orchestra.run.smithi116.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-02-21T22:51:48.755 INFO:teuthology.orchestra.run.smithi116.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-02-21T22:51:48.755 INFO:teuthology.orchestra.run.smithi116.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-02-21T22:51:48.755 INFO:teuthology.orchestra.run.smithi116.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-02-21T22:51:49.225 INFO:teuthology.orchestra.run.smithi116.stdout:Discarding blocks...Done. 2024-02-21T22:51:49.227 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi116.front.sepia.ceph.com -o noatime 2024-02-21T22:51:49.227 DEBUG:teuthology.orchestra.run.smithi116:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-02-21T22:51:49.318 DEBUG:teuthology.orchestra.run.smithi116:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-02-21T22:51:49.352 DEBUG:teuthology.orchestra.run.smithi116:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-02-21T22:51:49.419 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-02-21T22:51:49.419 INFO:tasks.ceph:role: osd.2 2024-02-21T22:51:49.419 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi116.front.sepia.ceph.com 2024-02-21T22:51:49.419 DEBUG:teuthology.orchestra.run.smithi116:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-02-21T22:51:49.492 INFO:teuthology.orchestra.run.smithi116.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-02-21T22:51:49.492 INFO:teuthology.orchestra.run.smithi116.stdout: = sectsz=512 attr=2, projid32bit=1 2024-02-21T22:51:49.493 INFO:teuthology.orchestra.run.smithi116.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-02-21T22:51:49.493 INFO:teuthology.orchestra.run.smithi116.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-02-21T22:51:49.493 INFO:teuthology.orchestra.run.smithi116.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-02-21T22:51:49.493 INFO:teuthology.orchestra.run.smithi116.stdout: = sunit=0 swidth=0 blks 2024-02-21T22:51:49.493 INFO:teuthology.orchestra.run.smithi116.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-02-21T22:51:49.493 INFO:teuthology.orchestra.run.smithi116.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-02-21T22:51:49.493 INFO:teuthology.orchestra.run.smithi116.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-02-21T22:51:49.493 INFO:teuthology.orchestra.run.smithi116.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-02-21T22:51:49.995 INFO:teuthology.orchestra.run.smithi116.stdout:Discarding blocks...Done. 2024-02-21T22:51:49.997 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi116.front.sepia.ceph.com -o noatime 2024-02-21T22:51:49.997 DEBUG:teuthology.orchestra.run.smithi116:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-02-21T22:51:50.130 DEBUG:teuthology.orchestra.run.smithi116:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-02-21T22:51:50.164 DEBUG:teuthology.orchestra.run.smithi116:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-02-21T22:51:50.231 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-02-21T22:51:50.231 INFO:tasks.ceph:role: osd.3 2024-02-21T22:51:50.231 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi116.front.sepia.ceph.com 2024-02-21T22:51:50.231 DEBUG:teuthology.orchestra.run.smithi116:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-02-21T22:51:50.304 INFO:teuthology.orchestra.run.smithi116.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-02-21T22:51:50.304 INFO:teuthology.orchestra.run.smithi116.stdout: = sectsz=512 attr=2, projid32bit=1 2024-02-21T22:51:50.305 INFO:teuthology.orchestra.run.smithi116.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-02-21T22:51:50.305 INFO:teuthology.orchestra.run.smithi116.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-02-21T22:51:50.305 INFO:teuthology.orchestra.run.smithi116.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-02-21T22:51:50.305 INFO:teuthology.orchestra.run.smithi116.stdout: = sunit=0 swidth=0 blks 2024-02-21T22:51:50.305 INFO:teuthology.orchestra.run.smithi116.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-02-21T22:51:50.305 INFO:teuthology.orchestra.run.smithi116.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-02-21T22:51:50.305 INFO:teuthology.orchestra.run.smithi116.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-02-21T22:51:50.305 INFO:teuthology.orchestra.run.smithi116.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-02-21T22:51:50.812 INFO:teuthology.orchestra.run.smithi116.stdout:Discarding blocks...Done. 2024-02-21T22:51:50.814 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi116.front.sepia.ceph.com -o noatime 2024-02-21T22:51:50.814 DEBUG:teuthology.orchestra.run.smithi116:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-02-21T22:51:50.952 DEBUG:teuthology.orchestra.run.smithi116:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-02-21T22:51:50.984 DEBUG:teuthology.orchestra.run.smithi116:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-02-21T22:51:51.081 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:51:51.090+0000 7f059900c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-02-21T22:51:51.081 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:51:51.090+0000 7f059900c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-02-21T22:51:51.081 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:51:51.090+0000 7f059900c640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-02-21T22:51:51.081 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:51:51.090+0000 7f059900c640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-02-21T22:51:51.082 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:51:51.090+0000 7f059900c640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-02-21T22:51:51.082 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:51:51.091+0000 7f059900c640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-02-21T22:51:53.938 DEBUG:teuthology.orchestra.run.smithi116:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-02-21T22:51:53.969 DEBUG:teuthology.orchestra.run.smithi116:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-02-21T22:51:54.063 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:51:54.072+0000 7fbc8fd6f640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-02-21T22:51:54.063 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:51:54.072+0000 7fbc8fd6f640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-02-21T22:51:54.063 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:51:54.072+0000 7fbc8fd6f640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-02-21T22:51:54.063 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:51:54.072+0000 7fbc8fd6f640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-02-21T22:51:54.063 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:51:54.072+0000 7fbc8fd6f640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-02-21T22:51:54.064 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:51:54.073+0000 7fbc8fd6f640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-02-21T22:51:56.912 DEBUG:teuthology.orchestra.run.smithi116:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-02-21T22:51:56.944 DEBUG:teuthology.orchestra.run.smithi116:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-02-21T22:51:57.035 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:51:57.043+0000 7fd52cc99640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-02-21T22:51:57.035 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:51:57.044+0000 7fd52cc99640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-02-21T22:51:57.035 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:51:57.044+0000 7fd52cc99640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-02-21T22:51:57.035 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:51:57.044+0000 7fd52cc99640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-02-21T22:51:57.035 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:51:57.044+0000 7fd52cc99640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-02-21T22:51:57.035 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:51:57.044+0000 7fd52cc99640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-02-21T22:51:59.888 DEBUG:teuthology.orchestra.run.smithi116:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-02-21T22:51:59.921 DEBUG:teuthology.orchestra.run.smithi116:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-02-21T22:52:00.015 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:00.024+0000 7f646ca06640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-02-21T22:52:00.015 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:00.024+0000 7f646ca06640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-02-21T22:52:00.015 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:00.024+0000 7f646ca06640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-02-21T22:52:00.015 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:00.024+0000 7f646ca06640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-02-21T22:52:00.015 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:00.024+0000 7f646ca06640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-02-21T22:52:00.015 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:00.024+0000 7f646ca06640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-02-21T22:52:02.870 DEBUG:teuthology.orchestra.run.smithi116:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-02-21T22:52:02.902 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-02-21T22:52:02.934 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-02-21T22:52:02.934 INFO:tasks.ceph:role: osd.4 2024-02-21T22:52:02.934 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi142.front.sepia.ceph.com 2024-02-21T22:52:02.934 DEBUG:teuthology.orchestra.run.smithi142:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-02-21T22:52:03.013 INFO:teuthology.orchestra.run.smithi142.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-02-21T22:52:03.013 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 attr=2, projid32bit=1 2024-02-21T22:52:03.014 INFO:teuthology.orchestra.run.smithi142.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-02-21T22:52:03.014 INFO:teuthology.orchestra.run.smithi142.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-02-21T22:52:03.014 INFO:teuthology.orchestra.run.smithi142.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-02-21T22:52:03.014 INFO:teuthology.orchestra.run.smithi142.stdout: = sunit=0 swidth=0 blks 2024-02-21T22:52:03.014 INFO:teuthology.orchestra.run.smithi142.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-02-21T22:52:03.014 INFO:teuthology.orchestra.run.smithi142.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-02-21T22:52:03.014 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-02-21T22:52:03.014 INFO:teuthology.orchestra.run.smithi142.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-02-21T22:52:03.494 INFO:teuthology.orchestra.run.smithi142.stdout:Discarding blocks...Done. 2024-02-21T22:52:03.496 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi142.front.sepia.ceph.com -o noatime 2024-02-21T22:52:03.497 DEBUG:teuthology.orchestra.run.smithi142:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-02-21T22:52:03.630 DEBUG:teuthology.orchestra.run.smithi142:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-02-21T22:52:03.663 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-02-21T22:52:03.731 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-02-21T22:52:03.731 INFO:tasks.ceph:role: osd.5 2024-02-21T22:52:03.731 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi142.front.sepia.ceph.com 2024-02-21T22:52:03.731 DEBUG:teuthology.orchestra.run.smithi142:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-02-21T22:52:03.806 INFO:teuthology.orchestra.run.smithi142.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-02-21T22:52:03.806 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 attr=2, projid32bit=1 2024-02-21T22:52:03.806 INFO:teuthology.orchestra.run.smithi142.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-02-21T22:52:03.806 INFO:teuthology.orchestra.run.smithi142.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-02-21T22:52:03.806 INFO:teuthology.orchestra.run.smithi142.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-02-21T22:52:03.806 INFO:teuthology.orchestra.run.smithi142.stdout: = sunit=0 swidth=0 blks 2024-02-21T22:52:03.806 INFO:teuthology.orchestra.run.smithi142.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-02-21T22:52:03.807 INFO:teuthology.orchestra.run.smithi142.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-02-21T22:52:03.807 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-02-21T22:52:03.807 INFO:teuthology.orchestra.run.smithi142.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-02-21T22:52:04.268 INFO:teuthology.orchestra.run.smithi142.stdout:Discarding blocks...Done. 2024-02-21T22:52:04.270 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi142.front.sepia.ceph.com -o noatime 2024-02-21T22:52:04.271 DEBUG:teuthology.orchestra.run.smithi142:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-02-21T22:52:04.359 DEBUG:teuthology.orchestra.run.smithi142:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-02-21T22:52:04.390 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-02-21T22:52:04.456 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-02-21T22:52:04.457 INFO:tasks.ceph:role: osd.6 2024-02-21T22:52:04.457 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi142.front.sepia.ceph.com 2024-02-21T22:52:04.457 DEBUG:teuthology.orchestra.run.smithi142:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-02-21T22:52:04.531 INFO:teuthology.orchestra.run.smithi142.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-02-21T22:52:04.532 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 attr=2, projid32bit=1 2024-02-21T22:52:04.532 INFO:teuthology.orchestra.run.smithi142.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-02-21T22:52:04.532 INFO:teuthology.orchestra.run.smithi142.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-02-21T22:52:04.532 INFO:teuthology.orchestra.run.smithi142.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-02-21T22:52:04.532 INFO:teuthology.orchestra.run.smithi142.stdout: = sunit=0 swidth=0 blks 2024-02-21T22:52:04.532 INFO:teuthology.orchestra.run.smithi142.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-02-21T22:52:04.532 INFO:teuthology.orchestra.run.smithi142.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-02-21T22:52:04.532 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-02-21T22:52:04.532 INFO:teuthology.orchestra.run.smithi142.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-02-21T22:52:05.015 INFO:teuthology.orchestra.run.smithi142.stdout:Discarding blocks...Done. 2024-02-21T22:52:05.017 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi142.front.sepia.ceph.com -o noatime 2024-02-21T22:52:05.017 DEBUG:teuthology.orchestra.run.smithi142:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-02-21T22:52:05.145 DEBUG:teuthology.orchestra.run.smithi142:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-02-21T22:52:05.178 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-02-21T22:52:05.245 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-02-21T22:52:05.246 INFO:tasks.ceph:role: osd.7 2024-02-21T22:52:05.246 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi142.front.sepia.ceph.com 2024-02-21T22:52:05.246 DEBUG:teuthology.orchestra.run.smithi142:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-02-21T22:52:05.320 INFO:teuthology.orchestra.run.smithi142.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-02-21T22:52:05.320 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 attr=2, projid32bit=1 2024-02-21T22:52:05.320 INFO:teuthology.orchestra.run.smithi142.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-02-21T22:52:05.320 INFO:teuthology.orchestra.run.smithi142.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-02-21T22:52:05.320 INFO:teuthology.orchestra.run.smithi142.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-02-21T22:52:05.320 INFO:teuthology.orchestra.run.smithi142.stdout: = sunit=0 swidth=0 blks 2024-02-21T22:52:05.320 INFO:teuthology.orchestra.run.smithi142.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-02-21T22:52:05.321 INFO:teuthology.orchestra.run.smithi142.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-02-21T22:52:05.321 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-02-21T22:52:05.321 INFO:teuthology.orchestra.run.smithi142.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-02-21T22:52:05.843 INFO:teuthology.orchestra.run.smithi142.stdout:Discarding blocks...Done. 2024-02-21T22:52:05.845 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi142.front.sepia.ceph.com -o noatime 2024-02-21T22:52:05.845 DEBUG:teuthology.orchestra.run.smithi142:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-02-21T22:52:05.988 DEBUG:teuthology.orchestra.run.smithi142:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-02-21T22:52:06.021 DEBUG:teuthology.orchestra.run.smithi142:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-02-21T22:52:06.118 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:06.127+0000 7f91e9fdf640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-02-21T22:52:06.118 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:06.128+0000 7f91e9fdf640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-02-21T22:52:06.118 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:06.128+0000 7f91e9fdf640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-02-21T22:52:06.118 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:06.128+0000 7f91e9fdf640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-02-21T22:52:06.119 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:06.128+0000 7f91e9fdf640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-02-21T22:52:06.119 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:06.128+0000 7f91e9fdf640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-02-21T22:52:08.979 DEBUG:teuthology.orchestra.run.smithi142:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-02-21T22:52:09.008 DEBUG:teuthology.orchestra.run.smithi142:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-02-21T22:52:09.095 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:09.105+0000 7f0a55a01640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-02-21T22:52:09.096 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:09.105+0000 7f0a55a01640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-02-21T22:52:09.096 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:09.105+0000 7f0a55a01640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-02-21T22:52:09.096 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:09.105+0000 7f0a55a01640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-02-21T22:52:09.096 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:09.105+0000 7f0a55a01640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-02-21T22:52:09.096 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:09.106+0000 7f0a55a01640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-02-21T22:52:11.941 DEBUG:teuthology.orchestra.run.smithi142:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-02-21T22:52:11.971 DEBUG:teuthology.orchestra.run.smithi142:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-02-21T22:52:12.061 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:12.069+0000 7f993d80d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-02-21T22:52:12.061 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:12.069+0000 7f993d80d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-02-21T22:52:12.061 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:12.069+0000 7f993d80d640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-02-21T22:52:12.061 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:12.069+0000 7f993d80d640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-02-21T22:52:12.061 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:12.069+0000 7f993d80d640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-02-21T22:52:12.061 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:12.070+0000 7f993d80d640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-02-21T22:52:14.615 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T22:52:14.618 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T22:52:14.913 DEBUG:teuthology.orchestra.run.smithi142:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-02-21T22:52:14.940 DEBUG:teuthology.orchestra.run.smithi142:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-02-21T22:52:15.028 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:15.036+0000 7f80f8749640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-02-21T22:52:15.029 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:15.037+0000 7f80f8749640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-02-21T22:52:15.029 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:15.037+0000 7f80f8749640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-02-21T22:52:15.029 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:15.037+0000 7f80f8749640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-02-21T22:52:15.029 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:15.037+0000 7f80f8749640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-02-21T22:52:15.029 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:15.037+0000 7f80f8749640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-02-21T22:52:17.883 DEBUG:teuthology.orchestra.run.smithi142:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-02-21T22:52:17.915 INFO:tasks.ceph:Reading keys from all nodes... 2024-02-21T22:52:17.915 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-02-21T22:52:17.915 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-02-21T22:52:17.947 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-02-21T22:52:17.947 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-02-21T22:52:18.019 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-02-21T22:52:18.020 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-02-21T22:52:18.090 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-02-21T22:52:18.090 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-02-21T22:52:18.160 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-02-21T22:52:18.160 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-02-21T22:52:18.233 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-02-21T22:52:18.233 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-02-21T22:52:18.301 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-02-21T22:52:18.302 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-02-21T22:52:18.370 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-02-21T22:52:18.370 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-02-21T22:52:18.402 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-02-21T22:52:18.403 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-02-21T22:52:18.473 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-02-21T22:52:18.473 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-02-21T22:52:18.543 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-02-21T22:52:18.543 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-02-21T22:52:18.611 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-02-21T22:52:18.612 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-02-21T22:52:18.680 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-02-21T22:52:18.680 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-02-21T22:52:18.747 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-02-21T22:52:18.747 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-02-21T22:52:18.815 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-02-21T22:52:18.815 DEBUG:teuthology.orchestra.run.smithi116:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-02-21T22:52:18.833 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-02-21T22:52:18.833 DEBUG:teuthology.orchestra.run.smithi116:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-02-21T22:52:18.891 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-02-21T22:52:18.891 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-02-21T22:52:18.906 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-02-21T22:52:18.907 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-02-21T22:52:18.961 INFO:tasks.ceph:Adding keys to all mons... 2024-02-21T22:52:18.961 DEBUG:teuthology.orchestra.run.smithi116:> sudo tee -a /etc/ceph/ceph.keyring 2024-02-21T22:52:18.964 DEBUG:teuthology.orchestra.run.smithi142:> sudo tee -a /etc/ceph/ceph.keyring 2024-02-21T22:52:19.005 INFO:teuthology.orchestra.run.smithi116.stdout:[mgr.y] 2024-02-21T22:52:19.005 INFO:teuthology.orchestra.run.smithi116.stdout: key = AQCDftZlHge/BBAAguW4iLZRegyPUDddvtoCPA== 2024-02-21T22:52:19.005 INFO:teuthology.orchestra.run.smithi116.stdout:[mds.a] 2024-02-21T22:52:19.005 INFO:teuthology.orchestra.run.smithi116.stdout: key = AQCDftZlNxhHDBAAb+gx5rwaS9GApZXg4uGIBw== 2024-02-21T22:52:19.005 INFO:teuthology.orchestra.run.smithi116.stdout:[mds.c] 2024-02-21T22:52:19.005 INFO:teuthology.orchestra.run.smithi116.stdout: key = AQCDftZlFyyrExAA7ENxsStKJ60yhKuuQgeZug== 2024-02-21T22:52:19.005 INFO:teuthology.orchestra.run.smithi116.stdout:[osd.0] 2024-02-21T22:52:19.006 INFO:teuthology.orchestra.run.smithi116.stdout: key = AQCHftZlacBzBRAAljCU45lWahy5VeLOy17Nyg== 2024-02-21T22:52:19.006 INFO:teuthology.orchestra.run.smithi116.stdout:[osd.1] 2024-02-21T22:52:19.006 INFO:teuthology.orchestra.run.smithi116.stdout: key = AQCKftZldTtdBBAAUXzIcrVJxMRmYsgkD/GtNQ== 2024-02-21T22:52:19.006 INFO:teuthology.orchestra.run.smithi116.stdout:[osd.2] 2024-02-21T22:52:19.006 INFO:teuthology.orchestra.run.smithi116.stdout: key = AQCNftZlFZOsAhAAgRqK9f+UYKCGfYzqz3mLdw== 2024-02-21T22:52:19.006 INFO:teuthology.orchestra.run.smithi116.stdout:[osd.3] 2024-02-21T22:52:19.006 INFO:teuthology.orchestra.run.smithi116.stdout: key = AQCQftZlA0t/ARAAm4AOkNWT4vIBeZ3E3YVmWA== 2024-02-21T22:52:19.006 INFO:teuthology.orchestra.run.smithi116.stdout:[mgr.x] 2024-02-21T22:52:19.006 INFO:teuthology.orchestra.run.smithi116.stdout: key = AQCDftZlTRLmCBAAwiPF4QFNCA7pyZV2fdbt7A== 2024-02-21T22:52:19.006 INFO:teuthology.orchestra.run.smithi116.stdout:[mds.b] 2024-02-21T22:52:19.006 INFO:teuthology.orchestra.run.smithi116.stdout: key = AQCDftZlzPmsGBAAyGOu7uSrW3IWtY3zHcuerw== 2024-02-21T22:52:19.006 INFO:teuthology.orchestra.run.smithi116.stdout:[mds.d] 2024-02-21T22:52:19.006 INFO:teuthology.orchestra.run.smithi116.stdout: key = AQCDftZlRocPIBAAf3if/JHaj70ocZzB6jeEkA== 2024-02-21T22:52:19.006 INFO:teuthology.orchestra.run.smithi116.stdout:[osd.4] 2024-02-21T22:52:19.007 INFO:teuthology.orchestra.run.smithi116.stdout: key = AQCWftZl3cekBxAAqXBT0Jn76px1YGSfAMsN4g== 2024-02-21T22:52:19.007 INFO:teuthology.orchestra.run.smithi116.stdout:[osd.5] 2024-02-21T22:52:19.007 INFO:teuthology.orchestra.run.smithi116.stdout: key = AQCZftZlUctNBhAAr+opUNCiRLwG4MAlrUG1vw== 2024-02-21T22:52:19.007 INFO:teuthology.orchestra.run.smithi116.stdout:[osd.6] 2024-02-21T22:52:19.007 INFO:teuthology.orchestra.run.smithi116.stdout: key = AQCcftZloqI5BBAAT4ikGusIlzIB8D5lVuwgrQ== 2024-02-21T22:52:19.007 INFO:teuthology.orchestra.run.smithi116.stdout:[osd.7] 2024-02-21T22:52:19.007 INFO:teuthology.orchestra.run.smithi116.stdout: key = AQCfftZlnVhGAhAAHcmhyOZ7SHZCIRcwLTpSig== 2024-02-21T22:52:19.007 INFO:teuthology.orchestra.run.smithi116.stdout:[client.0] 2024-02-21T22:52:19.007 INFO:teuthology.orchestra.run.smithi116.stdout: key = AQCDftZlkppVJBAAGajc7P7grvYaJipfLBk5yw== 2024-02-21T22:52:19.007 INFO:teuthology.orchestra.run.smithi116.stdout:[client.2] 2024-02-21T22:52:19.007 INFO:teuthology.orchestra.run.smithi116.stdout: key = AQCDftZl46ErKhAAlOImCFm/uktPXT24d0ik9w== 2024-02-21T22:52:19.007 INFO:teuthology.orchestra.run.smithi116.stdout:[client.1] 2024-02-21T22:52:19.007 INFO:teuthology.orchestra.run.smithi116.stdout: key = AQCDftZl8t+WLRAAyES1AIrsrUUUfqDMxv2I1A== 2024-02-21T22:52:19.007 INFO:teuthology.orchestra.run.smithi116.stdout:[client.3] 2024-02-21T22:52:19.007 INFO:teuthology.orchestra.run.smithi116.stdout: key = AQCDftZlxYBoMxAALBfTrC854PdzZ3Ji01ZLgQ== 2024-02-21T22:52:19.027 INFO:teuthology.orchestra.run.smithi142.stdout:[mgr.y] 2024-02-21T22:52:19.027 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQCDftZlHge/BBAAguW4iLZRegyPUDddvtoCPA== 2024-02-21T22:52:19.027 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.a] 2024-02-21T22:52:19.027 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQCDftZlNxhHDBAAb+gx5rwaS9GApZXg4uGIBw== 2024-02-21T22:52:19.027 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.c] 2024-02-21T22:52:19.027 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQCDftZlFyyrExAA7ENxsStKJ60yhKuuQgeZug== 2024-02-21T22:52:19.027 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.0] 2024-02-21T22:52:19.027 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQCHftZlacBzBRAAljCU45lWahy5VeLOy17Nyg== 2024-02-21T22:52:19.027 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.1] 2024-02-21T22:52:19.027 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQCKftZldTtdBBAAUXzIcrVJxMRmYsgkD/GtNQ== 2024-02-21T22:52:19.027 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.2] 2024-02-21T22:52:19.028 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQCNftZlFZOsAhAAgRqK9f+UYKCGfYzqz3mLdw== 2024-02-21T22:52:19.028 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.3] 2024-02-21T22:52:19.028 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQCQftZlA0t/ARAAm4AOkNWT4vIBeZ3E3YVmWA== 2024-02-21T22:52:19.028 INFO:teuthology.orchestra.run.smithi142.stdout:[mgr.x] 2024-02-21T22:52:19.028 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQCDftZlTRLmCBAAwiPF4QFNCA7pyZV2fdbt7A== 2024-02-21T22:52:19.028 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.b] 2024-02-21T22:52:19.028 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQCDftZlzPmsGBAAyGOu7uSrW3IWtY3zHcuerw== 2024-02-21T22:52:19.028 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.d] 2024-02-21T22:52:19.028 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQCDftZlRocPIBAAf3if/JHaj70ocZzB6jeEkA== 2024-02-21T22:52:19.028 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.4] 2024-02-21T22:52:19.028 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQCWftZl3cekBxAAqXBT0Jn76px1YGSfAMsN4g== 2024-02-21T22:52:19.028 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.5] 2024-02-21T22:52:19.028 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQCZftZlUctNBhAAr+opUNCiRLwG4MAlrUG1vw== 2024-02-21T22:52:19.028 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.6] 2024-02-21T22:52:19.029 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQCcftZloqI5BBAAT4ikGusIlzIB8D5lVuwgrQ== 2024-02-21T22:52:19.029 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.7] 2024-02-21T22:52:19.029 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQCfftZlnVhGAhAAHcmhyOZ7SHZCIRcwLTpSig== 2024-02-21T22:52:19.029 INFO:teuthology.orchestra.run.smithi142.stdout:[client.0] 2024-02-21T22:52:19.029 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQCDftZlkppVJBAAGajc7P7grvYaJipfLBk5yw== 2024-02-21T22:52:19.029 INFO:teuthology.orchestra.run.smithi142.stdout:[client.2] 2024-02-21T22:52:19.029 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQCDftZl46ErKhAAlOImCFm/uktPXT24d0ik9w== 2024-02-21T22:52:19.029 INFO:teuthology.orchestra.run.smithi142.stdout:[client.1] 2024-02-21T22:52:19.029 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQCDftZl8t+WLRAAyES1AIrsrUUUfqDMxv2I1A== 2024-02-21T22:52:19.029 INFO:teuthology.orchestra.run.smithi142.stdout:[client.3] 2024-02-21T22:52:19.029 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQCDftZlxYBoMxAALBfTrC854PdzZ3Ji01ZLgQ== 2024-02-21T22:52:19.030 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-02-21T22:52:19.051 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-02-21T22:52:19.122 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-21T22:52:19.124 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-21T22:52:19.179 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-21T22:52:19.181 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-21T22:52:19.236 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-21T22:52:19.238 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-21T22:52:19.289 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-21T22:52:19.292 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-21T22:52:19.344 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-21T22:52:19.348 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-21T22:52:19.400 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-21T22:52:19.402 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-21T22:52:19.454 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-02-21T22:52:19.456 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-02-21T22:52:19.508 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-21T22:52:19.510 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-21T22:52:19.565 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-21T22:52:19.567 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-21T22:52:19.621 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-21T22:52:19.623 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-21T22:52:19.675 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-21T22:52:19.678 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-21T22:52:19.730 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-21T22:52:19.733 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-21T22:52:19.784 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-21T22:52:19.787 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-21T22:52:19.839 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-02-21T22:52:19.842 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-02-21T22:52:19.897 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-02-21T22:52:19.899 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-02-21T22:52:19.954 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-02-21T22:52:19.957 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-02-21T22:52:20.011 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-02-21T22:52:20.014 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-02-21T22:52:20.068 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-02-21T22:52:20.069 DEBUG:teuthology.orchestra.run.smithi116:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-02-21T22:52:20.096 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-02-21T22:52:20.194 DEBUG:teuthology.orchestra.run.smithi116:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-02-21T22:52:20.221 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-02-21T22:52:20.248 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-02-21T22:52:20.346 DEBUG:teuthology.orchestra.run.smithi142:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-02-21T22:52:20.372 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-02-21T22:52:20.439 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-02-21T22:52:20.538 DEBUG:teuthology.orchestra.run.smithi142:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-02-21T22:52:20.565 DEBUG:teuthology.orchestra.run.smithi116:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-02-21T22:52:20.568 DEBUG:teuthology.orchestra.run.smithi142:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-02-21T22:52:20.621 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-02-21T22:52:20.622 INFO:tasks.ceph.mon.a:Restarting daemon 2024-02-21T22:52:20.622 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-02-21T22:52:20.625 INFO:tasks.ceph.mon.a:Started 2024-02-21T22:52:20.625 INFO:tasks.ceph.mon.b:Restarting daemon 2024-02-21T22:52:20.625 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-02-21T22:52:20.666 INFO:tasks.ceph.mon.b:Started 2024-02-21T22:52:20.666 INFO:tasks.ceph.mon.c:Restarting daemon 2024-02-21T22:52:20.666 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-02-21T22:52:20.668 INFO:tasks.ceph.mon.c:Started 2024-02-21T22:52:20.668 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-02-21T22:52:20.668 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-02-21T22:52:20.669 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-02-21T22:52:20.671 INFO:tasks.ceph.mgr.y:Started 2024-02-21T22:52:20.671 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-02-21T22:52:20.671 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-02-21T22:52:20.673 INFO:tasks.ceph.mgr.x:Started 2024-02-21T22:52:20.673 INFO:tasks.ceph:Setting crush tunables to default 2024-02-21T22:52:20.673 DEBUG:teuthology.orchestra.run.smithi116:> sudo ceph --cluster ceph osd crush tunables default 2024-02-21T22:52:20.773 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:20.782+0000 7f6aa0636640 1 Processor -- start 2024-02-21T22:52:20.773 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:20.782+0000 7f6aa0636640 1 -- start start 2024-02-21T22:52:20.775 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:20.783+0000 7f6aa0636640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f6a9806ae40 0x7f6a980d0140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:20.775 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:20.783+0000 7f6aa0636640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a9806f710 0x7f6a981658f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:20.775 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:20.783+0000 7f6aa0636640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a9806d6d0 con 0x7f6a980cf150 2024-02-21T22:52:20.775 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:20.783+0000 7f6aa0636640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a9806d940 con 0x7f6a9806ae40 2024-02-21T22:52:20.775 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:20.783+0000 7f6aa0636640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a9806dc20 con 0x7f6a9806f710 2024-02-21T22:52:20.775 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:20.784+0000 7f6a9dbd1640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f6a980cf150 0x7f6a9806b220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:50082/0 (socket says 172.21.15.116:50082) 2024-02-21T22:52:20.775 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:20.784+0000 7f6a9dbd1640 1 -- 172.21.15.116:0/3952776367 learned_addr learned my addr 172.21.15.116:0/3952776367 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-02-21T22:52:20.775 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:20.784+0000 7f6a9e3d2640 1 --2- 172.21.15.116:0/3952776367 >> v2:172.21.15.142:3300/0 conn(0x7f6a9806ae40 0x7f6a980d0140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:20.776 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:20.784+0000 7f6a9ebd3640 1 --2- 172.21.15.116:0/3952776367 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a9806f710 0x7f6a981658f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:20.776 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:20.784+0000 7f6a9e3d2640 1 -- 172.21.15.116:0/3952776367 >> v2:172.21.15.142:3300/0 conn(0x7f6a9806ae40 msgr2=0x7f6a980d0140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-02-21T22:52:20.776 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:20.784+0000 7f6a9e3d2640 1 -- 172.21.15.116:0/3952776367 >> v2:172.21.15.142:3300/0 conn(0x7f6a9806ae40 msgr2=0x7f6a980d0140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-02-21T22:52:20.776 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:20.784+0000 7f6a9e3d2640 1 --2- 172.21.15.116:0/3952776367 >> v2:172.21.15.142:3300/0 conn(0x7f6a9806ae40 0x7f6a980d0140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-02-21T22:52:20.776 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:20.784+0000 7f6a9ebd3640 1 -- 172.21.15.116:0/3952776367 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a9806f710 msgr2=0x7f6a981658f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-02-21T22:52:20.776 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:20.784+0000 7f6a9ebd3640 1 -- 172.21.15.116:0/3952776367 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a9806f710 msgr2=0x7f6a981658f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-02-21T22:52:20.776 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:20.784+0000 7f6a9ebd3640 1 --2- 172.21.15.116:0/3952776367 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a9806f710 0x7f6a981658f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-02-21T22:52:20.776 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:20.784+0000 7f6a9e3d2640 1 --2- 172.21.15.116:0/3952776367 >> v2:172.21.15.142:3300/0 conn(0x7f6a9806ae40 0x7f6a980d0140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T22:52:20.776 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:20.784+0000 7f6a9ebd3640 1 --2- 172.21.15.116:0/3952776367 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a9806f710 0x7f6a981658f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T22:52:20.976 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:20.985+0000 7f6a9e3d2640 1 --2- 172.21.15.116:0/3952776367 >> v2:172.21.15.142:3300/0 conn(0x7f6a9806ae40 0x7f6a980d0140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:20.976 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:20.985+0000 7f6a9ebd3640 1 --2- 172.21.15.116:0/3952776367 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a9806f710 0x7f6a981658f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:20.976 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:20.985+0000 7f6a9ebd3640 1 -- 172.21.15.116:0/3952776367 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a9806f710 msgr2=0x7f6a981658f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-02-21T22:52:20.977 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:20.985+0000 7f6a9ebd3640 1 -- 172.21.15.116:0/3952776367 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a9806f710 msgr2=0x7f6a981658f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-02-21T22:52:20.977 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:20.985+0000 7f6a9ebd3640 1 --2- 172.21.15.116:0/3952776367 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a9806f710 0x7f6a981658f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-02-21T22:52:20.977 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:20.985+0000 7f6a9e3d2640 1 -- 172.21.15.116:0/3952776367 >> v2:172.21.15.142:3300/0 conn(0x7f6a9806ae40 msgr2=0x7f6a980d0140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-02-21T22:52:20.977 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:20.985+0000 7f6a9e3d2640 1 -- 172.21.15.116:0/3952776367 >> v2:172.21.15.142:3300/0 conn(0x7f6a9806ae40 msgr2=0x7f6a980d0140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-02-21T22:52:20.977 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:20.985+0000 7f6a9ebd3640 1 --2- 172.21.15.116:0/3952776367 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a9806f710 0x7f6a981658f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T22:52:20.977 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:20.985+0000 7f6a9e3d2640 1 --2- 172.21.15.116:0/3952776367 >> v2:172.21.15.142:3300/0 conn(0x7f6a9806ae40 0x7f6a980d0140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-02-21T22:52:20.978 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:20.985+0000 7f6a9e3d2640 1 --2- 172.21.15.116:0/3952776367 >> v2:172.21.15.142:3300/0 conn(0x7f6a9806ae40 0x7f6a980d0140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T22:52:21.377 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:21.386+0000 7f6a9e3d2640 1 --2- 172.21.15.116:0/3952776367 >> v2:172.21.15.142:3300/0 conn(0x7f6a9806ae40 0x7f6a980d0140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:21.377 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:21.386+0000 7f6a9ebd3640 1 --2- 172.21.15.116:0/3952776367 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a9806f710 0x7f6a981658f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:21.377 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:21.386+0000 7f6a9e3d2640 1 -- 172.21.15.116:0/3952776367 >> v2:172.21.15.142:3300/0 conn(0x7f6a9806ae40 msgr2=0x7f6a980d0140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-02-21T22:52:21.377 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:21.386+0000 7f6a9ebd3640 1 -- 172.21.15.116:0/3952776367 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a9806f710 msgr2=0x7f6a981658f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-02-21T22:52:21.377 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:21.386+0000 7f6a9e3d2640 1 -- 172.21.15.116:0/3952776367 >> v2:172.21.15.142:3300/0 conn(0x7f6a9806ae40 msgr2=0x7f6a980d0140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-02-21T22:52:21.377 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:21.386+0000 7f6a9ebd3640 1 -- 172.21.15.116:0/3952776367 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a9806f710 msgr2=0x7f6a981658f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-02-21T22:52:21.377 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:21.386+0000 7f6a9ebd3640 1 --2- 172.21.15.116:0/3952776367 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a9806f710 0x7f6a981658f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-02-21T22:52:21.378 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:21.386+0000 7f6a9e3d2640 1 --2- 172.21.15.116:0/3952776367 >> v2:172.21.15.142:3300/0 conn(0x7f6a9806ae40 0x7f6a980d0140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-02-21T22:52:21.378 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:21.386+0000 7f6a9ebd3640 1 --2- 172.21.15.116:0/3952776367 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a9806f710 0x7f6a981658f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T22:52:21.378 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:21.386+0000 7f6a9e3d2640 1 --2- 172.21.15.116:0/3952776367 >> v2:172.21.15.142:3300/0 conn(0x7f6a9806ae40 0x7f6a980d0140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T22:52:22.178 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:22.187+0000 7f6a9e3d2640 1 --2- 172.21.15.116:0/3952776367 >> v2:172.21.15.142:3300/0 conn(0x7f6a9806ae40 0x7f6a980d0140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:22.179 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:22.187+0000 7f6a9ebd3640 1 --2- 172.21.15.116:0/3952776367 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a9806f710 0x7f6a981658f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:22.179 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:22.187+0000 7f6a9e3d2640 1 -- 172.21.15.116:0/3952776367 >> v2:172.21.15.142:3300/0 conn(0x7f6a9806ae40 msgr2=0x7f6a980d0140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-02-21T22:52:22.179 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:22.187+0000 7f6a9e3d2640 1 -- 172.21.15.116:0/3952776367 >> v2:172.21.15.142:3300/0 conn(0x7f6a9806ae40 msgr2=0x7f6a980d0140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-02-21T22:52:22.179 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:22.187+0000 7f6a9e3d2640 1 --2- 172.21.15.116:0/3952776367 >> v2:172.21.15.142:3300/0 conn(0x7f6a9806ae40 0x7f6a980d0140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-02-21T22:52:22.179 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:22.188+0000 7f6a9ebd3640 1 -- 172.21.15.116:0/3952776367 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a9806f710 msgr2=0x7f6a981658f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-02-21T22:52:22.179 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:22.188+0000 7f6a9ebd3640 1 -- 172.21.15.116:0/3952776367 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a9806f710 msgr2=0x7f6a981658f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-02-21T22:52:22.179 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:22.188+0000 7f6a9ebd3640 1 --2- 172.21.15.116:0/3952776367 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a9806f710 0x7f6a981658f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-02-21T22:52:22.179 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:22.188+0000 7f6a9e3d2640 1 --2- 172.21.15.116:0/3952776367 >> v2:172.21.15.142:3300/0 conn(0x7f6a9806ae40 0x7f6a980d0140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T22:52:22.179 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:22.188+0000 7f6a9ebd3640 1 --2- 172.21.15.116:0/3952776367 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a9806f710 0x7f6a981658f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T22:52:23.775 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:23.784+0000 7f6a8ffff640 1 -- 172.21.15.116:0/3952776367 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a9806f710 msgr2=0x7f6a981658f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T22:52:23.775 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:23.784+0000 7f6a8ffff640 1 --2- 172.21.15.116:0/3952776367 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a9806f710 0x7f6a981658f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:23.775 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:23.784+0000 7f6a8ffff640 1 -- 172.21.15.116:0/3952776367 >> v2:172.21.15.142:3300/0 conn(0x7f6a9806ae40 msgr2=0x7f6a980d0140 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T22:52:23.775 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:23.784+0000 7f6a8ffff640 1 --2- 172.21.15.116:0/3952776367 >> v2:172.21.15.142:3300/0 conn(0x7f6a9806ae40 0x7f6a980d0140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:23.775 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:23.784+0000 7f6a8ffff640 1 -- 172.21.15.116:0/3952776367 >> v1:172.21.15.116:6789/0 conn(0x7f6a980cf150 legacy=0x7f6a9806b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:23.775 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:23.784+0000 7f6a8ffff640 1 --2- 172.21.15.116:0/3952776367 >> v2:172.21.15.116:3300/0 conn(0x7f6a7c0036e0 0x7f6a7c005b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:23.775 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:23.784+0000 7f6a8ffff640 1 -- 172.21.15.116:0/3952776367 --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a9806df00 con 0x7f6a7c006170 2024-02-21T22:52:23.776 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:23.784+0000 7f6a8ffff640 1 -- 172.21.15.116:0/3952776367 --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a9806d940 con 0x7f6a7c0036e0 2024-02-21T22:52:23.776 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:23.784+0000 7f6a9e3d2640 1 --2- 172.21.15.116:0/3952776367 >> v2:172.21.15.116:3300/0 conn(0x7f6a7c0036e0 0x7f6a7c005b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:23.776 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:23.784+0000 7f6a9e3d2640 1 -- 172.21.15.116:0/3952776367 >> v2:172.21.15.116:3300/0 conn(0x7f6a7c0036e0 msgr2=0x7f6a7c005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-02-21T22:52:23.776 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:23.784+0000 7f6a9e3d2640 1 -- 172.21.15.116:0/3952776367 >> v2:172.21.15.116:3300/0 conn(0x7f6a7c0036e0 msgr2=0x7f6a7c005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-02-21T22:52:23.776 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:23.784+0000 7f6a9e3d2640 1 --2- 172.21.15.116:0/3952776367 >> v2:172.21.15.116:3300/0 conn(0x7f6a7c0036e0 0x7f6a7c005b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-02-21T22:52:23.776 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:23.784+0000 7f6a9e3d2640 1 --2- 172.21.15.116:0/3952776367 >> v2:172.21.15.116:3300/0 conn(0x7f6a7c0036e0 0x7f6a7c005b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T22:52:23.976 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:23.985+0000 7f6a9e3d2640 1 --2- 172.21.15.116:0/3952776367 >> v2:172.21.15.116:3300/0 conn(0x7f6a7c0036e0 0x7f6a7c005b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:23.976 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:23.985+0000 7f6a9e3d2640 1 -- 172.21.15.116:0/3952776367 >> v2:172.21.15.116:3300/0 conn(0x7f6a7c0036e0 msgr2=0x7f6a7c005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-02-21T22:52:23.976 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:23.985+0000 7f6a9e3d2640 1 -- 172.21.15.116:0/3952776367 >> v2:172.21.15.116:3300/0 conn(0x7f6a7c0036e0 msgr2=0x7f6a7c005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-02-21T22:52:23.976 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:23.985+0000 7f6a9e3d2640 1 --2- 172.21.15.116:0/3952776367 >> v2:172.21.15.116:3300/0 conn(0x7f6a7c0036e0 0x7f6a7c005b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-02-21T22:52:23.976 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:23.985+0000 7f6a9e3d2640 1 --2- 172.21.15.116:0/3952776367 >> v2:172.21.15.116:3300/0 conn(0x7f6a7c0036e0 0x7f6a7c005b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T22:52:24.377 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:24.386+0000 7f6a9e3d2640 1 --2- 172.21.15.116:0/3952776367 >> v2:172.21.15.116:3300/0 conn(0x7f6a7c0036e0 0x7f6a7c005b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:24.377 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:24.386+0000 7f6a9e3d2640 1 -- 172.21.15.116:0/3952776367 >> v2:172.21.15.116:3300/0 conn(0x7f6a7c0036e0 msgr2=0x7f6a7c005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-02-21T22:52:24.377 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:24.386+0000 7f6a9e3d2640 1 -- 172.21.15.116:0/3952776367 >> v2:172.21.15.116:3300/0 conn(0x7f6a7c0036e0 msgr2=0x7f6a7c005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-02-21T22:52:24.377 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:24.386+0000 7f6a9e3d2640 1 --2- 172.21.15.116:0/3952776367 >> v2:172.21.15.116:3300/0 conn(0x7f6a7c0036e0 0x7f6a7c005b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-02-21T22:52:24.377 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:24.386+0000 7f6a9e3d2640 1 --2- 172.21.15.116:0/3952776367 >> v2:172.21.15.116:3300/0 conn(0x7f6a7c0036e0 0x7f6a7c005b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T22:52:25.178 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:25.187+0000 7f6a9e3d2640 1 --2- 172.21.15.116:0/3952776367 >> v2:172.21.15.116:3300/0 conn(0x7f6a7c0036e0 0x7f6a7c005b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:25.178 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:25.187+0000 7f6a9e3d2640 1 -- 172.21.15.116:0/3952776367 >> v2:172.21.15.116:3300/0 conn(0x7f6a7c0036e0 msgr2=0x7f6a7c005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-02-21T22:52:25.178 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:25.187+0000 7f6a9e3d2640 1 -- 172.21.15.116:0/3952776367 >> v2:172.21.15.116:3300/0 conn(0x7f6a7c0036e0 msgr2=0x7f6a7c005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-02-21T22:52:25.178 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:25.187+0000 7f6a9e3d2640 1 --2- 172.21.15.116:0/3952776367 >> v2:172.21.15.116:3300/0 conn(0x7f6a7c0036e0 0x7f6a7c005b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-02-21T22:52:25.178 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:25.187+0000 7f6a9e3d2640 1 --2- 172.21.15.116:0/3952776367 >> v2:172.21.15.116:3300/0 conn(0x7f6a7c0036e0 0x7f6a7c005b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T22:52:26.004 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:26.014+0000 7f6a9d3d0640 1 -- 172.21.15.116:0/3952776367 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1055108687 0 0) 0x7f6a9806df00 con 0x7f6a7c006170 2024-02-21T22:52:26.004 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:26.014+0000 7f6a9d3d0640 1 -- 172.21.15.116:0/3952776367 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a84003520 con 0x7f6a7c006170 2024-02-21T22:52:26.011 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:26.019+0000 7f6a9d3d0640 1 -- 172.21.15.116:0/3952776367 <== mon.1 v1:172.21.15.142:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 6781835 0 0) 0x7f6a84003520 con 0x7f6a7c006170 2024-02-21T22:52:26.012 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:26.019+0000 7f6a9d3d0640 1 -- 172.21.15.116:0/3952776367 >> v2:172.21.15.116:3300/0 conn(0x7f6a7c0036e0 msgr2=0x7f6a7c005b20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T22:52:26.012 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:26.019+0000 7f6a9d3d0640 1 --2- 172.21.15.116:0/3952776367 >> v2:172.21.15.116:3300/0 conn(0x7f6a7c0036e0 0x7f6a7c005b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:26.012 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:26.019+0000 7f6a9d3d0640 1 -- 172.21.15.116:0/3952776367 --> v1:172.21.15.142:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a7c00af10 con 0x7f6a7c006170 2024-02-21T22:52:26.012 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:26.019+0000 7f6a9d3d0640 1 -- 172.21.15.116:0/3952776367 <== mon.1 v1:172.21.15.142:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1101981580 0 0) 0x7f6a880016f0 con 0x7f6a7c006170 2024-02-21T22:52:26.012 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:26.019+0000 7f6a9d3d0640 1 -- 172.21.15.116:0/3952776367 >> v1:172.21.15.142:6789/0 conn(0x7f6a7c006170 legacy=0x7f6a7c008630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:26.012 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:26.019+0000 7f6a9ebd3640 1 -- 172.21.15.116:0/3952776367 reap_dead start 2024-02-21T22:52:26.012 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:26.019+0000 7f6a9d3d0640 1 --2- 172.21.15.116:0/3952776367 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6a84003a00 0x7f6a84003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:26.012 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:26.019+0000 7f6a9d3d0640 1 --2- 172.21.15.116:0/3952776367 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a84004800 0x7f6a84004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:26.012 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:26.019+0000 7f6a9d3d0640 1 --2- 172.21.15.116:0/3952776367 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a840053c0 0x7f6a8400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:26.012 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:26.019+0000 7f6a9d3d0640 1 -- 172.21.15.116:0/3952776367 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a9806d940 con 0x7f6a84003a00 2024-02-21T22:52:26.012 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:26.019+0000 7f6a9d3d0640 1 -- 172.21.15.116:0/3952776367 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a8400c280 con 0x7f6a84004800 2024-02-21T22:52:26.012 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:26.019+0000 7f6a9d3d0640 1 -- 172.21.15.116:0/3952776367 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a8400c480 con 0x7f6a840053c0 2024-02-21T22:52:26.013 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:26.020+0000 7f6a9e3d2640 1 --2- 172.21.15.116:0/3952776367 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6a84003a00 0x7f6a84003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:26.013 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:26.020+0000 7f6a9ebd3640 1 --2- 172.21.15.116:0/3952776367 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a840053c0 0x7f6a8400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:26.013 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:26.020+0000 7f6a9dbd1640 1 --2- 172.21.15.116:0/3952776367 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a84004800 0x7f6a84004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:26.013 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:26.020+0000 7f6a9e3d2640 1 -- 172.21.15.116:0/3952776367 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a840053c0 msgr2=0x7f6a8400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:52:26.013 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:26.020+0000 7f6a9e3d2640 1 --2- 172.21.15.116:0/3952776367 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a840053c0 0x7f6a8400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:26.013 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:26.020+0000 7f6a9e3d2640 1 -- 172.21.15.116:0/3952776367 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a84004800 msgr2=0x7f6a84004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:52:26.013 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:26.020+0000 7f6a9e3d2640 1 --2- 172.21.15.116:0/3952776367 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a84004800 0x7f6a84004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:26.013 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:26.020+0000 7f6a9e3d2640 1 -- 172.21.15.116:0/3952776367 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a84003520 con 0x7f6a84003a00 2024-02-21T22:52:26.013 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:26.021+0000 7f6a9e3d2640 1 --2- 172.21.15.116:0/3952776367 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6a84003a00 0x7f6a84003e00 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f6a94019cc0 tx=0x7f6a84005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91f0628831ecc37 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:52:26.013 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:26.021+0000 7f6a9d3d0640 1 -- 172.21.15.116:0/3952776367 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a94019940 con 0x7f6a84003a00 2024-02-21T22:52:26.013 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:26.021+0000 7f6a9d3d0640 1 -- 172.21.15.116:0/3952776367 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a9402f500 con 0x7f6a84003a00 2024-02-21T22:52:26.013 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:26.021+0000 7f6a9d3d0640 1 -- 172.21.15.116:0/3952776367 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a9402f910 con 0x7f6a84003a00 2024-02-21T22:52:26.017 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:26.022+0000 7f6aa0636640 1 -- 172.21.15.116:0/3952776367 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6a84003a00 msgr2=0x7f6a84003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:26.017 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:26.022+0000 7f6aa0636640 1 --2- 172.21.15.116:0/3952776367 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6a84003a00 0x7f6a84003e00 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f6a94019cc0 tx=0x7f6a84005830 comp rx=0 tx=0).stop 2024-02-21T22:52:26.017 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:26.022+0000 7f6aa0636640 1 -- 172.21.15.116:0/3952776367 shutdown_connections 2024-02-21T22:52:26.017 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:26.022+0000 7f6aa0636640 1 --2- 172.21.15.116:0/3952776367 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a840053c0 0x7f6a8400b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:26.017 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:26.022+0000 7f6aa0636640 1 --2- 172.21.15.116:0/3952776367 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6a84003a00 0x7f6a84003e00 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:26.017 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:26.022+0000 7f6aa0636640 1 --2- 172.21.15.116:0/3952776367 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a84004800 0x7f6a84004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:26.017 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:26.022+0000 7f6aa0636640 1 -- 172.21.15.116:0/3952776367 >> 172.21.15.116:0/3952776367 conn(0x7f6a980d0b00 msgr2=0x7f6a980d0f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:52:26.017 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:26.022+0000 7f6aa0636640 1 -- 172.21.15.116:0/3952776367 shutdown_connections 2024-02-21T22:52:26.018 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:26.022+0000 7f6aa0636640 1 -- 172.21.15.116:0/3952776367 wait complete. 2024-02-21T22:52:26.018 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:26.023+0000 7f6aa0636640 1 Processor -- start 2024-02-21T22:52:26.018 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:26.023+0000 7f6aa0636640 1 -- start start 2024-02-21T22:52:26.018 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:26.024+0000 7f6aa0636640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a84003a00 0x7f6a980abee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:26.018 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:26.024+0000 7f6aa0636640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6a84004800 0x7f6a980b3a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:26.018 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:26.024+0000 7f6aa0636640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a840053c0 0x7f6a980b3fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:26.018 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:26.024+0000 7f6aa0636640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a98145800 con 0x7f6a84004800 2024-02-21T22:52:26.018 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:26.024+0000 7f6aa0636640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a980d1930 con 0x7f6a84003a00 2024-02-21T22:52:26.018 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:26.024+0000 7f6aa0636640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a98145980 con 0x7f6a840053c0 2024-02-21T22:52:26.018 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:26.024+0000 7f6a9dbd1640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6a84004800 0x7f6a980b3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:26.018 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:26.024+0000 7f6a9e3d2640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a84003a00 0x7f6a980abee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:26.018 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:26.024+0000 7f6a9dbd1640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6a84004800 0x7f6a980b3a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:60072/0 (socket says 172.21.15.116:60072) 2024-02-21T22:52:26.018 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:26.024+0000 7f6a9e3d2640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a84003a00 0x7f6a980abee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.116:55052/0 (socket says 172.21.15.116:55052) 2024-02-21T22:52:26.018 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:26.024+0000 7f6a9dbd1640 1 -- 172.21.15.116:0/2806987327 learned_addr learned my addr 172.21.15.116:0/2806987327 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:52:26.019 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:26.024+0000 7f6a9ebd3640 1 --2- 172.21.15.116:0/2806987327 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a840053c0 0x7f6a980b3fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:26.019 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:26.025+0000 7f6a9dbd1640 1 -- 172.21.15.116:0/2806987327 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a840053c0 msgr2=0x7f6a980b3fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:26.019 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:26.025+0000 7f6a9dbd1640 1 --2- 172.21.15.116:0/2806987327 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a840053c0 0x7f6a980b3fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:26.019 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:26.025+0000 7f6a9dbd1640 1 -- 172.21.15.116:0/2806987327 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a84003a00 msgr2=0x7f6a980abee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:26.019 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:26.025+0000 7f6a9dbd1640 1 --2- 172.21.15.116:0/2806987327 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a84003a00 0x7f6a980abee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:26.019 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:26.025+0000 7f6a9dbd1640 1 -- 172.21.15.116:0/2806987327 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a980b4610 con 0x7f6a84004800 2024-02-21T22:52:26.019 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:26.025+0000 7f6a9dbd1640 1 --2- 172.21.15.116:0/2806987327 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6a84004800 0x7f6a980b3a70 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f6a88000c00 tx=0x7f6a8800fc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:52:26.019 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:26.025+0000 7f6a8effd640 1 -- 172.21.15.116:0/2806987327 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a88005a20 con 0x7f6a84004800 2024-02-21T22:52:26.019 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:26.025+0000 7f6a8effd640 1 -- 172.21.15.116:0/2806987327 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a88018070 con 0x7f6a84004800 2024-02-21T22:52:26.019 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:26.025+0000 7f6aa0636640 1 -- 172.21.15.116:0/2806987327 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a980b48f0 con 0x7f6a84004800 2024-02-21T22:52:26.019 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:26.025+0000 7f6a8effd640 1 -- 172.21.15.116:0/2806987327 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a88005e20 con 0x7f6a84004800 2024-02-21T22:52:26.019 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:26.025+0000 7f6aa0636640 1 -- 172.21.15.116:0/2806987327 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a980b4eb0 con 0x7f6a84004800 2024-02-21T22:52:26.019 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:26.025+0000 7f6a8effd640 1 -- 172.21.15.116:0/2806987327 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f6a880070d0 con 0x7f6a84004800 2024-02-21T22:52:26.019 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:26.025+0000 7f6a8effd640 1 -- 172.21.15.116:0/2806987327 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f6a8801d460 con 0x7f6a84004800 2024-02-21T22:52:26.019 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:26.026+0000 7f6aa0636640 1 -- 172.21.15.116:0/2806987327 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a981f48d0 con 0x7f6a84004800 2024-02-21T22:52:26.020 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:26.029+0000 7f6a8effd640 1 -- 172.21.15.116:0/2806987327 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f6a880075a0 con 0x7f6a84004800 2024-02-21T22:52:26.084 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:26.094+0000 7f6aa0636640 1 -- 172.21.15.116:0/2806987327 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f6a980752f0 con 0x7f6a84004800 2024-02-21T22:52:26.088 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:26.097+0000 7f6a8effd640 1 -- 172.21.15.116:0/2806987327 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f6a8800d700 con 0x7f6a84004800 2024-02-21T22:52:26.088 INFO:teuthology.orchestra.run.smithi116.stderr:adjusted tunables profile to default 2024-02-21T22:52:26.089 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:26.098+0000 7f6aa0636640 1 -- 172.21.15.116:0/2806987327 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6a84004800 msgr2=0x7f6a980b3a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:26.089 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:26.098+0000 7f6aa0636640 1 --2- 172.21.15.116:0/2806987327 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6a84004800 0x7f6a980b3a70 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f6a88000c00 tx=0x7f6a8800fc90 comp rx=0 tx=0).stop 2024-02-21T22:52:26.089 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:26.098+0000 7f6aa0636640 1 -- 172.21.15.116:0/2806987327 shutdown_connections 2024-02-21T22:52:26.089 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:26.098+0000 7f6aa0636640 1 --2- 172.21.15.116:0/2806987327 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a840053c0 0x7f6a980b3fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:26.089 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:26.098+0000 7f6aa0636640 1 --2- 172.21.15.116:0/2806987327 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6a84004800 0x7f6a980b3a70 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:26.090 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:26.098+0000 7f6aa0636640 1 --2- 172.21.15.116:0/2806987327 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a84003a00 0x7f6a980abee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:26.090 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:26.098+0000 7f6aa0636640 1 -- 172.21.15.116:0/2806987327 >> 172.21.15.116:0/2806987327 conn(0x7f6a980d0b00 msgr2=0x7f6a980b05e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:52:26.090 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:26.098+0000 7f6aa0636640 1 -- 172.21.15.116:0/2806987327 shutdown_connections 2024-02-21T22:52:26.090 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:26.098+0000 7f6aa0636640 1 -- 172.21.15.116:0/2806987327 wait complete. 2024-02-21T22:52:26.100 INFO:tasks.ceph:check_enable_crimson: False 2024-02-21T22:52:26.100 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-02-21T22:52:26.100 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-02-21T22:52:26.100 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-02-21T22:52:26.128 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-02-21T22:52:26.128 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-02-21T22:52:26.195 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-02-21T22:52:26.196 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-02-21T22:52:26.262 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-02-21T22:52:26.262 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-02-21T22:52:26.329 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-02-21T22:52:26.329 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-02-21T22:52:26.356 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-02-21T22:52:26.356 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-02-21T22:52:26.423 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-02-21T22:52:26.424 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-02-21T22:52:26.491 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-02-21T22:52:26.491 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-02-21T22:52:26.496 INFO:tasks.ceph.mgr.x.smithi142.stderr:2024-02-21T22:52:26.505+0000 7f3555a0d040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-02-21T22:52:26.521 DEBUG:teuthology.orchestra.run.smithi142:> sudo ceph --cluster ceph osd new 4f09126b-b5e4-4876-8b08-f5cbb967388a 0 2024-02-21T22:52:26.552 INFO:tasks.ceph.mgr.x.smithi142.stderr:2024-02-21T22:52:26.561+0000 7f3555a0d040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-02-21T22:52:26.653 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:26.662+0000 7fadc6181640 1 Processor -- start 2024-02-21T22:52:26.653 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:26.662+0000 7fadc6181640 1 -- start start 2024-02-21T22:52:26.654 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:26.663+0000 7fadc6181640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fadc00ced40 0x7fadc00d2740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:26.654 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:26.663+0000 7fadc6181640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadc00cc310 con 0x7fadc00cfa00 2024-02-21T22:52:26.655 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:26.663+0000 7fadc6181640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadc00cc5f0 con 0x7fadc0161790 2024-02-21T22:52:26.655 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:26.663+0000 7fadc6181640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadc0161b70 con 0x7fadc00ced40 2024-02-21T22:52:26.655 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:26.663+0000 7fadbf7fe640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fadc0161790 0x7fadc00ce630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:39202/0 (socket says 172.21.15.142:39202) 2024-02-21T22:52:26.655 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:26.663+0000 7fadbf7fe640 1 -- 172.21.15.142:0/3991591396 learned_addr learned my addr 172.21.15.142:0/3991591396 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-02-21T22:52:26.655 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:26.663+0000 7fadb6ffd640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fadc00ced40 0x7fadc00d2740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:26.655 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:26.663+0000 7fadb6ffd640 1 -- 172.21.15.142:0/3991591396 >> v1:172.21.15.142:6789/0 conn(0x7fadc0161790 legacy=0x7fadc00ce630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:26.655 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:26.663+0000 7fadb6ffd640 1 -- 172.21.15.142:0/3991591396 >> v1:172.21.15.116:6789/0 conn(0x7fadc00cfa00 legacy=0x7fadc00cd3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:52:26.655 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:26.663+0000 7fadbeffd640 1 -- 172.21.15.142:0/3991591396 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2841347337 0 0) 0x7fadc00cc5f0 con 0x7fadc0161790 2024-02-21T22:52:26.655 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:26.663+0000 7fadb6ffd640 1 -- 172.21.15.142:0/3991591396 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadc00cc8d0 con 0x7fadc00ced40 2024-02-21T22:52:26.656 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:26.664+0000 7fadb6ffd640 1 --2- 172.21.15.142:0/3991591396 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fadc00ced40 0x7fadc00d2740 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fada80097a0 tx=0x7fada802b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e2d9bc07fe2c2d24 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:52:26.656 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:26.664+0000 7fadbeffd640 1 -- 172.21.15.142:0/3991591396 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fada8035020 con 0x7fadc00ced40 2024-02-21T22:52:26.656 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:26.664+0000 7fadbeffd640 1 -- 172.21.15.142:0/3991591396 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fada8031830 con 0x7fadc00ced40 2024-02-21T22:52:26.657 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:26.664+0000 7fadbeffd640 1 -- 172.21.15.142:0/3991591396 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fada8031c00 con 0x7fadc00ced40 2024-02-21T22:52:26.657 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:26.665+0000 7fadc6181640 1 -- 172.21.15.142:0/3991591396 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fadc00ced40 msgr2=0x7fadc00d2740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:26.657 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:26.665+0000 7fadc6181640 1 --2- 172.21.15.142:0/3991591396 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fadc00ced40 0x7fadc00d2740 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fada80097a0 tx=0x7fada802b8d0 comp rx=0 tx=0).stop 2024-02-21T22:52:26.657 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:26.665+0000 7fadc6181640 1 -- 172.21.15.142:0/3991591396 shutdown_connections 2024-02-21T22:52:26.657 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:26.665+0000 7fadc6181640 1 --2- 172.21.15.142:0/3991591396 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fadc00ced40 0x7fadc00d2740 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:26.657 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:26.665+0000 7fadc6181640 1 -- 172.21.15.142:0/3991591396 >> 172.21.15.142:0/3991591396 conn(0x7fadc00d1c20 msgr2=0x7fadc00d2030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:52:26.657 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:26.665+0000 7fadc6181640 1 -- 172.21.15.142:0/3991591396 shutdown_connections 2024-02-21T22:52:26.657 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:26.665+0000 7fadc6181640 1 -- 172.21.15.142:0/3991591396 wait complete. 2024-02-21T22:52:26.657 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:26.666+0000 7fadc6181640 1 Processor -- start 2024-02-21T22:52:26.659 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:26.666+0000 7fadc6181640 1 -- start start 2024-02-21T22:52:26.659 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:26.667+0000 7fadc6181640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fadc00ced40 0x7fadc0158f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:26.660 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:26.667+0000 7fadc6181640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fadc00cfa00 0x7fadc00b50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:26.660 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:26.667+0000 7fadc6181640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fadc0161790 0x7fadc00c8070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:26.660 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:26.667+0000 7fadc6181640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadc00b12c0 con 0x7fadc00cfa00 2024-02-21T22:52:26.660 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:26.667+0000 7fadc6181640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadc00cce90 con 0x7fadc0161790 2024-02-21T22:52:26.660 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:26.667+0000 7fadc6181640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadc00b1440 con 0x7fadc00ced40 2024-02-21T22:52:26.660 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:26.667+0000 7fadbf7fe640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fadc00ced40 0x7fadc0158f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:26.660 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:26.667+0000 7fadbffff640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fadc0161790 0x7fadc00c8070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:26.660 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:26.667+0000 7fadbf7fe640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fadc00ced40 0x7fadc0158f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.142:57598/0 (socket says 172.21.15.142:57598) 2024-02-21T22:52:26.660 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:26.667+0000 7fadbf7fe640 1 -- 172.21.15.142:0/3852660865 learned_addr learned my addr 172.21.15.142:0/3852660865 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-02-21T22:52:26.660 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:26.667+0000 7fadb6ffd640 1 --2- 172.21.15.142:0/3852660865 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fadc00cfa00 0x7fadc00b50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:26.660 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:26.667+0000 7fadbf7fe640 1 -- 172.21.15.142:0/3852660865 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fadc0161790 msgr2=0x7fadc00c8070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:26.660 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:26.667+0000 7fadbf7fe640 1 --2- 172.21.15.142:0/3852660865 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fadc0161790 0x7fadc00c8070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:26.660 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:26.667+0000 7fadbf7fe640 1 -- 172.21.15.142:0/3852660865 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fadc00cfa00 msgr2=0x7fadc00b50c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:26.660 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:26.667+0000 7fadbf7fe640 1 --2- 172.21.15.142:0/3852660865 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fadc00cfa00 0x7fadc00b50c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:26.661 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:26.667+0000 7fadbf7fe640 1 -- 172.21.15.142:0/3852660865 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadc00b7220 con 0x7fadc00ced40 2024-02-21T22:52:26.661 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:26.667+0000 7fadbffff640 1 --2- 172.21.15.142:0/3852660865 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fadc0161790 0x7fadc00c8070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T22:52:26.661 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:26.667+0000 7fadbf7fe640 1 --2- 172.21.15.142:0/3852660865 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fadc00ced40 0x7fadc0158f70 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fadb000c430 tx=0x7fadb000c8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:52:26.661 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:26.667+0000 7fadbcff9640 1 -- 172.21.15.142:0/3852660865 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadb00074e0 con 0x7fadc00ced40 2024-02-21T22:52:26.661 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:26.668+0000 7fadbcff9640 1 -- 172.21.15.142:0/3852660865 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadb00047e0 con 0x7fadc00ced40 2024-02-21T22:52:26.661 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:26.668+0000 7fadbcff9640 1 -- 172.21.15.142:0/3852660865 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadb0004bd0 con 0x7fadc00ced40 2024-02-21T22:52:26.661 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:26.668+0000 7fadc6181640 1 -- 172.21.15.142:0/3852660865 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadc00b7560 con 0x7fadc00ced40 2024-02-21T22:52:26.661 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:26.668+0000 7fadc6181640 1 -- 172.21.15.142:0/3852660865 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadc00c6800 con 0x7fadc00ced40 2024-02-21T22:52:26.661 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:26.668+0000 7fadbcff9640 1 -- 172.21.15.142:0/3852660865 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7fadb0011070 con 0x7fadc00ced40 2024-02-21T22:52:26.661 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:26.668+0000 7fadbcff9640 1 -- 172.21.15.142:0/3852660865 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7fadb0013700 con 0x7fadc00ced40 2024-02-21T22:52:26.661 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:26.669+0000 7fadc6181640 1 -- 172.21.15.142:0/3852660865 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadc00752f0 con 0x7fadc00ced40 2024-02-21T22:52:26.663 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:26.673+0000 7fadbcff9640 1 -- 172.21.15.142:0/3852660865 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7fadc00b7560 con 0x7fadc00ced40 2024-02-21T22:52:26.735 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:26.745+0000 7fadc6181640 1 -- 172.21.15.142:0/3852660865 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "osd new", "uuid": "4f09126b-b5e4-4876-8b08-f5cbb967388a", "id": 0} v 0) v1 -- 0x7fadc015b6c0 con 0x7fadc00ced40 2024-02-21T22:52:26.739 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:26.748+0000 7fadbcff9640 1 -- 172.21.15.142:0/3852660865 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "4f09126b-b5e4-4876-8b08-f5cbb967388a", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7fadb0013900 con 0x7fadc00ced40 2024-02-21T22:52:26.740 INFO:teuthology.orchestra.run.smithi142.stdout:0 2024-02-21T22:52:26.741 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:26.749+0000 7fadc6181640 1 -- 172.21.15.142:0/3852660865 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fadc00ced40 msgr2=0x7fadc0158f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:26.742 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:26.749+0000 7fadc6181640 1 --2- 172.21.15.142:0/3852660865 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fadc00ced40 0x7fadc0158f70 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fadb000c430 tx=0x7fadb000c8f0 comp rx=0 tx=0).stop 2024-02-21T22:52:26.742 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:26.749+0000 7fadc6181640 1 -- 172.21.15.142:0/3852660865 shutdown_connections 2024-02-21T22:52:26.742 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:26.749+0000 7fadc6181640 1 --2- 172.21.15.142:0/3852660865 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fadc0161790 0x7fadc00c8070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:26.742 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:26.749+0000 7fadc6181640 1 --2- 172.21.15.142:0/3852660865 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fadc00cfa00 0x7fadc00b50c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:26.742 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:26.749+0000 7fadc6181640 1 --2- 172.21.15.142:0/3852660865 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fadc00ced40 0x7fadc0158f70 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:26.742 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:26.749+0000 7fadc6181640 1 -- 172.21.15.142:0/3852660865 >> 172.21.15.142:0/3852660865 conn(0x7fadc00d1c20 msgr2=0x7fadc00ce630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:52:26.743 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:26.749+0000 7fadc6181640 1 -- 172.21.15.142:0/3852660865 shutdown_connections 2024-02-21T22:52:26.743 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:26.749+0000 7fadc6181640 1 -- 172.21.15.142:0/3852660865 wait complete. 2024-02-21T22:52:26.751 DEBUG:teuthology.orchestra.run.smithi142:> sudo ceph --cluster ceph osd new 7272c51d-51f9-4536-931d-33ad7a4b377e 1 2024-02-21T22:52:26.854 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:26.860+0000 7f86fa6d5640 1 Processor -- start 2024-02-21T22:52:26.854 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:26.860+0000 7f86fa6d5640 1 -- start start 2024-02-21T22:52:26.854 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:26.860+0000 7f86fa6d5640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f86f415ee40 0x7f86f406f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:26.854 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:26.861+0000 7f86fa6d5640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f86f406b550 0x7f86f4161a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:26.854 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:26.861+0000 7f86fa6d5640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86f40cd710 con 0x7f86f415f220 2024-02-21T22:52:26.854 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:26.861+0000 7f86fa6d5640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86f415e6d0 con 0x7f86f406b550 2024-02-21T22:52:26.854 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:26.861+0000 7f86fa6d5640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86f40cd9f0 con 0x7f86f415ee40 2024-02-21T22:52:26.854 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:26.861+0000 7f86f3fff640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f86f415ee40 0x7f86f406f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:26.854 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:26.861+0000 7f86f3fff640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f86f415ee40 0x7f86f406f0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:46040/0 (socket says 172.21.15.142:46040) 2024-02-21T22:52:26.855 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:26.861+0000 7f86f3fff640 1 -- 172.21.15.142:0/186031824 learned_addr learned my addr 172.21.15.142:0/186031824 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-02-21T22:52:26.855 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:26.861+0000 7f86f8c72640 1 --2- 172.21.15.142:0/186031824 >> v2:172.21.15.116:3300/0 conn(0x7f86f406b550 0x7f86f4161a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:26.855 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:26.861+0000 7f86f3fff640 1 -- 172.21.15.142:0/186031824 >> v2:172.21.15.116:3300/0 conn(0x7f86f406b550 msgr2=0x7f86f4161a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:52:26.855 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:26.861+0000 7f86f3fff640 1 --2- 172.21.15.142:0/186031824 >> v2:172.21.15.116:3300/0 conn(0x7f86f406b550 0x7f86f4161a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:26.855 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:26.861+0000 7f86f3fff640 1 -- 172.21.15.142:0/186031824 >> v1:172.21.15.116:6789/0 conn(0x7f86f415f220 legacy=0x7f86f406ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:26.855 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:26.861+0000 7f86f3fff640 1 -- 172.21.15.142:0/186031824 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86f40cdcd0 con 0x7f86f415ee40 2024-02-21T22:52:26.855 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:26.861+0000 7f86f8c72640 1 --2- 172.21.15.142:0/186031824 >> v2:172.21.15.116:3300/0 conn(0x7f86f406b550 0x7f86f4161a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T22:52:26.855 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:26.862+0000 7f86f3fff640 1 --2- 172.21.15.142:0/186031824 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f86f415ee40 0x7f86f406f0b0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f86f40b3130 tx=0x7f86e402b9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ba6c0e3d2e8862b1 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:52:26.855 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:26.862+0000 7f86f2ffd640 1 -- 172.21.15.142:0/186031824 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86e4034070 con 0x7f86f415ee40 2024-02-21T22:52:26.855 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:26.862+0000 7f86f2ffd640 1 -- 172.21.15.142:0/186031824 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86e4030860 con 0x7f86f415ee40 2024-02-21T22:52:26.855 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:26.862+0000 7f86f2ffd640 1 -- 172.21.15.142:0/186031824 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86e4030c30 con 0x7f86f415ee40 2024-02-21T22:52:26.855 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:26.862+0000 7f86fa6d5640 1 -- 172.21.15.142:0/186031824 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f86f415ee40 msgr2=0x7f86f406f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:26.855 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:26.862+0000 7f86fa6d5640 1 --2- 172.21.15.142:0/186031824 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f86f415ee40 0x7f86f406f0b0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f86f40b3130 tx=0x7f86e402b9a0 comp rx=0 tx=0).stop 2024-02-21T22:52:26.855 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:26.862+0000 7f86fa6d5640 1 -- 172.21.15.142:0/186031824 shutdown_connections 2024-02-21T22:52:26.855 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:26.862+0000 7f86fa6d5640 1 --2- 172.21.15.142:0/186031824 >> v2:172.21.15.116:3300/0 conn(0x7f86f406b550 0x7f86f4161a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:26.856 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:26.862+0000 7f86fa6d5640 1 --2- 172.21.15.142:0/186031824 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f86f415ee40 0x7f86f406f0b0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:26.856 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:26.862+0000 7f86fa6d5640 1 -- 172.21.15.142:0/186031824 >> 172.21.15.142:0/186031824 conn(0x7f86f40b2590 msgr2=0x7f86f40b2970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:52:26.856 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:26.862+0000 7f86fa6d5640 1 -- 172.21.15.142:0/186031824 shutdown_connections 2024-02-21T22:52:26.856 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:26.862+0000 7f86fa6d5640 1 -- 172.21.15.142:0/186031824 wait complete. 2024-02-21T22:52:26.859 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:26.864+0000 7f86fa6d5640 1 Processor -- start 2024-02-21T22:52:26.859 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:26.864+0000 7f86fa6d5640 1 -- start start 2024-02-21T22:52:26.859 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:26.864+0000 7f86fa6d5640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f86f406b550 0x7f86f4157cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:26.859 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:26.864+0000 7f86fa6d5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f86f415ee40 0x7f86f40b51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:26.859 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:26.864+0000 7f86fa6d5640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f86f40b5700 0x7f86f40ae9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:26.859 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:26.864+0000 7f86fa6d5640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86f406f5f0 con 0x7f86f406b550 2024-02-21T22:52:26.859 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:26.864+0000 7f86fa6d5640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86f40cd400 con 0x7f86f415ee40 2024-02-21T22:52:26.859 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:26.864+0000 7f86fa6d5640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86f40b0010 con 0x7f86f40b5700 2024-02-21T22:52:26.859 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:26.864+0000 7f86f37fe640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f86f415ee40 0x7f86f40b51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:26.859 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:26.865+0000 7f86f37fe640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f86f415ee40 0x7f86f40b51c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:46054/0 (socket says 172.21.15.142:46054) 2024-02-21T22:52:26.860 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:26.865+0000 7f86f37fe640 1 -- 172.21.15.142:0/1194955244 learned_addr learned my addr 172.21.15.142:0/1194955244 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-02-21T22:52:26.860 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:26.865+0000 7f86f8c72640 1 --2- 172.21.15.142:0/1194955244 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f86f40b5700 0x7f86f40ae9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:26.860 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:26.865+0000 7f86f3fff640 1 --2- 172.21.15.142:0/1194955244 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f86f406b550 0x7f86f4157cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:26.860 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:26.865+0000 7f86f37fe640 1 -- 172.21.15.142:0/1194955244 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f86f40b5700 msgr2=0x7f86f40ae9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:26.860 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:26.865+0000 7f86f37fe640 1 --2- 172.21.15.142:0/1194955244 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f86f40b5700 0x7f86f40ae9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:26.860 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:26.865+0000 7f86f37fe640 1 -- 172.21.15.142:0/1194955244 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f86f406b550 msgr2=0x7f86f4157cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:26.860 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:26.865+0000 7f86f37fe640 1 --2- 172.21.15.142:0/1194955244 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f86f406b550 0x7f86f4157cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:26.860 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:26.865+0000 7f86f37fe640 1 -- 172.21.15.142:0/1194955244 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86f41581f0 con 0x7f86f415ee40 2024-02-21T22:52:26.860 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:26.865+0000 7f86f37fe640 1 --2- 172.21.15.142:0/1194955244 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f86f415ee40 0x7f86f40b51c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f86e800c3f0 tx=0x7f86e800c7f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:52:26.860 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:26.865+0000 7f86f0ff9640 1 -- 172.21.15.142:0/1194955244 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86e80052d0 con 0x7f86f415ee40 2024-02-21T22:52:26.860 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:26.865+0000 7f86f0ff9640 1 -- 172.21.15.142:0/1194955244 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86e8005490 con 0x7f86f415ee40 2024-02-21T22:52:26.860 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:26.865+0000 7f86fa6d5640 1 -- 172.21.15.142:0/1194955244 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86f40c52d0 con 0x7f86f415ee40 2024-02-21T22:52:26.860 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:26.865+0000 7f86f0ff9640 1 -- 172.21.15.142:0/1194955244 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86e8007260 con 0x7f86f415ee40 2024-02-21T22:52:26.860 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:26.865+0000 7f86fa6d5640 1 -- 172.21.15.142:0/1194955244 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86f40c5850 con 0x7f86f415ee40 2024-02-21T22:52:26.861 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:26.865+0000 7f86f0ff9640 1 -- 172.21.15.142:0/1194955244 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f86e8007400 con 0x7f86f415ee40 2024-02-21T22:52:26.861 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:26.865+0000 7f86f0ff9640 1 -- 172.21.15.142:0/1194955244 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f86e8003ad0 con 0x7f86f415ee40 2024-02-21T22:52:26.861 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:26.866+0000 7f86fa6d5640 1 -- 172.21.15.142:0/1194955244 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86f40b5b10 con 0x7f86f415ee40 2024-02-21T22:52:26.861 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:26.868+0000 7f86f0ff9640 1 -- 172.21.15.142:0/1194955244 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f86f40b5b10 con 0x7f86f415ee40 2024-02-21T22:52:26.931 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:26.940+0000 7f86fa6d5640 1 -- 172.21.15.142:0/1194955244 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd new", "uuid": "7272c51d-51f9-4536-931d-33ad7a4b377e", "id": 1} v 0) v1 -- 0x7f86f40752f0 con 0x7f86f415ee40 2024-02-21T22:52:26.936 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:26.945+0000 7f86f0ff9640 1 -- 172.21.15.142:0/1194955244 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7272c51d-51f9-4536-931d-33ad7a4b377e", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f86e80035f0 con 0x7f86f415ee40 2024-02-21T22:52:26.936 INFO:teuthology.orchestra.run.smithi142.stdout:1 2024-02-21T22:52:26.937 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:26.946+0000 7f86fa6d5640 1 -- 172.21.15.142:0/1194955244 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f86f415ee40 msgr2=0x7f86f40b51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:26.938 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:26.946+0000 7f86fa6d5640 1 --2- 172.21.15.142:0/1194955244 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f86f415ee40 0x7f86f40b51c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f86e800c3f0 tx=0x7f86e800c7f0 comp rx=0 tx=0).stop 2024-02-21T22:52:26.938 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:26.946+0000 7f86fa6d5640 1 -- 172.21.15.142:0/1194955244 shutdown_connections 2024-02-21T22:52:26.938 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:26.946+0000 7f86fa6d5640 1 --2- 172.21.15.142:0/1194955244 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f86f40b5700 0x7f86f40ae9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:26.938 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:26.946+0000 7f86fa6d5640 1 --2- 172.21.15.142:0/1194955244 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f86f415ee40 0x7f86f40b51c0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:26.938 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:26.946+0000 7f86fa6d5640 1 --2- 172.21.15.142:0/1194955244 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f86f406b550 0x7f86f4157cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:26.938 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:26.946+0000 7f86fa6d5640 1 -- 172.21.15.142:0/1194955244 >> 172.21.15.142:0/1194955244 conn(0x7f86f40b2590 msgr2=0x7f86f406ae40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:52:26.938 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:26.947+0000 7f86fa6d5640 1 -- 172.21.15.142:0/1194955244 shutdown_connections 2024-02-21T22:52:26.938 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:26.947+0000 7f86fa6d5640 1 -- 172.21.15.142:0/1194955244 wait complete. 2024-02-21T22:52:26.948 DEBUG:teuthology.orchestra.run.smithi142:> sudo ceph --cluster ceph osd new 2589616c-adf1-4187-aac3-735256cf624b 2 2024-02-21T22:52:27.054 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.059+0000 7fc25391e640 1 Processor -- start 2024-02-21T22:52:27.054 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.059+0000 7fc25391e640 1 -- start start 2024-02-21T22:52:27.054 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.060+0000 7fc25391e640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc24c0cf670 0x7fc24c06df30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:27.054 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.060+0000 7fc25391e640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc24c15f300 con 0x7fc24c0cf290 2024-02-21T22:52:27.054 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.060+0000 7fc25391e640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc24c15f5e0 con 0x7fc24c06e470 2024-02-21T22:52:27.054 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.060+0000 7fc25391e640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc24c0cb930 con 0x7fc24c0cf670 2024-02-21T22:52:27.054 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.060+0000 7fc250eb9640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc24c0cf670 0x7fc24c06df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:27.054 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.060+0000 7fc251ebb640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fc24c06e470 0x7fc24c0cc130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:39212/0 (socket says 172.21.15.142:39212) 2024-02-21T22:52:27.054 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.060+0000 7fc251ebb640 1 -- 172.21.15.142:0/1303601998 learned_addr learned my addr 172.21.15.142:0/1303601998 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-02-21T22:52:27.054 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.060+0000 7fc250eb9640 1 -- 172.21.15.142:0/1303601998 >> v1:172.21.15.142:6789/0 conn(0x7fc24c06e470 legacy=0x7fc24c0cc130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:27.054 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.060+0000 7fc250eb9640 1 -- 172.21.15.142:0/1303601998 >> v1:172.21.15.116:6789/0 conn(0x7fc24c0cf290 legacy=0x7fc24c15e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:27.054 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.060+0000 7fc250eb9640 1 -- 172.21.15.142:0/1303601998 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc24c0cbc10 con 0x7fc24c0cf670 2024-02-21T22:52:27.054 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.061+0000 7fc250eb9640 1 --2- 172.21.15.142:0/1303601998 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc24c0cf670 0x7fc24c06df30 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fc2480097a0 tx=0x7fc24802b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6897ed97fa812978 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:52:27.055 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.061+0000 7fc243fff640 1 -- 172.21.15.142:0/1303601998 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc248035020 con 0x7fc24c0cf670 2024-02-21T22:52:27.055 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.061+0000 7fc243fff640 1 -- 172.21.15.142:0/1303601998 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc248031830 con 0x7fc24c0cf670 2024-02-21T22:52:27.055 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.061+0000 7fc243fff640 1 -- 172.21.15.142:0/1303601998 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc248031c00 con 0x7fc24c0cf670 2024-02-21T22:52:27.055 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.062+0000 7fc25391e640 1 -- 172.21.15.142:0/1303601998 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc24c0cf670 msgr2=0x7fc24c06df30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:27.055 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.062+0000 7fc25391e640 1 --2- 172.21.15.142:0/1303601998 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc24c0cf670 0x7fc24c06df30 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fc2480097a0 tx=0x7fc24802b8d0 comp rx=0 tx=0).stop 2024-02-21T22:52:27.055 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.062+0000 7fc25391e640 1 -- 172.21.15.142:0/1303601998 shutdown_connections 2024-02-21T22:52:27.055 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.062+0000 7fc25391e640 1 --2- 172.21.15.142:0/1303601998 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc24c0cf670 0x7fc24c06df30 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:27.055 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.062+0000 7fc25391e640 1 -- 172.21.15.142:0/1303601998 >> 172.21.15.142:0/1303601998 conn(0x7fc24c0b2590 msgr2=0x7fc24c0b2970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:52:27.055 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.062+0000 7fc25391e640 1 -- 172.21.15.142:0/1303601998 shutdown_connections 2024-02-21T22:52:27.055 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.062+0000 7fc25391e640 1 -- 172.21.15.142:0/1303601998 wait complete. 2024-02-21T22:52:27.055 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.063+0000 7fc25391e640 1 Processor -- start 2024-02-21T22:52:27.055 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.063+0000 7fc25391e640 1 -- start start 2024-02-21T22:52:27.060 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.064+0000 7fc25391e640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc24c06e470 0x7fc24c150430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:27.060 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.064+0000 7fc25391e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc24c0cf290 0x7fc24c0c6000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:27.060 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.064+0000 7fc25391e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc24c0cf670 0x7fc24c15db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:27.060 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.064+0000 7fc25391e640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc24c0ce9e0 con 0x7fc24c06e470 2024-02-21T22:52:27.060 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.064+0000 7fc25391e640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc24c0cb5e0 con 0x7fc24c0cf670 2024-02-21T22:52:27.060 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.064+0000 7fc25391e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc24c0ceb60 con 0x7fc24c0cf290 2024-02-21T22:52:27.060 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.064+0000 7fc251ebb640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc24c0cf670 0x7fc24c15db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:27.060 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.064+0000 7fc250eb9640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc24c0cf290 0x7fc24c0c6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:27.060 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.064+0000 7fc251ebb640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc24c0cf670 0x7fc24c15db40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:46076/0 (socket says 172.21.15.142:46076) 2024-02-21T22:52:27.060 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.064+0000 7fc251ebb640 1 -- 172.21.15.142:0/2055729701 learned_addr learned my addr 172.21.15.142:0/2055729701 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-02-21T22:52:27.061 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.064+0000 7fc2516ba640 1 --2- 172.21.15.142:0/2055729701 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc24c06e470 0x7fc24c150430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:27.061 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.064+0000 7fc250eb9640 1 -- 172.21.15.142:0/2055729701 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc24c0cf670 msgr2=0x7fc24c15db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:27.061 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.064+0000 7fc250eb9640 1 --2- 172.21.15.142:0/2055729701 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc24c0cf670 0x7fc24c15db40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:27.061 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.064+0000 7fc250eb9640 1 -- 172.21.15.142:0/2055729701 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc24c06e470 msgr2=0x7fc24c150430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:27.061 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.064+0000 7fc250eb9640 1 --2- 172.21.15.142:0/2055729701 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc24c06e470 0x7fc24c150430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:27.061 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.064+0000 7fc250eb9640 1 -- 172.21.15.142:0/2055729701 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc24c15e080 con 0x7fc24c0cf290 2024-02-21T22:52:27.061 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.064+0000 7fc251ebb640 1 --2- 172.21.15.142:0/2055729701 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc24c0cf670 0x7fc24c15db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T22:52:27.061 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.064+0000 7fc250eb9640 1 --2- 172.21.15.142:0/2055729701 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc24c0cf290 0x7fc24c0c6000 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fc248033000 tx=0x7fc2480046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:52:27.061 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.065+0000 7fc241ffb640 1 -- 172.21.15.142:0/2055729701 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc248040070 con 0x7fc24c0cf290 2024-02-21T22:52:27.061 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.065+0000 7fc241ffb640 1 -- 172.21.15.142:0/2055729701 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc248039a20 con 0x7fc24c0cf290 2024-02-21T22:52:27.061 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.065+0000 7fc25391e640 1 -- 172.21.15.142:0/2055729701 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc24c0c4f80 con 0x7fc24c0cf290 2024-02-21T22:52:27.061 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.065+0000 7fc241ffb640 1 -- 172.21.15.142:0/2055729701 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc248035040 con 0x7fc24c0cf290 2024-02-21T22:52:27.061 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.065+0000 7fc25391e640 1 -- 172.21.15.142:0/2055729701 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc24c0c5540 con 0x7fc24c0cf290 2024-02-21T22:52:27.061 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.065+0000 7fc241ffb640 1 -- 172.21.15.142:0/2055729701 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7fc248038020 con 0x7fc24c0cf290 2024-02-21T22:52:27.061 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.065+0000 7fc241ffb640 1 -- 172.21.15.142:0/2055729701 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7fc24803a840 con 0x7fc24c0cf290 2024-02-21T22:52:27.062 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.066+0000 7fc25391e640 1 -- 172.21.15.142:0/2055729701 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc24c0752f0 con 0x7fc24c0cf290 2024-02-21T22:52:27.062 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.068+0000 7fc241ffb640 1 -- 172.21.15.142:0/2055729701 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7fc248052020 con 0x7fc24c0cf290 2024-02-21T22:52:27.116 INFO:tasks.ceph.mgr.x.smithi142.stderr:2024-02-21T22:52:27.126+0000 7f3555a0d040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-02-21T22:52:27.129 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.139+0000 7fc25391e640 1 -- 172.21.15.142:0/2055729701 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "osd new", "uuid": "2589616c-adf1-4187-aac3-735256cf624b", "id": 2} v 0) v1 -- 0x7fc24c14b470 con 0x7fc24c0cf290 2024-02-21T22:52:27.135 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.144+0000 7fc241ffb640 1 -- 172.21.15.142:0/2055729701 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2589616c-adf1-4187-aac3-735256cf624b", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7fc24803a420 con 0x7fc24c0cf290 2024-02-21T22:52:27.135 INFO:teuthology.orchestra.run.smithi142.stdout:2 2024-02-21T22:52:27.136 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.145+0000 7fc25391e640 1 -- 172.21.15.142:0/2055729701 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc24c0cf290 msgr2=0x7fc24c0c6000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:27.136 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.145+0000 7fc25391e640 1 --2- 172.21.15.142:0/2055729701 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc24c0cf290 0x7fc24c0c6000 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fc248033000 tx=0x7fc2480046c0 comp rx=0 tx=0).stop 2024-02-21T22:52:27.136 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.145+0000 7fc25391e640 1 -- 172.21.15.142:0/2055729701 shutdown_connections 2024-02-21T22:52:27.136 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.145+0000 7fc25391e640 1 --2- 172.21.15.142:0/2055729701 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc24c0cf670 0x7fc24c15db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:27.136 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.145+0000 7fc25391e640 1 --2- 172.21.15.142:0/2055729701 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc24c0cf290 0x7fc24c0c6000 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:27.136 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.145+0000 7fc25391e640 1 --2- 172.21.15.142:0/2055729701 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc24c06e470 0x7fc24c150430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:27.137 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.145+0000 7fc25391e640 1 -- 172.21.15.142:0/2055729701 >> 172.21.15.142:0/2055729701 conn(0x7fc24c0b2590 msgr2=0x7fc24c14d0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:52:27.137 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.145+0000 7fc25391e640 1 -- 172.21.15.142:0/2055729701 shutdown_connections 2024-02-21T22:52:27.137 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.145+0000 7fc25391e640 1 -- 172.21.15.142:0/2055729701 wait complete. 2024-02-21T22:52:27.146 DEBUG:teuthology.orchestra.run.smithi142:> sudo ceph --cluster ceph osd new 0fd2e563-7c5b-46f6-82c2-b60c86072c93 3 2024-02-21T22:52:27.174 INFO:tasks.ceph.mgr.x.smithi142.stderr:2024-02-21T22:52:27.183+0000 7f3555a0d040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-02-21T22:52:27.211 INFO:tasks.ceph.mgr.y.smithi116.stderr:2024-02-21T22:52:27.221+0000 7fb397c73040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-02-21T22:52:27.221 INFO:tasks.ceph.mgr.x.smithi142.stderr:2024-02-21T22:52:27.230+0000 7f3555a0d040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-02-21T22:52:27.247 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.256+0000 7fd3fe8c8640 1 Processor -- start 2024-02-21T22:52:27.247 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.256+0000 7fd3fe8c8640 1 -- start start 2024-02-21T22:52:27.251 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.257+0000 7fd3fe8c8640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fd3f8071fc0 0x7fd3f8165cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:27.252 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.257+0000 7fd3fe8c8640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3f815ebf0 con 0x7fd3f80af920 2024-02-21T22:52:27.252 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.257+0000 7fd3fe8c8640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3f815eed0 con 0x7fd3f815ae60 2024-02-21T22:52:27.252 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.257+0000 7fd3fe8c8640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3f815e9a0 con 0x7fd3f8071fc0 2024-02-21T22:52:27.252 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.257+0000 7fd3f7fff640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fd3f815ae60 0x7fd3f80d0210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:39218/0 (socket says 172.21.15.142:39218) 2024-02-21T22:52:27.252 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.257+0000 7fd3f7fff640 1 -- 172.21.15.142:0/3816250936 learned_addr learned my addr 172.21.15.142:0/3816250936 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-02-21T22:52:27.252 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.257+0000 7fd3f6ffd640 1 -- 172.21.15.142:0/3816250936 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 656948474 0 0) 0x7fd3f815eed0 con 0x7fd3f815ae60 2024-02-21T22:52:27.255 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.257+0000 7fd3f6ffd640 1 -- 172.21.15.142:0/3816250936 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd3e0003520 con 0x7fd3f815ae60 2024-02-21T22:52:27.255 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.257+0000 7fd3fce65640 1 --2- 172.21.15.142:0/3816250936 >> v2:172.21.15.116:3300/0 conn(0x7fd3f8071fc0 0x7fd3f8165cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:27.255 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.257+0000 7fd3f6ffd640 1 -- 172.21.15.142:0/3816250936 <== mon.1 v1:172.21.15.142:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3320169107 0 0) 0x7fd3e0003520 con 0x7fd3f815ae60 2024-02-21T22:52:27.255 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.257+0000 7fd3f6ffd640 1 -- 172.21.15.142:0/3816250936 >> v2:172.21.15.116:3300/0 conn(0x7fd3f8071fc0 msgr2=0x7fd3f8165cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:52:27.255 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.257+0000 7fd3f6ffd640 1 --2- 172.21.15.142:0/3816250936 >> v2:172.21.15.116:3300/0 conn(0x7fd3f8071fc0 0x7fd3f8165cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:27.255 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.257+0000 7fd3f6ffd640 1 -- 172.21.15.142:0/3816250936 >> v1:172.21.15.116:6789/0 conn(0x7fd3f80af920 legacy=0x7fd3f80718b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:27.255 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.257+0000 7fd3f6ffd640 1 -- 172.21.15.142:0/3816250936 --> v1:172.21.15.142:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3f815f1b0 con 0x7fd3f815ae60 2024-02-21T22:52:27.255 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.257+0000 7fd3f6ffd640 1 -- 172.21.15.142:0/3816250936 <== mon.1 v1:172.21.15.142:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1101981580 0 0) 0x7fd3ec001670 con 0x7fd3f815ae60 2024-02-21T22:52:27.256 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.257+0000 7fd3f6ffd640 1 -- 172.21.15.142:0/3816250936 >> v1:172.21.15.142:6789/0 conn(0x7fd3f815ae60 legacy=0x7fd3f80d0210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:27.256 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.258+0000 7fd3f6ffd640 1 --2- 172.21.15.142:0/3816250936 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd3e00039b0 0x7fd3e0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:27.256 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.258+0000 7fd3f6ffd640 1 --2- 172.21.15.142:0/3816250936 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3e0004800 0x7fd3e0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:27.256 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.258+0000 7fd3f6ffd640 1 --2- 172.21.15.142:0/3816250936 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3e00051c0 0x7fd3e000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:27.256 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.258+0000 7fd3f6ffd640 1 -- 172.21.15.142:0/3816250936 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3f815e9a0 con 0x7fd3e00039b0 2024-02-21T22:52:27.256 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.258+0000 7fd3f6ffd640 1 -- 172.21.15.142:0/3816250936 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3e000c110 con 0x7fd3e0004800 2024-02-21T22:52:27.256 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.258+0000 7fd3f6ffd640 1 -- 172.21.15.142:0/3816250936 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3e000c310 con 0x7fd3e00051c0 2024-02-21T22:52:27.256 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.258+0000 7fd3f77fe640 1 --2- 172.21.15.142:0/3816250936 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3e0004800 0x7fd3e0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:27.256 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.258+0000 7fd3f7fff640 1 --2- 172.21.15.142:0/3816250936 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd3e00039b0 0x7fd3e0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:27.256 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.258+0000 7fd3fce65640 1 --2- 172.21.15.142:0/3816250936 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3e00051c0 0x7fd3e000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:27.256 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.258+0000 7fd3f77fe640 1 -- 172.21.15.142:0/3816250936 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3e00051c0 msgr2=0x7fd3e000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:52:27.256 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.258+0000 7fd3f77fe640 1 --2- 172.21.15.142:0/3816250936 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3e00051c0 0x7fd3e000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:27.256 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.258+0000 7fd3f77fe640 1 -- 172.21.15.142:0/3816250936 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd3e00039b0 msgr2=0x7fd3e0003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:52:27.256 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.258+0000 7fd3f77fe640 1 --2- 172.21.15.142:0/3816250936 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd3e00039b0 0x7fd3e0003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:27.256 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.258+0000 7fd3f77fe640 1 -- 172.21.15.142:0/3816250936 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3e0003520 con 0x7fd3e0004800 2024-02-21T22:52:27.257 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.258+0000 7fd3fce65640 1 -- 172.21.15.142:0/3816250936 reap_dead start 2024-02-21T22:52:27.257 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.259+0000 7fd3f77fe640 1 --2- 172.21.15.142:0/3816250936 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3e0004800 0x7fd3e0004c80 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fd3e8001750 tx=0x7fd3e0005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cba72e0b6ae69336 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:52:27.257 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.259+0000 7fd3f6ffd640 1 -- 172.21.15.142:0/3816250936 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3e8001370 con 0x7fd3e0004800 2024-02-21T22:52:27.257 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.259+0000 7fd3f6ffd640 1 -- 172.21.15.142:0/3816250936 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3e80052d0 con 0x7fd3e0004800 2024-02-21T22:52:27.257 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.259+0000 7fd3f6ffd640 1 -- 172.21.15.142:0/3816250936 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3e8003830 con 0x7fd3e0004800 2024-02-21T22:52:27.257 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.260+0000 7fd3fe8c8640 1 -- 172.21.15.142:0/3816250936 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3e0004800 msgr2=0x7fd3e0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:27.257 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.260+0000 7fd3fe8c8640 1 --2- 172.21.15.142:0/3816250936 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3e0004800 0x7fd3e0004c80 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fd3e8001750 tx=0x7fd3e0005830 comp rx=0 tx=0).stop 2024-02-21T22:52:27.257 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.260+0000 7fd3fe8c8640 1 -- 172.21.15.142:0/3816250936 shutdown_connections 2024-02-21T22:52:27.257 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.260+0000 7fd3fe8c8640 1 --2- 172.21.15.142:0/3816250936 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3e0004800 0x7fd3e0004c80 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:27.257 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.260+0000 7fd3fe8c8640 1 -- 172.21.15.142:0/3816250936 >> 172.21.15.142:0/3816250936 conn(0x7fd3f80d0ac0 msgr2=0x7fd3f80d0ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:52:27.257 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.260+0000 7fd3fe8c8640 1 -- 172.21.15.142:0/3816250936 shutdown_connections 2024-02-21T22:52:27.257 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.260+0000 7fd3fe8c8640 1 -- 172.21.15.142:0/3816250936 wait complete. 2024-02-21T22:52:27.260 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.261+0000 7fd3fe8c8640 1 Processor -- start 2024-02-21T22:52:27.260 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.261+0000 7fd3fe8c8640 1 -- start start 2024-02-21T22:52:27.260 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.262+0000 7fd3fe8c8640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd3e0004800 0x7fd3f80b4e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:27.260 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.262+0000 7fd3fe8c8640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3f81f71d0 0x7fd3f80b53c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:27.260 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.262+0000 7fd3fe8c8640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3f81f40f0 0x7fd3f81f45a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:27.260 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.262+0000 7fd3fe8c8640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3f806e660 con 0x7fd3e0004800 2024-02-21T22:52:27.260 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.262+0000 7fd3fe8c8640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3f815b240 con 0x7fd3f81f40f0 2024-02-21T22:52:27.260 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.262+0000 7fd3fe8c8640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3f806e7e0 con 0x7fd3f81f71d0 2024-02-21T22:52:27.260 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.262+0000 7fd3fce65640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3f81f40f0 0x7fd3f81f45a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:27.260 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.262+0000 7fd3fce65640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3f81f40f0 0x7fd3f81f45a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:46100/0 (socket says 172.21.15.142:46100) 2024-02-21T22:52:27.261 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.262+0000 7fd3fce65640 1 -- 172.21.15.142:0/2160611779 learned_addr learned my addr 172.21.15.142:0/2160611779 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-02-21T22:52:27.261 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.262+0000 7fd3f77fe640 1 --2- 172.21.15.142:0/2160611779 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3f81f71d0 0x7fd3f80b53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:27.261 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.262+0000 7fd3f7fff640 1 --2- 172.21.15.142:0/2160611779 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd3e0004800 0x7fd3f80b4e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:27.261 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.262+0000 7fd3fce65640 1 -- 172.21.15.142:0/2160611779 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3f81f71d0 msgr2=0x7fd3f80b53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:27.261 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.262+0000 7fd3fce65640 1 --2- 172.21.15.142:0/2160611779 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3f81f71d0 0x7fd3f80b53c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:27.261 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.262+0000 7fd3fce65640 1 -- 172.21.15.142:0/2160611779 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd3e0004800 msgr2=0x7fd3f80b4e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:27.261 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.262+0000 7fd3fce65640 1 --2- 172.21.15.142:0/2160611779 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd3e0004800 0x7fd3f80b4e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:27.261 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.262+0000 7fd3fce65640 1 -- 172.21.15.142:0/2160611779 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3f80b14f0 con 0x7fd3f81f40f0 2024-02-21T22:52:27.261 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.263+0000 7fd3fce65640 1 --2- 172.21.15.142:0/2160611779 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3f81f40f0 0x7fd3f81f45a0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fd3f8072970 tx=0x7fd3f0003f60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:52:27.261 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.263+0000 7fd3f4ff9640 1 -- 172.21.15.142:0/2160611779 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3f0007b70 con 0x7fd3f81f40f0 2024-02-21T22:52:27.261 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.263+0000 7fd3f4ff9640 1 -- 172.21.15.142:0/2160611779 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3f001a070 con 0x7fd3f81f40f0 2024-02-21T22:52:27.261 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.263+0000 7fd3f4ff9640 1 -- 172.21.15.142:0/2160611779 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3f0015420 con 0x7fd3f81f40f0 2024-02-21T22:52:27.261 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.263+0000 7fd3fe8c8640 1 -- 172.21.15.142:0/2160611779 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3f81f4ae0 con 0x7fd3f81f40f0 2024-02-21T22:52:27.261 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.263+0000 7fd3fe8c8640 1 -- 172.21.15.142:0/2160611779 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3f81f7990 con 0x7fd3f81f40f0 2024-02-21T22:52:27.261 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.263+0000 7fd3f4ff9640 1 -- 172.21.15.142:0/2160611779 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7fd3f0005d10 con 0x7fd3f81f40f0 2024-02-21T22:52:27.262 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.263+0000 7fd3f4ff9640 1 -- 172.21.15.142:0/2160611779 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7fd3f0015de0 con 0x7fd3f81f40f0 2024-02-21T22:52:27.262 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.264+0000 7fd3fe8c8640 1 -- 172.21.15.142:0/2160611779 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3f80752f0 con 0x7fd3f81f40f0 2024-02-21T22:52:27.262 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.266+0000 7fd3f4ff9640 1 -- 172.21.15.142:0/2160611779 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7fd3f001e410 con 0x7fd3f81f40f0 2024-02-21T22:52:27.265 INFO:tasks.ceph.mgr.y.smithi116.stderr:2024-02-21T22:52:27.275+0000 7fb397c73040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-02-21T22:52:27.295 INFO:tasks.ceph.mgr.x.smithi142.stderr:2024-02-21T22:52:27.304+0000 7f3555a0d040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-02-21T22:52:27.327 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.336+0000 7fd3fe8c8640 1 -- 172.21.15.142:0/2160611779 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd new", "uuid": "0fd2e563-7c5b-46f6-82c2-b60c86072c93", "id": 3} v 0) v1 -- 0x7fd3f80b4c60 con 0x7fd3f81f40f0 2024-02-21T22:52:27.332 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.342+0000 7fd3f4ff9640 1 -- 172.21.15.142:0/2160611779 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "0fd2e563-7c5b-46f6-82c2-b60c86072c93", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7fd3f0015a80 con 0x7fd3f81f40f0 2024-02-21T22:52:27.333 INFO:teuthology.orchestra.run.smithi142.stdout:3 2024-02-21T22:52:27.334 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.343+0000 7fd3fe8c8640 1 -- 172.21.15.142:0/2160611779 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3f81f40f0 msgr2=0x7fd3f81f45a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:27.334 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.343+0000 7fd3fe8c8640 1 --2- 172.21.15.142:0/2160611779 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3f81f40f0 0x7fd3f81f45a0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fd3f8072970 tx=0x7fd3f0003f60 comp rx=0 tx=0).stop 2024-02-21T22:52:27.334 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.343+0000 7fd3fe8c8640 1 -- 172.21.15.142:0/2160611779 shutdown_connections 2024-02-21T22:52:27.334 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.343+0000 7fd3fe8c8640 1 --2- 172.21.15.142:0/2160611779 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3f81f40f0 0x7fd3f81f45a0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:27.334 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.343+0000 7fd3fe8c8640 1 --2- 172.21.15.142:0/2160611779 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3f81f71d0 0x7fd3f80b53c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:27.334 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.343+0000 7fd3fe8c8640 1 --2- 172.21.15.142:0/2160611779 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd3e0004800 0x7fd3f80b4e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:27.334 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.343+0000 7fd3fe8c8640 1 -- 172.21.15.142:0/2160611779 >> 172.21.15.142:0/2160611779 conn(0x7fd3f80d0ac0 msgr2=0x7fd3f806f1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:52:27.335 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.343+0000 7fd3fe8c8640 1 -- 172.21.15.142:0/2160611779 shutdown_connections 2024-02-21T22:52:27.335 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.343+0000 7fd3fe8c8640 1 -- 172.21.15.142:0/2160611779 wait complete. 2024-02-21T22:52:27.338 INFO:tasks.ceph.mgr.x.smithi142.stderr:2024-02-21T22:52:27.348+0000 7f3555a0d040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-02-21T22:52:27.344 DEBUG:teuthology.orchestra.run.smithi142:> sudo ceph --cluster ceph osd new 79ae35b7-dda8-4ab8-96ce-47515afde082 4 2024-02-21T22:52:27.459 INFO:tasks.ceph.mgr.x.smithi142.stderr:2024-02-21T22:52:27.468+0000 7f3555a0d040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-02-21T22:52:27.485 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.494+0000 7fc51e036640 1 Processor -- start 2024-02-21T22:52:27.485 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.494+0000 7fc51e036640 1 -- start start 2024-02-21T22:52:27.486 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.495+0000 7fc51e036640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fc5180cf290 0x7fc51815e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:27.486 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.495+0000 7fc51e036640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc51815f300 con 0x7fc5180cf670 2024-02-21T22:52:27.486 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.495+0000 7fc51e036640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc51815f5e0 con 0x7fc51815edf0 2024-02-21T22:52:27.486 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.495+0000 7fc51e036640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5180cb930 con 0x7fc5180cf290 2024-02-21T22:52:27.486 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.495+0000 7fc516ffd640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fc51815edf0 0x7fc51806df30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:39232/0 (socket says 172.21.15.142:39232) 2024-02-21T22:52:27.487 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.495+0000 7fc516ffd640 1 -- 172.21.15.142:0/3561206982 learned_addr learned my addr 172.21.15.142:0/3561206982 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-02-21T22:52:27.487 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.495+0000 7fc5177fe640 1 --2- 172.21.15.142:0/3561206982 >> v2:172.21.15.116:3300/0 conn(0x7fc5180cf290 0x7fc51815e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:27.487 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.495+0000 7fc5167fc640 1 -- 172.21.15.142:0/3561206982 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2959187026 0 0) 0x7fc51815f5e0 con 0x7fc51815edf0 2024-02-21T22:52:27.487 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.495+0000 7fc5167fc640 1 -- 172.21.15.142:0/3561206982 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc500003520 con 0x7fc51815edf0 2024-02-21T22:52:27.487 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.495+0000 7fc5177fe640 1 -- 172.21.15.142:0/3561206982 >> v1:172.21.15.142:6789/0 conn(0x7fc51815edf0 legacy=0x7fc51806df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:27.487 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.495+0000 7fc5177fe640 1 -- 172.21.15.142:0/3561206982 >> v1:172.21.15.116:6789/0 conn(0x7fc5180cf670 legacy=0x7fc5180cc130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:27.487 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.495+0000 7fc5167fc640 1 -- 172.21.15.142:0/3561206982 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3525327475 0 0) 0x7fc51815f300 con 0x7fc5180cf670 2024-02-21T22:52:27.487 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.495+0000 7fc5177fe640 1 -- 172.21.15.142:0/3561206982 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5180cbc10 con 0x7fc5180cf290 2024-02-21T22:52:27.489 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.496+0000 7fc5177fe640 1 --2- 172.21.15.142:0/3561206982 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc5180cf290 0x7fc51815e8b0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fc5080097d0 tx=0x7fc50802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6774cc982c769e4d server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:52:27.489 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.496+0000 7fc5167fc640 1 -- 172.21.15.142:0/3561206982 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc508035020 con 0x7fc5180cf290 2024-02-21T22:52:27.489 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.496+0000 7fc5167fc640 1 -- 172.21.15.142:0/3561206982 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc508031830 con 0x7fc5180cf290 2024-02-21T22:52:27.489 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.496+0000 7fc5167fc640 1 -- 172.21.15.142:0/3561206982 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc508031c00 con 0x7fc5180cf290 2024-02-21T22:52:27.489 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.497+0000 7fc51e036640 1 -- 172.21.15.142:0/3561206982 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc5180cf290 msgr2=0x7fc51815e8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:27.489 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.497+0000 7fc51e036640 1 --2- 172.21.15.142:0/3561206982 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc5180cf290 0x7fc51815e8b0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fc5080097d0 tx=0x7fc50802b8d0 comp rx=0 tx=0).stop 2024-02-21T22:52:27.489 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.497+0000 7fc51e036640 1 -- 172.21.15.142:0/3561206982 shutdown_connections 2024-02-21T22:52:27.489 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.497+0000 7fc51e036640 1 --2- 172.21.15.142:0/3561206982 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc5180cf290 0x7fc51815e8b0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:27.489 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.497+0000 7fc51e036640 1 -- 172.21.15.142:0/3561206982 >> 172.21.15.142:0/3561206982 conn(0x7fc5180b2590 msgr2=0x7fc5180b2970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:52:27.489 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.497+0000 7fc51e036640 1 -- 172.21.15.142:0/3561206982 shutdown_connections 2024-02-21T22:52:27.489 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.497+0000 7fc51e036640 1 -- 172.21.15.142:0/3561206982 wait complete. 2024-02-21T22:52:27.490 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.498+0000 7fc51e036640 1 Processor -- start 2024-02-21T22:52:27.490 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.498+0000 7fc51e036640 1 -- start start 2024-02-21T22:52:27.492 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.499+0000 7fc51e036640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc5180cf290 0x7fc5180c9110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:27.492 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.499+0000 7fc51e036640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc5180cf670 0x7fc51814ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:27.492 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.499+0000 7fc51e036640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc51815edf0 0x7fc51814f280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:27.492 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.499+0000 7fc51e036640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5180ceb60 con 0x7fc51815edf0 2024-02-21T22:52:27.492 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.499+0000 7fc51e036640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5180ce9e0 con 0x7fc5180cf670 2024-02-21T22:52:27.492 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.499+0000 7fc51e036640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc51806e640 con 0x7fc5180cf290 2024-02-21T22:52:27.492 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.499+0000 7fc516ffd640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc5180cf670 0x7fc51814ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:27.492 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.499+0000 7fc5177fe640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc5180cf290 0x7fc5180c9110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:27.492 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.499+0000 7fc5177fe640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc5180cf290 0x7fc5180c9110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.142:57646/0 (socket says 172.21.15.142:57646) 2024-02-21T22:52:27.493 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.499+0000 7fc5177fe640 1 -- 172.21.15.142:0/3753961716 learned_addr learned my addr 172.21.15.142:0/3753961716 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-02-21T22:52:27.493 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.499+0000 7fc517fff640 1 --2- 172.21.15.142:0/3753961716 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc51815edf0 0x7fc51814f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:27.493 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.499+0000 7fc5177fe640 1 -- 172.21.15.142:0/3753961716 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc5180cf670 msgr2=0x7fc51814ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:27.493 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.499+0000 7fc5177fe640 1 --2- 172.21.15.142:0/3753961716 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc5180cf670 0x7fc51814ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:27.493 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.499+0000 7fc5177fe640 1 -- 172.21.15.142:0/3753961716 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc51815edf0 msgr2=0x7fc51814f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:27.493 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.499+0000 7fc5177fe640 1 --2- 172.21.15.142:0/3753961716 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc51815edf0 0x7fc51814f280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:27.493 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.499+0000 7fc5177fe640 1 -- 172.21.15.142:0/3753961716 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5180c9aa0 con 0x7fc5180cf290 2024-02-21T22:52:27.493 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.499+0000 7fc5177fe640 1 --2- 172.21.15.142:0/3753961716 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc5180cf290 0x7fc5180c9110 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fc5080098f0 tx=0x7fc5080046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:52:27.493 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.500+0000 7fc4fffff640 1 -- 172.21.15.142:0/3753961716 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc508040070 con 0x7fc5180cf290 2024-02-21T22:52:27.493 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.500+0000 7fc4fffff640 1 -- 172.21.15.142:0/3753961716 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc50803a830 con 0x7fc5180cf290 2024-02-21T22:52:27.493 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.500+0000 7fc51e036640 1 -- 172.21.15.142:0/3753961716 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5180c9d80 con 0x7fc5180cf290 2024-02-21T22:52:27.493 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.500+0000 7fc4fffff640 1 -- 172.21.15.142:0/3753961716 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc508035040 con 0x7fc5180cf290 2024-02-21T22:52:27.493 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.500+0000 7fc51e036640 1 -- 172.21.15.142:0/3753961716 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5180ca340 con 0x7fc5180cf290 2024-02-21T22:52:27.494 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.500+0000 7fc4fffff640 1 -- 172.21.15.142:0/3753961716 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7fc50804b060 con 0x7fc5180cf290 2024-02-21T22:52:27.494 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.500+0000 7fc4fffff640 1 -- 172.21.15.142:0/3753961716 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7fc508044910 con 0x7fc5180cf290 2024-02-21T22:52:27.494 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.501+0000 7fc51e036640 1 -- 172.21.15.142:0/3753961716 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5180752f0 con 0x7fc5180cf290 2024-02-21T22:52:27.495 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.504+0000 7fc4fffff640 1 -- 172.21.15.142:0/3753961716 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7fc508044bf0 con 0x7fc5180cf290 2024-02-21T22:52:27.534 INFO:tasks.ceph.mgr.x.smithi142.stderr:2024-02-21T22:52:27.543+0000 7f3555a0d040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-02-21T22:52:27.569 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.578+0000 7fc51e036640 1 -- 172.21.15.142:0/3753961716 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "osd new", "uuid": "79ae35b7-dda8-4ab8-96ce-47515afde082", "id": 4} v 0) v1 -- 0x7fc51806da40 con 0x7fc5180cf290 2024-02-21T22:52:27.574 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.583+0000 7fc4fffff640 1 -- 172.21.15.142:0/3753961716 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "79ae35b7-dda8-4ab8-96ce-47515afde082", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7fc5080317f0 con 0x7fc5180cf290 2024-02-21T22:52:27.574 INFO:teuthology.orchestra.run.smithi142.stdout:4 2024-02-21T22:52:27.576 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.584+0000 7fc51e036640 1 -- 172.21.15.142:0/3753961716 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc5180cf290 msgr2=0x7fc5180c9110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:27.576 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.584+0000 7fc51e036640 1 --2- 172.21.15.142:0/3753961716 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc5180cf290 0x7fc5180c9110 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fc5080098f0 tx=0x7fc5080046c0 comp rx=0 tx=0).stop 2024-02-21T22:52:27.576 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.584+0000 7fc51e036640 1 -- 172.21.15.142:0/3753961716 shutdown_connections 2024-02-21T22:52:27.576 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.584+0000 7fc51e036640 1 --2- 172.21.15.142:0/3753961716 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc51815edf0 0x7fc51814f280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:27.576 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.584+0000 7fc51e036640 1 --2- 172.21.15.142:0/3753961716 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc5180cf670 0x7fc51814ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:27.576 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.584+0000 7fc51e036640 1 --2- 172.21.15.142:0/3753961716 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc5180cf290 0x7fc5180c9110 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:27.576 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.584+0000 7fc51e036640 1 -- 172.21.15.142:0/3753961716 >> 172.21.15.142:0/3753961716 conn(0x7fc5180b2590 msgr2=0x7fc518150cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:52:27.576 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.585+0000 7fc51e036640 1 -- 172.21.15.142:0/3753961716 shutdown_connections 2024-02-21T22:52:27.576 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.585+0000 7fc51e036640 1 -- 172.21.15.142:0/3753961716 wait complete. 2024-02-21T22:52:27.582 INFO:tasks.ceph.mgr.x.smithi142.stderr:2024-02-21T22:52:27.592+0000 7f3555a0d040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-02-21T22:52:27.586 DEBUG:teuthology.orchestra.run.smithi142:> sudo ceph --cluster ceph osd new 3166eb2c-3fcf-41c8-9362-45bafaabaa39 5 2024-02-21T22:52:27.638 INFO:tasks.ceph.mgr.x.smithi142.stderr:2024-02-21T22:52:27.647+0000 7f3555a0d040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-02-21T22:52:27.686 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.695+0000 7f7a710de640 1 Processor -- start 2024-02-21T22:52:27.686 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.695+0000 7f7a710de640 1 -- start start 2024-02-21T22:52:27.688 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.696+0000 7f7a710de640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7a6c0cf290 0x7f7a6c15e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:27.688 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.696+0000 7f7a710de640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f7a6c15edf0 0x7f7a6c06df30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:27.688 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.696+0000 7f7a710de640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a6c15f300 con 0x7f7a6c0cf670 2024-02-21T22:52:27.688 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.696+0000 7f7a710de640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a6c15f5e0 con 0x7f7a6c15edf0 2024-02-21T22:52:27.688 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.696+0000 7f7a710de640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a6c0cb930 con 0x7f7a6c0cf290 2024-02-21T22:52:27.689 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.696+0000 7f7a6ad9d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7a6c0cf290 0x7f7a6c15e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:27.689 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.696+0000 7f7a6ad9d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7a6c0cf290 0x7f7a6c15e8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.142:57660/0 (socket says 172.21.15.142:57660) 2024-02-21T22:52:27.689 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.696+0000 7f7a6ad9d640 1 -- 172.21.15.142:0/2048673159 learned_addr learned my addr 172.21.15.142:0/2048673159 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-02-21T22:52:27.689 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.697+0000 7f7a63fff640 1 --2- 172.21.15.142:0/2048673159 >> v2:172.21.15.116:3300/0 conn(0x7f7a6c15edf0 0x7f7a6c06df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:27.689 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.697+0000 7f7a6ad9d640 1 -- 172.21.15.142:0/2048673159 >> v2:172.21.15.116:3300/0 conn(0x7f7a6c15edf0 msgr2=0x7f7a6c06df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:52:27.689 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.697+0000 7f7a6ad9d640 1 --2- 172.21.15.142:0/2048673159 >> v2:172.21.15.116:3300/0 conn(0x7f7a6c15edf0 0x7f7a6c06df30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:27.689 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.697+0000 7f7a6ad9d640 1 -- 172.21.15.142:0/2048673159 >> v1:172.21.15.116:6789/0 conn(0x7f7a6c0cf670 legacy=0x7f7a6c0cc130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:27.689 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.697+0000 7f7a6ad9d640 1 -- 172.21.15.142:0/2048673159 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a6c0cbc10 con 0x7f7a6c0cf290 2024-02-21T22:52:27.689 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.697+0000 7f7a63fff640 1 --2- 172.21.15.142:0/2048673159 >> v2:172.21.15.116:3300/0 conn(0x7f7a6c15edf0 0x7f7a6c06df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T22:52:27.689 INFO:tasks.ceph.mgr.x.smithi142.stderr:2024-02-21T22:52:27.697+0000 7f3555a0d040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-02-21T22:52:27.693 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.697+0000 7f7a6ad9d640 1 --2- 172.21.15.142:0/2048673159 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7a6c0cf290 0x7f7a6c15e8b0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f7a5c009870 tx=0x7f7a5c02b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=642f7607bf1fa3ad server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:52:27.693 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.698+0000 7f7a6a59c640 1 -- 172.21.15.142:0/2048673159 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a5c035020 con 0x7f7a6c0cf290 2024-02-21T22:52:27.693 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.698+0000 7f7a6a59c640 1 -- 172.21.15.142:0/2048673159 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a5c031640 con 0x7f7a6c0cf290 2024-02-21T22:52:27.693 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.698+0000 7f7a6a59c640 1 -- 172.21.15.142:0/2048673159 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a5c02d040 con 0x7f7a6c0cf290 2024-02-21T22:52:27.693 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.698+0000 7f7a710de640 1 -- 172.21.15.142:0/2048673159 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7a6c0cf290 msgr2=0x7f7a6c15e8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:27.693 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.698+0000 7f7a710de640 1 --2- 172.21.15.142:0/2048673159 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7a6c0cf290 0x7f7a6c15e8b0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f7a5c009870 tx=0x7f7a5c02b8f0 comp rx=0 tx=0).stop 2024-02-21T22:52:27.693 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.698+0000 7f7a710de640 1 -- 172.21.15.142:0/2048673159 shutdown_connections 2024-02-21T22:52:27.694 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.698+0000 7f7a710de640 1 --2- 172.21.15.142:0/2048673159 >> v2:172.21.15.116:3300/0 conn(0x7f7a6c15edf0 0x7f7a6c06df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:27.694 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.698+0000 7f7a710de640 1 --2- 172.21.15.142:0/2048673159 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7a6c0cf290 0x7f7a6c15e8b0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:27.694 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.698+0000 7f7a710de640 1 -- 172.21.15.142:0/2048673159 >> 172.21.15.142:0/2048673159 conn(0x7f7a6c0b2590 msgr2=0x7f7a6c0b2970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:52:27.694 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.698+0000 7f7a710de640 1 -- 172.21.15.142:0/2048673159 shutdown_connections 2024-02-21T22:52:27.694 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.698+0000 7f7a710de640 1 -- 172.21.15.142:0/2048673159 wait complete. 2024-02-21T22:52:27.694 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.700+0000 7f7a710de640 1 Processor -- start 2024-02-21T22:52:27.694 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.700+0000 7f7a710de640 1 -- start start 2024-02-21T22:52:27.694 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.700+0000 7f7a710de640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7a6c0cf290 0x7f7a6c158ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:27.694 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.700+0000 7f7a710de640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7a6c0cf670 0x7f7a6c148af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:27.694 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.700+0000 7f7a710de640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7a6c15edf0 0x7f7a6c0c2b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:27.694 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.700+0000 7f7a710de640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a6c0ceb60 con 0x7f7a6c0cf290 2024-02-21T22:52:27.694 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.700+0000 7f7a710de640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a6c0ce9e0 con 0x7f7a6c0cf670 2024-02-21T22:52:27.694 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.700+0000 7f7a710de640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a6c0cc840 con 0x7f7a6c15edf0 2024-02-21T22:52:27.694 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.700+0000 7f7a6b59e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7a6c15edf0 0x7f7a6c0c2b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:27.694 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.700+0000 7f7a63fff640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7a6c0cf670 0x7f7a6c148af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:27.694 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.700+0000 7f7a6b59e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7a6c15edf0 0x7f7a6c0c2b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.142:57664/0 (socket says 172.21.15.142:57664) 2024-02-21T22:52:27.694 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.700+0000 7f7a63fff640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7a6c0cf670 0x7f7a6c148af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:46112/0 (socket says 172.21.15.142:46112) 2024-02-21T22:52:27.695 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.700+0000 7f7a6b59e640 1 -- 172.21.15.142:0/4009998135 learned_addr learned my addr 172.21.15.142:0/4009998135 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-02-21T22:52:27.695 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.700+0000 7f7a6ad9d640 1 --2- 172.21.15.142:0/4009998135 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7a6c0cf290 0x7f7a6c158ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:27.695 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.701+0000 7f7a63fff640 1 -- 172.21.15.142:0/4009998135 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7a6c15edf0 msgr2=0x7f7a6c0c2b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:27.695 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.701+0000 7f7a63fff640 1 --2- 172.21.15.142:0/4009998135 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7a6c15edf0 0x7f7a6c0c2b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:27.695 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.701+0000 7f7a63fff640 1 -- 172.21.15.142:0/4009998135 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7a6c0cf290 msgr2=0x7f7a6c158ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:27.695 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.701+0000 7f7a63fff640 1 --2- 172.21.15.142:0/4009998135 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7a6c0cf290 0x7f7a6c158ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:27.695 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.701+0000 7f7a63fff640 1 -- 172.21.15.142:0/4009998135 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a6c0c3c00 con 0x7f7a6c0cf670 2024-02-21T22:52:27.695 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.701+0000 7f7a6b59e640 1 --2- 172.21.15.142:0/4009998135 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7a6c15edf0 0x7f7a6c0c2b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T22:52:27.695 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.701+0000 7f7a6ad9d640 1 --2- 172.21.15.142:0/4009998135 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7a6c0cf290 0x7f7a6c158ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T22:52:27.695 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.701+0000 7f7a63fff640 1 --2- 172.21.15.142:0/4009998135 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7a6c0cf670 0x7f7a6c148af0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f7a6c15f230 tx=0x7f7a5400ec70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:52:27.695 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.701+0000 7f7a637fe640 1 -- 172.21.15.142:0/4009998135 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a5400f040 con 0x7f7a6c0cf670 2024-02-21T22:52:27.695 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.701+0000 7f7a637fe640 1 -- 172.21.15.142:0/4009998135 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a54004030 con 0x7f7a6c0cf670 2024-02-21T22:52:27.695 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.701+0000 7f7a637fe640 1 -- 172.21.15.142:0/4009998135 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a540043e0 con 0x7f7a6c0cf670 2024-02-21T22:52:27.695 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.701+0000 7f7a710de640 1 -- 172.21.15.142:0/4009998135 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a6c0c3ee0 con 0x7f7a6c0cf670 2024-02-21T22:52:27.695 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.701+0000 7f7a710de640 1 -- 172.21.15.142:0/4009998135 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a6c15a4e0 con 0x7f7a6c0cf670 2024-02-21T22:52:27.696 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.701+0000 7f7a637fe640 1 -- 172.21.15.142:0/4009998135 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f7a5400ca60 con 0x7f7a6c0cf670 2024-02-21T22:52:27.696 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.701+0000 7f7a637fe640 1 -- 172.21.15.142:0/4009998135 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f7a54013990 con 0x7f7a6c0cf670 2024-02-21T22:52:27.696 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.702+0000 7f7a710de640 1 -- 172.21.15.142:0/4009998135 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a6c0752f0 con 0x7f7a6c0cf670 2024-02-21T22:52:27.696 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.704+0000 7f7a637fe640 1 -- 172.21.15.142:0/4009998135 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f7a54017020 con 0x7f7a6c0cf670 2024-02-21T22:52:27.768 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.777+0000 7f7a710de640 1 -- 172.21.15.142:0/4009998135 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd new", "uuid": "3166eb2c-3fcf-41c8-9362-45bafaabaa39", "id": 5} v 0) v1 -- 0x7f7a6c06da40 con 0x7f7a6c0cf670 2024-02-21T22:52:27.771 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.780+0000 7f7a637fe640 1 -- 172.21.15.142:0/4009998135 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "3166eb2c-3fcf-41c8-9362-45bafaabaa39", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f7a54013c70 con 0x7f7a6c0cf670 2024-02-21T22:52:27.771 INFO:teuthology.orchestra.run.smithi142.stdout:5 2024-02-21T22:52:27.772 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.781+0000 7f7a710de640 1 -- 172.21.15.142:0/4009998135 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7a6c0cf670 msgr2=0x7f7a6c148af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:27.772 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.781+0000 7f7a710de640 1 --2- 172.21.15.142:0/4009998135 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7a6c0cf670 0x7f7a6c148af0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f7a6c15f230 tx=0x7f7a5400ec70 comp rx=0 tx=0).stop 2024-02-21T22:52:27.773 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.781+0000 7f7a710de640 1 -- 172.21.15.142:0/4009998135 shutdown_connections 2024-02-21T22:52:27.773 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.781+0000 7f7a710de640 1 --2- 172.21.15.142:0/4009998135 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7a6c15edf0 0x7f7a6c0c2b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:27.773 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.781+0000 7f7a710de640 1 --2- 172.21.15.142:0/4009998135 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7a6c0cf670 0x7f7a6c148af0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:27.773 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.781+0000 7f7a710de640 1 --2- 172.21.15.142:0/4009998135 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7a6c0cf290 0x7f7a6c158ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:27.773 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.781+0000 7f7a710de640 1 -- 172.21.15.142:0/4009998135 >> 172.21.15.142:0/4009998135 conn(0x7f7a6c0b2590 msgr2=0x7f7a6c159910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:52:27.773 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.781+0000 7f7a710de640 1 -- 172.21.15.142:0/4009998135 shutdown_connections 2024-02-21T22:52:27.773 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.781+0000 7f7a710de640 1 -- 172.21.15.142:0/4009998135 wait complete. 2024-02-21T22:52:27.783 DEBUG:teuthology.orchestra.run.smithi142:> sudo ceph --cluster ceph osd new f9aa9672-7527-43e2-963e-b61868e5e63f 6 2024-02-21T22:52:27.791 INFO:tasks.ceph.mgr.y.smithi116.stderr:2024-02-21T22:52:27.800+0000 7fb397c73040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-02-21T22:52:27.844 INFO:tasks.ceph.mgr.y.smithi116.stderr:2024-02-21T22:52:27.853+0000 7fb397c73040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-02-21T22:52:27.884 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.893+0000 7f39b9f1e640 1 Processor -- start 2024-02-21T22:52:27.885 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.893+0000 7f39b9f1e640 1 -- start start 2024-02-21T22:52:27.887 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.894+0000 7f39b9f1e640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f39b415ee40 0x7f39b406f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:27.887 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.894+0000 7f39b9f1e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f39b406b550 0x7f39b4161a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:27.887 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.894+0000 7f39b9f1e640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39b40cd710 con 0x7f39b415f220 2024-02-21T22:52:27.887 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.894+0000 7f39b9f1e640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39b415e6d0 con 0x7f39b415ee40 2024-02-21T22:52:27.887 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.894+0000 7f39b9f1e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39b40cd9f0 con 0x7f39b406b550 2024-02-21T22:52:27.887 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.894+0000 7f39b3fff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f39b406b550 0x7f39b4161a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:27.887 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.894+0000 7f39b3fff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f39b406b550 0x7f39b4161a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.142:57674/0 (socket says 172.21.15.142:57674) 2024-02-21T22:52:27.888 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.894+0000 7f39b3fff640 1 -- 172.21.15.142:0/2446162112 learned_addr learned my addr 172.21.15.142:0/2446162112 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-02-21T22:52:27.888 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.894+0000 7f39b37fe640 1 --2- 172.21.15.142:0/2446162112 >> v2:172.21.15.116:3300/0 conn(0x7f39b415ee40 0x7f39b406f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:27.888 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.894+0000 7f39b3fff640 1 -- 172.21.15.142:0/2446162112 >> v2:172.21.15.116:3300/0 conn(0x7f39b415ee40 msgr2=0x7f39b406f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:52:27.888 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.894+0000 7f39b3fff640 1 --2- 172.21.15.142:0/2446162112 >> v2:172.21.15.116:3300/0 conn(0x7f39b415ee40 0x7f39b406f0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:27.888 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.894+0000 7f39b3fff640 1 -- 172.21.15.142:0/2446162112 >> v1:172.21.15.116:6789/0 conn(0x7f39b415f220 legacy=0x7f39b406ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:27.889 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.894+0000 7f39b3fff640 1 -- 172.21.15.142:0/2446162112 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39b40cdcd0 con 0x7f39b406b550 2024-02-21T22:52:27.889 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.895+0000 7f39b3fff640 1 --2- 172.21.15.142:0/2446162112 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f39b406b550 0x7f39b4161a60 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f39ac009e50 tx=0x7f39ac02bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=32e62e0000140382 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:52:27.889 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.895+0000 7f39b2ffd640 1 -- 172.21.15.142:0/2446162112 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39ac02cb00 con 0x7f39b406b550 2024-02-21T22:52:27.889 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.895+0000 7f39b2ffd640 1 -- 172.21.15.142:0/2446162112 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39ac02cca0 con 0x7f39b406b550 2024-02-21T22:52:27.889 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.895+0000 7f39b2ffd640 1 -- 172.21.15.142:0/2446162112 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39ac034610 con 0x7f39b406b550 2024-02-21T22:52:27.889 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.896+0000 7f39b9f1e640 1 -- 172.21.15.142:0/2446162112 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f39b406b550 msgr2=0x7f39b4161a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:27.889 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.896+0000 7f39b9f1e640 1 --2- 172.21.15.142:0/2446162112 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f39b406b550 0x7f39b4161a60 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f39ac009e50 tx=0x7f39ac02bf60 comp rx=0 tx=0).stop 2024-02-21T22:52:27.889 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.896+0000 7f39b9f1e640 1 -- 172.21.15.142:0/2446162112 shutdown_connections 2024-02-21T22:52:27.889 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.896+0000 7f39b9f1e640 1 --2- 172.21.15.142:0/2446162112 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f39b406b550 0x7f39b4161a60 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:27.889 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.896+0000 7f39b9f1e640 1 --2- 172.21.15.142:0/2446162112 >> v2:172.21.15.116:3300/0 conn(0x7f39b415ee40 0x7f39b406f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:27.889 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.896+0000 7f39b9f1e640 1 -- 172.21.15.142:0/2446162112 >> 172.21.15.142:0/2446162112 conn(0x7f39b40b2590 msgr2=0x7f39b40b2970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:52:27.889 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.896+0000 7f39b9f1e640 1 -- 172.21.15.142:0/2446162112 shutdown_connections 2024-02-21T22:52:27.890 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.896+0000 7f39b9f1e640 1 -- 172.21.15.142:0/2446162112 wait complete. 2024-02-21T22:52:27.890 INFO:tasks.ceph.mgr.y.smithi116.stderr:2024-02-21T22:52:27.897+0000 7fb397c73040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-02-21T22:52:27.893 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.897+0000 7f39b9f1e640 1 Processor -- start 2024-02-21T22:52:27.893 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.897+0000 7f39b9f1e640 1 -- start start 2024-02-21T22:52:27.893 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.898+0000 7f39b9f1e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f39b406b550 0x7f39b4153f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:27.893 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.898+0000 7f39b9f1e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f39b415ee40 0x7f39b40c60d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:27.893 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.898+0000 7f39b9f1e640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f39b40c6d90 0x7f39b40c6610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:27.893 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.898+0000 7f39b9f1e640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39b406f5f0 con 0x7f39b40c6d90 2024-02-21T22:52:27.893 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.898+0000 7f39b9f1e640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39b40cd400 con 0x7f39b415ee40 2024-02-21T22:52:27.894 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.898+0000 7f39b9f1e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39b40b0010 con 0x7f39b406b550 2024-02-21T22:52:27.894 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.898+0000 7f39b37fe640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f39b406b550 0x7f39b4153f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:27.894 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.898+0000 7f39abfff640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f39b415ee40 0x7f39b40c60d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:27.894 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.898+0000 7f39b37fe640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f39b406b550 0x7f39b4153f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.142:57684/0 (socket says 172.21.15.142:57684) 2024-02-21T22:52:27.894 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.898+0000 7f39b37fe640 1 -- 172.21.15.142:0/3151184036 learned_addr learned my addr 172.21.15.142:0/3151184036 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-02-21T22:52:27.894 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.898+0000 7f39b3fff640 1 --2- 172.21.15.142:0/3151184036 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f39b40c6d90 0x7f39b40c6610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:27.894 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.898+0000 7f39b37fe640 1 -- 172.21.15.142:0/3151184036 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f39b415ee40 msgr2=0x7f39b40c60d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:27.894 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.898+0000 7f39b37fe640 1 --2- 172.21.15.142:0/3151184036 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f39b415ee40 0x7f39b40c60d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:27.894 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.898+0000 7f39b37fe640 1 -- 172.21.15.142:0/3151184036 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f39b40c6d90 msgr2=0x7f39b40c6610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:27.894 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.898+0000 7f39b37fe640 1 --2- 172.21.15.142:0/3151184036 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f39b40c6d90 0x7f39b40c6610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:27.894 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.898+0000 7f39b37fe640 1 -- 172.21.15.142:0/3151184036 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39b40b4ee0 con 0x7f39b406b550 2024-02-21T22:52:27.894 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.898+0000 7f39abfff640 1 --2- 172.21.15.142:0/3151184036 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f39b415ee40 0x7f39b40c60d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T22:52:27.894 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.899+0000 7f39b37fe640 1 --2- 172.21.15.142:0/3151184036 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f39b406b550 0x7f39b4153f10 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f39a400d830 tx=0x7f39a400dcf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:52:27.894 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.899+0000 7f39b0ff9640 1 -- 172.21.15.142:0/3151184036 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39a400b6c0 con 0x7f39b406b550 2024-02-21T22:52:27.894 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.899+0000 7f39b0ff9640 1 -- 172.21.15.142:0/3151184036 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39a4019070 con 0x7f39b406b550 2024-02-21T22:52:27.895 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.899+0000 7f39b9f1e640 1 -- 172.21.15.142:0/3151184036 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39b40b51c0 con 0x7f39b406b550 2024-02-21T22:52:27.895 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.899+0000 7f39b0ff9640 1 -- 172.21.15.142:0/3151184036 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39a400bac0 con 0x7f39b406b550 2024-02-21T22:52:27.895 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.899+0000 7f39b9f1e640 1 -- 172.21.15.142:0/3151184036 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39b40b5780 con 0x7f39b406b550 2024-02-21T22:52:27.895 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.899+0000 7f39b0ff9640 1 -- 172.21.15.142:0/3151184036 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f39a400bc60 con 0x7f39b406b550 2024-02-21T22:52:27.895 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.899+0000 7f39b0ff9640 1 -- 172.21.15.142:0/3151184036 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f39a4014b10 con 0x7f39b406b550 2024-02-21T22:52:27.895 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.900+0000 7f39b9f1e640 1 -- 172.21.15.142:0/3151184036 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39b40752f0 con 0x7f39b406b550 2024-02-21T22:52:27.895 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.902+0000 7f39b0ff9640 1 -- 172.21.15.142:0/3151184036 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f39a4014730 con 0x7f39b406b550 2024-02-21T22:52:27.942 INFO:tasks.ceph.mgr.y.smithi116.stderr:2024-02-21T22:52:27.952+0000 7fb397c73040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-02-21T22:52:27.965 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.974+0000 7f39b9f1e640 1 -- 172.21.15.142:0/3151184036 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "osd new", "uuid": "f9aa9672-7527-43e2-963e-b61868e5e63f", "id": 6} v 0) v1 -- 0x7f39b406ee90 con 0x7f39b406b550 2024-02-21T22:52:27.968 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.978+0000 7f39b0ff9640 1 -- 172.21.15.142:0/3151184036 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f9aa9672-7527-43e2-963e-b61868e5e63f", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f39a4014df0 con 0x7f39b406b550 2024-02-21T22:52:27.968 INFO:teuthology.orchestra.run.smithi142.stdout:6 2024-02-21T22:52:27.970 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.978+0000 7f39b9f1e640 1 -- 172.21.15.142:0/3151184036 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f39b406b550 msgr2=0x7f39b4153f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:27.970 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.978+0000 7f39b9f1e640 1 --2- 172.21.15.142:0/3151184036 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f39b406b550 0x7f39b4153f10 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f39a400d830 tx=0x7f39a400dcf0 comp rx=0 tx=0).stop 2024-02-21T22:52:27.970 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.979+0000 7f39b9f1e640 1 -- 172.21.15.142:0/3151184036 shutdown_connections 2024-02-21T22:52:27.970 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.979+0000 7f39b9f1e640 1 --2- 172.21.15.142:0/3151184036 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f39b40c6d90 0x7f39b40c6610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:27.970 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.979+0000 7f39b9f1e640 1 --2- 172.21.15.142:0/3151184036 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f39b415ee40 0x7f39b40c60d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:27.970 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.979+0000 7f39b9f1e640 1 --2- 172.21.15.142:0/3151184036 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f39b406b550 0x7f39b4153f10 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:27.970 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.979+0000 7f39b9f1e640 1 -- 172.21.15.142:0/3151184036 >> 172.21.15.142:0/3151184036 conn(0x7f39b40b2590 msgr2=0x7f39b415d8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:52:27.970 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.979+0000 7f39b9f1e640 1 -- 172.21.15.142:0/3151184036 shutdown_connections 2024-02-21T22:52:27.970 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:27.979+0000 7f39b9f1e640 1 -- 172.21.15.142:0/3151184036 wait complete. 2024-02-21T22:52:27.980 DEBUG:teuthology.orchestra.run.smithi142:> sudo ceph --cluster ceph osd new 7ed29226-fc42-4382-a91a-fa50f7ec5426 7 2024-02-21T22:52:27.985 INFO:tasks.ceph.mgr.y.smithi116.stderr:2024-02-21T22:52:27.995+0000 7fb397c73040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-02-21T22:52:28.081 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:28.090+0000 7f423691e640 1 Processor -- start 2024-02-21T22:52:28.081 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:28.090+0000 7f423691e640 1 -- start start 2024-02-21T22:52:28.083 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:28.091+0000 7f423691e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f42300cf670 0x7f423006df30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:28.083 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:28.091+0000 7f423691e640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f423006e470 0x7f42300cc130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:28.084 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:28.091+0000 7f423691e640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f423015f300 con 0x7f42300cf290 2024-02-21T22:52:28.084 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:28.091+0000 7f423691e640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f423015f5e0 con 0x7f423006e470 2024-02-21T22:52:28.084 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:28.091+0000 7f423691e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42300cb930 con 0x7f42300cf670 2024-02-21T22:52:28.084 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:28.091+0000 7f422ffff640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f42300cf290 0x7f423015e8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:39244/0 (socket says 172.21.15.142:39244) 2024-02-21T22:52:28.084 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:28.091+0000 7f422ffff640 1 -- 172.21.15.142:0/2273655576 learned_addr learned my addr 172.21.15.142:0/2273655576 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-02-21T22:52:28.084 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:28.091+0000 7f422f7fe640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f42300cf670 0x7f423006df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:28.084 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:28.091+0000 7f4234ebb640 1 --2- 172.21.15.142:0/2273655576 >> v2:172.21.15.116:3300/0 conn(0x7f423006e470 0x7f42300cc130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:28.084 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:28.091+0000 7f422effd640 1 -- 172.21.15.142:0/2273655576 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2652783969 0 0) 0x7f423015f300 con 0x7f42300cf290 2024-02-21T22:52:28.084 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:28.091+0000 7f422effd640 1 -- 172.21.15.142:0/2273655576 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4218003520 con 0x7f42300cf290 2024-02-21T22:52:28.084 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:28.092+0000 7f422f7fe640 1 -- 172.21.15.142:0/2273655576 >> v2:172.21.15.116:3300/0 conn(0x7f423006e470 msgr2=0x7f42300cc130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:52:28.084 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:28.092+0000 7f422f7fe640 1 --2- 172.21.15.142:0/2273655576 >> v2:172.21.15.116:3300/0 conn(0x7f423006e470 0x7f42300cc130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:28.084 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:28.092+0000 7f422f7fe640 1 -- 172.21.15.142:0/2273655576 >> v1:172.21.15.142:6789/0 conn(0x7f42300cf290 legacy=0x7f423015e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:28.084 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:28.092+0000 7f422f7fe640 1 -- 172.21.15.142:0/2273655576 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42300cbc10 con 0x7f42300cf670 2024-02-21T22:52:28.084 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:28.092+0000 7f422f7fe640 1 --2- 172.21.15.142:0/2273655576 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f42300cf670 0x7f423006df30 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f42200097a0 tx=0x7f422002b820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=570f9fcf294cc062 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:52:28.084 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:28.092+0000 7f422effd640 1 -- 172.21.15.142:0/2273655576 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4220031780 con 0x7f42300cf670 2024-02-21T22:52:28.085 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:28.092+0000 7f422effd640 1 -- 172.21.15.142:0/2273655576 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4220037070 con 0x7f42300cf670 2024-02-21T22:52:28.085 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:28.092+0000 7f422effd640 1 -- 172.21.15.142:0/2273655576 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4220031b40 con 0x7f42300cf670 2024-02-21T22:52:28.088 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:28.093+0000 7f423691e640 1 -- 172.21.15.142:0/2273655576 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f42300cf670 msgr2=0x7f423006df30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:28.088 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:28.093+0000 7f423691e640 1 --2- 172.21.15.142:0/2273655576 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f42300cf670 0x7f423006df30 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f42200097a0 tx=0x7f422002b820 comp rx=0 tx=0).stop 2024-02-21T22:52:28.088 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:28.093+0000 7f423691e640 1 -- 172.21.15.142:0/2273655576 shutdown_connections 2024-02-21T22:52:28.088 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:28.093+0000 7f423691e640 1 --2- 172.21.15.142:0/2273655576 >> v2:172.21.15.116:3300/0 conn(0x7f423006e470 0x7f42300cc130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:28.088 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:28.093+0000 7f423691e640 1 --2- 172.21.15.142:0/2273655576 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f42300cf670 0x7f423006df30 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:28.088 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:28.093+0000 7f423691e640 1 -- 172.21.15.142:0/2273655576 >> 172.21.15.142:0/2273655576 conn(0x7f42300b2590 msgr2=0x7f42300b2970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:52:28.088 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:28.093+0000 7f423691e640 1 -- 172.21.15.142:0/2273655576 shutdown_connections 2024-02-21T22:52:28.088 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:28.093+0000 7f423691e640 1 -- 172.21.15.142:0/2273655576 wait complete. 2024-02-21T22:52:28.088 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:28.094+0000 7f423691e640 1 Processor -- start 2024-02-21T22:52:28.088 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:28.095+0000 7f423691e640 1 -- start start 2024-02-21T22:52:28.088 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:28.095+0000 7f423691e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f423006e470 0x7f42300c5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:28.088 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:28.095+0000 7f423691e640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f42300cf290 0x7f4230146eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:28.089 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:28.095+0000 7f423691e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f42300cf670 0x7f42300ca4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:28.089 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:28.095+0000 7f423691e640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42300ce9e0 con 0x7f42300cf290 2024-02-21T22:52:28.089 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:28.095+0000 7f423691e640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42300cb5e0 con 0x7f423006e470 2024-02-21T22:52:28.089 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:28.095+0000 7f423691e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42300ceb60 con 0x7f42300cf670 2024-02-21T22:52:28.089 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:28.095+0000 7f422ffff640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f423006e470 0x7f42300c5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:28.089 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:28.095+0000 7f4234ebb640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f42300cf670 0x7f42300ca4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:28.089 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:28.095+0000 7f422ffff640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f423006e470 0x7f42300c5fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:46132/0 (socket says 172.21.15.142:46132) 2024-02-21T22:52:28.089 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:28.095+0000 7f4234ebb640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f42300cf670 0x7f42300ca4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.142:57690/0 (socket says 172.21.15.142:57690) 2024-02-21T22:52:28.089 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:28.095+0000 7f422ffff640 1 -- 172.21.15.142:0/3286470165 learned_addr learned my addr 172.21.15.142:0/3286470165 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-02-21T22:52:28.090 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:28.095+0000 7f422f7fe640 1 --2- 172.21.15.142:0/3286470165 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f42300cf290 0x7f4230146eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:28.090 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:28.096+0000 7f422ffff640 1 -- 172.21.15.142:0/3286470165 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f42300cf670 msgr2=0x7f42300ca4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:28.090 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:28.096+0000 7f422ffff640 1 --2- 172.21.15.142:0/3286470165 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f42300cf670 0x7f42300ca4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:28.090 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:28.096+0000 7f422ffff640 1 -- 172.21.15.142:0/3286470165 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f42300cf290 msgr2=0x7f4230146eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:28.090 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:28.096+0000 7f422ffff640 1 --2- 172.21.15.142:0/3286470165 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f42300cf290 0x7f4230146eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:28.090 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:28.096+0000 7f422ffff640 1 -- 172.21.15.142:0/3286470165 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42300ca9e0 con 0x7f423006e470 2024-02-21T22:52:28.090 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:28.096+0000 7f4234ebb640 1 --2- 172.21.15.142:0/3286470165 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f42300cf670 0x7f42300ca4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T22:52:28.090 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:28.096+0000 7f422f7fe640 1 --2- 172.21.15.142:0/3286470165 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f42300cf290 0x7f4230146eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T22:52:28.091 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:28.096+0000 7f422ffff640 1 --2- 172.21.15.142:0/3286470165 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f423006e470 0x7f42300c5fd0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f422400c430 tx=0x7f422400c8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:52:28.091 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:28.096+0000 7f422cff9640 1 -- 172.21.15.142:0/3286470165 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4224017070 con 0x7f423006e470 2024-02-21T22:52:28.091 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:28.096+0000 7f422cff9640 1 -- 172.21.15.142:0/3286470165 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4224005ce0 con 0x7f423006e470 2024-02-21T22:52:28.091 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:28.096+0000 7f423691e640 1 -- 172.21.15.142:0/3286470165 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42300c6660 con 0x7f423006e470 2024-02-21T22:52:28.091 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:28.096+0000 7f422cff9640 1 -- 172.21.15.142:0/3286470165 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42240072f0 con 0x7f423006e470 2024-02-21T22:52:28.091 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:28.096+0000 7f423691e640 1 -- 172.21.15.142:0/3286470165 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42300c6c20 con 0x7f423006e470 2024-02-21T22:52:28.091 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:28.096+0000 7f422cff9640 1 -- 172.21.15.142:0/3286470165 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f422401a070 con 0x7f423006e470 2024-02-21T22:52:28.091 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:28.096+0000 7f422cff9640 1 -- 172.21.15.142:0/3286470165 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f4224012a60 con 0x7f423006e470 2024-02-21T22:52:28.091 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:28.097+0000 7f423691e640 1 -- 172.21.15.142:0/3286470165 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42300752f0 con 0x7f423006e470 2024-02-21T22:52:28.092 INFO:tasks.ceph.mgr.x.smithi142.stderr:2024-02-21T22:52:28.099+0000 7f3555a0d040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-02-21T22:52:28.092 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:28.101+0000 7f422cff9640 1 -- 172.21.15.142:0/3286470165 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f4224021020 con 0x7f423006e470 2024-02-21T22:52:28.102 INFO:tasks.ceph.mgr.y.smithi116.stderr:2024-02-21T22:52:28.112+0000 7fb397c73040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-02-21T22:52:28.164 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:28.173+0000 7f423691e640 1 -- 172.21.15.142:0/3286470165 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd new", "uuid": "7ed29226-fc42-4382-a91a-fa50f7ec5426", "id": 7} v 0) v1 -- 0x7f423006da40 con 0x7f423006e470 2024-02-21T22:52:28.172 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:28.181+0000 7f422cff9640 1 -- 172.21.15.142:0/3286470165 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7ed29226-fc42-4382-a91a-fa50f7ec5426", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f42240075d0 con 0x7f423006e470 2024-02-21T22:52:28.172 INFO:teuthology.orchestra.run.smithi142.stdout:7 2024-02-21T22:52:28.173 INFO:tasks.ceph.mgr.y.smithi116.stderr:2024-02-21T22:52:28.182+0000 7fb397c73040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-02-21T22:52:28.174 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:28.182+0000 7f423691e640 1 -- 172.21.15.142:0/3286470165 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f423006e470 msgr2=0x7f42300c5fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:28.174 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:28.182+0000 7f423691e640 1 --2- 172.21.15.142:0/3286470165 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f423006e470 0x7f42300c5fd0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f422400c430 tx=0x7f422400c8f0 comp rx=0 tx=0).stop 2024-02-21T22:52:28.174 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:28.182+0000 7f423691e640 1 -- 172.21.15.142:0/3286470165 shutdown_connections 2024-02-21T22:52:28.174 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:28.182+0000 7f423691e640 1 --2- 172.21.15.142:0/3286470165 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f42300cf670 0x7f42300ca4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:28.174 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:28.182+0000 7f423691e640 1 --2- 172.21.15.142:0/3286470165 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f42300cf290 0x7f4230146eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:28.174 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:28.182+0000 7f423691e640 1 --2- 172.21.15.142:0/3286470165 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f423006e470 0x7f42300c5fd0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:28.174 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:28.182+0000 7f423691e640 1 -- 172.21.15.142:0/3286470165 >> 172.21.15.142:0/3286470165 conn(0x7f42300b2590 msgr2=0x7f423006ae40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:52:28.174 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:28.183+0000 7f423691e640 1 -- 172.21.15.142:0/3286470165 shutdown_connections 2024-02-21T22:52:28.174 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-21T22:52:28.183+0000 7f423691e640 1 -- 172.21.15.142:0/3286470165 wait complete. 2024-02-21T22:52:28.184 INFO:tasks.ceph.osd.0:Restarting daemon 2024-02-21T22:52:28.184 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-02-21T22:52:28.186 INFO:tasks.ceph.osd.0:Started 2024-02-21T22:52:28.186 INFO:tasks.ceph.osd.1:Restarting daemon 2024-02-21T22:52:28.186 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-02-21T22:52:28.188 INFO:tasks.ceph.osd.1:Started 2024-02-21T22:52:28.189 INFO:tasks.ceph.osd.2:Restarting daemon 2024-02-21T22:52:28.189 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-02-21T22:52:28.191 INFO:tasks.ceph.osd.2:Started 2024-02-21T22:52:28.191 INFO:tasks.ceph.osd.3:Restarting daemon 2024-02-21T22:52:28.191 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-02-21T22:52:28.193 INFO:tasks.ceph.osd.3:Started 2024-02-21T22:52:28.193 INFO:tasks.ceph.osd.4:Restarting daemon 2024-02-21T22:52:28.193 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-02-21T22:52:28.195 INFO:tasks.ceph.osd.4:Started 2024-02-21T22:52:28.195 INFO:tasks.ceph.osd.5:Restarting daemon 2024-02-21T22:52:28.195 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-02-21T22:52:28.197 INFO:tasks.ceph.osd.5:Started 2024-02-21T22:52:28.197 INFO:tasks.ceph.osd.6:Restarting daemon 2024-02-21T22:52:28.197 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-02-21T22:52:28.199 INFO:tasks.ceph.osd.6:Started 2024-02-21T22:52:28.199 INFO:tasks.ceph.osd.7:Restarting daemon 2024-02-21T22:52:28.199 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-02-21T22:52:28.201 INFO:tasks.ceph.osd.7:Started 2024-02-21T22:52:28.202 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-21T22:52:28.236 INFO:tasks.ceph.mgr.y.smithi116.stderr:2024-02-21T22:52:28.246+0000 7fb397c73040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-02-21T22:52:28.241 INFO:tasks.ceph.mgr.x.smithi142.stderr:2024-02-21T22:52:28.250+0000 7f3555a0d040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-02-21T22:52:28.309 INFO:tasks.ceph.mgr.y.smithi116.stderr:2024-02-21T22:52:28.318+0000 7fb397c73040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-02-21T22:52:28.328 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:28.337+0000 7fbe652c8640 1 Processor -- start 2024-02-21T22:52:28.328 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:28.337+0000 7fbe652c8640 1 -- start start 2024-02-21T22:52:28.329 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:28.338+0000 7fbe652c8640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fbe600d0510 0x7fbe600d08f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:28.329 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:28.338+0000 7fbe652c8640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbe600d1c30 0x7fbe600d2430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:28.329 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:28.338+0000 7fbe652c8640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe600cfa50 con 0x7fbe600ce8c0 2024-02-21T22:52:28.329 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:28.338+0000 7fbe652c8640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe600d1450 con 0x7fbe600d0510 2024-02-21T22:52:28.329 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:28.338+0000 7fbe652c8640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe600d0e30 con 0x7fbe600d1c30 2024-02-21T22:52:28.329 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:28.338+0000 7fbe5e7fc640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbe600d1c30 0x7fbe600d2430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:28.329 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:28.338+0000 7fbe5effd640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fbe600d0510 0x7fbe600d08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:28.329 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:28.338+0000 7fbe5f7fe640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fbe600ce8c0 0x7fbe600ced50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.116:51840/0 (socket says 172.21.15.116:51840) 2024-02-21T22:52:28.329 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:28.338+0000 7fbe5effd640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fbe600d0510 0x7fbe600d08f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.116:55108/0 (socket says 172.21.15.116:55108) 2024-02-21T22:52:28.330 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:28.338+0000 7fbe5e7fc640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbe600d1c30 0x7fbe600d2430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.116:33498/0 (socket says 172.21.15.116:33498) 2024-02-21T22:52:28.330 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:28.338+0000 7fbe5f7fe640 1 -- 172.21.15.116:0/2172685906 learned_addr learned my addr 172.21.15.116:0/2172685906 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-02-21T22:52:28.330 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:28.338+0000 7fbe5e7fc640 1 -- 172.21.15.116:0/2172685906 >> v2:172.21.15.142:3300/0 conn(0x7fbe600d0510 msgr2=0x7fbe600d08f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:52:28.330 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:28.338+0000 7fbe5e7fc640 1 --2- 172.21.15.116:0/2172685906 >> v2:172.21.15.142:3300/0 conn(0x7fbe600d0510 0x7fbe600d08f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:28.330 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:28.338+0000 7fbe5e7fc640 1 -- 172.21.15.116:0/2172685906 >> v1:172.21.15.142:6789/0 conn(0x7fbe600ce8c0 legacy=0x7fbe600ced50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:28.330 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:28.338+0000 7fbe5e7fc640 1 -- 172.21.15.116:0/2172685906 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe600cfcc0 con 0x7fbe600d1c30 2024-02-21T22:52:28.330 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:28.338+0000 7fbe5effd640 1 --2- 172.21.15.116:0/2172685906 >> v2:172.21.15.142:3300/0 conn(0x7fbe600d0510 0x7fbe600d08f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T22:52:28.331 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:28.339+0000 7fbe5e7fc640 1 --2- 172.21.15.116:0/2172685906 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbe600d1c30 0x7fbe600d2430 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fbe540097a0 tx=0x7fbe5402b820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fec8abb5d5e39c17 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:52:28.331 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:28.339+0000 7fbe5dffb640 1 -- 172.21.15.116:0/2172685906 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe54031780 con 0x7fbe600d1c30 2024-02-21T22:52:28.331 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:28.339+0000 7fbe5dffb640 1 -- 172.21.15.116:0/2172685906 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe54037070 con 0x7fbe600d1c30 2024-02-21T22:52:28.331 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:28.339+0000 7fbe5dffb640 1 -- 172.21.15.116:0/2172685906 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe54031b40 con 0x7fbe600d1c30 2024-02-21T22:52:28.331 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:28.340+0000 7fbe652c8640 1 -- 172.21.15.116:0/2172685906 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbe600d1c30 msgr2=0x7fbe600d2430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:28.331 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:28.340+0000 7fbe652c8640 1 --2- 172.21.15.116:0/2172685906 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbe600d1c30 0x7fbe600d2430 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fbe540097a0 tx=0x7fbe5402b820 comp rx=0 tx=0).stop 2024-02-21T22:52:28.332 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:28.340+0000 7fbe652c8640 1 -- 172.21.15.116:0/2172685906 shutdown_connections 2024-02-21T22:52:28.332 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:28.340+0000 7fbe652c8640 1 --2- 172.21.15.116:0/2172685906 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbe600d1c30 0x7fbe600d2430 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:28.332 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:28.340+0000 7fbe652c8640 1 --2- 172.21.15.116:0/2172685906 >> v2:172.21.15.142:3300/0 conn(0x7fbe600d0510 0x7fbe600d08f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:28.332 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:28.340+0000 7fbe652c8640 1 -- 172.21.15.116:0/2172685906 >> 172.21.15.116:0/2172685906 conn(0x7fbe600d3e50 msgr2=0x7fbe600d4260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:52:28.332 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:28.340+0000 7fbe652c8640 1 -- 172.21.15.116:0/2172685906 shutdown_connections 2024-02-21T22:52:28.332 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:28.340+0000 7fbe652c8640 1 -- 172.21.15.116:0/2172685906 wait complete. 2024-02-21T22:52:28.334 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:28.341+0000 7fbe652c8640 1 Processor -- start 2024-02-21T22:52:28.334 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:28.341+0000 7fbe652c8640 1 -- start start 2024-02-21T22:52:28.335 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:28.342+0000 7fbe652c8640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbe600ce8c0 0x7fbe600ca230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:28.335 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:28.342+0000 7fbe652c8640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbe600d0510 0x7fbe60153600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:28.335 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:28.342+0000 7fbe652c8640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbe600d1c30 0x7fbe600cb4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:28.335 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:28.342+0000 7fbe652c8640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe6015e640 con 0x7fbe600d0510 2024-02-21T22:52:28.335 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:28.342+0000 7fbe652c8640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe600d10e0 con 0x7fbe600d1c30 2024-02-21T22:52:28.335 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:28.342+0000 7fbe652c8640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe600d2970 con 0x7fbe600ce8c0 2024-02-21T22:52:28.335 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:28.342+0000 7fbe5e7fc640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbe600d0510 0x7fbe60153600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:28.335 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:28.342+0000 7fbe5effd640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbe600ce8c0 0x7fbe600ca230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:28.335 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:28.342+0000 7fbe5effd640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbe600ce8c0 0x7fbe600ca230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.116:33502/0 (socket says 172.21.15.116:33502) 2024-02-21T22:52:28.335 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:28.342+0000 7fbe5effd640 1 -- 172.21.15.116:0/956134154 learned_addr learned my addr 172.21.15.116:0/956134154 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:52:28.335 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:28.342+0000 7fbe5f7fe640 1 --2- 172.21.15.116:0/956134154 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbe600d1c30 0x7fbe600cb4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:28.335 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:28.343+0000 7fbe5effd640 1 -- 172.21.15.116:0/956134154 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbe600d1c30 msgr2=0x7fbe600cb4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:28.335 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:28.343+0000 7fbe5effd640 1 --2- 172.21.15.116:0/956134154 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbe600d1c30 0x7fbe600cb4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:28.335 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:28.343+0000 7fbe5effd640 1 -- 172.21.15.116:0/956134154 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbe600d0510 msgr2=0x7fbe60153600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:28.335 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:28.343+0000 7fbe5effd640 1 --2- 172.21.15.116:0/956134154 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbe600d0510 0x7fbe60153600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:28.336 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:28.343+0000 7fbe5effd640 1 -- 172.21.15.116:0/956134154 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe600c9190 con 0x7fbe600ce8c0 2024-02-21T22:52:28.336 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:28.343+0000 7fbe5effd640 1 --2- 172.21.15.116:0/956134154 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbe600ce8c0 0x7fbe600ca230 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fbe5800efc0 tx=0x7fbe5800c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:52:28.336 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:28.343+0000 7fbe477fe640 1 -- 172.21.15.116:0/956134154 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe58018020 con 0x7fbe600ce8c0 2024-02-21T22:52:28.336 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:28.343+0000 7fbe477fe640 1 -- 172.21.15.116:0/956134154 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe58014680 con 0x7fbe600ce8c0 2024-02-21T22:52:28.336 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:28.343+0000 7fbe477fe640 1 -- 172.21.15.116:0/956134154 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe58014a50 con 0x7fbe600ce8c0 2024-02-21T22:52:28.336 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:28.343+0000 7fbe652c8640 1 -- 172.21.15.116:0/956134154 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe600c9470 con 0x7fbe600ce8c0 2024-02-21T22:52:28.336 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:28.343+0000 7fbe652c8640 1 -- 172.21.15.116:0/956134154 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe600c9a30 con 0x7fbe600ce8c0 2024-02-21T22:52:28.336 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:28.344+0000 7fbe477fe640 1 -- 172.21.15.116:0/956134154 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7fbe58005d10 con 0x7fbe600ce8c0 2024-02-21T22:52:28.336 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:28.344+0000 7fbe477fe640 1 -- 172.21.15.116:0/956134154 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fbe58013ab0 con 0x7fbe600ce8c0 2024-02-21T22:52:28.336 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:28.344+0000 7fbe652c8640 1 -- 172.21.15.116:0/956134154 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe600752f0 con 0x7fbe600ce8c0 2024-02-21T22:52:28.337 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:28.346+0000 7fbe477fe640 1 -- 172.21.15.116:0/956134154 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7fbe58022030 con 0x7fbe600ce8c0 2024-02-21T22:52:28.359 INFO:tasks.ceph.mgr.y.smithi116.stderr:2024-02-21T22:52:28.368+0000 7fb397c73040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-02-21T22:52:28.371 INFO:tasks.ceph.mgr.x.smithi142.stderr:2024-02-21T22:52:28.380+0000 7f3555a0d040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-02-21T22:52:28.397 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:28.407+0000 7fbe652c8640 1 -- 172.21.15.116:0/956134154 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbe600d2210 con 0x7fbe600ce8c0 2024-02-21T22:52:28.398 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:28.407+0000 7fbe477fe640 1 -- 172.21.15.116:0/956134154 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7058 (secure 0 0 0) 0x7fbe58010040 con 0x7fbe600ce8c0 2024-02-21T22:52:28.398 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-02-21T22:52:28.398 INFO:teuthology.orchestra.run.smithi116.stdout:{"epoch":10,"fsid":"7c298660-5f63-4b5c-a800-58c5be9a8445","created":"2024-02-21T22:52:25.994613+0000","modified":"2024-02-21T22:52:28.176031+0000","last_up_change":"0.000000","last_in_change":"2024-02-21T22:52:28.176031+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"4f09126b-b5e4-4876-8b08-f5cbb967388a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"7272c51d-51f9-4536-931d-33ad7a4b377e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"2589616c-adf1-4187-aac3-735256cf624b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"0fd2e563-7c5b-46f6-82c2-b60c86072c93","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"79ae35b7-dda8-4ab8-96ce-47515afde082","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"3166eb2c-3fcf-41c8-9362-45bafaabaa39","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"f9aa9672-7527-43e2-963e-b61868e5e63f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"7ed29226-fc42-4382-a91a-fa50f7ec5426","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-21T22:52:28.399 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:28.408+0000 7fbe652c8640 1 -- 172.21.15.116:0/956134154 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbe600ce8c0 msgr2=0x7fbe600ca230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:28.399 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:28.408+0000 7fbe652c8640 1 --2- 172.21.15.116:0/956134154 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbe600ce8c0 0x7fbe600ca230 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fbe5800efc0 tx=0x7fbe5800c490 comp rx=0 tx=0).stop 2024-02-21T22:52:28.399 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:28.408+0000 7fbe652c8640 1 -- 172.21.15.116:0/956134154 shutdown_connections 2024-02-21T22:52:28.400 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:28.408+0000 7fbe652c8640 1 --2- 172.21.15.116:0/956134154 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbe600d1c30 0x7fbe600cb4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:28.400 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:28.408+0000 7fbe652c8640 1 --2- 172.21.15.116:0/956134154 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbe600d0510 0x7fbe60153600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:28.400 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:28.408+0000 7fbe652c8640 1 --2- 172.21.15.116:0/956134154 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbe600ce8c0 0x7fbe600ca230 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:28.400 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:28.408+0000 7fbe652c8640 1 -- 172.21.15.116:0/956134154 >> 172.21.15.116:0/956134154 conn(0x7fbe600d3e50 msgr2=0x7fbe60151b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:52:28.400 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:28.408+0000 7fbe652c8640 1 -- 172.21.15.116:0/956134154 shutdown_connections 2024-02-21T22:52:28.400 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:28.409+0000 7fbe652c8640 1 -- 172.21.15.116:0/956134154 wait complete. 2024-02-21T22:52:28.410 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-02-21T22:52:28.410 INFO:tasks.ceph:Waiting for OSDs to come up 2024-02-21T22:52:28.417 INFO:tasks.ceph.mgr.x.smithi142.stderr:2024-02-21T22:52:28.426+0000 7f3555a0d040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-02-21T22:52:28.529 INFO:tasks.ceph.mgr.x.smithi142.stderr:2024-02-21T22:52:28.538+0000 7f3555a0d040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-02-21T22:52:28.626 INFO:tasks.ceph.mgr.x.smithi142.stderr:2024-02-21T22:52:28.635+0000 7f3555a0d040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-02-21T22:52:28.739 INFO:tasks.ceph.mgr.y.smithi116.stderr:2024-02-21T22:52:28.748+0000 7fb397c73040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-02-21T22:52:28.779 INFO:tasks.ceph.mgr.x.smithi142.stderr:2024-02-21T22:52:28.788+0000 7f3555a0d040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-02-21T22:52:28.796 INFO:tasks.ceph.osd.3.smithi116.stderr:2024-02-21T22:52:28.805+0000 7ff9f6a04640 -1 Falling back to public interface 2024-02-21T22:52:28.798 INFO:tasks.ceph.osd.6.smithi142.stderr:2024-02-21T22:52:28.807+0000 7fb05d80d640 -1 Falling back to public interface 2024-02-21T22:52:28.800 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-02-21T22:52:28.810+0000 7f3cfc419640 -1 Falling back to public interface 2024-02-21T22:52:28.801 INFO:tasks.ceph.osd.7.smithi142.stderr:2024-02-21T22:52:28.810+0000 7f9194906640 -1 Falling back to public interface 2024-02-21T22:52:28.804 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-02-21T22:52:28.813+0000 7fc41f938640 -1 Falling back to public interface 2024-02-21T22:52:28.807 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-02-21T22:52:28.817+0000 7f0ef4215640 -1 Falling back to public interface 2024-02-21T22:52:28.823 INFO:tasks.ceph.mgr.x.smithi142.stderr:2024-02-21T22:52:28.832+0000 7f3555a0d040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-02-21T22:52:28.824 INFO:tasks.ceph.osd.5.smithi142.stderr:2024-02-21T22:52:28.833+0000 7fbebe911640 -1 Falling back to public interface 2024-02-21T22:52:28.827 INFO:tasks.ceph.osd.4.smithi142.stderr:2024-02-21T22:52:28.837+0000 7efde1613640 -1 Falling back to public interface 2024-02-21T22:52:28.875 INFO:tasks.ceph.mgr.y.smithi116.stderr:2024-02-21T22:52:28.884+0000 7fb397c73040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-02-21T22:52:28.981 INFO:tasks.ceph.mgr.x.smithi142.stderr:2024-02-21T22:52:28.990+0000 7f3555a0d040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-02-21T22:52:28.982 INFO:tasks.ceph.mgr.y.smithi116.stderr:2024-02-21T22:52:28.991+0000 7fb397c73040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-02-21T22:52:29.028 INFO:tasks.ceph.mgr.y.smithi116.stderr:2024-02-21T22:52:29.037+0000 7fb397c73040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-02-21T22:52:29.141 INFO:tasks.ceph.mgr.y.smithi116.stderr:2024-02-21T22:52:29.150+0000 7fb397c73040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-02-21T22:52:29.215 DEBUG:teuthology.orchestra.run.smithi116:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-02-21T22:52:29.237 INFO:tasks.ceph.mgr.y.smithi116.stderr:2024-02-21T22:52:29.247+0000 7fb397c73040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-02-21T22:52:29.306 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:29.315+0000 7f4ca48ad640 1 Processor -- start 2024-02-21T22:52:29.306 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:29.315+0000 7f4ca48ad640 1 -- start start 2024-02-21T22:52:29.308 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:29.316+0000 7f4ca48ad640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4ca0144590 0x7f4ca00b4830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:29.308 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:29.316+0000 7f4ca48ad640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f4ca0071b80 0x7f4ca0071fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:29.308 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:29.316+0000 7f4ca48ad640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ca015c200 con 0x7f4ca015c440 2024-02-21T22:52:29.308 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:29.316+0000 7f4ca48ad640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ca0072520 con 0x7f4ca0071b80 2024-02-21T22:52:29.309 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:29.316+0000 7f4ca48ad640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ca00b3a70 con 0x7f4ca0144590 2024-02-21T22:52:29.309 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:29.316+0000 7f4c97fff640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f4ca0071b80 0x7f4ca0071fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:29.309 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:29.316+0000 7f4c97fff640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f4ca0071b80 0x7f4ca0071fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:60128/0 (socket says 172.21.15.116:60128) 2024-02-21T22:52:29.309 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:29.316+0000 7f4c97fff640 1 -- 172.21.15.116:0/2663610143 learned_addr learned my addr 172.21.15.116:0/2663610143 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:52:29.309 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:29.317+0000 7f4c9e59c640 1 --2- 172.21.15.116:0/2663610143 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4ca0144590 0x7f4ca00b4830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:29.309 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:29.317+0000 7f4c97fff640 1 -- 172.21.15.116:0/2663610143 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4ca0144590 msgr2=0x7f4ca00b4830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:52:29.309 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:29.317+0000 7f4c97fff640 1 --2- 172.21.15.116:0/2663610143 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4ca0144590 0x7f4ca00b4830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:29.309 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:29.317+0000 7f4c97fff640 1 -- 172.21.15.116:0/2663610143 >> v1:172.21.15.142:6789/0 conn(0x7f4ca015c440 legacy=0x7f4ca015c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:29.309 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:29.317+0000 7f4c97fff640 1 -- 172.21.15.116:0/2663610143 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ca00b3d50 con 0x7f4ca0071b80 2024-02-21T22:52:29.309 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:29.317+0000 7f4c9e59c640 1 --2- 172.21.15.116:0/2663610143 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4ca0144590 0x7f4ca00b4830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T22:52:29.309 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:29.317+0000 7f4c97fff640 1 --2- 172.21.15.116:0/2663610143 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4ca0071b80 0x7f4ca0071fe0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f4c88009870 tx=0x7f4c8802b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=131a26e267757a38 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:52:29.309 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:29.318+0000 7f4c9dd9b640 1 -- 172.21.15.116:0/2663610143 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c88034070 con 0x7f4ca0071b80 2024-02-21T22:52:29.309 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:29.318+0000 7f4c9dd9b640 1 -- 172.21.15.116:0/2663610143 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c88030840 con 0x7f4ca0071b80 2024-02-21T22:52:29.309 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:29.318+0000 7f4c9dd9b640 1 -- 172.21.15.116:0/2663610143 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c88030c10 con 0x7f4ca0071b80 2024-02-21T22:52:29.312 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:29.318+0000 7f4ca48ad640 1 -- 172.21.15.116:0/2663610143 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4ca0071b80 msgr2=0x7f4ca0071fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:29.312 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:29.318+0000 7f4ca48ad640 1 --2- 172.21.15.116:0/2663610143 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4ca0071b80 0x7f4ca0071fe0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f4c88009870 tx=0x7f4c8802b980 comp rx=0 tx=0).stop 2024-02-21T22:52:29.312 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:29.318+0000 7f4ca48ad640 1 -- 172.21.15.116:0/2663610143 shutdown_connections 2024-02-21T22:52:29.312 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:29.318+0000 7f4ca48ad640 1 --2- 172.21.15.116:0/2663610143 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4ca0071b80 0x7f4ca0071fe0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:29.312 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:29.318+0000 7f4ca48ad640 1 --2- 172.21.15.116:0/2663610143 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4ca0144590 0x7f4ca00b4830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:29.313 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:29.318+0000 7f4ca48ad640 1 -- 172.21.15.116:0/2663610143 >> 172.21.15.116:0/2663610143 conn(0x7f4ca00b26d0 msgr2=0x7f4ca00b2ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:52:29.313 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:29.318+0000 7f4ca48ad640 1 -- 172.21.15.116:0/2663610143 shutdown_connections 2024-02-21T22:52:29.313 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:29.318+0000 7f4ca48ad640 1 -- 172.21.15.116:0/2663610143 wait complete. 2024-02-21T22:52:29.313 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:29.320+0000 7f4ca48ad640 1 Processor -- start 2024-02-21T22:52:29.313 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:29.320+0000 7f4ca48ad640 1 -- start start 2024-02-21T22:52:29.313 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:29.320+0000 7f4ca48ad640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4ca0071b80 0x7f4ca015a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:29.313 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:29.320+0000 7f4ca48ad640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4ca0144590 0x7f4ca00cc2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:29.313 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:29.320+0000 7f4ca48ad640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4ca015c440 0x7f4ca00b1900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:29.313 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:29.320+0000 7f4ca48ad640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ca00b4d70 con 0x7f4ca0071b80 2024-02-21T22:52:29.313 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:29.320+0000 7f4ca48ad640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ca0144970 con 0x7f4ca0144590 2024-02-21T22:52:29.313 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:29.320+0000 7f4ca48ad640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ca015b4d0 con 0x7f4ca015c440 2024-02-21T22:52:29.313 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:29.320+0000 7f4c9e59c640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4ca0071b80 0x7f4ca015a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:29.313 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:29.320+0000 7f4c9e59c640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4ca0071b80 0x7f4ca015a6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:60136/0 (socket says 172.21.15.116:60136) 2024-02-21T22:52:29.313 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:29.320+0000 7f4c9e59c640 1 -- 172.21.15.116:0/78721523 learned_addr learned my addr 172.21.15.116:0/78721523 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:52:29.314 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:29.320+0000 7f4c97fff640 1 --2- 172.21.15.116:0/78721523 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4ca0144590 0x7f4ca00cc2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:29.314 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:29.320+0000 7f4c9ed9d640 1 --2- 172.21.15.116:0/78721523 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4ca015c440 0x7f4ca00b1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:29.314 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:29.321+0000 7f4c9e59c640 1 -- 172.21.15.116:0/78721523 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4ca015c440 msgr2=0x7f4ca00b1900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:29.314 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:29.321+0000 7f4c9e59c640 1 --2- 172.21.15.116:0/78721523 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4ca015c440 0x7f4ca00b1900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:29.314 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:29.321+0000 7f4c9e59c640 1 -- 172.21.15.116:0/78721523 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4ca0144590 msgr2=0x7f4ca00cc2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:29.314 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:29.321+0000 7f4c9e59c640 1 --2- 172.21.15.116:0/78721523 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4ca0144590 0x7f4ca00cc2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:29.314 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:29.321+0000 7f4c9e59c640 1 -- 172.21.15.116:0/78721523 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ca00cb210 con 0x7f4ca0071b80 2024-02-21T22:52:29.314 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:29.321+0000 7f4c9e59c640 1 --2- 172.21.15.116:0/78721523 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4ca0071b80 0x7f4ca015a6a0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f4c9000e7e0 tx=0x7f4c9000eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:52:29.314 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:29.321+0000 7f4c96ffd640 1 -- 172.21.15.116:0/78721523 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c9000f040 con 0x7f4ca0071b80 2024-02-21T22:52:29.314 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:29.321+0000 7f4c96ffd640 1 -- 172.21.15.116:0/78721523 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c90004030 con 0x7f4ca0071b80 2024-02-21T22:52:29.314 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:29.321+0000 7f4ca48ad640 1 -- 172.21.15.116:0/78721523 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ca00cb4f0 con 0x7f4ca0071b80 2024-02-21T22:52:29.314 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:29.321+0000 7f4c96ffd640 1 -- 172.21.15.116:0/78721523 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c90004400 con 0x7f4ca0071b80 2024-02-21T22:52:29.314 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:29.321+0000 7f4ca48ad640 1 -- 172.21.15.116:0/78721523 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ca00cbab0 con 0x7f4ca0071b80 2024-02-21T22:52:29.314 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:29.321+0000 7f4c96ffd640 1 -- 172.21.15.116:0/78721523 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f4c9000ca60 con 0x7f4ca0071b80 2024-02-21T22:52:29.315 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:29.321+0000 7f4c96ffd640 1 -- 172.21.15.116:0/78721523 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f4c90013c70 con 0x7f4ca0071b80 2024-02-21T22:52:29.315 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:29.322+0000 7f4ca48ad640 1 -- 172.21.15.116:0/78721523 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ca004f290 con 0x7f4ca0071b80 2024-02-21T22:52:29.315 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:29.324+0000 7f4c96ffd640 1 -- 172.21.15.116:0/78721523 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f4c90017020 con 0x7f4ca0071b80 2024-02-21T22:52:29.376 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:29.385+0000 7f4ca48ad640 1 -- 172.21.15.116:0/78721523 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4ca00cd560 con 0x7f4ca0071b80 2024-02-21T22:52:29.377 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:29.386+0000 7f4c96ffd640 1 -- 172.21.15.116:0/78721523 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7058 (secure 0 0 0) 0x7f4c900135a0 con 0x7f4ca0071b80 2024-02-21T22:52:29.377 INFO:teuthology.misc.health.smithi116.stdout: 2024-02-21T22:52:29.377 INFO:teuthology.misc.health.smithi116.stdout:{"epoch":10,"fsid":"7c298660-5f63-4b5c-a800-58c5be9a8445","created":"2024-02-21T22:52:25.994613+0000","modified":"2024-02-21T22:52:28.176031+0000","last_up_change":"0.000000","last_in_change":"2024-02-21T22:52:28.176031+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"4f09126b-b5e4-4876-8b08-f5cbb967388a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"7272c51d-51f9-4536-931d-33ad7a4b377e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"2589616c-adf1-4187-aac3-735256cf624b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"0fd2e563-7c5b-46f6-82c2-b60c86072c93","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"79ae35b7-dda8-4ab8-96ce-47515afde082","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"3166eb2c-3fcf-41c8-9362-45bafaabaa39","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"f9aa9672-7527-43e2-963e-b61868e5e63f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"7ed29226-fc42-4382-a91a-fa50f7ec5426","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-21T22:52:29.378 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:29.387+0000 7f4ca48ad640 1 -- 172.21.15.116:0/78721523 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4ca0071b80 msgr2=0x7f4ca015a6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:29.378 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:29.387+0000 7f4ca48ad640 1 --2- 172.21.15.116:0/78721523 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4ca0071b80 0x7f4ca015a6a0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f4c9000e7e0 tx=0x7f4c9000eca0 comp rx=0 tx=0).stop 2024-02-21T22:52:29.378 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:29.387+0000 7f4ca48ad640 1 -- 172.21.15.116:0/78721523 shutdown_connections 2024-02-21T22:52:29.378 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:29.387+0000 7f4ca48ad640 1 --2- 172.21.15.116:0/78721523 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4ca015c440 0x7f4ca00b1900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:29.378 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:29.387+0000 7f4ca48ad640 1 --2- 172.21.15.116:0/78721523 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4ca0144590 0x7f4ca00cc2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:29.378 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:29.387+0000 7f4ca48ad640 1 --2- 172.21.15.116:0/78721523 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4ca0071b80 0x7f4ca015a6a0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:29.379 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:29.387+0000 7f4ca48ad640 1 -- 172.21.15.116:0/78721523 >> 172.21.15.116:0/78721523 conn(0x7f4ca00b26d0 msgr2=0x7f4ca006fcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:52:29.379 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:29.387+0000 7f4ca48ad640 1 -- 172.21.15.116:0/78721523 shutdown_connections 2024-02-21T22:52:29.379 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:29.387+0000 7f4ca48ad640 1 -- 172.21.15.116:0/78721523 wait complete. 2024-02-21T22:52:29.387 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-02-21T22:52:29.402 INFO:tasks.ceph.mgr.y.smithi116.stderr:2024-02-21T22:52:29.411+0000 7fb397c73040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-02-21T22:52:29.445 INFO:tasks.ceph.mgr.y.smithi116.stderr:2024-02-21T22:52:29.454+0000 7fb397c73040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-02-21T22:52:29.597 INFO:tasks.ceph.mgr.y.smithi116.stderr:2024-02-21T22:52:29.606+0000 7fb397c73040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-02-21T22:52:29.807 INFO:tasks.ceph.mgr.x.smithi142.stderr:2024-02-21T22:52:29.816+0000 7f3555a0d040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-02-21T22:52:30.085 INFO:tasks.ceph.mgr.x.smithi142.stderr:2024-02-21T22:52:30.095+0000 7f3555a0d040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-02-21T22:52:30.136 INFO:tasks.ceph.mgr.x.smithi142.stderr:2024-02-21T22:52:30.146+0000 7f3555a0d040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-02-21T22:52:30.253 INFO:tasks.ceph.mgr.x.smithi142.stderr:2024-02-21T22:52:30.262+0000 7f3555a0d040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-02-21T22:52:30.418 INFO:tasks.ceph.mgr.y.smithi116.stderr:2024-02-21T22:52:30.427+0000 7fb397c73040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-02-21T22:52:30.692 INFO:tasks.ceph.mgr.y.smithi116.stderr:2024-02-21T22:52:30.701+0000 7fb397c73040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-02-21T22:52:30.745 INFO:tasks.ceph.mgr.y.smithi116.stderr:2024-02-21T22:52:30.754+0000 7fb397c73040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-02-21T22:52:30.858 INFO:tasks.ceph.mgr.y.smithi116.stderr:2024-02-21T22:52:30.867+0000 7fb397c73040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-02-21T22:52:31.280 INFO:tasks.ceph.mgr.x.smithi142.stderr:2024-02-21T22:52:31.289+0000 7f34f601e640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-02-21T22:52:31.281 INFO:tasks.ceph.mgr.x.smithi142.stderr:2024-02-21T22:52:31.290+0000 7f34f601e640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-02-21T22:52:32.272 INFO:tasks.ceph.osd.3.smithi116.stderr:2024-02-21T22:52:32.282+0000 7ff9f6a04640 -1 osd.3 0 log_to_monitors true 2024-02-21T22:52:32.302 INFO:tasks.ceph.osd.6.smithi142.stderr:2024-02-21T22:52:32.310+0000 7fb05d80d640 -1 osd.6 0 log_to_monitors true 2024-02-21T22:52:32.303 INFO:tasks.ceph.osd.7.smithi142.stderr:2024-02-21T22:52:32.312+0000 7f9194906640 -1 osd.7 0 log_to_monitors true 2024-02-21T22:52:32.310 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-02-21T22:52:32.320+0000 7f3cfc419640 -1 osd.0 0 log_to_monitors true 2024-02-21T22:52:32.313 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-02-21T22:52:32.323+0000 7f0ef4215640 -1 osd.2 0 log_to_monitors true 2024-02-21T22:52:32.318 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-02-21T22:52:32.328+0000 7fc41f938640 -1 osd.1 0 log_to_monitors true 2024-02-21T22:52:32.336 INFO:tasks.ceph.osd.4.smithi142.stderr:2024-02-21T22:52:32.346+0000 7efde1613640 -1 osd.4 0 log_to_monitors true 2024-02-21T22:52:32.349 INFO:tasks.ceph.osd.5.smithi142.stderr:2024-02-21T22:52:32.358+0000 7fbebe911640 -1 osd.5 0 log_to_monitors true 2024-02-21T22:52:36.195 DEBUG:teuthology.orchestra.run.smithi116:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-02-21T22:52:36.300 INFO:tasks.ceph.osd.5.smithi142.stderr:2024-02-21T22:52:36.310+0000 7fbeb9df6640 -1 osd.5 0 waiting for initial osdmap 2024-02-21T22:52:36.311 INFO:tasks.ceph.osd.5.smithi142.stderr:2024-02-21T22:52:36.321+0000 7fbeb2480640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-21T22:52:36.315 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-02-21T22:52:36.325+0000 7f3cf73c1640 -1 osd.0 0 waiting for initial osdmap 2024-02-21T22:52:36.327 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-02-21T22:52:36.336+0000 7f0eeeff6640 -1 osd.2 0 waiting for initial osdmap 2024-02-21T22:52:36.328 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:36.337+0000 7f67ca460640 1 Processor -- start 2024-02-21T22:52:36.328 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:36.337+0000 7f67ca460640 1 -- start start 2024-02-21T22:52:36.330 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:36.339+0000 7f67ca460640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f67c415e1c0 0x7f67c40ce930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:36.330 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:36.339+0000 7f67ca460640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67c40b7940 con 0x7f67c40cee70 2024-02-21T22:52:36.330 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:36.339+0000 7f67ca460640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67c40b7c20 con 0x7f67c40b99f0 2024-02-21T22:52:36.330 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:36.339+0000 7f67c89fd640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f67c40b99f0 0x7f67c40d1b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.116:58798/0 (socket says 172.21.15.116:58798) 2024-02-21T22:52:36.330 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:36.339+0000 7f67c89fd640 1 -- 172.21.15.116:0/1686977424 learned_addr learned my addr 172.21.15.116:0/1686977424 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-02-21T22:52:36.330 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:36.339+0000 7f67ca460640 1 -- 172.21.15.116:0/1686977424 --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67c40b7f00 con 0x7f67c415e1c0 2024-02-21T22:52:36.331 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:36.340+0000 7f67c3fff640 1 --2- 172.21.15.116:0/1686977424 >> v2:172.21.15.142:3300/0 conn(0x7f67c415e1c0 0x7f67c40ce930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:36.331 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:36.340+0000 7f67c2ffd640 1 -- 172.21.15.116:0/1686977424 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2259288680 0 0) 0x7f67c40b7940 con 0x7f67c40cee70 2024-02-21T22:52:36.331 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:36.340+0000 7f67c3fff640 1 -- 172.21.15.116:0/1686977424 >> v1:172.21.15.142:6789/0 conn(0x7f67c40b99f0 legacy=0x7f67c40d1b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:36.331 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-02-21T22:52:36.340+0000 7f3cef9f3640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-21T22:52:36.331 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:36.340+0000 7f67c3fff640 1 -- 172.21.15.116:0/1686977424 >> v1:172.21.15.116:6789/0 conn(0x7f67c40cee70 legacy=0x7f67c40cf300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:36.331 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:36.340+0000 7f67c3fff640 1 -- 172.21.15.116:0/1686977424 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67c40b81e0 con 0x7f67c415e1c0 2024-02-21T22:52:36.332 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:36.341+0000 7f67c3fff640 1 --2- 172.21.15.116:0/1686977424 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f67c415e1c0 0x7f67c40ce930 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f67b80097a0 tx=0x7f67b802b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9c2f9e2983b5603f server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:52:36.332 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:36.342+0000 7f67c2ffd640 1 -- 172.21.15.116:0/1686977424 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67b80315a0 con 0x7f67c415e1c0 2024-02-21T22:52:36.332 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:36.342+0000 7f67c2ffd640 1 -- 172.21.15.116:0/1686977424 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67b8037070 con 0x7f67c415e1c0 2024-02-21T22:52:36.332 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:36.342+0000 7f67c2ffd640 1 -- 172.21.15.116:0/1686977424 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67b8031960 con 0x7f67c415e1c0 2024-02-21T22:52:36.333 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:36.343+0000 7f67ca460640 1 -- 172.21.15.116:0/1686977424 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f67c415e1c0 msgr2=0x7f67c40ce930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:36.333 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:36.343+0000 7f67ca460640 1 --2- 172.21.15.116:0/1686977424 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f67c415e1c0 0x7f67c40ce930 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f67b80097a0 tx=0x7f67b802b840 comp rx=0 tx=0).stop 2024-02-21T22:52:36.334 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:36.343+0000 7f67ca460640 1 -- 172.21.15.116:0/1686977424 shutdown_connections 2024-02-21T22:52:36.334 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:36.343+0000 7f67ca460640 1 --2- 172.21.15.116:0/1686977424 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f67c415e1c0 0x7f67c40ce930 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:36.334 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:36.343+0000 7f67ca460640 1 -- 172.21.15.116:0/1686977424 >> 172.21.15.116:0/1686977424 conn(0x7f67c40d3db0 msgr2=0x7f67c40d41c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:52:36.334 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:36.343+0000 7f67ca460640 1 -- 172.21.15.116:0/1686977424 shutdown_connections 2024-02-21T22:52:36.334 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:36.343+0000 7f67ca460640 1 -- 172.21.15.116:0/1686977424 wait complete. 2024-02-21T22:52:36.335 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:36.344+0000 7f67ca460640 1 Processor -- start 2024-02-21T22:52:36.335 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:36.344+0000 7f67ca460640 1 -- start start 2024-02-21T22:52:36.337 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:36.345+0000 7f67ca460640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f67c40b99f0 0x7f67c4151390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:36.337 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:36.345+0000 7f67ca460640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f67c40cee70 0x7f67c41f4930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:36.337 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:36.345+0000 7f67ca460640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f67c415e1c0 0x7f67c41f7550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:36.337 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:36.345+0000 7f67ca460640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67c415e5a0 con 0x7f67c40cee70 2024-02-21T22:52:36.337 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:36.345+0000 7f67ca460640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67c40b7610 con 0x7f67c40b99f0 2024-02-21T22:52:36.337 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:36.345+0000 7f67ca460640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67c415e720 con 0x7f67c415e1c0 2024-02-21T22:52:36.338 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:36.345+0000 7f67c89fd640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f67c415e1c0 0x7f67c41f7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:36.338 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:36.345+0000 7f67c3fff640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f67c40b99f0 0x7f67c4151390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:36.338 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:36.345+0000 7f67c89fd640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f67c415e1c0 0x7f67c41f7550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.116:58372/0 (socket says 172.21.15.116:58372) 2024-02-21T22:52:36.338 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:36.345+0000 7f67c3fff640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f67c40b99f0 0x7f67c4151390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.116:45004/0 (socket says 172.21.15.116:45004) 2024-02-21T22:52:36.338 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:36.345+0000 7f67c89fd640 1 -- 172.21.15.116:0/3143132771 learned_addr learned my addr 172.21.15.116:0/3143132771 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:52:36.338 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:36.345+0000 7f67c37fe640 1 --2- 172.21.15.116:0/3143132771 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f67c40cee70 0x7f67c41f4930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:36.338 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:36.346+0000 7f67c89fd640 1 -- 172.21.15.116:0/3143132771 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f67c40b99f0 msgr2=0x7f67c4151390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:36.338 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:36.346+0000 7f67c89fd640 1 --2- 172.21.15.116:0/3143132771 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f67c40b99f0 0x7f67c4151390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:36.338 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:36.346+0000 7f67c89fd640 1 -- 172.21.15.116:0/3143132771 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f67c40cee70 msgr2=0x7f67c41f4930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:36.338 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:36.346+0000 7f67c89fd640 1 --2- 172.21.15.116:0/3143132771 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f67c40cee70 0x7f67c41f4930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:36.338 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:36.346+0000 7f67c89fd640 1 -- 172.21.15.116:0/3143132771 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67c41f4150 con 0x7f67c415e1c0 2024-02-21T22:52:36.338 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:36.346+0000 7f67c37fe640 1 --2- 172.21.15.116:0/3143132771 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f67c40cee70 0x7f67c41f4930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T22:52:36.338 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:36.346+0000 7f67c89fd640 1 --2- 172.21.15.116:0/3143132771 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f67c415e1c0 0x7f67c41f7550 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f67bc00c420 tx=0x7f67bc00c8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:52:36.339 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:36.346+0000 7f67c0ff9640 1 -- 172.21.15.116:0/3143132771 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67bc017070 con 0x7f67c415e1c0 2024-02-21T22:52:36.339 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:36.346+0000 7f67c0ff9640 1 -- 172.21.15.116:0/3143132771 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67bc005ce0 con 0x7f67c415e1c0 2024-02-21T22:52:36.339 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:36.346+0000 7f67c0ff9640 1 -- 172.21.15.116:0/3143132771 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67bc0072d0 con 0x7f67c415e1c0 2024-02-21T22:52:36.339 INFO:tasks.ceph.osd.7.smithi142.stderr:2024-02-21T22:52:36.345+0000 7f918fdf6640 -1 osd.7 0 waiting for initial osdmap 2024-02-21T22:52:36.340 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:36.347+0000 7f67ca460640 1 -- 172.21.15.116:0/3143132771 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67c41f7fa0 con 0x7f67c415e1c0 2024-02-21T22:52:36.340 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:36.347+0000 7f67ca460640 1 -- 172.21.15.116:0/3143132771 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67c41f4e70 con 0x7f67c415e1c0 2024-02-21T22:52:36.340 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:36.348+0000 7f67ca460640 1 -- 172.21.15.116:0/3143132771 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67c404f290 con 0x7f67c415e1c0 2024-02-21T22:52:36.340 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-02-21T22:52:36.349+0000 7f0ee7680640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-21T22:52:36.342 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:36.350+0000 7f67c0ff9640 1 -- 172.21.15.116:0/3143132771 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 4) v1 ==== 89724+0+0 (secure 0 0 0) 0x7f67bc01a070 con 0x7f67c415e1c0 2024-02-21T22:52:36.342 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:36.351+0000 7f67c0ff9640 1 --2- 172.21.15.116:0/3143132771 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f67b006b440 0x7f67b006d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:36.342 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:36.351+0000 7f67c0ff9640 1 -- 172.21.15.116:0/3143132771 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2231+0+0 (secure 0 0 0) 0x7f67bc088df0 con 0x7f67c415e1c0 2024-02-21T22:52:36.342 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:36.351+0000 7f67c3fff640 1 --2- 172.21.15.116:0/3143132771 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f67b006b440 0x7f67b006d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:36.342 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:36.352+0000 7f67c3fff640 1 --2- 172.21.15.116:0/3143132771 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f67b006b440 0x7f67b006d900 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f67b8036000 tx=0x7f67b803d040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:52:36.344 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-02-21T22:52:36.354+0000 7fc41adf6640 -1 osd.1 0 waiting for initial osdmap 2024-02-21T22:52:36.345 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:36.355+0000 7f67c0ff9640 1 -- 172.21.15.116:0/3143132771 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f67bc058500 con 0x7f67c415e1c0 2024-02-21T22:52:36.348 INFO:tasks.ceph.osd.7.smithi142.stderr:2024-02-21T22:52:36.358+0000 7f9188480640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-21T22:52:36.350 INFO:tasks.ceph.osd.4.smithi142.stderr:2024-02-21T22:52:36.359+0000 7efddc9f6640 -1 osd.4 0 waiting for initial osdmap 2024-02-21T22:52:36.354 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-02-21T22:52:36.364+0000 7fc413480640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-21T22:52:36.361 INFO:tasks.ceph.osd.4.smithi142.stderr:2024-02-21T22:52:36.370+0000 7efdd5080640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-21T22:52:36.361 INFO:tasks.ceph.osd.3.smithi116.stderr:2024-02-21T22:52:36.371+0000 7ff9f35f9640 -1 osd.3 0 waiting for initial osdmap 2024-02-21T22:52:36.370 INFO:tasks.ceph.osd.3.smithi116.stderr:2024-02-21T22:52:36.380+0000 7ff9ea480640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-21T22:52:36.391 INFO:tasks.ceph.osd.6.smithi142.stderr:2024-02-21T22:52:36.400+0000 7fb0585f6640 -1 osd.6 0 waiting for initial osdmap 2024-02-21T22:52:36.405 INFO:tasks.ceph.osd.6.smithi142.stderr:2024-02-21T22:52:36.414+0000 7fb050c80640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-21T22:52:36.527 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:36.536+0000 7f67ca460640 1 -- 172.21.15.116:0/3143132771 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f67c41f3f10 con 0x7f67c415e1c0 2024-02-21T22:52:36.527 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:36.537+0000 7f67c0ff9640 1 -- 172.21.15.116:0/3143132771 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+7058 (secure 0 0 0) 0x7f67bc05c5a0 con 0x7f67c415e1c0 2024-02-21T22:52:36.527 INFO:teuthology.misc.health.smithi116.stdout: 2024-02-21T22:52:36.528 INFO:teuthology.misc.health.smithi116.stdout:{"epoch":12,"fsid":"7c298660-5f63-4b5c-a800-58c5be9a8445","created":"2024-02-21T22:52:25.994613+0000","modified":"2024-02-21T22:52:34.290861+0000","last_up_change":"0.000000","last_in_change":"2024-02-21T22:52:28.176031+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"4f09126b-b5e4-4876-8b08-f5cbb967388a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"7272c51d-51f9-4536-931d-33ad7a4b377e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"2589616c-adf1-4187-aac3-735256cf624b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"0fd2e563-7c5b-46f6-82c2-b60c86072c93","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"79ae35b7-dda8-4ab8-96ce-47515afde082","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"3166eb2c-3fcf-41c8-9362-45bafaabaa39","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"f9aa9672-7527-43e2-963e-b61868e5e63f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"7ed29226-fc42-4382-a91a-fa50f7ec5426","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-21T22:52:36.530 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:36.539+0000 7f67ca460640 1 -- 172.21.15.116:0/3143132771 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f67b006b440 msgr2=0x7f67b006d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:36.530 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:36.539+0000 7f67ca460640 1 --2- 172.21.15.116:0/3143132771 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f67b006b440 0x7f67b006d900 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f67b8036000 tx=0x7f67b803d040 comp rx=0 tx=0).stop 2024-02-21T22:52:36.530 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:36.539+0000 7f67ca460640 1 -- 172.21.15.116:0/3143132771 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f67c415e1c0 msgr2=0x7f67c41f7550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:36.530 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:36.539+0000 7f67ca460640 1 --2- 172.21.15.116:0/3143132771 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f67c415e1c0 0x7f67c41f7550 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f67bc00c420 tx=0x7f67bc00c8e0 comp rx=0 tx=0).stop 2024-02-21T22:52:36.530 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:36.539+0000 7f67ca460640 1 -- 172.21.15.116:0/3143132771 shutdown_connections 2024-02-21T22:52:36.530 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:36.539+0000 7f67ca460640 1 --2- 172.21.15.116:0/3143132771 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f67b006b440 0x7f67b006d900 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:36.530 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:36.539+0000 7f67ca460640 1 --2- 172.21.15.116:0/3143132771 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f67c415e1c0 0x7f67c41f7550 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:36.530 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:36.539+0000 7f67ca460640 1 --2- 172.21.15.116:0/3143132771 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f67c40cee70 0x7f67c41f4930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:36.530 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:36.539+0000 7f67ca460640 1 --2- 172.21.15.116:0/3143132771 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f67c40b99f0 0x7f67c4151390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:36.530 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:36.539+0000 7f67ca460640 1 -- 172.21.15.116:0/3143132771 >> 172.21.15.116:0/3143132771 conn(0x7f67c40d3db0 msgr2=0x7f67c40d2160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:52:36.530 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:36.539+0000 7f67ca460640 1 -- 172.21.15.116:0/3143132771 shutdown_connections 2024-02-21T22:52:36.530 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:36.539+0000 7f67ca460640 1 -- 172.21.15.116:0/3143132771 wait complete. 2024-02-21T22:52:36.539 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-02-21T22:52:43.347 DEBUG:teuthology.orchestra.run.smithi116:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-02-21T22:52:43.447 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:43.456+0000 7feff7b5d640 1 Processor -- start 2024-02-21T22:52:43.447 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:43.457+0000 7feff7b5d640 1 -- start start 2024-02-21T22:52:43.448 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:43.457+0000 7feff7b5d640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7feff015adc0 0x7feff00ae740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:43.448 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:43.457+0000 7feff7b5d640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7feff00ca0f0 0x7feff006e450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:43.449 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:43.457+0000 7feff7b5d640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feff015b1a0 con 0x7feff00aec80 2024-02-21T22:52:43.449 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:43.457+0000 7feff7b5d640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feff00af120 con 0x7feff00ca0f0 2024-02-21T22:52:43.449 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:43.457+0000 7feff7b5d640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feff015b450 con 0x7feff015adc0 2024-02-21T22:52:43.449 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:43.457+0000 7feff50f8640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7feff00ca0f0 0x7feff006e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:43.449 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:43.457+0000 7feff60fa640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7feff00aec80 0x7feff015e830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:41032/0 (socket says 172.21.15.116:41032) 2024-02-21T22:52:43.449 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:43.458+0000 7feff60fa640 1 -- 172.21.15.116:0/3401032230 learned_addr learned my addr 172.21.15.116:0/3401032230 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-02-21T22:52:43.449 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:43.458+0000 7feff58f9640 1 --2- 172.21.15.116:0/3401032230 >> v2:172.21.15.142:3300/0 conn(0x7feff015adc0 0x7feff00ae740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:43.449 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:43.458+0000 7feff50f8640 1 -- 172.21.15.116:0/3401032230 >> v2:172.21.15.142:3300/0 conn(0x7feff015adc0 msgr2=0x7feff00ae740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:52:43.449 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:43.458+0000 7feff50f8640 1 --2- 172.21.15.116:0/3401032230 >> v2:172.21.15.142:3300/0 conn(0x7feff015adc0 0x7feff00ae740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:43.449 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:43.458+0000 7feff50f8640 1 -- 172.21.15.116:0/3401032230 >> v1:172.21.15.116:6789/0 conn(0x7feff00aec80 legacy=0x7feff015e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:43.449 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:43.458+0000 7feff50f8640 1 -- 172.21.15.116:0/3401032230 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feff015b730 con 0x7feff00ca0f0 2024-02-21T22:52:43.449 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:43.458+0000 7feff48f7640 1 -- 172.21.15.116:0/3401032230 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3073609474 0 0) 0x7feff015b1a0 con 0x7feff00aec80 2024-02-21T22:52:43.449 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:43.458+0000 7feff58f9640 1 --2- 172.21.15.116:0/3401032230 >> v2:172.21.15.142:3300/0 conn(0x7feff015adc0 0x7feff00ae740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T22:52:43.450 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:43.459+0000 7feff50f8640 1 --2- 172.21.15.116:0/3401032230 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7feff00ca0f0 0x7feff006e450 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7feff006c030 tx=0x7fefe002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca7d680b3481145f server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:52:43.451 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:43.459+0000 7feff48f7640 1 -- 172.21.15.116:0/3401032230 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefe0035020 con 0x7feff00ca0f0 2024-02-21T22:52:43.451 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:43.459+0000 7feff48f7640 1 -- 172.21.15.116:0/3401032230 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefe0031830 con 0x7feff00ca0f0 2024-02-21T22:52:43.451 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:43.459+0000 7feff48f7640 1 -- 172.21.15.116:0/3401032230 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefe0031c00 con 0x7feff00ca0f0 2024-02-21T22:52:43.451 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:43.459+0000 7feff7b5d640 1 -- 172.21.15.116:0/3401032230 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7feff00ca0f0 msgr2=0x7feff006e450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:43.451 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:43.459+0000 7feff7b5d640 1 --2- 172.21.15.116:0/3401032230 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7feff00ca0f0 0x7feff006e450 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7feff006c030 tx=0x7fefe002b8d0 comp rx=0 tx=0).stop 2024-02-21T22:52:43.451 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:43.459+0000 7feff7b5d640 1 -- 172.21.15.116:0/3401032230 shutdown_connections 2024-02-21T22:52:43.451 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:43.459+0000 7feff7b5d640 1 --2- 172.21.15.116:0/3401032230 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7feff00ca0f0 0x7feff006e450 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:43.451 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:43.459+0000 7feff7b5d640 1 --2- 172.21.15.116:0/3401032230 >> v2:172.21.15.142:3300/0 conn(0x7feff015adc0 0x7feff00ae740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:43.451 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:43.459+0000 7feff7b5d640 1 -- 172.21.15.116:0/3401032230 >> 172.21.15.116:0/3401032230 conn(0x7feff00cf910 msgr2=0x7feff00cfd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:52:43.451 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:43.459+0000 7feff7b5d640 1 -- 172.21.15.116:0/3401032230 shutdown_connections 2024-02-21T22:52:43.451 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:43.459+0000 7feff7b5d640 1 -- 172.21.15.116:0/3401032230 wait complete. 2024-02-21T22:52:43.454 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:43.461+0000 7feff7b5d640 1 Processor -- start 2024-02-21T22:52:43.454 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:43.461+0000 7feff7b5d640 1 -- start start 2024-02-21T22:52:43.454 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:43.461+0000 7feff7b5d640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7feff00aec80 0x7feff00b4ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:43.454 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:43.461+0000 7feff7b5d640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feff00ca0f0 0x7feff00b26d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:43.455 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:43.461+0000 7feff7b5d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feff015adc0 0x7feff00b03b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:43.455 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:43.461+0000 7feff7b5d640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feff015c0b0 con 0x7feff00aec80 2024-02-21T22:52:43.455 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:43.461+0000 7feff7b5d640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feff015bf30 con 0x7feff00ca0f0 2024-02-21T22:52:43.455 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:43.461+0000 7feff7b5d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feff015c230 con 0x7feff015adc0 2024-02-21T22:52:43.455 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:43.461+0000 7feff58f9640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7feff00aec80 0x7feff00b4ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:43.455 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:43.461+0000 7feff58f9640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7feff00aec80 0x7feff00b4ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:53624/0 (socket says 172.21.15.116:53624) 2024-02-21T22:52:43.455 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:43.461+0000 7feff58f9640 1 -- 172.21.15.116:0/3507235530 learned_addr learned my addr 172.21.15.116:0/3507235530 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:52:43.455 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:43.462+0000 7feff50f8640 1 --2- 172.21.15.116:0/3507235530 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feff00ca0f0 0x7feff00b26d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:43.455 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:43.462+0000 7feff60fa640 1 --2- 172.21.15.116:0/3507235530 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feff015adc0 0x7feff00b03b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:43.455 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:43.462+0000 7feff58f9640 1 -- 172.21.15.116:0/3507235530 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feff015adc0 msgr2=0x7feff00b03b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:43.455 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:43.462+0000 7feff58f9640 1 --2- 172.21.15.116:0/3507235530 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feff015adc0 0x7feff00b03b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:43.455 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:43.462+0000 7feff58f9640 1 -- 172.21.15.116:0/3507235530 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feff00ca0f0 msgr2=0x7feff00b26d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:43.455 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:43.462+0000 7feff58f9640 1 --2- 172.21.15.116:0/3507235530 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feff00ca0f0 0x7feff00b26d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:43.455 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:43.462+0000 7feff58f9640 1 -- 172.21.15.116:0/3507235530 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feff00b2c10 con 0x7feff00aec80 2024-02-21T22:52:43.456 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:43.462+0000 7feff60fa640 1 --2- 172.21.15.116:0/3507235530 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feff015adc0 0x7feff00b03b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T22:52:43.456 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:43.462+0000 7feff58f9640 1 --2- 172.21.15.116:0/3507235530 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7feff00aec80 0x7feff00b4ca0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fefec009fa0 tx=0x7fefec00d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:52:43.456 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:43.462+0000 7fefe67fc640 1 -- 172.21.15.116:0/3507235530 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefec01a070 con 0x7feff00aec80 2024-02-21T22:52:43.456 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:43.462+0000 7fefe67fc640 1 -- 172.21.15.116:0/3507235530 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefec003bb0 con 0x7feff00aec80 2024-02-21T22:52:43.456 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:43.462+0000 7feff7b5d640 1 -- 172.21.15.116:0/3507235530 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feff00b2eb0 con 0x7feff00aec80 2024-02-21T22:52:43.456 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:43.462+0000 7fefe67fc640 1 -- 172.21.15.116:0/3507235530 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefec004030 con 0x7feff00aec80 2024-02-21T22:52:43.456 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:43.462+0000 7feff7b5d640 1 -- 172.21.15.116:0/3507235530 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feff00b3470 con 0x7feff00aec80 2024-02-21T22:52:43.456 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:43.463+0000 7feff7b5d640 1 -- 172.21.15.116:0/3507235530 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feff006bdc0 con 0x7feff00aec80 2024-02-21T22:52:43.456 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:43.463+0000 7fefe67fc640 1 -- 172.21.15.116:0/3507235530 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fefec01d070 con 0x7feff00aec80 2024-02-21T22:52:43.456 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:43.464+0000 7fefe67fc640 1 --2- 172.21.15.116:0/3507235530 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fefd406b4d0 0x7fefd406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:43.456 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:43.464+0000 7fefe67fc640 1 -- 172.21.15.116:0/3507235530 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fefec08a010 con 0x7feff00aec80 2024-02-21T22:52:43.456 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:43.464+0000 7feff50f8640 1 --2- 172.21.15.116:0/3507235530 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fefd406b4d0 0x7fefd406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:43.457 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:43.464+0000 7feff50f8640 1 --2- 172.21.15.116:0/3507235530 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fefd406b4d0 0x7fefd406d990 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fefe0036000 tx=0x7fefe0008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:52:43.459 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:43.468+0000 7fefe67fc640 1 -- 172.21.15.116:0/3507235530 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7feff006bdc0 con 0x7feff00aec80 2024-02-21T22:52:43.636 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:43.644+0000 7feff7b5d640 1 -- 172.21.15.116:0/3507235530 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7feff004f290 con 0x7feff00aec80 2024-02-21T22:52:43.636 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:43.644+0000 7fefe67fc640 1 -- 172.21.15.116:0/3507235530 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12932 (secure 0 0 0) 0x7fefec010070 con 0x7feff00aec80 2024-02-21T22:52:43.637 INFO:teuthology.misc.health.smithi116.stdout: 2024-02-21T22:52:43.637 INFO:teuthology.misc.health.smithi116.stdout:{"epoch":16,"fsid":"7c298660-5f63-4b5c-a800-58c5be9a8445","created":"2024-02-21T22:52:25.994613+0000","modified":"2024-02-21T22:52:41.407615+0000","last_up_change":"2024-02-21T22:52:37.313595+0000","last_in_change":"2024-02-21T22:52:28.176031+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-21T22:52:38.328796+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4f09126b-b5e4-4876-8b08-f5cbb967388a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":1613202231},{"type":"v1","addr":"172.21.15.116:6809","nonce":1613202231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":1613202231},{"type":"v1","addr":"172.21.15.116:6811","nonce":1613202231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":1613202231},{"type":"v1","addr":"172.21.15.116:6815","nonce":1613202231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":1613202231},{"type":"v1","addr":"172.21.15.116:6813","nonce":1613202231}]},"public_addr":"172.21.15.116:6809/1613202231","cluster_addr":"172.21.15.116:6811/1613202231","heartbeat_back_addr":"172.21.15.116:6815/1613202231","heartbeat_front_addr":"172.21.15.116:6813/1613202231","state":["exists","up"]},{"osd":1,"uuid":"7272c51d-51f9-4536-931d-33ad7a4b377e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6816","nonce":172614746},{"type":"v1","addr":"172.21.15.116:6817","nonce":172614746}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":172614746},{"type":"v1","addr":"172.21.15.116:6819","nonce":172614746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":172614746},{"type":"v1","addr":"172.21.15.116:6823","nonce":172614746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":172614746},{"type":"v1","addr":"172.21.15.116:6821","nonce":172614746}]},"public_addr":"172.21.15.116:6817/172614746","cluster_addr":"172.21.15.116:6819/172614746","heartbeat_back_addr":"172.21.15.116:6823/172614746","heartbeat_front_addr":"172.21.15.116:6821/172614746","state":["exists","up"]},{"osd":2,"uuid":"2589616c-adf1-4187-aac3-735256cf624b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":1029280577},{"type":"v1","addr":"172.21.15.116:6825","nonce":1029280577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":1029280577},{"type":"v1","addr":"172.21.15.116:6827","nonce":1029280577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":1029280577},{"type":"v1","addr":"172.21.15.116:6831","nonce":1029280577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":1029280577},{"type":"v1","addr":"172.21.15.116:6829","nonce":1029280577}]},"public_addr":"172.21.15.116:6825/1029280577","cluster_addr":"172.21.15.116:6827/1029280577","heartbeat_back_addr":"172.21.15.116:6831/1029280577","heartbeat_front_addr":"172.21.15.116:6829/1029280577","state":["exists","up"]},{"osd":3,"uuid":"0fd2e563-7c5b-46f6-82c2-b60c86072c93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":3106627557},{"type":"v1","addr":"172.21.15.116:6801","nonce":3106627557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":3106627557},{"type":"v1","addr":"172.21.15.116:6803","nonce":3106627557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":3106627557},{"type":"v1","addr":"172.21.15.116:6807","nonce":3106627557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":3106627557},{"type":"v1","addr":"172.21.15.116:6805","nonce":3106627557}]},"public_addr":"172.21.15.116:6801/3106627557","cluster_addr":"172.21.15.116:6803/3106627557","heartbeat_back_addr":"172.21.15.116:6807/3106627557","heartbeat_front_addr":"172.21.15.116:6805/3106627557","state":["exists","up"]},{"osd":4,"uuid":"79ae35b7-dda8-4ab8-96ce-47515afde082","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":3231407772},{"type":"v1","addr":"172.21.15.142:6825","nonce":3231407772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":3231407772},{"type":"v1","addr":"172.21.15.142:6827","nonce":3231407772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":3231407772},{"type":"v1","addr":"172.21.15.142:6831","nonce":3231407772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":3231407772},{"type":"v1","addr":"172.21.15.142:6829","nonce":3231407772}]},"public_addr":"172.21.15.142:6825/3231407772","cluster_addr":"172.21.15.142:6827/3231407772","heartbeat_back_addr":"172.21.15.142:6831/3231407772","heartbeat_front_addr":"172.21.15.142:6829/3231407772","state":["exists","up"]},{"osd":5,"uuid":"3166eb2c-3fcf-41c8-9362-45bafaabaa39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":1184158716},{"type":"v1","addr":"172.21.15.142:6817","nonce":1184158716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":1184158716},{"type":"v1","addr":"172.21.15.142:6819","nonce":1184158716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":1184158716},{"type":"v1","addr":"172.21.15.142:6823","nonce":1184158716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":1184158716},{"type":"v1","addr":"172.21.15.142:6821","nonce":1184158716}]},"public_addr":"172.21.15.142:6817/1184158716","cluster_addr":"172.21.15.142:6819/1184158716","heartbeat_back_addr":"172.21.15.142:6823/1184158716","heartbeat_front_addr":"172.21.15.142:6821/1184158716","state":["exists","up"]},{"osd":6,"uuid":"f9aa9672-7527-43e2-963e-b61868e5e63f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":1987868911},{"type":"v1","addr":"172.21.15.142:6801","nonce":1987868911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":1987868911},{"type":"v1","addr":"172.21.15.142:6803","nonce":1987868911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":1987868911},{"type":"v1","addr":"172.21.15.142:6807","nonce":1987868911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":1987868911},{"type":"v1","addr":"172.21.15.142:6805","nonce":1987868911}]},"public_addr":"172.21.15.142:6801/1987868911","cluster_addr":"172.21.15.142:6803/1987868911","heartbeat_back_addr":"172.21.15.142:6807/1987868911","heartbeat_front_addr":"172.21.15.142:6805/1987868911","state":["exists","up"]},{"osd":7,"uuid":"7ed29226-fc42-4382-a91a-fa50f7ec5426","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":1272081937},{"type":"v1","addr":"172.21.15.142:6809","nonce":1272081937}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":1272081937},{"type":"v1","addr":"172.21.15.142:6811","nonce":1272081937}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":1272081937},{"type":"v1","addr":"172.21.15.142:6815","nonce":1272081937}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":1272081937},{"type":"v1","addr":"172.21.15.142:6813","nonce":1272081937}]},"public_addr":"172.21.15.142:6809/1272081937","cluster_addr":"172.21.15.142:6811/1272081937","heartbeat_back_addr":"172.21.15.142:6815/1272081937","heartbeat_front_addr":"172.21.15.142:6813/1272081937","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.350998+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.307201+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.289112+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.243888+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.312091+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.370472+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.275659+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.289297+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-21T22:52:43.639 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:43.646+0000 7feff7b5d640 1 -- 172.21.15.116:0/3507235530 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fefd406b4d0 msgr2=0x7fefd406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:43.639 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:43.646+0000 7feff7b5d640 1 --2- 172.21.15.116:0/3507235530 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fefd406b4d0 0x7fefd406d990 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fefe0036000 tx=0x7fefe0008030 comp rx=0 tx=0).stop 2024-02-21T22:52:43.639 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:43.646+0000 7feff7b5d640 1 -- 172.21.15.116:0/3507235530 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7feff00aec80 msgr2=0x7feff00b4ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:43.639 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:43.646+0000 7feff7b5d640 1 --2- 172.21.15.116:0/3507235530 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7feff00aec80 0x7feff00b4ca0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fefec009fa0 tx=0x7fefec00d560 comp rx=0 tx=0).stop 2024-02-21T22:52:43.639 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:43.646+0000 7feff7b5d640 1 -- 172.21.15.116:0/3507235530 shutdown_connections 2024-02-21T22:52:43.639 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:43.646+0000 7feff7b5d640 1 --2- 172.21.15.116:0/3507235530 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fefd406b4d0 0x7fefd406d990 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:43.639 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:43.646+0000 7feff7b5d640 1 --2- 172.21.15.116:0/3507235530 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feff015adc0 0x7feff00b03b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:43.640 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:43.646+0000 7feff7b5d640 1 --2- 172.21.15.116:0/3507235530 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feff00ca0f0 0x7feff00b26d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:43.640 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:43.646+0000 7feff7b5d640 1 --2- 172.21.15.116:0/3507235530 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7feff00aec80 0x7feff00b4ca0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:43.640 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:43.646+0000 7feff7b5d640 1 -- 172.21.15.116:0/3507235530 >> 172.21.15.116:0/3507235530 conn(0x7feff00cf910 msgr2=0x7feff015f160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:52:43.640 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:43.646+0000 7feff7b5d640 1 -- 172.21.15.116:0/3507235530 shutdown_connections 2024-02-21T22:52:43.640 INFO:teuthology.misc.health.smithi116.stderr:2024-02-21T22:52:43.646+0000 7feff7b5d640 1 -- 172.21.15.116:0/3507235530 wait complete. 2024-02-21T22:52:43.647 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-02-21T22:52:43.647 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-02-21T22:52:43.647 INFO:tasks.ceph.mds.a:Restarting daemon 2024-02-21T22:52:43.648 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-02-21T22:52:43.650 INFO:tasks.ceph.mds.a:Started 2024-02-21T22:52:43.650 INFO:tasks.ceph.mds.c:Restarting daemon 2024-02-21T22:52:43.651 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-02-21T22:52:43.652 INFO:tasks.ceph.mds.c:Started 2024-02-21T22:52:43.653 INFO:tasks.ceph.mds.b:Restarting daemon 2024-02-21T22:52:43.653 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-02-21T22:52:43.655 INFO:tasks.ceph.mds.b:Started 2024-02-21T22:52:43.656 INFO:tasks.ceph.mds.d:Restarting daemon 2024-02-21T22:52:43.656 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-02-21T22:52:43.658 INFO:tasks.ceph.mds.d:Started 2024-02-21T22:52:43.658 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-02-21T22:52:43.661 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-21T22:52:43.726 INFO:tasks.ceph.mds.a.smithi116.stdout:starting mds.a at 2024-02-21T22:52:43.726 INFO:tasks.ceph.mds.c.smithi116.stdout:starting mds.c at 2024-02-21T22:52:43.741 INFO:tasks.ceph.mds.b.smithi142.stdout:starting mds.b at 2024-02-21T22:52:43.742 INFO:tasks.ceph.mds.d.smithi142.stdout:starting mds.d at 2024-02-21T22:52:43.742 INFO:tasks.ceph.mds.d.smithi142.stderr:2024-02-21T22:52:43.751+0000 7fc8a07fd640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2024-02-21T22:52:43.766 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:43.775+0000 7f27cf836640 1 Processor -- start 2024-02-21T22:52:43.766 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:43.775+0000 7f27cf836640 1 -- start start 2024-02-21T22:52:43.767 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:43.776+0000 7f27cf836640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f27c8144520 0x7f27c80b4790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:43.767 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:43.776+0000 7f27cf836640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27c806d7b0 con 0x7f27c80b4cd0 2024-02-21T22:52:43.768 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:43.776+0000 7f27cf836640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27c806da90 con 0x7f27c80720a0 2024-02-21T22:52:43.768 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:43.776+0000 7f27cf836640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27c806dd70 con 0x7f27c8144520 2024-02-21T22:52:43.768 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:43.776+0000 7f27ccdd1640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f27c80b4cd0 0x7f27c8071990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:41054/0 (socket says 172.21.15.116:41054) 2024-02-21T22:52:43.768 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:43.776+0000 7f27ccdd1640 1 -- 172.21.15.116:0/1918855448 learned_addr learned my addr 172.21.15.116:0/1918855448 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-02-21T22:52:43.768 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:43.776+0000 7f27cd5d2640 1 --2- 172.21.15.116:0/1918855448 >> v2:172.21.15.116:3300/0 conn(0x7f27c8144520 0x7f27c80b4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:43.768 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:43.777+0000 7f27bffff640 1 -- 172.21.15.116:0/1918855448 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 105863223 0 0) 0x7f27c806d7b0 con 0x7f27c80b4cd0 2024-02-21T22:52:43.768 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:43.777+0000 7f27bffff640 1 -- 172.21.15.116:0/1918855448 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27b4003520 con 0x7f27c80b4cd0 2024-02-21T22:52:43.768 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:43.777+0000 7f27cd5d2640 1 -- 172.21.15.116:0/1918855448 >> v1:172.21.15.142:6789/0 conn(0x7f27c80720a0 legacy=0x7f27c806e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:43.768 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:43.777+0000 7f27cd5d2640 1 -- 172.21.15.116:0/1918855448 >> v1:172.21.15.116:6789/0 conn(0x7f27c80b4cd0 legacy=0x7f27c8071990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:43.768 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:43.777+0000 7f27cd5d2640 1 -- 172.21.15.116:0/1918855448 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27c806e050 con 0x7f27c8144520 2024-02-21T22:52:43.770 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:43.777+0000 7f27cd5d2640 1 --2- 172.21.15.116:0/1918855448 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f27c8144520 0x7f27c80b4790 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f27c4009a00 tx=0x7f27c402ddc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49b74a2999effeb5 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:52:43.770 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:43.778+0000 7f27bffff640 1 -- 172.21.15.116:0/1918855448 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27c403b070 con 0x7f27c8144520 2024-02-21T22:52:43.770 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:43.778+0000 7f27bffff640 1 -- 172.21.15.116:0/1918855448 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27c402e960 con 0x7f27c8144520 2024-02-21T22:52:43.770 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:43.778+0000 7f27bffff640 1 -- 172.21.15.116:0/1918855448 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27c402ed10 con 0x7f27c8144520 2024-02-21T22:52:43.770 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:43.778+0000 7f27cf836640 1 -- 172.21.15.116:0/1918855448 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f27c8144520 msgr2=0x7f27c80b4790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:43.770 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:43.778+0000 7f27cf836640 1 --2- 172.21.15.116:0/1918855448 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f27c8144520 0x7f27c80b4790 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f27c4009a00 tx=0x7f27c402ddc0 comp rx=0 tx=0).stop 2024-02-21T22:52:43.770 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:43.778+0000 7f27cf836640 1 -- 172.21.15.116:0/1918855448 shutdown_connections 2024-02-21T22:52:43.770 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:43.778+0000 7f27cf836640 1 --2- 172.21.15.116:0/1918855448 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f27c8144520 0x7f27c80b4790 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:43.770 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:43.778+0000 7f27cf836640 1 -- 172.21.15.116:0/1918855448 >> 172.21.15.116:0/1918855448 conn(0x7f27c80b2750 msgr2=0x7f27c80b2b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:52:43.770 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:43.778+0000 7f27cf836640 1 -- 172.21.15.116:0/1918855448 shutdown_connections 2024-02-21T22:52:43.770 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:43.778+0000 7f27cf836640 1 -- 172.21.15.116:0/1918855448 wait complete. 2024-02-21T22:52:43.771 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:43.779+0000 7f27cf836640 1 Processor -- start 2024-02-21T22:52:43.771 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:43.779+0000 7f27cf836640 1 -- start start 2024-02-21T22:52:43.773 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:43.780+0000 7f27cf836640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f27c80720a0 0x7f27c813b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:43.773 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:43.780+0000 7f27cf836640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f27c80b4cd0 0x7f27c8158500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:43.773 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:43.780+0000 7f27cf836640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f27c8144520 0x7f27c813ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:43.773 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:43.780+0000 7f27cf836640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27c8144900 con 0x7f27c80720a0 2024-02-21T22:52:43.773 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:43.780+0000 7f27cf836640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27c815c590 con 0x7f27c80b4cd0 2024-02-21T22:52:43.773 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:43.780+0000 7f27cf836640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27c8144a80 con 0x7f27c8144520 2024-02-21T22:52:43.773 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:43.780+0000 7f27cd5d2640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f27c80720a0 0x7f27c813b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:43.773 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:43.780+0000 7f27cd5d2640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f27c80720a0 0x7f27c813b410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:53660/0 (socket says 172.21.15.116:53660) 2024-02-21T22:52:43.774 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:43.780+0000 7f27cd5d2640 1 -- 172.21.15.116:0/4206310285 learned_addr learned my addr 172.21.15.116:0/4206310285 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:52:43.774 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:43.780+0000 7f27cddd3640 1 --2- 172.21.15.116:0/4206310285 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f27c8144520 0x7f27c813ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:43.774 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:43.780+0000 7f27cd5d2640 1 -- 172.21.15.116:0/4206310285 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f27c8144520 msgr2=0x7f27c813ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:43.774 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:43.780+0000 7f27cd5d2640 1 --2- 172.21.15.116:0/4206310285 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f27c8144520 0x7f27c813ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:43.774 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:43.780+0000 7f27cd5d2640 1 -- 172.21.15.116:0/4206310285 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f27c80b4cd0 msgr2=0x7f27c8158500 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-02-21T22:52:43.774 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:43.780+0000 7f27cd5d2640 1 --2- 172.21.15.116:0/4206310285 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f27c80b4cd0 0x7f27c8158500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:43.774 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:43.780+0000 7f27cd5d2640 1 -- 172.21.15.116:0/4206310285 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27c813e130 con 0x7f27c80720a0 2024-02-21T22:52:43.774 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:43.781+0000 7f27cd5d2640 1 --2- 172.21.15.116:0/4206310285 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f27c80720a0 0x7f27c813b410 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f27c4039040 tx=0x7f27c40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:52:43.774 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:43.781+0000 7f27bdffb640 1 -- 172.21.15.116:0/4206310285 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27c4045020 con 0x7f27c80720a0 2024-02-21T22:52:43.774 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:43.781+0000 7f27bdffb640 1 -- 172.21.15.116:0/4206310285 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27c4003610 con 0x7f27c80720a0 2024-02-21T22:52:43.774 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:43.781+0000 7f27bdffb640 1 -- 172.21.15.116:0/4206310285 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27c403b040 con 0x7f27c80720a0 2024-02-21T22:52:43.774 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:43.781+0000 7f27cf836640 1 -- 172.21.15.116:0/4206310285 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27c8140c60 con 0x7f27c80720a0 2024-02-21T22:52:43.774 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:43.781+0000 7f27cf836640 1 -- 172.21.15.116:0/4206310285 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27c813b950 con 0x7f27c80720a0 2024-02-21T22:52:43.774 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:43.782+0000 7f27cf836640 1 -- 172.21.15.116:0/4206310285 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27c8141050 con 0x7f27c80720a0 2024-02-21T22:52:43.774 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:43.782+0000 7f27bdffb640 1 -- 172.21.15.116:0/4206310285 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f27c4048020 con 0x7f27c80720a0 2024-02-21T22:52:43.775 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:43.782+0000 7f27bdffb640 1 --2- 172.21.15.116:0/4206310285 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f27ac06b4d0 0x7f27ac06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:43.775 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:43.783+0000 7f27bdffb640 1 -- 172.21.15.116:0/4206310285 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f27c40abdd0 con 0x7f27c80720a0 2024-02-21T22:52:43.775 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:43.783+0000 7f27ccdd1640 1 --2- 172.21.15.116:0/4206310285 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f27ac06b4d0 0x7f27ac06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:43.775 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:43.783+0000 7f27ccdd1640 1 --2- 172.21.15.116:0/4206310285 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f27ac06b4d0 0x7f27ac06d990 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f27c80b2720 tx=0x7f27b80078f0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:52:43.777 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:43.787+0000 7f27bdffb640 1 -- 172.21.15.116:0/4206310285 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f27c404f030 con 0x7f27c80720a0 2024-02-21T22:52:43.948 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:43.958+0000 7f27cf836640 1 -- 172.21.15.116:0/4206310285 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f27c8140e30 con 0x7f27c80720a0 2024-02-21T22:52:43.949 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:43.959+0000 7f27bdffb640 1 -- 172.21.15.116:0/4206310285 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12932 (secure 0 0 0) 0x7f27c407afb0 con 0x7f27c80720a0 2024-02-21T22:52:43.949 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-02-21T22:52:43.950 INFO:teuthology.orchestra.run.smithi116.stdout:{"epoch":16,"fsid":"7c298660-5f63-4b5c-a800-58c5be9a8445","created":"2024-02-21T22:52:25.994613+0000","modified":"2024-02-21T22:52:41.407615+0000","last_up_change":"2024-02-21T22:52:37.313595+0000","last_in_change":"2024-02-21T22:52:28.176031+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-21T22:52:38.328796+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4f09126b-b5e4-4876-8b08-f5cbb967388a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":1613202231},{"type":"v1","addr":"172.21.15.116:6809","nonce":1613202231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":1613202231},{"type":"v1","addr":"172.21.15.116:6811","nonce":1613202231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":1613202231},{"type":"v1","addr":"172.21.15.116:6815","nonce":1613202231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":1613202231},{"type":"v1","addr":"172.21.15.116:6813","nonce":1613202231}]},"public_addr":"172.21.15.116:6809/1613202231","cluster_addr":"172.21.15.116:6811/1613202231","heartbeat_back_addr":"172.21.15.116:6815/1613202231","heartbeat_front_addr":"172.21.15.116:6813/1613202231","state":["exists","up"]},{"osd":1,"uuid":"7272c51d-51f9-4536-931d-33ad7a4b377e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6816","nonce":172614746},{"type":"v1","addr":"172.21.15.116:6817","nonce":172614746}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":172614746},{"type":"v1","addr":"172.21.15.116:6819","nonce":172614746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":172614746},{"type":"v1","addr":"172.21.15.116:6823","nonce":172614746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":172614746},{"type":"v1","addr":"172.21.15.116:6821","nonce":172614746}]},"public_addr":"172.21.15.116:6817/172614746","cluster_addr":"172.21.15.116:6819/172614746","heartbeat_back_addr":"172.21.15.116:6823/172614746","heartbeat_front_addr":"172.21.15.116:6821/172614746","state":["exists","up"]},{"osd":2,"uuid":"2589616c-adf1-4187-aac3-735256cf624b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":1029280577},{"type":"v1","addr":"172.21.15.116:6825","nonce":1029280577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":1029280577},{"type":"v1","addr":"172.21.15.116:6827","nonce":1029280577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":1029280577},{"type":"v1","addr":"172.21.15.116:6831","nonce":1029280577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":1029280577},{"type":"v1","addr":"172.21.15.116:6829","nonce":1029280577}]},"public_addr":"172.21.15.116:6825/1029280577","cluster_addr":"172.21.15.116:6827/1029280577","heartbeat_back_addr":"172.21.15.116:6831/1029280577","heartbeat_front_addr":"172.21.15.116:6829/1029280577","state":["exists","up"]},{"osd":3,"uuid":"0fd2e563-7c5b-46f6-82c2-b60c86072c93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":3106627557},{"type":"v1","addr":"172.21.15.116:6801","nonce":3106627557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":3106627557},{"type":"v1","addr":"172.21.15.116:6803","nonce":3106627557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":3106627557},{"type":"v1","addr":"172.21.15.116:6807","nonce":3106627557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":3106627557},{"type":"v1","addr":"172.21.15.116:6805","nonce":3106627557}]},"public_addr":"172.21.15.116:6801/3106627557","cluster_addr":"172.21.15.116:6803/3106627557","heartbeat_back_addr":"172.21.15.116:6807/3106627557","heartbeat_front_addr":"172.21.15.116:6805/3106627557","state":["exists","up"]},{"osd":4,"uuid":"79ae35b7-dda8-4ab8-96ce-47515afde082","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":3231407772},{"type":"v1","addr":"172.21.15.142:6825","nonce":3231407772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":3231407772},{"type":"v1","addr":"172.21.15.142:6827","nonce":3231407772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":3231407772},{"type":"v1","addr":"172.21.15.142:6831","nonce":3231407772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":3231407772},{"type":"v1","addr":"172.21.15.142:6829","nonce":3231407772}]},"public_addr":"172.21.15.142:6825/3231407772","cluster_addr":"172.21.15.142:6827/3231407772","heartbeat_back_addr":"172.21.15.142:6831/3231407772","heartbeat_front_addr":"172.21.15.142:6829/3231407772","state":["exists","up"]},{"osd":5,"uuid":"3166eb2c-3fcf-41c8-9362-45bafaabaa39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":1184158716},{"type":"v1","addr":"172.21.15.142:6817","nonce":1184158716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":1184158716},{"type":"v1","addr":"172.21.15.142:6819","nonce":1184158716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":1184158716},{"type":"v1","addr":"172.21.15.142:6823","nonce":1184158716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":1184158716},{"type":"v1","addr":"172.21.15.142:6821","nonce":1184158716}]},"public_addr":"172.21.15.142:6817/1184158716","cluster_addr":"172.21.15.142:6819/1184158716","heartbeat_back_addr":"172.21.15.142:6823/1184158716","heartbeat_front_addr":"172.21.15.142:6821/1184158716","state":["exists","up"]},{"osd":6,"uuid":"f9aa9672-7527-43e2-963e-b61868e5e63f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":1987868911},{"type":"v1","addr":"172.21.15.142:6801","nonce":1987868911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":1987868911},{"type":"v1","addr":"172.21.15.142:6803","nonce":1987868911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":1987868911},{"type":"v1","addr":"172.21.15.142:6807","nonce":1987868911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":1987868911},{"type":"v1","addr":"172.21.15.142:6805","nonce":1987868911}]},"public_addr":"172.21.15.142:6801/1987868911","cluster_addr":"172.21.15.142:6803/1987868911","heartbeat_back_addr":"172.21.15.142:6807/1987868911","heartbeat_front_addr":"172.21.15.142:6805/1987868911","state":["exists","up"]},{"osd":7,"uuid":"7ed29226-fc42-4382-a91a-fa50f7ec5426","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":1272081937},{"type":"v1","addr":"172.21.15.142:6809","nonce":1272081937}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":1272081937},{"type":"v1","addr":"172.21.15.142:6811","nonce":1272081937}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":1272081937},{"type":"v1","addr":"172.21.15.142:6815","nonce":1272081937}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":1272081937},{"type":"v1","addr":"172.21.15.142:6813","nonce":1272081937}]},"public_addr":"172.21.15.142:6809/1272081937","cluster_addr":"172.21.15.142:6811/1272081937","heartbeat_back_addr":"172.21.15.142:6815/1272081937","heartbeat_front_addr":"172.21.15.142:6813/1272081937","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.350998+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.307201+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.289112+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.243888+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.312091+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.370472+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.275659+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.289297+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-21T22:52:43.952 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:43.961+0000 7f27cf836640 1 -- 172.21.15.116:0/4206310285 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f27ac06b4d0 msgr2=0x7f27ac06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:43.952 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:43.961+0000 7f27cf836640 1 --2- 172.21.15.116:0/4206310285 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f27ac06b4d0 0x7f27ac06d990 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f27c80b2720 tx=0x7f27b80078f0 comp rx=0 tx=0).stop 2024-02-21T22:52:43.952 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:43.961+0000 7f27cf836640 1 -- 172.21.15.116:0/4206310285 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f27c80720a0 msgr2=0x7f27c813b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:43.952 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:43.961+0000 7f27cf836640 1 --2- 172.21.15.116:0/4206310285 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f27c80720a0 0x7f27c813b410 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f27c4039040 tx=0x7f27c40046c0 comp rx=0 tx=0).stop 2024-02-21T22:52:43.952 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:43.961+0000 7f27cf836640 1 -- 172.21.15.116:0/4206310285 shutdown_connections 2024-02-21T22:52:43.952 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:43.961+0000 7f27cf836640 1 --2- 172.21.15.116:0/4206310285 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f27ac06b4d0 0x7f27ac06d990 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:43.952 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:43.961+0000 7f27cf836640 1 --2- 172.21.15.116:0/4206310285 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f27c8144520 0x7f27c813ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:43.952 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:43.961+0000 7f27cf836640 1 --2- 172.21.15.116:0/4206310285 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f27c80b4cd0 0x7f27c8158500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:43.952 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:43.961+0000 7f27cf836640 1 --2- 172.21.15.116:0/4206310285 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f27c80720a0 0x7f27c813b410 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:43.952 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:43.961+0000 7f27cf836640 1 -- 172.21.15.116:0/4206310285 >> 172.21.15.116:0/4206310285 conn(0x7f27c80b2750 msgr2=0x7f27c80d1170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:52:43.952 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:43.961+0000 7f27cf836640 1 -- 172.21.15.116:0/4206310285 shutdown_connections 2024-02-21T22:52:43.953 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:43.961+0000 7f27cf836640 1 -- 172.21.15.116:0/4206310285 wait complete. 2024-02-21T22:52:43.962 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-21T22:52:38.328796+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-21T22:52:43.962 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-21T22:52:44.064 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:44.073+0000 7f4ffbd74640 1 Processor -- start 2024-02-21T22:52:44.064 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:44.074+0000 7f4ffbd74640 1 -- start start 2024-02-21T22:52:44.065 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:44.074+0000 7f4ffbd74640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f4ff415c0b0 0x7f4ff40ceb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:44.065 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:44.074+0000 7f4ffbd74640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4ff40d0860 0x7f4ff40c56c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:44.065 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:44.074+0000 7f4ffbd74640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ff40d2690 con 0x7f4ff40b2cc0 2024-02-21T22:52:44.065 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:44.074+0000 7f4ffbd74640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ff40cf950 con 0x7f4ff415c0b0 2024-02-21T22:52:44.065 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:44.074+0000 7f4ffbd74640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ff40cfc30 con 0x7f4ff40d0860 2024-02-21T22:52:44.065 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:44.075+0000 7f4ff9b10640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f4ff415c0b0 0x7f4ff40ceb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:44.065 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:44.075+0000 7f4ffa311640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4ff40d0860 0x7f4ff40c56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:44.065 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:44.075+0000 7f4ff9b10640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f4ff415c0b0 0x7f4ff40ceb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.116:45042/0 (socket says 172.21.15.116:45042) 2024-02-21T22:52:44.066 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:44.075+0000 7f4ff9b10640 1 -- 172.21.15.116:0/2809089094 learned_addr learned my addr 172.21.15.116:0/2809089094 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:52:44.066 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:44.075+0000 7f4ffa311640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4ff40d0860 0x7f4ff40c56c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.116:58422/0 (socket says 172.21.15.116:58422) 2024-02-21T22:52:44.067 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:44.075+0000 7f4ff9b10640 1 -- 172.21.15.116:0/2809089094 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4ff40d0860 msgr2=0x7f4ff40c56c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:52:44.067 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:44.075+0000 7f4ff9b10640 1 --2- 172.21.15.116:0/2809089094 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4ff40d0860 0x7f4ff40c56c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:44.067 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:44.075+0000 7f4ff9b10640 1 -- 172.21.15.116:0/2809089094 >> v1:172.21.15.142:6789/0 conn(0x7f4ff40b2cc0 legacy=0x7f4ff40d0150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:44.067 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:44.075+0000 7f4ff9b10640 1 -- 172.21.15.116:0/2809089094 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ff40cdb50 con 0x7f4ff415c0b0 2024-02-21T22:52:44.068 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:44.076+0000 7f4ff9b10640 1 --2- 172.21.15.116:0/2809089094 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4ff415c0b0 0x7f4ff40ceb60 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f4ff0009870 tx=0x7f4ff002b8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e4d805f431815167 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:52:44.068 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:44.076+0000 7f4ff8b0e640 1 -- 172.21.15.116:0/2809089094 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ff0035020 con 0x7f4ff415c0b0 2024-02-21T22:52:44.068 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:44.076+0000 7f4ff8b0e640 1 -- 172.21.15.116:0/2809089094 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ff0031640 con 0x7f4ff415c0b0 2024-02-21T22:52:44.068 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:44.076+0000 7f4ff8b0e640 1 -- 172.21.15.116:0/2809089094 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ff002d040 con 0x7f4ff415c0b0 2024-02-21T22:52:44.068 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:44.076+0000 7f4ffbd74640 1 -- 172.21.15.116:0/2809089094 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4ff415c0b0 msgr2=0x7f4ff40ceb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:44.068 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:44.076+0000 7f4ffbd74640 1 --2- 172.21.15.116:0/2809089094 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4ff415c0b0 0x7f4ff40ceb60 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f4ff0009870 tx=0x7f4ff002b8f0 comp rx=0 tx=0).stop 2024-02-21T22:52:44.068 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:44.076+0000 7f4ffbd74640 1 -- 172.21.15.116:0/2809089094 shutdown_connections 2024-02-21T22:52:44.068 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:44.076+0000 7f4ffbd74640 1 --2- 172.21.15.116:0/2809089094 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4ff40d0860 0x7f4ff40c56c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:44.068 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:44.076+0000 7f4ffbd74640 1 --2- 172.21.15.116:0/2809089094 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4ff415c0b0 0x7f4ff40ceb60 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:44.068 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:44.076+0000 7f4ffbd74640 1 -- 172.21.15.116:0/2809089094 >> 172.21.15.116:0/2809089094 conn(0x7f4ff40d1b70 msgr2=0x7f4ff40d1f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:52:44.068 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:44.077+0000 7f4ffbd74640 1 -- 172.21.15.116:0/2809089094 shutdown_connections 2024-02-21T22:52:44.068 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:44.077+0000 7f4ffbd74640 1 -- 172.21.15.116:0/2809089094 wait complete. 2024-02-21T22:52:44.070 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:44.078+0000 7f4ffbd74640 1 Processor -- start 2024-02-21T22:52:44.070 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:44.078+0000 7f4ffbd74640 1 -- start start 2024-02-21T22:52:44.070 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:44.078+0000 7f4ffbd74640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4ff40b2cc0 0x7f4ff4151950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:44.070 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:44.078+0000 7f4ffbd74640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4ff40d0860 0x7f4ff4150060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:44.071 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:44.078+0000 7f4ffbd74640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4ff415c0b0 0x7f4ff414ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:44.071 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:44.078+0000 7f4ffbd74640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ff40cd910 con 0x7f4ff40b2cc0 2024-02-21T22:52:44.071 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:44.078+0000 7f4ffbd74640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ff40cd790 con 0x7f4ff40d0860 2024-02-21T22:52:44.071 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:44.078+0000 7f4ffbd74640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ff415c490 con 0x7f4ff415c0b0 2024-02-21T22:52:44.071 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:44.079+0000 7f4ff9b10640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4ff40b2cc0 0x7f4ff4151950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:44.071 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:44.079+0000 7f4ff9b10640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4ff40b2cc0 0x7f4ff4151950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:53670/0 (socket says 172.21.15.116:53670) 2024-02-21T22:52:44.071 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:44.079+0000 7f4ff9b10640 1 -- 172.21.15.116:0/2554429373 learned_addr learned my addr 172.21.15.116:0/2554429373 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:52:44.071 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:44.079+0000 7f4ff930f640 1 --2- 172.21.15.116:0/2554429373 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4ff40d0860 0x7f4ff4150060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:44.071 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:44.079+0000 7f4ffa311640 1 --2- 172.21.15.116:0/2554429373 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4ff415c0b0 0x7f4ff414ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:44.071 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:44.079+0000 7f4ff9b10640 1 -- 172.21.15.116:0/2554429373 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4ff415c0b0 msgr2=0x7f4ff414ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:44.071 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:44.079+0000 7f4ff9b10640 1 --2- 172.21.15.116:0/2554429373 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4ff415c0b0 0x7f4ff414ea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:44.071 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:44.079+0000 7f4ff9b10640 1 -- 172.21.15.116:0/2554429373 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4ff40d0860 msgr2=0x7f4ff4150060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:44.071 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:44.079+0000 7f4ff9b10640 1 --2- 172.21.15.116:0/2554429373 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4ff40d0860 0x7f4ff4150060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:44.071 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:44.079+0000 7f4ff9b10640 1 -- 172.21.15.116:0/2554429373 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ff41508b0 con 0x7f4ff40b2cc0 2024-02-21T22:52:44.072 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:44.079+0000 7f4ff930f640 1 --2- 172.21.15.116:0/2554429373 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4ff40d0860 0x7f4ff4150060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T22:52:44.072 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:44.079+0000 7f4ff9b10640 1 --2- 172.21.15.116:0/2554429373 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4ff40b2cc0 0x7f4ff4151950 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f4ff002b930 tx=0x7f4ff00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:52:44.072 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:44.079+0000 7f4fea7fc640 1 -- 172.21.15.116:0/2554429373 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ff0040070 con 0x7f4ff40b2cc0 2024-02-21T22:52:44.072 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:44.079+0000 7f4fea7fc640 1 -- 172.21.15.116:0/2554429373 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ff003e070 con 0x7f4ff40b2cc0 2024-02-21T22:52:44.072 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:44.079+0000 7f4ffbd74640 1 -- 172.21.15.116:0/2554429373 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ff4150b90 con 0x7f4ff40b2cc0 2024-02-21T22:52:44.072 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:44.079+0000 7f4fea7fc640 1 -- 172.21.15.116:0/2554429373 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ff0035040 con 0x7f4ff40b2cc0 2024-02-21T22:52:44.072 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:44.079+0000 7f4ffbd74640 1 -- 172.21.15.116:0/2554429373 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ff4151150 con 0x7f4ff40b2cc0 2024-02-21T22:52:44.073 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:44.080+0000 7f4ffbd74640 1 -- 172.21.15.116:0/2554429373 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ff40752f0 con 0x7f4ff40b2cc0 2024-02-21T22:52:44.073 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:44.081+0000 7f4fea7fc640 1 -- 172.21.15.116:0/2554429373 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f4ff0038020 con 0x7f4ff40b2cc0 2024-02-21T22:52:44.073 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:44.081+0000 7f4fea7fc640 1 --2- 172.21.15.116:0/2554429373 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f4fd806b500 0x7f4fd806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:44.073 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:44.081+0000 7f4fea7fc640 1 -- 172.21.15.116:0/2554429373 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f4ff00ab7c0 con 0x7f4ff40b2cc0 2024-02-21T22:52:44.073 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:44.081+0000 7f4ff930f640 1 --2- 172.21.15.116:0/2554429373 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f4fd806b500 0x7f4fd806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:44.073 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:44.082+0000 7f4ff930f640 1 --2- 172.21.15.116:0/2554429373 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f4fd806b500 0x7f4fd806d9c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f4ff414fa90 tx=0x7f4fe4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:52:44.076 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:44.086+0000 7f4fea7fc640 1 -- 172.21.15.116:0/2554429373 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f4ff007a990 con 0x7f4ff40b2cc0 2024-02-21T22:52:44.246 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:44.255+0000 7f4ffbd74640 1 -- 172.21.15.116:0/2554429373 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4ff40d0460 con 0x7f4ff40b2cc0 2024-02-21T22:52:44.246 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:44.256+0000 7f4fea7fc640 1 -- 172.21.15.116:0/2554429373 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4ff007a290 con 0x7f4ff40b2cc0 2024-02-21T22:52:44.247 INFO:teuthology.orchestra.run.smithi116.stdout:pg_num: 1 2024-02-21T22:52:44.249 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:44.258+0000 7f4ffbd74640 1 -- 172.21.15.116:0/2554429373 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f4fd806b500 msgr2=0x7f4fd806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:44.249 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:44.258+0000 7f4ffbd74640 1 --2- 172.21.15.116:0/2554429373 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f4fd806b500 0x7f4fd806d9c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f4ff414fa90 tx=0x7f4fe4009040 comp rx=0 tx=0).stop 2024-02-21T22:52:44.249 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:44.258+0000 7f4ffbd74640 1 -- 172.21.15.116:0/2554429373 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4ff40b2cc0 msgr2=0x7f4ff4151950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:44.249 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:44.258+0000 7f4ffbd74640 1 --2- 172.21.15.116:0/2554429373 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4ff40b2cc0 0x7f4ff4151950 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f4ff002b930 tx=0x7f4ff00046c0 comp rx=0 tx=0).stop 2024-02-21T22:52:44.249 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:44.258+0000 7f4ffbd74640 1 -- 172.21.15.116:0/2554429373 shutdown_connections 2024-02-21T22:52:44.249 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:44.258+0000 7f4ffbd74640 1 --2- 172.21.15.116:0/2554429373 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f4fd806b500 0x7f4fd806d9c0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:44.249 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:44.258+0000 7f4ffbd74640 1 --2- 172.21.15.116:0/2554429373 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4ff415c0b0 0x7f4ff414ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:44.249 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:44.258+0000 7f4ffbd74640 1 --2- 172.21.15.116:0/2554429373 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4ff40d0860 0x7f4ff4150060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:44.249 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:44.258+0000 7f4ffbd74640 1 --2- 172.21.15.116:0/2554429373 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4ff40b2cc0 0x7f4ff4151950 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:44.249 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:44.258+0000 7f4ffbd74640 1 -- 172.21.15.116:0/2554429373 >> 172.21.15.116:0/2554429373 conn(0x7f4ff40d1b70 msgr2=0x7f4ff41545c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:52:44.249 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:44.258+0000 7f4ffbd74640 1 -- 172.21.15.116:0/2554429373 shutdown_connections 2024-02-21T22:52:44.249 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:44.258+0000 7f4ffbd74640 1 -- 172.21.15.116:0/2554429373 wait complete. 2024-02-21T22:52:44.259 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-21T22:52:44.359 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:44.368+0000 7fdec7e20640 1 Processor -- start 2024-02-21T22:52:44.359 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:44.368+0000 7fdec7e20640 1 -- start start 2024-02-21T22:52:44.360 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:44.369+0000 7fdec7e20640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fdec00d0fc0 0x7fdec00d1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:44.360 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:44.369+0000 7fdec7e20640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdec00ce8f0 con 0x7fdec015e560 2024-02-21T22:52:44.360 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:44.369+0000 7fdec7e20640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdec00d1530 con 0x7fdec015e180 2024-02-21T22:52:44.360 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:44.369+0000 7fdec7e20640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdec00b31b0 con 0x7fdec00d0fc0 2024-02-21T22:52:44.360 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:44.369+0000 7fdec63bd640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fdec00d0fc0 0x7fdec00d1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:44.360 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:44.369+0000 7fdec53bb640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7fdec015e560 0x7fdec00b0a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:41062/0 (socket says 172.21.15.116:41062) 2024-02-21T22:52:44.360 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:44.369+0000 7fdec53bb640 1 -- 172.21.15.116:0/2295441191 learned_addr learned my addr 172.21.15.116:0/2295441191 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-02-21T22:52:44.360 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:44.369+0000 7fdec63bd640 1 -- 172.21.15.116:0/2295441191 >> v1:172.21.15.142:6789/0 conn(0x7fdec015e180 legacy=0x7fdec00cf650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:52:44.360 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:44.369+0000 7fdec63bd640 1 -- 172.21.15.116:0/2295441191 >> v1:172.21.15.116:6789/0 conn(0x7fdec015e560 legacy=0x7fdec00b0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:44.361 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:44.369+0000 7fdec63bd640 1 -- 172.21.15.116:0/2295441191 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdec00ceb70 con 0x7fdec00d0fc0 2024-02-21T22:52:44.361 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:44.369+0000 7fdec4bba640 1 -- 172.21.15.116:0/2295441191 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3640811974 0 0) 0x7fdeb0001110 con 0x7fdec015e560 2024-02-21T22:52:44.362 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:44.370+0000 7fdec63bd640 1 --2- 172.21.15.116:0/2295441191 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdec00d0fc0 0x7fdec00d1bc0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fdeb8009d90 tx=0x7fdeb802beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5b107fb3c451ad3 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:52:44.362 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:44.370+0000 7fdec4bba640 1 -- 172.21.15.116:0/2295441191 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdeb8039070 con 0x7fdec00d0fc0 2024-02-21T22:52:44.362 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:44.370+0000 7fdec4bba640 1 -- 172.21.15.116:0/2295441191 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdeb802cc60 con 0x7fdec00d0fc0 2024-02-21T22:52:44.362 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:44.370+0000 7fdec4bba640 1 -- 172.21.15.116:0/2295441191 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdeb8034660 con 0x7fdec00d0fc0 2024-02-21T22:52:44.362 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:44.371+0000 7fdec7e20640 1 -- 172.21.15.116:0/2295441191 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdec00d0fc0 msgr2=0x7fdec00d1bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:44.362 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:44.371+0000 7fdec7e20640 1 --2- 172.21.15.116:0/2295441191 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdec00d0fc0 0x7fdec00d1bc0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fdeb8009d90 tx=0x7fdeb802beb0 comp rx=0 tx=0).stop 2024-02-21T22:52:44.362 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:44.371+0000 7fdec7e20640 1 -- 172.21.15.116:0/2295441191 shutdown_connections 2024-02-21T22:52:44.362 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:44.371+0000 7fdec7e20640 1 --2- 172.21.15.116:0/2295441191 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdec00d0fc0 0x7fdec00d1bc0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:44.362 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:44.371+0000 7fdec7e20640 1 -- 172.21.15.116:0/2295441191 >> 172.21.15.116:0/2295441191 conn(0x7fdec00d3de0 msgr2=0x7fdec00d41f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:52:44.362 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:44.371+0000 7fdec7e20640 1 -- 172.21.15.116:0/2295441191 shutdown_connections 2024-02-21T22:52:44.362 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:44.371+0000 7fdec7e20640 1 -- 172.21.15.116:0/2295441191 wait complete. 2024-02-21T22:52:44.365 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:44.372+0000 7fdec7e20640 1 Processor -- start 2024-02-21T22:52:44.365 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:44.372+0000 7fdec7e20640 1 -- start start 2024-02-21T22:52:44.365 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:44.373+0000 7fdec7e20640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdec00d0fc0 0x7fdec01f7b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:44.365 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:44.373+0000 7fdec7e20640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdec015e180 0x7fdec00ca120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:44.365 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:44.373+0000 7fdec7e20640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdec015e560 0x7fdec015ff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:44.365 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:44.373+0000 7fdec7e20640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdec00cf1c0 con 0x7fdec015e180 2024-02-21T22:52:44.365 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:44.373+0000 7fdec7e20640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdec00d2100 con 0x7fdec00d0fc0 2024-02-21T22:52:44.365 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:44.373+0000 7fdec7e20640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdec00cfd60 con 0x7fdec015e560 2024-02-21T22:52:44.366 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:44.373+0000 7fdec53bb640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdec015e180 0x7fdec00ca120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:44.366 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:44.373+0000 7fdec53bb640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdec015e180 0x7fdec00ca120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:53692/0 (socket says 172.21.15.116:53692) 2024-02-21T22:52:44.366 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:44.373+0000 7fdec53bb640 1 -- 172.21.15.116:0/416816197 learned_addr learned my addr 172.21.15.116:0/416816197 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:52:44.366 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:44.373+0000 7fdec5bbc640 1 --2- 172.21.15.116:0/416816197 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdec00d0fc0 0x7fdec01f7b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:44.366 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:44.373+0000 7fdec63bd640 1 --2- 172.21.15.116:0/416816197 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdec015e560 0x7fdec015ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:44.366 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:44.373+0000 7fdec53bb640 1 -- 172.21.15.116:0/416816197 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdec015e560 msgr2=0x7fdec015ff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:44.366 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:44.373+0000 7fdec53bb640 1 --2- 172.21.15.116:0/416816197 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdec015e560 0x7fdec015ff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:44.366 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:44.373+0000 7fdec53bb640 1 -- 172.21.15.116:0/416816197 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdec00d0fc0 msgr2=0x7fdec01f7b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:44.366 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:44.373+0000 7fdec53bb640 1 --2- 172.21.15.116:0/416816197 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdec00d0fc0 0x7fdec01f7b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:44.366 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:44.373+0000 7fdec53bb640 1 -- 172.21.15.116:0/416816197 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdec00c7a90 con 0x7fdec015e180 2024-02-21T22:52:44.366 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:44.373+0000 7fdec5bbc640 1 --2- 172.21.15.116:0/416816197 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdec00d0fc0 0x7fdec01f7b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T22:52:44.366 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:44.373+0000 7fdec63bd640 1 --2- 172.21.15.116:0/416816197 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdec015e560 0x7fdec015ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T22:52:44.366 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:44.373+0000 7fdec53bb640 1 --2- 172.21.15.116:0/416816197 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdec015e180 0x7fdec00ca120 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fdeb000c3f0 tx=0x7fdeb000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:52:44.366 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:44.373+0000 7fdeb67fc640 1 -- 172.21.15.116:0/416816197 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdeb00074e0 con 0x7fdec015e180 2024-02-21T22:52:44.367 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:44.373+0000 7fdeb67fc640 1 -- 172.21.15.116:0/416816197 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdeb00047e0 con 0x7fdec015e180 2024-02-21T22:52:44.367 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:44.373+0000 7fdec7e20640 1 -- 172.21.15.116:0/416816197 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdec00c7d70 con 0x7fdec015e180 2024-02-21T22:52:44.367 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:44.373+0000 7fdeb67fc640 1 -- 172.21.15.116:0/416816197 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdeb0004bd0 con 0x7fdec015e180 2024-02-21T22:52:44.367 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:44.373+0000 7fdec7e20640 1 -- 172.21.15.116:0/416816197 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdec00c8330 con 0x7fdec015e180 2024-02-21T22:52:44.367 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:44.374+0000 7fdec7e20640 1 -- 172.21.15.116:0/416816197 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdec00752f0 con 0x7fdec015e180 2024-02-21T22:52:44.367 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:44.375+0000 7fdeb67fc640 1 -- 172.21.15.116:0/416816197 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fdeb0011070 con 0x7fdec015e180 2024-02-21T22:52:44.368 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:44.375+0000 7fdeb67fc640 1 --2- 172.21.15.116:0/416816197 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fdea406b4d0 0x7fdea406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:44.368 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:44.375+0000 7fdeb67fc640 1 -- 172.21.15.116:0/416816197 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fdeb0089a50 con 0x7fdec015e180 2024-02-21T22:52:44.368 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:44.375+0000 7fdec5bbc640 1 --2- 172.21.15.116:0/416816197 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fdea406b4d0 0x7fdea406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:44.368 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:44.376+0000 7fdec5bbc640 1 --2- 172.21.15.116:0/416816197 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fdea406b4d0 0x7fdea406d990 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fdebc003eb0 tx=0x7fdebc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:52:44.370 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:44.379+0000 7fdeb67fc640 1 -- 172.21.15.116:0/416816197 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7fdec00ce8f0 con 0x7fdec015e180 2024-02-21T22:52:44.576 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:44.586+0000 7fdec7e20640 1 -- 172.21.15.116:0/416816197 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdec008d5a0 con 0x7fdec015e180 2024-02-21T22:52:44.577 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:44.586+0000 7fdeb67fc640 1 -- 172.21.15.116:0/416816197 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1327 (secure 0 0 0) 0x7fdeb0058cb0 con 0x7fdec015e180 2024-02-21T22:52:44.577 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-02-21T22:52:44.577 INFO:teuthology.orchestra.run.smithi116.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6834/1717961923","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":1717961923},{"type":"v1","addr":"172.21.15.116:6834","nonce":1717961923}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2024-02-21T22:52:44.578 INFO:teuthology.orchestra.run.smithi116.stderr:dumped fsmap epoch 2 2024-02-21T22:52:44.579 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:44.588+0000 7fdec7e20640 1 -- 172.21.15.116:0/416816197 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fdea406b4d0 msgr2=0x7fdea406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:44.579 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:44.588+0000 7fdec7e20640 1 --2- 172.21.15.116:0/416816197 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fdea406b4d0 0x7fdea406d990 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fdebc003eb0 tx=0x7fdebc009040 comp rx=0 tx=0).stop 2024-02-21T22:52:44.579 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:44.588+0000 7fdec7e20640 1 -- 172.21.15.116:0/416816197 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdec015e180 msgr2=0x7fdec00ca120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:44.579 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:44.588+0000 7fdec7e20640 1 --2- 172.21.15.116:0/416816197 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdec015e180 0x7fdec00ca120 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fdeb000c3f0 tx=0x7fdeb000c8b0 comp rx=0 tx=0).stop 2024-02-21T22:52:44.579 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:44.588+0000 7fdec7e20640 1 -- 172.21.15.116:0/416816197 shutdown_connections 2024-02-21T22:52:44.579 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:44.588+0000 7fdec7e20640 1 --2- 172.21.15.116:0/416816197 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fdea406b4d0 0x7fdea406d990 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:44.579 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:44.588+0000 7fdec7e20640 1 --2- 172.21.15.116:0/416816197 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdec015e560 0x7fdec015ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:44.580 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:44.588+0000 7fdec7e20640 1 --2- 172.21.15.116:0/416816197 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdec015e180 0x7fdec00ca120 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:44.580 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:44.588+0000 7fdec7e20640 1 --2- 172.21.15.116:0/416816197 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdec00d0fc0 0x7fdec01f7b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:44.580 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:44.588+0000 7fdec7e20640 1 -- 172.21.15.116:0/416816197 >> 172.21.15.116:0/416816197 conn(0x7fdec00d3de0 msgr2=0x7fdec00b1eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:52:44.580 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:44.588+0000 7fdec7e20640 1 -- 172.21.15.116:0/416816197 shutdown_connections 2024-02-21T22:52:44.580 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:44.588+0000 7fdec7e20640 1 -- 172.21.15.116:0/416816197 wait complete. 2024-02-21T22:52:44.703 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T22:52:44.706 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T22:52:46.590 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-21T22:52:46.702 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:46.712+0000 7f660e155640 1 Processor -- start 2024-02-21T22:52:46.703 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:46.712+0000 7f660e155640 1 -- start start 2024-02-21T22:52:46.705 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:46.712+0000 7f660e155640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f660815bf00 0x7f66080b00e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:46.705 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:46.712+0000 7f660e155640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f66080ccbd0 0x7f6608066cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:46.705 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:46.712+0000 7f660e155640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f66080d0230 0x7f66080d06c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:46.705 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:46.713+0000 7f660e155640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66080b5080 con 0x7f66080ccbd0 2024-02-21T22:52:46.706 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:46.713+0000 7f660e155640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66080b0620 con 0x7f660815bf00 2024-02-21T22:52:46.706 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:46.713+0000 7f660e155640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66080cd170 con 0x7f66080d0230 2024-02-21T22:52:46.706 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:46.713+0000 7f6606ffd640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f66080ccbd0 0x7f6608066cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:46.706 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:46.713+0000 7f6606ffd640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f66080ccbd0 0x7f6608066cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:50778/0 (socket says 172.21.15.116:50778) 2024-02-21T22:52:46.706 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:46.713+0000 7f6606ffd640 1 -- 172.21.15.116:0/674621410 learned_addr learned my addr 172.21.15.116:0/674621410 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:52:46.706 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:46.713+0000 7f6607fff640 1 --2- 172.21.15.116:0/674621410 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f66080d0230 0x7f66080d06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:46.706 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:46.713+0000 7f6606ffd640 1 -- 172.21.15.116:0/674621410 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f66080d0230 msgr2=0x7f66080d06c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:52:46.706 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:46.713+0000 7f6606ffd640 1 --2- 172.21.15.116:0/674621410 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f66080d0230 0x7f66080d06c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:46.706 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:46.713+0000 7f6606ffd640 1 -- 172.21.15.116:0/674621410 >> v2:172.21.15.142:3300/0 conn(0x7f660815bf00 msgr2=0x7f66080b00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:52:46.706 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:46.713+0000 7f66077fe640 1 --2- 172.21.15.116:0/674621410 >> v2:172.21.15.142:3300/0 conn(0x7f660815bf00 0x7f66080b00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:46.706 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:46.713+0000 7f6606ffd640 1 --2- 172.21.15.116:0/674621410 >> v2:172.21.15.142:3300/0 conn(0x7f660815bf00 0x7f66080b00e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:46.706 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:46.713+0000 7f6606ffd640 1 -- 172.21.15.116:0/674621410 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66080cd450 con 0x7f66080ccbd0 2024-02-21T22:52:46.706 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:46.713+0000 7f6607fff640 1 --2- 172.21.15.116:0/674621410 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f66080d0230 0x7f66080d06c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T22:52:46.706 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:46.713+0000 7f66077fe640 1 --2- 172.21.15.116:0/674621410 >> v2:172.21.15.142:3300/0 conn(0x7f660815bf00 0x7f66080b00e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T22:52:46.707 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:46.714+0000 7f6606ffd640 1 --2- 172.21.15.116:0/674621410 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f66080ccbd0 0x7f6608066cf0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f66080cde40 tx=0x7f65fc02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d951e94bbc22a9a server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:52:46.707 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:46.714+0000 7f66067fc640 1 -- 172.21.15.116:0/674621410 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65fc035020 con 0x7f66080ccbd0 2024-02-21T22:52:46.707 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:46.714+0000 7f66067fc640 1 -- 172.21.15.116:0/674621410 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65fc031870 con 0x7f66080ccbd0 2024-02-21T22:52:46.707 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:46.714+0000 7f66067fc640 1 -- 172.21.15.116:0/674621410 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65fc031c40 con 0x7f66080ccbd0 2024-02-21T22:52:46.707 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:46.714+0000 7f660e155640 1 -- 172.21.15.116:0/674621410 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f66080ccbd0 msgr2=0x7f6608066cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:46.707 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:46.714+0000 7f660e155640 1 --2- 172.21.15.116:0/674621410 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f66080ccbd0 0x7f6608066cf0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f66080cde40 tx=0x7f65fc02b910 comp rx=0 tx=0).stop 2024-02-21T22:52:46.707 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:46.714+0000 7f660e155640 1 -- 172.21.15.116:0/674621410 shutdown_connections 2024-02-21T22:52:46.707 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:46.714+0000 7f660e155640 1 --2- 172.21.15.116:0/674621410 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f66080d0230 0x7f66080d06c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:46.707 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:46.714+0000 7f660e155640 1 --2- 172.21.15.116:0/674621410 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f66080ccbd0 0x7f6608066cf0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:46.707 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:46.714+0000 7f660e155640 1 --2- 172.21.15.116:0/674621410 >> v2:172.21.15.142:3300/0 conn(0x7f660815bf00 0x7f66080b00e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:46.707 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:46.714+0000 7f660e155640 1 -- 172.21.15.116:0/674621410 >> 172.21.15.116:0/674621410 conn(0x7f66080724f0 msgr2=0x7f6608072900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:52:46.707 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:46.715+0000 7f660e155640 1 -- 172.21.15.116:0/674621410 shutdown_connections 2024-02-21T22:52:46.707 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:46.715+0000 7f660e155640 1 -- 172.21.15.116:0/674621410 wait complete. 2024-02-21T22:52:46.710 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:46.716+0000 7f660e155640 1 Processor -- start 2024-02-21T22:52:46.710 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:46.716+0000 7f660e155640 1 -- start start 2024-02-21T22:52:46.710 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:46.717+0000 7f660e155640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f66080ccbd0 0x7f66080c8000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:46.710 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:46.717+0000 7f660e155640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f66080d0230 0x7f66081f4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:46.710 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:46.717+0000 7f660e155640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f660815bf00 0x7f660815ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:46.710 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:46.717+0000 7f660e155640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6608067230 con 0x7f66080ccbd0 2024-02-21T22:52:46.710 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:46.717+0000 7f660e155640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66080cda10 con 0x7f66080d0230 2024-02-21T22:52:46.710 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:46.717+0000 7f660e155640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f660815c2e0 con 0x7f660815bf00 2024-02-21T22:52:46.710 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:46.717+0000 7f66077fe640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f66080ccbd0 0x7f66080c8000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:46.711 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:46.717+0000 7f66077fe640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f66080ccbd0 0x7f66080c8000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:50788/0 (socket says 172.21.15.116:50788) 2024-02-21T22:52:46.711 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:46.717+0000 7f66077fe640 1 -- 172.21.15.116:0/2854189764 learned_addr learned my addr 172.21.15.116:0/2854189764 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:52:46.711 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:46.717+0000 7f6607fff640 1 --2- 172.21.15.116:0/2854189764 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f660815bf00 0x7f660815ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:46.711 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:46.717+0000 7f6606ffd640 1 --2- 172.21.15.116:0/2854189764 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f66080d0230 0x7f66081f4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:46.711 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:46.717+0000 7f66077fe640 1 -- 172.21.15.116:0/2854189764 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f660815bf00 msgr2=0x7f660815ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:46.711 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:46.717+0000 7f66077fe640 1 --2- 172.21.15.116:0/2854189764 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f660815bf00 0x7f660815ea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:46.711 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:46.717+0000 7f66077fe640 1 -- 172.21.15.116:0/2854189764 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f66080d0230 msgr2=0x7f66081f4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:46.711 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:46.717+0000 7f66077fe640 1 --2- 172.21.15.116:0/2854189764 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f66080d0230 0x7f66081f4cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:46.711 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:46.717+0000 7f66077fe640 1 -- 172.21.15.116:0/2854189764 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f660815e7b0 con 0x7f66080ccbd0 2024-02-21T22:52:46.711 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:46.717+0000 7f66077fe640 1 --2- 172.21.15.116:0/2854189764 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f66080ccbd0 0x7f66080c8000 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f65f800c820 tx=0x7f65f800cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:52:46.711 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:46.717+0000 7f65effff640 1 -- 172.21.15.116:0/2854189764 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65f8015070 con 0x7f66080ccbd0 2024-02-21T22:52:46.711 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:46.717+0000 7f65effff640 1 -- 172.21.15.116:0/2854189764 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65f8007a30 con 0x7f66080ccbd0 2024-02-21T22:52:46.711 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:46.717+0000 7f65effff640 1 -- 172.21.15.116:0/2854189764 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65f8007e00 con 0x7f66080ccbd0 2024-02-21T22:52:46.711 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:46.717+0000 7f660e155640 1 -- 172.21.15.116:0/2854189764 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66080c7b20 con 0x7f66080ccbd0 2024-02-21T22:52:46.712 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:46.717+0000 7f660e155640 1 -- 172.21.15.116:0/2854189764 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f660815e4d0 con 0x7f66080ccbd0 2024-02-21T22:52:46.712 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:46.718+0000 7f660e155640 1 -- 172.21.15.116:0/2854189764 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66080b0440 con 0x7f66080ccbd0 2024-02-21T22:52:46.712 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:46.719+0000 7f65effff640 1 -- 172.21.15.116:0/2854189764 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f65f8018070 con 0x7f66080ccbd0 2024-02-21T22:52:46.712 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:46.719+0000 7f65effff640 1 --2- 172.21.15.116:0/2854189764 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f65f406b4d0 0x7f65f406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:46.712 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:46.719+0000 7f65effff640 1 -- 172.21.15.116:0/2854189764 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f65f8089e00 con 0x7f66080ccbd0 2024-02-21T22:52:46.712 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:46.719+0000 7f6606ffd640 1 --2- 172.21.15.116:0/2854189764 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f65f406b4d0 0x7f65f406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:46.712 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:46.720+0000 7f6606ffd640 1 --2- 172.21.15.116:0/2854189764 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f65f406b4d0 0x7f65f406d990 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f65fc036000 tx=0x7f65fc03c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:52:46.714 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:46.724+0000 7f65effff640 1 -- 172.21.15.116:0/2854189764 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f66080b0440 con 0x7f66080ccbd0 2024-02-21T22:52:46.922 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:46.931+0000 7f660e155640 1 -- 172.21.15.116:0/2854189764 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f66080752f0 con 0x7f66080ccbd0 2024-02-21T22:52:46.922 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:46.932+0000 7f65effff640 1 -- 172.21.15.116:0/2854189764 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3703 (secure 0 0 0) 0x7f65f8059060 con 0x7f66080ccbd0 2024-02-21T22:52:46.923 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-02-21T22:52:46.923 INFO:teuthology.orchestra.run.smithi116.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6834/1717961923","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":1717961923},{"type":"v1","addr":"172.21.15.116:6834","nonce":1717961923}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6835/2228298220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6833","nonce":2228298220},{"type":"v1","addr":"172.21.15.116:6835","nonce":2228298220}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4285,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/1675920719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":1675920719},{"type":"v1","addr":"172.21.15.142:6837","nonce":1675920719}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4290,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/939436511","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":939436511},{"type":"v1","addr":"172.21.15.142:6836","nonce":939436511}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2024-02-21T22:52:46.923 INFO:teuthology.orchestra.run.smithi116.stderr:dumped fsmap epoch 3 2024-02-21T22:52:46.925 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:46.934+0000 7f660e155640 1 -- 172.21.15.116:0/2854189764 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f65f406b4d0 msgr2=0x7f65f406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:46.925 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:46.934+0000 7f660e155640 1 --2- 172.21.15.116:0/2854189764 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f65f406b4d0 0x7f65f406d990 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f65fc036000 tx=0x7f65fc03c040 comp rx=0 tx=0).stop 2024-02-21T22:52:46.925 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:46.934+0000 7f660e155640 1 -- 172.21.15.116:0/2854189764 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f66080ccbd0 msgr2=0x7f66080c8000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:46.925 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:46.934+0000 7f660e155640 1 --2- 172.21.15.116:0/2854189764 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f66080ccbd0 0x7f66080c8000 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f65f800c820 tx=0x7f65f800cc20 comp rx=0 tx=0).stop 2024-02-21T22:52:46.925 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:46.934+0000 7f660e155640 1 -- 172.21.15.116:0/2854189764 shutdown_connections 2024-02-21T22:52:46.925 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:46.934+0000 7f660e155640 1 --2- 172.21.15.116:0/2854189764 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f65f406b4d0 0x7f65f406d990 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:46.925 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:46.934+0000 7f660e155640 1 --2- 172.21.15.116:0/2854189764 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f660815bf00 0x7f660815ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:46.925 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:46.934+0000 7f660e155640 1 --2- 172.21.15.116:0/2854189764 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f66080d0230 0x7f66081f4cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:46.925 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:46.934+0000 7f660e155640 1 --2- 172.21.15.116:0/2854189764 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f66080ccbd0 0x7f66080c8000 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:46.925 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:46.934+0000 7f660e155640 1 -- 172.21.15.116:0/2854189764 >> 172.21.15.116:0/2854189764 conn(0x7f66080724f0 msgr2=0x7f66080b11b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:52:46.926 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:46.934+0000 7f660e155640 1 -- 172.21.15.116:0/2854189764 shutdown_connections 2024-02-21T22:52:46.926 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:46.934+0000 7f660e155640 1 -- 172.21.15.116:0/2854189764 wait complete. 2024-02-21T22:52:46.935 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-21T22:52:47.036 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.045+0000 7f0736bbb640 1 Processor -- start 2024-02-21T22:52:47.036 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.045+0000 7f0736bbb640 1 -- start start 2024-02-21T22:52:47.038 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.046+0000 7f0736bbb640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f07300cf7a0 0x7f07300d0470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:47.038 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.046+0000 7f0736bbb640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f07300ccd70 0x7f07300cd200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:47.038 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.046+0000 7f0736bbb640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07300cc890 con 0x7f073015bfe0 2024-02-21T22:52:47.038 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.046+0000 7f0736bbb640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07300b1490 con 0x7f07300ccd70 2024-02-21T22:52:47.038 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.046+0000 7f0736bbb640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07300b11b0 con 0x7f07300cf7a0 2024-02-21T22:52:47.039 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.046+0000 7f0735158640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f07300ccd70 0x7f07300cd200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:47.039 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.046+0000 7f0734957640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f073015bfe0 0x7f07300cfd60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:56830/0 (socket says 172.21.15.116:56830) 2024-02-21T22:52:47.039 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.046+0000 7f0734957640 1 -- 172.21.15.116:0/2699532702 learned_addr learned my addr 172.21.15.116:0/2699532702 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-02-21T22:52:47.039 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.046+0000 7f072ffff640 1 --2- 172.21.15.116:0/2699532702 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f07300cf7a0 0x7f07300d0470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:47.039 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.046+0000 7f0735158640 1 -- 172.21.15.116:0/2699532702 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f07300cf7a0 msgr2=0x7f07300d0470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:52:47.039 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.046+0000 7f0735158640 1 --2- 172.21.15.116:0/2699532702 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f07300cf7a0 0x7f07300d0470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:47.039 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.046+0000 7f0735158640 1 -- 172.21.15.116:0/2699532702 >> v1:172.21.15.116:6789/0 conn(0x7f073015bfe0 legacy=0x7f07300cfd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:47.039 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.046+0000 7f0735158640 1 -- 172.21.15.116:0/2699532702 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07300cf070 con 0x7f07300ccd70 2024-02-21T22:52:47.039 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.046+0000 7f072f7fe640 1 -- 172.21.15.116:0/2699532702 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3604831026 0 0) 0x7f07300cc890 con 0x7f073015bfe0 2024-02-21T22:52:47.039 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.047+0000 7f0735158640 1 --2- 172.21.15.116:0/2699532702 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f07300ccd70 0x7f07300cd200 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f0728009d90 tx=0x7f072802be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfe8d28f3d0f7016 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:52:47.039 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.047+0000 7f072f7fe640 1 -- 172.21.15.116:0/2699532702 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0728039070 con 0x7f07300ccd70 2024-02-21T22:52:47.039 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.047+0000 7f072f7fe640 1 -- 172.21.15.116:0/2699532702 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f072802cbc0 con 0x7f07300ccd70 2024-02-21T22:52:47.039 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.047+0000 7f072f7fe640 1 -- 172.21.15.116:0/2699532702 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0728034440 con 0x7f07300ccd70 2024-02-21T22:52:47.039 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.047+0000 7f0736bbb640 1 -- 172.21.15.116:0/2699532702 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f07300ccd70 msgr2=0x7f07300cd200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:47.040 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.047+0000 7f0736bbb640 1 --2- 172.21.15.116:0/2699532702 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f07300ccd70 0x7f07300cd200 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f0728009d90 tx=0x7f072802be10 comp rx=0 tx=0).stop 2024-02-21T22:52:47.040 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.047+0000 7f0736bbb640 1 -- 172.21.15.116:0/2699532702 shutdown_connections 2024-02-21T22:52:47.040 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.047+0000 7f0736bbb640 1 --2- 172.21.15.116:0/2699532702 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f07300ccd70 0x7f07300cd200 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:47.040 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.047+0000 7f0736bbb640 1 --2- 172.21.15.116:0/2699532702 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f07300cf7a0 0x7f07300d0470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:47.040 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.047+0000 7f0736bbb640 1 -- 172.21.15.116:0/2699532702 >> 172.21.15.116:0/2699532702 conn(0x7f07300d1bd0 msgr2=0x7f07300d1fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:52:47.040 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.048+0000 7f0736bbb640 1 -- 172.21.15.116:0/2699532702 shutdown_connections 2024-02-21T22:52:47.040 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.048+0000 7f0736bbb640 1 -- 172.21.15.116:0/2699532702 wait complete. 2024-02-21T22:52:47.043 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.049+0000 7f0736bbb640 1 Processor -- start 2024-02-21T22:52:47.043 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.049+0000 7f0736bbb640 1 -- start start 2024-02-21T22:52:47.043 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.050+0000 7f0736bbb640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f07300ccd70 0x7f0730157810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:47.043 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.050+0000 7f0736bbb640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f07300cf7a0 0x7f07300c6b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:47.043 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.050+0000 7f0736bbb640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f073015bfe0 0x7f073009bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:47.043 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.050+0000 7f0736bbb640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f073006eba0 con 0x7f07300ccd70 2024-02-21T22:52:47.043 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.050+0000 7f0736bbb640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f073015c3c0 con 0x7f073015bfe0 2024-02-21T22:52:47.044 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.050+0000 7f0736bbb640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f073006ed20 con 0x7f07300cf7a0 2024-02-21T22:52:47.044 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.050+0000 7f0734957640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f07300ccd70 0x7f0730157810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:47.044 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.050+0000 7f0734957640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f07300ccd70 0x7f0730157810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:50814/0 (socket says 172.21.15.116:50814) 2024-02-21T22:52:47.044 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.050+0000 7f0734957640 1 -- 172.21.15.116:0/3349060830 learned_addr learned my addr 172.21.15.116:0/3349060830 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:52:47.044 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.050+0000 7f072ffff640 1 --2- 172.21.15.116:0/3349060830 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f07300cf7a0 0x7f07300c6b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:47.044 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.050+0000 7f0735158640 1 --2- 172.21.15.116:0/3349060830 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f073015bfe0 0x7f073009bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:47.044 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.050+0000 7f0734957640 1 -- 172.21.15.116:0/3349060830 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f07300cf7a0 msgr2=0x7f07300c6b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:47.044 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.050+0000 7f0734957640 1 --2- 172.21.15.116:0/3349060830 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f07300cf7a0 0x7f07300c6b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:47.044 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.050+0000 7f0734957640 1 -- 172.21.15.116:0/3349060830 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f073015bfe0 msgr2=0x7f073009bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:47.044 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.050+0000 7f0734957640 1 --2- 172.21.15.116:0/3349060830 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f073015bfe0 0x7f073009bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:47.044 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.050+0000 7f0734957640 1 -- 172.21.15.116:0/3349060830 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f073009dcd0 con 0x7f07300ccd70 2024-02-21T22:52:47.044 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.050+0000 7f0735158640 1 --2- 172.21.15.116:0/3349060830 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f073015bfe0 0x7f073009bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T22:52:47.044 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.050+0000 7f0734957640 1 --2- 172.21.15.116:0/3349060830 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f07300ccd70 0x7f0730157810 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f072400c500 tx=0x7f072400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:52:47.045 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.050+0000 7f072d7fa640 1 -- 172.21.15.116:0/3349060830 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0724018070 con 0x7f07300ccd70 2024-02-21T22:52:47.045 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.050+0000 7f072d7fa640 1 -- 172.21.15.116:0/3349060830 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0724007580 con 0x7f07300ccd70 2024-02-21T22:52:47.045 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.050+0000 7f072d7fa640 1 -- 172.21.15.116:0/3349060830 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0724004a20 con 0x7f07300ccd70 2024-02-21T22:52:47.045 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.050+0000 7f0736bbb640 1 -- 172.21.15.116:0/3349060830 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0730158bf0 con 0x7f07300ccd70 2024-02-21T22:52:47.045 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.050+0000 7f0736bbb640 1 -- 172.21.15.116:0/3349060830 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f073009df70 con 0x7f07300ccd70 2024-02-21T22:52:47.045 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.051+0000 7f0736bbb640 1 -- 172.21.15.116:0/3349060830 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07300752f0 con 0x7f07300ccd70 2024-02-21T22:52:47.045 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.052+0000 7f072d7fa640 1 -- 172.21.15.116:0/3349060830 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f072401b070 con 0x7f07300ccd70 2024-02-21T22:52:47.045 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.052+0000 7f072d7fa640 1 --2- 172.21.15.116:0/3349060830 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f071406b4d0 0x7f071406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:47.045 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.052+0000 7f072d7fa640 1 -- 172.21.15.116:0/3349060830 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f0724089120 con 0x7f07300ccd70 2024-02-21T22:52:47.045 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.052+0000 7f072ffff640 1 --2- 172.21.15.116:0/3349060830 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f071406b4d0 0x7f071406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:47.045 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.052+0000 7f072ffff640 1 --2- 172.21.15.116:0/3349060830 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f071406b4d0 0x7f071406d990 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f07300d26c0 tx=0x7f071c009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:52:47.046 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.056+0000 7f072d7fa640 1 -- 172.21.15.116:0/3349060830 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f0724057c90 con 0x7f07300ccd70 2024-02-21T22:52:47.217 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.226+0000 7f0736bbb640 1 -- 172.21.15.116:0/3349060830 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f07300b7b50 con 0x7f07300ccd70 2024-02-21T22:52:47.218 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.227+0000 7f072d7fa640 1 -- 172.21.15.116:0/3349060830 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12932 (secure 0 0 0) 0x7f072405bd30 con 0x7f07300ccd70 2024-02-21T22:52:47.218 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-02-21T22:52:47.218 INFO:teuthology.orchestra.run.smithi116.stdout:{"epoch":16,"fsid":"7c298660-5f63-4b5c-a800-58c5be9a8445","created":"2024-02-21T22:52:25.994613+0000","modified":"2024-02-21T22:52:41.407615+0000","last_up_change":"2024-02-21T22:52:37.313595+0000","last_in_change":"2024-02-21T22:52:28.176031+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-21T22:52:38.328796+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4f09126b-b5e4-4876-8b08-f5cbb967388a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":1613202231},{"type":"v1","addr":"172.21.15.116:6809","nonce":1613202231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":1613202231},{"type":"v1","addr":"172.21.15.116:6811","nonce":1613202231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":1613202231},{"type":"v1","addr":"172.21.15.116:6815","nonce":1613202231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":1613202231},{"type":"v1","addr":"172.21.15.116:6813","nonce":1613202231}]},"public_addr":"172.21.15.116:6809/1613202231","cluster_addr":"172.21.15.116:6811/1613202231","heartbeat_back_addr":"172.21.15.116:6815/1613202231","heartbeat_front_addr":"172.21.15.116:6813/1613202231","state":["exists","up"]},{"osd":1,"uuid":"7272c51d-51f9-4536-931d-33ad7a4b377e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6816","nonce":172614746},{"type":"v1","addr":"172.21.15.116:6817","nonce":172614746}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":172614746},{"type":"v1","addr":"172.21.15.116:6819","nonce":172614746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":172614746},{"type":"v1","addr":"172.21.15.116:6823","nonce":172614746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":172614746},{"type":"v1","addr":"172.21.15.116:6821","nonce":172614746}]},"public_addr":"172.21.15.116:6817/172614746","cluster_addr":"172.21.15.116:6819/172614746","heartbeat_back_addr":"172.21.15.116:6823/172614746","heartbeat_front_addr":"172.21.15.116:6821/172614746","state":["exists","up"]},{"osd":2,"uuid":"2589616c-adf1-4187-aac3-735256cf624b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":1029280577},{"type":"v1","addr":"172.21.15.116:6825","nonce":1029280577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":1029280577},{"type":"v1","addr":"172.21.15.116:6827","nonce":1029280577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":1029280577},{"type":"v1","addr":"172.21.15.116:6831","nonce":1029280577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":1029280577},{"type":"v1","addr":"172.21.15.116:6829","nonce":1029280577}]},"public_addr":"172.21.15.116:6825/1029280577","cluster_addr":"172.21.15.116:6827/1029280577","heartbeat_back_addr":"172.21.15.116:6831/1029280577","heartbeat_front_addr":"172.21.15.116:6829/1029280577","state":["exists","up"]},{"osd":3,"uuid":"0fd2e563-7c5b-46f6-82c2-b60c86072c93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":3106627557},{"type":"v1","addr":"172.21.15.116:6801","nonce":3106627557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":3106627557},{"type":"v1","addr":"172.21.15.116:6803","nonce":3106627557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":3106627557},{"type":"v1","addr":"172.21.15.116:6807","nonce":3106627557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":3106627557},{"type":"v1","addr":"172.21.15.116:6805","nonce":3106627557}]},"public_addr":"172.21.15.116:6801/3106627557","cluster_addr":"172.21.15.116:6803/3106627557","heartbeat_back_addr":"172.21.15.116:6807/3106627557","heartbeat_front_addr":"172.21.15.116:6805/3106627557","state":["exists","up"]},{"osd":4,"uuid":"79ae35b7-dda8-4ab8-96ce-47515afde082","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":3231407772},{"type":"v1","addr":"172.21.15.142:6825","nonce":3231407772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":3231407772},{"type":"v1","addr":"172.21.15.142:6827","nonce":3231407772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":3231407772},{"type":"v1","addr":"172.21.15.142:6831","nonce":3231407772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":3231407772},{"type":"v1","addr":"172.21.15.142:6829","nonce":3231407772}]},"public_addr":"172.21.15.142:6825/3231407772","cluster_addr":"172.21.15.142:6827/3231407772","heartbeat_back_addr":"172.21.15.142:6831/3231407772","heartbeat_front_addr":"172.21.15.142:6829/3231407772","state":["exists","up"]},{"osd":5,"uuid":"3166eb2c-3fcf-41c8-9362-45bafaabaa39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":1184158716},{"type":"v1","addr":"172.21.15.142:6817","nonce":1184158716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":1184158716},{"type":"v1","addr":"172.21.15.142:6819","nonce":1184158716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":1184158716},{"type":"v1","addr":"172.21.15.142:6823","nonce":1184158716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":1184158716},{"type":"v1","addr":"172.21.15.142:6821","nonce":1184158716}]},"public_addr":"172.21.15.142:6817/1184158716","cluster_addr":"172.21.15.142:6819/1184158716","heartbeat_back_addr":"172.21.15.142:6823/1184158716","heartbeat_front_addr":"172.21.15.142:6821/1184158716","state":["exists","up"]},{"osd":6,"uuid":"f9aa9672-7527-43e2-963e-b61868e5e63f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":1987868911},{"type":"v1","addr":"172.21.15.142:6801","nonce":1987868911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":1987868911},{"type":"v1","addr":"172.21.15.142:6803","nonce":1987868911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":1987868911},{"type":"v1","addr":"172.21.15.142:6807","nonce":1987868911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":1987868911},{"type":"v1","addr":"172.21.15.142:6805","nonce":1987868911}]},"public_addr":"172.21.15.142:6801/1987868911","cluster_addr":"172.21.15.142:6803/1987868911","heartbeat_back_addr":"172.21.15.142:6807/1987868911","heartbeat_front_addr":"172.21.15.142:6805/1987868911","state":["exists","up"]},{"osd":7,"uuid":"7ed29226-fc42-4382-a91a-fa50f7ec5426","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":1272081937},{"type":"v1","addr":"172.21.15.142:6809","nonce":1272081937}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":1272081937},{"type":"v1","addr":"172.21.15.142:6811","nonce":1272081937}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":1272081937},{"type":"v1","addr":"172.21.15.142:6815","nonce":1272081937}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":1272081937},{"type":"v1","addr":"172.21.15.142:6813","nonce":1272081937}]},"public_addr":"172.21.15.142:6809/1272081937","cluster_addr":"172.21.15.142:6811/1272081937","heartbeat_back_addr":"172.21.15.142:6815/1272081937","heartbeat_front_addr":"172.21.15.142:6813/1272081937","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.350998+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.307201+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.289112+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.243888+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.312091+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.370472+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.275659+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.289297+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-21T22:52:47.220 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.229+0000 7f0736bbb640 1 -- 172.21.15.116:0/3349060830 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f071406b4d0 msgr2=0x7f071406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:47.220 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.229+0000 7f0736bbb640 1 --2- 172.21.15.116:0/3349060830 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f071406b4d0 0x7f071406d990 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f07300d26c0 tx=0x7f071c009190 comp rx=0 tx=0).stop 2024-02-21T22:52:47.220 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.229+0000 7f0736bbb640 1 -- 172.21.15.116:0/3349060830 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f07300ccd70 msgr2=0x7f0730157810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:47.220 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.229+0000 7f0736bbb640 1 --2- 172.21.15.116:0/3349060830 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f07300ccd70 0x7f0730157810 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f072400c500 tx=0x7f072400c9c0 comp rx=0 tx=0).stop 2024-02-21T22:52:47.220 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.229+0000 7f0736bbb640 1 -- 172.21.15.116:0/3349060830 shutdown_connections 2024-02-21T22:52:47.220 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.229+0000 7f0736bbb640 1 --2- 172.21.15.116:0/3349060830 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f073015bfe0 0x7f073009bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:47.220 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.229+0000 7f0736bbb640 1 --2- 172.21.15.116:0/3349060830 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f071406b4d0 0x7f071406d990 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:47.221 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.229+0000 7f0736bbb640 1 --2- 172.21.15.116:0/3349060830 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f07300cf7a0 0x7f07300c6b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:47.221 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.229+0000 7f0736bbb640 1 --2- 172.21.15.116:0/3349060830 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f07300ccd70 0x7f0730157810 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:47.221 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.229+0000 7f0736bbb640 1 -- 172.21.15.116:0/3349060830 >> 172.21.15.116:0/3349060830 conn(0x7f07300d1bd0 msgr2=0x7f07300b0010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:52:47.221 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.229+0000 7f0736bbb640 1 -- 172.21.15.116:0/3349060830 shutdown_connections 2024-02-21T22:52:47.221 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.229+0000 7f0736bbb640 1 -- 172.21.15.116:0/3349060830 wait complete. 2024-02-21T22:52:47.231 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-21T22:52:38.328796+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-21T22:52:47.231 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-21T22:52:47.335 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.344+0000 7fa1bd6de640 1 Processor -- start 2024-02-21T22:52:47.335 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.344+0000 7fa1bd6de640 1 -- start start 2024-02-21T22:52:47.337 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.345+0000 7fa1bd6de640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fa1b815c140 0x7fa1b80cd590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:47.337 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.345+0000 7fa1bd6de640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1b80cdde0 con 0x7fa1b80cf260 2024-02-21T22:52:47.337 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.345+0000 7fa1bd6de640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1b80ce0c0 con 0x7fa1b80cecd0 2024-02-21T22:52:47.337 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.345+0000 7fa1bd6de640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1b80b4cf0 con 0x7fa1b815c140 2024-02-21T22:52:47.337 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.345+0000 7fa1b6ffd640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fa1b815c140 0x7fa1b80cd590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:47.337 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.345+0000 7fa1b67fc640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7fa1b80cf260 0x7fa1b80ce5c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:56836/0 (socket says 172.21.15.116:56836) 2024-02-21T22:52:47.337 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.345+0000 7fa1b67fc640 1 -- 172.21.15.116:0/1398016920 learned_addr learned my addr 172.21.15.116:0/1398016920 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-02-21T22:52:47.337 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.346+0000 7fa1b6ffd640 1 -- 172.21.15.116:0/1398016920 >> v1:172.21.15.142:6789/0 conn(0x7fa1b80cecd0 legacy=0x7fa1b80b54f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:47.337 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.346+0000 7fa1b6ffd640 1 -- 172.21.15.116:0/1398016920 >> v1:172.21.15.116:6789/0 conn(0x7fa1b80cf260 legacy=0x7fa1b80ce5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:47.338 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.346+0000 7fa1b6ffd640 1 -- 172.21.15.116:0/1398016920 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1b80b4fd0 con 0x7fa1b815c140 2024-02-21T22:52:47.338 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.346+0000 7fa1b6ffd640 1 --2- 172.21.15.116:0/1398016920 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa1b815c140 0x7fa1b80cd590 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fa1a8009d90 tx=0x7fa1a802bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e9838359cc4f72e server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:52:47.338 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.346+0000 7fa1b5ffb640 1 -- 172.21.15.116:0/1398016920 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1a8039070 con 0x7fa1b815c140 2024-02-21T22:52:47.338 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.346+0000 7fa1b5ffb640 1 -- 172.21.15.116:0/1398016920 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1a802cd00 con 0x7fa1b815c140 2024-02-21T22:52:47.338 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.346+0000 7fa1b5ffb640 1 -- 172.21.15.116:0/1398016920 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1a8034660 con 0x7fa1b815c140 2024-02-21T22:52:47.341 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.347+0000 7fa1bd6de640 1 -- 172.21.15.116:0/1398016920 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa1b815c140 msgr2=0x7fa1b80cd590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:47.341 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.347+0000 7fa1bd6de640 1 --2- 172.21.15.116:0/1398016920 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa1b815c140 0x7fa1b80cd590 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fa1a8009d90 tx=0x7fa1a802bf50 comp rx=0 tx=0).stop 2024-02-21T22:52:47.341 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.347+0000 7fa1bd6de640 1 -- 172.21.15.116:0/1398016920 shutdown_connections 2024-02-21T22:52:47.341 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.347+0000 7fa1bd6de640 1 --2- 172.21.15.116:0/1398016920 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa1b815c140 0x7fa1b80cd590 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:47.341 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.347+0000 7fa1bd6de640 1 -- 172.21.15.116:0/1398016920 >> 172.21.15.116:0/1398016920 conn(0x7fa1b80d1c90 msgr2=0x7fa1b80d20a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:52:47.341 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.347+0000 7fa1bd6de640 1 -- 172.21.15.116:0/1398016920 shutdown_connections 2024-02-21T22:52:47.341 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.347+0000 7fa1bd6de640 1 -- 172.21.15.116:0/1398016920 wait complete. 2024-02-21T22:52:47.341 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.348+0000 7fa1bd6de640 1 Processor -- start 2024-02-21T22:52:47.341 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.348+0000 7fa1bd6de640 1 -- start start 2024-02-21T22:52:47.341 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.349+0000 7fa1bd6de640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa1b80cecd0 0x7fa1b80c5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:47.341 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.349+0000 7fa1bd6de640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa1b80cf260 0x7fa1b81f55a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:47.342 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.349+0000 7fa1bd6de640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa1b815c140 0x7fa1b81f4a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:47.342 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.349+0000 7fa1bd6de640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1b80b5c00 con 0x7fa1b815c140 2024-02-21T22:52:47.342 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.349+0000 7fa1bd6de640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1b815c520 con 0x7fa1b80cecd0 2024-02-21T22:52:47.342 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.349+0000 7fa1bd6de640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1b80b5d80 con 0x7fa1b80cf260 2024-02-21T22:52:47.342 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.349+0000 7fa1b77fe640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa1b815c140 0x7fa1b81f4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:47.342 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.349+0000 7fa1b77fe640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa1b815c140 0x7fa1b81f4a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:50840/0 (socket says 172.21.15.116:50840) 2024-02-21T22:52:47.342 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.349+0000 7fa1b77fe640 1 -- 172.21.15.116:0/3682193093 learned_addr learned my addr 172.21.15.116:0/3682193093 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:52:47.342 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.349+0000 7fa1b6ffd640 1 --2- 172.21.15.116:0/3682193093 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa1b80cecd0 0x7fa1b80c5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:47.342 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.349+0000 7fa1b67fc640 1 --2- 172.21.15.116:0/3682193093 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa1b80cf260 0x7fa1b81f55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:47.342 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.349+0000 7fa1b77fe640 1 -- 172.21.15.116:0/3682193093 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa1b80cf260 msgr2=0x7fa1b81f55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:47.342 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.349+0000 7fa1b77fe640 1 --2- 172.21.15.116:0/3682193093 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa1b80cf260 0x7fa1b81f55a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:47.342 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.349+0000 7fa1b77fe640 1 -- 172.21.15.116:0/3682193093 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa1b80cecd0 msgr2=0x7fa1b80c5250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:47.342 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.349+0000 7fa1b77fe640 1 --2- 172.21.15.116:0/3682193093 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa1b80cecd0 0x7fa1b80c5250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:47.342 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.349+0000 7fa1b77fe640 1 -- 172.21.15.116:0/3682193093 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1b80c72f0 con 0x7fa1b815c140 2024-02-21T22:52:47.343 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.350+0000 7fa1b77fe640 1 --2- 172.21.15.116:0/3682193093 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa1b815c140 0x7fa1b81f4a90 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa1b000c3a0 tx=0x7fa1b000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:52:47.343 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.350+0000 7fa19f7fe640 1 -- 172.21.15.116:0/3682193093 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1b0017070 con 0x7fa1b815c140 2024-02-21T22:52:47.343 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.350+0000 7fa19f7fe640 1 -- 172.21.15.116:0/3682193093 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1b00052d0 con 0x7fa1b815c140 2024-02-21T22:52:47.343 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.350+0000 7fa1bd6de640 1 -- 172.21.15.116:0/3682193093 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1b80c5b80 con 0x7fa1b815c140 2024-02-21T22:52:47.343 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.350+0000 7fa19f7fe640 1 -- 172.21.15.116:0/3682193093 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1b0003830 con 0x7fa1b815c140 2024-02-21T22:52:47.343 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.350+0000 7fa1bd6de640 1 -- 172.21.15.116:0/3682193093 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1b80c7870 con 0x7fa1b815c140 2024-02-21T22:52:47.344 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.351+0000 7fa1bd6de640 1 -- 172.21.15.116:0/3682193093 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1b80752f0 con 0x7fa1b815c140 2024-02-21T22:52:47.344 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.351+0000 7fa19f7fe640 1 -- 172.21.15.116:0/3682193093 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fa1b001a070 con 0x7fa1b815c140 2024-02-21T22:52:47.344 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.352+0000 7fa19f7fe640 1 --2- 172.21.15.116:0/3682193093 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fa1a406b4d0 0x7fa1a406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:47.344 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.352+0000 7fa19f7fe640 1 -- 172.21.15.116:0/3682193093 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fa1b0089210 con 0x7fa1b815c140 2024-02-21T22:52:47.344 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.352+0000 7fa1b6ffd640 1 --2- 172.21.15.116:0/3682193093 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fa1a406b4d0 0x7fa1a406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:47.344 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.352+0000 7fa1b6ffd640 1 --2- 172.21.15.116:0/3682193093 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fa1a406b4d0 0x7fa1a406d990 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa1a8036000 tx=0x7fa1a8030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:52:47.346 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.356+0000 7fa19f7fe640 1 -- 172.21.15.116:0/3682193093 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7fa1b0057dc0 con 0x7fa1b815c140 2024-02-21T22:52:47.518 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.527+0000 7fa1bd6de640 1 -- 172.21.15.116:0/3682193093 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa1b80ce650 con 0x7fa1b815c140 2024-02-21T22:52:47.518 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.528+0000 7fa19f7fe640 1 -- 172.21.15.116:0/3682193093 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa1b005be60 con 0x7fa1b815c140 2024-02-21T22:52:47.519 INFO:teuthology.orchestra.run.smithi116.stdout:pg_num: 1 2024-02-21T22:52:47.521 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.530+0000 7fa1bd6de640 1 -- 172.21.15.116:0/3682193093 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fa1a406b4d0 msgr2=0x7fa1a406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:47.521 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.530+0000 7fa1bd6de640 1 --2- 172.21.15.116:0/3682193093 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fa1a406b4d0 0x7fa1a406d990 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa1a8036000 tx=0x7fa1a8030000 comp rx=0 tx=0).stop 2024-02-21T22:52:47.521 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.530+0000 7fa1bd6de640 1 -- 172.21.15.116:0/3682193093 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa1b815c140 msgr2=0x7fa1b81f4a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:47.521 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.530+0000 7fa1bd6de640 1 --2- 172.21.15.116:0/3682193093 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa1b815c140 0x7fa1b81f4a90 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa1b000c3a0 tx=0x7fa1b000c860 comp rx=0 tx=0).stop 2024-02-21T22:52:47.521 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.530+0000 7fa1bd6de640 1 -- 172.21.15.116:0/3682193093 shutdown_connections 2024-02-21T22:52:47.521 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.530+0000 7fa1bd6de640 1 --2- 172.21.15.116:0/3682193093 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa1b815c140 0x7fa1b81f4a90 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:47.521 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.530+0000 7fa1bd6de640 1 --2- 172.21.15.116:0/3682193093 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fa1a406b4d0 0x7fa1a406d990 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:47.521 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.530+0000 7fa1bd6de640 1 --2- 172.21.15.116:0/3682193093 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa1b80cf260 0x7fa1b81f55a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:47.522 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.530+0000 7fa1bd6de640 1 --2- 172.21.15.116:0/3682193093 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa1b80cecd0 0x7fa1b80c5250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:47.522 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.530+0000 7fa1bd6de640 1 -- 172.21.15.116:0/3682193093 >> 172.21.15.116:0/3682193093 conn(0x7fa1b80d1c90 msgr2=0x7fa1b80b2c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:52:47.522 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.530+0000 7fa1bd6de640 1 -- 172.21.15.116:0/3682193093 shutdown_connections 2024-02-21T22:52:47.522 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.530+0000 7fa1bd6de640 1 -- 172.21.15.116:0/3682193093 wait complete. 2024-02-21T22:52:47.531 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-02-21T22:52:47.631 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.641+0000 7f102c636640 1 Processor -- start 2024-02-21T22:52:47.632 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.641+0000 7f102c636640 1 -- start start 2024-02-21T22:52:47.635 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.642+0000 7f102c636640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f10240d0fc0 0x7f10240d1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:47.635 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.642+0000 7f102c636640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10240ce8f0 con 0x7f102415e560 2024-02-21T22:52:47.635 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.642+0000 7f102c636640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10240d1530 con 0x7f102415e180 2024-02-21T22:52:47.635 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.642+0000 7f102c636640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10240b31b0 con 0x7f10240d0fc0 2024-02-21T22:52:47.635 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.642+0000 7f1029bd1640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f102415e560 0x7f10240b0a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:56844/0 (socket says 172.21.15.116:56844) 2024-02-21T22:52:47.635 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.642+0000 7f1029bd1640 1 -- 172.21.15.116:0/563824314 learned_addr learned my addr 172.21.15.116:0/563824314 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-02-21T22:52:47.635 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.642+0000 7f10293d0640 1 -- 172.21.15.116:0/563824314 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4215079842 0 0) 0x7f1014001110 con 0x7f102415e560 2024-02-21T22:52:47.635 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.642+0000 7f10293d0640 1 -- 172.21.15.116:0/563824314 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1010003520 con 0x7f102415e560 2024-02-21T22:52:47.635 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.642+0000 7f10293d0640 1 -- 172.21.15.116:0/563824314 <== mon.0 v1:172.21.15.116:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2739183120 0 0) 0x7f1010003520 con 0x7f102415e560 2024-02-21T22:52:47.635 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.642+0000 7f10293d0640 1 -- 172.21.15.116:0/563824314 >> v2:172.21.15.142:3300/0 conn(0x7f10240d0fc0 msgr2=0x7f10240d1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:52:47.635 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.642+0000 7f10293d0640 1 --2- 172.21.15.116:0/563824314 >> v2:172.21.15.142:3300/0 conn(0x7f10240d0fc0 0x7f10240d1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:47.636 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.642+0000 7f10293d0640 1 -- 172.21.15.116:0/563824314 >> v1:172.21.15.142:6789/0 conn(0x7f102415e180 legacy=0x7f10240cf650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:52:47.636 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.642+0000 7f10293d0640 1 -- 172.21.15.116:0/563824314 --> v1:172.21.15.116:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10240ceb70 con 0x7f102415e560 2024-02-21T22:52:47.636 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.642+0000 7f10293d0640 1 -- 172.21.15.116:0/563824314 <== mon.0 v1:172.21.15.116:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1101981580 0 0) 0x7f1014001840 con 0x7f102415e560 2024-02-21T22:52:47.636 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.642+0000 7f10293d0640 1 -- 172.21.15.116:0/563824314 >> v1:172.21.15.116:6789/0 conn(0x7f102415e560 legacy=0x7f10240b0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:47.636 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.642+0000 7f10293d0640 1 --2- 172.21.15.116:0/563824314 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f10100039b0 0x7f1010003db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:47.636 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.642+0000 7f10293d0640 1 --2- 172.21.15.116:0/563824314 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1010004800 0x7f1010004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:47.636 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.642+0000 7f10293d0640 1 --2- 172.21.15.116:0/563824314 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f10100052e0 0x7f101000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:47.636 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.642+0000 7f10293d0640 1 -- 172.21.15.116:0/563824314 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10240b31b0 con 0x7f10100039b0 2024-02-21T22:52:47.636 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.642+0000 7f10293d0640 1 -- 172.21.15.116:0/563824314 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f101000c1e0 con 0x7f10100052e0 2024-02-21T22:52:47.636 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.642+0000 7f10293d0640 1 -- 172.21.15.116:0/563824314 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f101000c3e0 con 0x7f1010004800 2024-02-21T22:52:47.636 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.642+0000 7f102a3d2640 1 --2- 172.21.15.116:0/563824314 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f10100039b0 0x7f1010003db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:47.636 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.643+0000 7f102a3d2640 1 -- 172.21.15.116:0/563824314 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1010004800 msgr2=0x7f1010004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:52:47.636 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.643+0000 7f102a3d2640 1 --2- 172.21.15.116:0/563824314 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1010004800 0x7f1010004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:47.636 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.643+0000 7f102a3d2640 1 -- 172.21.15.116:0/563824314 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f10100052e0 msgr2=0x7f101000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:52:47.637 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.643+0000 7f102a3d2640 1 --2- 172.21.15.116:0/563824314 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f10100052e0 0x7f101000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:47.637 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.643+0000 7f102a3d2640 1 -- 172.21.15.116:0/563824314 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1010003520 con 0x7f10100039b0 2024-02-21T22:52:47.637 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.643+0000 7f102abd3640 1 -- 172.21.15.116:0/563824314 reap_dead start 2024-02-21T22:52:47.637 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.643+0000 7f102a3d2640 1 --2- 172.21.15.116:0/563824314 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f10100039b0 0x7f1010003db0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1020001620 tx=0x7f1010005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee5a3a3191dfed6f server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:52:47.637 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.643+0000 7f10293d0640 1 -- 172.21.15.116:0/563824314 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1020001220 con 0x7f10100039b0 2024-02-21T22:52:47.637 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.643+0000 7f10293d0640 1 -- 172.21.15.116:0/563824314 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1020005290 con 0x7f10100039b0 2024-02-21T22:52:47.637 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.643+0000 7f10293d0640 1 -- 172.21.15.116:0/563824314 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1020003850 con 0x7f10100039b0 2024-02-21T22:52:47.637 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.644+0000 7f102c636640 1 -- 172.21.15.116:0/563824314 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f10100039b0 msgr2=0x7f1010003db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:47.637 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.644+0000 7f102c636640 1 --2- 172.21.15.116:0/563824314 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f10100039b0 0x7f1010003db0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1020001620 tx=0x7f1010005830 comp rx=0 tx=0).stop 2024-02-21T22:52:47.637 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.644+0000 7f102c636640 1 -- 172.21.15.116:0/563824314 shutdown_connections 2024-02-21T22:52:47.637 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.644+0000 7f102c636640 1 --2- 172.21.15.116:0/563824314 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f10100039b0 0x7f1010003db0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:47.638 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.644+0000 7f102c636640 1 -- 172.21.15.116:0/563824314 >> 172.21.15.116:0/563824314 conn(0x7f10240d3de0 msgr2=0x7f10240d41f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:52:47.638 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.644+0000 7f102c636640 1 -- 172.21.15.116:0/563824314 shutdown_connections 2024-02-21T22:52:47.638 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.644+0000 7f102c636640 1 -- 172.21.15.116:0/563824314 wait complete. 2024-02-21T22:52:47.641 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.645+0000 7f102c636640 1 Processor -- start 2024-02-21T22:52:47.641 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.645+0000 7f102c636640 1 -- start start 2024-02-21T22:52:47.641 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.646+0000 7f102c636640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f10100039b0 0x7f10241f5470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:47.642 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.646+0000 7f102c636640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f10241f4250 0x7f102414d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:47.642 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.646+0000 7f102c636640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f102415eb80 0x7f10240c8f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:47.642 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.646+0000 7f102c636640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10240d1bc0 con 0x7f10100039b0 2024-02-21T22:52:47.642 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.646+0000 7f102c636640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10240cf1c0 con 0x7f10241f4250 2024-02-21T22:52:47.642 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.646+0000 7f102c636640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10240d1d40 con 0x7f102415eb80 2024-02-21T22:52:47.642 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.646+0000 7f102a3d2640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f10100039b0 0x7f10241f5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:47.642 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.646+0000 7f102a3d2640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f10100039b0 0x7f10241f5470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:50844/0 (socket says 172.21.15.116:50844) 2024-02-21T22:52:47.642 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.646+0000 7f102a3d2640 1 -- 172.21.15.116:0/2059411108 learned_addr learned my addr 172.21.15.116:0/2059411108 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:52:47.642 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.646+0000 7f102a3d2640 1 -- 172.21.15.116:0/2059411108 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f102415eb80 msgr2=0x7f10240c8f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:47.642 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.646+0000 7f102a3d2640 1 --2- 172.21.15.116:0/2059411108 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f102415eb80 0x7f10240c8f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:47.642 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.646+0000 7f102a3d2640 1 -- 172.21.15.116:0/2059411108 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f10241f4250 msgr2=0x7f102414d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:47.642 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.646+0000 7f102a3d2640 1 --2- 172.21.15.116:0/2059411108 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f10241f4250 0x7f102414d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:47.642 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.646+0000 7f102a3d2640 1 -- 172.21.15.116:0/2059411108 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10241f59b0 con 0x7f10100039b0 2024-02-21T22:52:47.642 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.646+0000 7f102a3d2640 1 --2- 172.21.15.116:0/2059411108 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f10100039b0 0x7f10241f5470 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f1020001740 tx=0x7f1020000fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:52:47.643 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.647+0000 7f101affd640 1 -- 172.21.15.116:0/2059411108 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1020038040 con 0x7f10100039b0 2024-02-21T22:52:47.643 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.647+0000 7f101affd640 1 -- 172.21.15.116:0/2059411108 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1020042070 con 0x7f10100039b0 2024-02-21T22:52:47.643 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.647+0000 7f102c636640 1 -- 172.21.15.116:0/2059411108 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f102414d750 con 0x7f10100039b0 2024-02-21T22:52:47.643 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.647+0000 7f101affd640 1 -- 172.21.15.116:0/2059411108 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10200074c0 con 0x7f10100039b0 2024-02-21T22:52:47.643 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.647+0000 7f102c636640 1 -- 172.21.15.116:0/2059411108 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10241f4b00 con 0x7f10100039b0 2024-02-21T22:52:47.643 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.648+0000 7f102c636640 1 -- 172.21.15.116:0/2059411108 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10240752f0 con 0x7f10100039b0 2024-02-21T22:52:47.644 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.648+0000 7f101affd640 1 -- 172.21.15.116:0/2059411108 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f10200067b0 con 0x7f10100039b0 2024-02-21T22:52:47.644 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.648+0000 7f101affd640 1 --2- 172.21.15.116:0/2059411108 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f100806b4d0 0x7f100806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:47.644 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.648+0000 7f101affd640 1 -- 172.21.15.116:0/2059411108 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f10200aad30 con 0x7f10100039b0 2024-02-21T22:52:47.644 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.649+0000 7f1029bd1640 1 --2- 172.21.15.116:0/2059411108 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f100806b4d0 0x7f100806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:47.644 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.649+0000 7f1029bd1640 1 --2- 172.21.15.116:0/2059411108 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f100806b4d0 0x7f100806d990 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f1014000fd0 tx=0x7f1014001270 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:52:47.644 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.653+0000 7f101affd640 1 -- 172.21.15.116:0/2059411108 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f102004b020 con 0x7f10100039b0 2024-02-21T22:52:47.816 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.825+0000 7f102c636640 1 -- 172.21.15.116:0/2059411108 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f10240ca940 con 0x7f10100039b0 2024-02-21T22:52:47.816 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.825+0000 7f101affd640 1 -- 172.21.15.116:0/2059411108 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) v1 ==== 84+0+65 (secure 0 0 0) 0x7f102414d750 con 0x7f10100039b0 2024-02-21T22:52:47.816 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-02-21T22:52:47.816 INFO:teuthology.orchestra.run.smithi116.stdout:[ 2024-02-21T22:52:47.816 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-02-21T22:52:47.816 INFO:teuthology.orchestra.run.smithi116.stdout: "poolnum": 1, 2024-02-21T22:52:47.816 INFO:teuthology.orchestra.run.smithi116.stdout: "poolname": ".mgr" 2024-02-21T22:52:47.817 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-02-21T22:52:47.817 INFO:teuthology.orchestra.run.smithi116.stdout:] 2024-02-21T22:52:47.818 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.827+0000 7f102c636640 1 -- 172.21.15.116:0/2059411108 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f100806b4d0 msgr2=0x7f100806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:47.818 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.827+0000 7f102c636640 1 --2- 172.21.15.116:0/2059411108 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f100806b4d0 0x7f100806d990 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f1014000fd0 tx=0x7f1014001270 comp rx=0 tx=0).stop 2024-02-21T22:52:47.818 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.827+0000 7f102c636640 1 -- 172.21.15.116:0/2059411108 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f10100039b0 msgr2=0x7f10241f5470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:47.818 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.827+0000 7f102c636640 1 --2- 172.21.15.116:0/2059411108 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f10100039b0 0x7f10241f5470 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f1020001740 tx=0x7f1020000fb0 comp rx=0 tx=0).stop 2024-02-21T22:52:47.818 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.827+0000 7f102c636640 1 -- 172.21.15.116:0/2059411108 shutdown_connections 2024-02-21T22:52:47.819 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.827+0000 7f102c636640 1 --2- 172.21.15.116:0/2059411108 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f100806b4d0 0x7f100806d990 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:47.819 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.827+0000 7f102c636640 1 --2- 172.21.15.116:0/2059411108 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f102415eb80 0x7f10240c8f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:47.819 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.827+0000 7f102c636640 1 --2- 172.21.15.116:0/2059411108 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f10241f4250 0x7f102414d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:47.819 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.827+0000 7f102c636640 1 --2- 172.21.15.116:0/2059411108 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f10100039b0 0x7f10241f5470 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:47.819 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.827+0000 7f102c636640 1 -- 172.21.15.116:0/2059411108 >> 172.21.15.116:0/2059411108 conn(0x7f10240d3de0 msgr2=0x7f10240b1fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:52:47.819 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.827+0000 7f102c636640 1 -- 172.21.15.116:0/2059411108 shutdown_connections 2024-02-21T22:52:47.819 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.827+0000 7f102c636640 1 -- 172.21.15.116:0/2059411108 wait complete. 2024-02-21T22:52:47.828 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-02-21T22:52:47.828 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-02-21T22:52:47.935 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.942+0000 7f90d6374640 1 Processor -- start 2024-02-21T22:52:47.935 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.942+0000 7f90d6374640 1 -- start start 2024-02-21T22:52:47.940 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.943+0000 7f90d6374640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f90d0161770 0x7f90d00aff10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:47.940 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.943+0000 7f90d6374640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f90d0071870 0x7f90d006ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:47.940 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.943+0000 7f90d6374640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90d006f080 con 0x7f90d00af9c0 2024-02-21T22:52:47.940 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.943+0000 7f90d6374640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90d006f680 con 0x7f90d0071870 2024-02-21T22:52:47.940 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.943+0000 7f90d6374640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90d006f3a0 con 0x7f90d0161770 2024-02-21T22:52:47.940 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.943+0000 7f90d4911640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f90d0071870 0x7f90d006ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:47.940 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.943+0000 7f90d4911640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f90d0071870 0x7f90d006ae40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:50858/0 (socket says 172.21.15.116:50858) 2024-02-21T22:52:47.940 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.943+0000 7f90d4911640 1 -- 172.21.15.116:0/275294440 learned_addr learned my addr 172.21.15.116:0/275294440 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:52:47.940 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.943+0000 7f90cffff640 1 --2- 172.21.15.116:0/275294440 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f90d0161770 0x7f90d00aff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:47.941 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.943+0000 7f90d4911640 1 -- 172.21.15.116:0/275294440 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f90d0161770 msgr2=0x7f90d00aff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:52:47.941 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.943+0000 7f90d4911640 1 --2- 172.21.15.116:0/275294440 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f90d0161770 0x7f90d00aff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:47.941 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.943+0000 7f90d4911640 1 -- 172.21.15.116:0/275294440 >> v1:172.21.15.142:6789/0 conn(0x7f90d00af9c0 legacy=0x7f90d00ce630 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-21T22:52:47.941 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.943+0000 7f90d4911640 1 -- 172.21.15.116:0/275294440 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90d0162960 con 0x7f90d0071870 2024-02-21T22:52:47.941 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.943+0000 7f90cffff640 1 --2- 172.21.15.116:0/275294440 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f90d0161770 0x7f90d00aff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T22:52:47.941 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.944+0000 7f90d4911640 1 --2- 172.21.15.116:0/275294440 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f90d0071870 0x7f90d006ae40 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f90c8009e50 tx=0x7f90c802be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf3c589fc8cee350 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:52:47.941 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.944+0000 7f90ceffd640 1 -- 172.21.15.116:0/275294440 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90c802c9e0 con 0x7f90d0071870 2024-02-21T22:52:47.941 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.944+0000 7f90ceffd640 1 -- 172.21.15.116:0/275294440 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90c802cb80 con 0x7f90d0071870 2024-02-21T22:52:47.941 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.944+0000 7f90ceffd640 1 -- 172.21.15.116:0/275294440 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90c80343f0 con 0x7f90d0071870 2024-02-21T22:52:47.941 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.944+0000 7f90d6374640 1 -- 172.21.15.116:0/275294440 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f90d0071870 msgr2=0x7f90d006ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:47.941 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.944+0000 7f90d6374640 1 --2- 172.21.15.116:0/275294440 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f90d0071870 0x7f90d006ae40 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f90c8009e50 tx=0x7f90c802be40 comp rx=0 tx=0).stop 2024-02-21T22:52:47.941 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.944+0000 7f90d6374640 1 -- 172.21.15.116:0/275294440 shutdown_connections 2024-02-21T22:52:47.941 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.944+0000 7f90d6374640 1 --2- 172.21.15.116:0/275294440 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f90d0071870 0x7f90d006ae40 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:47.941 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.944+0000 7f90d6374640 1 --2- 172.21.15.116:0/275294440 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f90d0161770 0x7f90d00aff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:47.942 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.944+0000 7f90d6374640 1 -- 172.21.15.116:0/275294440 >> 172.21.15.116:0/275294440 conn(0x7f90d00d0a60 msgr2=0x7f90d00d0e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:52:47.942 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.944+0000 7f90d6374640 1 -- 172.21.15.116:0/275294440 shutdown_connections 2024-02-21T22:52:47.942 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.944+0000 7f90d6374640 1 -- 172.21.15.116:0/275294440 wait complete. 2024-02-21T22:52:47.942 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.945+0000 7f90d6374640 1 Processor -- start 2024-02-21T22:52:47.942 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.946+0000 7f90d6374640 1 -- start start 2024-02-21T22:52:47.942 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.946+0000 7f90d6374640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f90d0071870 0x7f90d0158690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:47.942 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.946+0000 7f90d6374640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f90d00af9c0 0x7f90d01e8b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:47.942 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.946+0000 7f90d6374640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f90d0161770 0x7f90d0156b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:47.942 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.946+0000 7f90d6374640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90d0161b50 con 0x7f90d00af9c0 2024-02-21T22:52:47.942 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.946+0000 7f90d6374640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90d00d07c0 con 0x7f90d0071870 2024-02-21T22:52:47.942 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.946+0000 7f90d6374640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90d0071cc0 con 0x7f90d0161770 2024-02-21T22:52:47.942 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.946+0000 7f90cf7fe640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f90d00af9c0 0x7f90d01e8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:47.942 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.947+0000 7f90cf7fe640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f90d00af9c0 0x7f90d01e8b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:50872/0 (socket says 172.21.15.116:50872) 2024-02-21T22:52:47.942 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.947+0000 7f90cf7fe640 1 -- 172.21.15.116:0/551204581 learned_addr learned my addr 172.21.15.116:0/551204581 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:52:47.942 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.947+0000 7f90cf7fe640 1 -- 172.21.15.116:0/551204581 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f90d0161770 msgr2=0x7f90d0156b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:47.943 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.947+0000 7f90cf7fe640 1 --2- 172.21.15.116:0/551204581 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f90d0161770 0x7f90d0156b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:47.943 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.947+0000 7f90cf7fe640 1 -- 172.21.15.116:0/551204581 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f90d0071870 msgr2=0x7f90d0158690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:47.943 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.947+0000 7f90cf7fe640 1 --2- 172.21.15.116:0/551204581 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f90d0071870 0x7f90d0158690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:47.943 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.947+0000 7f90cf7fe640 1 -- 172.21.15.116:0/551204581 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90d0158f50 con 0x7f90d00af9c0 2024-02-21T22:52:47.943 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.947+0000 7f90cf7fe640 1 --2- 172.21.15.116:0/551204581 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f90d00af9c0 0x7f90d01e8b20 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f90c400b450 tx=0x7f90c400b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:52:47.943 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.947+0000 7f90ccff9640 1 -- 172.21.15.116:0/551204581 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90c4015020 con 0x7f90d00af9c0 2024-02-21T22:52:47.943 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.947+0000 7f90ccff9640 1 -- 172.21.15.116:0/551204581 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90c40118b0 con 0x7f90d00af9c0 2024-02-21T22:52:47.943 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.947+0000 7f90d6374640 1 -- 172.21.15.116:0/551204581 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90d015f680 con 0x7f90d00af9c0 2024-02-21T22:52:47.943 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.947+0000 7f90ccff9640 1 -- 172.21.15.116:0/551204581 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90c4011ca0 con 0x7f90d00af9c0 2024-02-21T22:52:47.943 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.947+0000 7f90d6374640 1 -- 172.21.15.116:0/551204581 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90d015fc40 con 0x7f90d00af9c0 2024-02-21T22:52:47.943 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.948+0000 7f90d6374640 1 -- 172.21.15.116:0/551204581 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90d015f470 con 0x7f90d00af9c0 2024-02-21T22:52:47.943 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.948+0000 7f90ccff9640 1 -- 172.21.15.116:0/551204581 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f90c4018020 con 0x7f90d00af9c0 2024-02-21T22:52:47.943 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.949+0000 7f90ccff9640 1 --2- 172.21.15.116:0/551204581 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f90bc06b4d0 0x7f90bc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:47.943 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.949+0000 7f90ccff9640 1 -- 172.21.15.116:0/551204581 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f90c408a0a0 con 0x7f90d00af9c0 2024-02-21T22:52:47.944 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.949+0000 7f90cffff640 1 --2- 172.21.15.116:0/551204581 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f90bc06b4d0 0x7f90bc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:47.944 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.949+0000 7f90cffff640 1 --2- 172.21.15.116:0/551204581 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f90bc06b4d0 0x7f90bc06d990 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f90c0006fd0 tx=0x7f90c0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:52:47.944 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:47.953+0000 7f90ccff9640 1 -- 172.21.15.116:0/551204581 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f90c401f020 con 0x7f90d00af9c0 2024-02-21T22:52:48.117 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:48.126+0000 7f90d6374640 1 -- 172.21.15.116:0/551204581 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f90d00752f0 con 0x7f90d00af9c0 2024-02-21T22:52:48.757 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:48.764+0000 7f90ccff9640 1 -- 172.21.15.116:0/551204581 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) v1 ==== 138+0+0 (secure 0 0 0) 0x7f90c400d040 con 0x7f90d00af9c0 2024-02-21T22:52:48.757 INFO:teuthology.orchestra.run.smithi116.stderr:pool 'cephfs_metadata' created 2024-02-21T22:52:48.758 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:48.767+0000 7f90d6374640 1 -- 172.21.15.116:0/551204581 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f90bc06b4d0 msgr2=0x7f90bc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:48.758 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:48.767+0000 7f90d6374640 1 --2- 172.21.15.116:0/551204581 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f90bc06b4d0 0x7f90bc06d990 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f90c0006fd0 tx=0x7f90c0008040 comp rx=0 tx=0).stop 2024-02-21T22:52:48.758 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:48.767+0000 7f90d6374640 1 -- 172.21.15.116:0/551204581 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f90d00af9c0 msgr2=0x7f90d01e8b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:48.758 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:48.767+0000 7f90d6374640 1 --2- 172.21.15.116:0/551204581 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f90d00af9c0 0x7f90d01e8b20 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f90c400b450 tx=0x7f90c400b910 comp rx=0 tx=0).stop 2024-02-21T22:52:48.758 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:48.767+0000 7f90d6374640 1 -- 172.21.15.116:0/551204581 shutdown_connections 2024-02-21T22:52:48.759 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:48.767+0000 7f90d6374640 1 --2- 172.21.15.116:0/551204581 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f90bc06b4d0 0x7f90bc06d990 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:48.759 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:48.767+0000 7f90d6374640 1 --2- 172.21.15.116:0/551204581 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f90d0161770 0x7f90d0156b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:48.759 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:48.767+0000 7f90d6374640 1 --2- 172.21.15.116:0/551204581 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f90d00af9c0 0x7f90d01e8b20 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:48.759 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:48.767+0000 7f90d6374640 1 --2- 172.21.15.116:0/551204581 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f90d0071870 0x7f90d0158690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:48.759 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:48.767+0000 7f90d6374640 1 -- 172.21.15.116:0/551204581 >> 172.21.15.116:0/551204581 conn(0x7f90d00d0a60 msgr2=0x7f90d00d0e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:52:48.759 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:48.768+0000 7f90d6374640 1 -- 172.21.15.116:0/551204581 shutdown_connections 2024-02-21T22:52:48.759 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:48.768+0000 7f90d6374640 1 -- 172.21.15.116:0/551204581 wait complete. 2024-02-21T22:52:48.773 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-02-21T22:52:48.883 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:48.892+0000 7fd16b155640 1 Processor -- start 2024-02-21T22:52:48.883 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:48.892+0000 7fd16b155640 1 -- start start 2024-02-21T22:52:48.885 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:48.893+0000 7fd16b155640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd164161f90 0x7fd16406cc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:48.885 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:48.893+0000 7fd16b155640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd164162370 0x7fd1640ceaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:48.885 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:48.893+0000 7fd16b155640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1640d1150 con 0x7fd16406d140 2024-02-21T22:52:48.885 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:48.893+0000 7fd16b155640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1640cf830 con 0x7fd164161f90 2024-02-21T22:52:48.886 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:48.893+0000 7fd16b155640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1640d0cc0 con 0x7fd164162370 2024-02-21T22:52:48.886 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:48.893+0000 7fd1696f2640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd164162370 0x7fd1640ceaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:48.886 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:48.893+0000 7fd168ef1640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd164161f90 0x7fd16406cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:48.886 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:48.893+0000 7fd168ef1640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd164161f90 0x7fd16406cc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.116:46584/0 (socket says 172.21.15.116:46584) 2024-02-21T22:52:48.886 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:48.893+0000 7fd1696f2640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd164162370 0x7fd1640ceaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.116:44150/0 (socket says 172.21.15.116:44150) 2024-02-21T22:52:48.886 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:48.893+0000 7fd163fff640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fd16406d140 0x7fd1640ce3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.116:49226/0 (socket says 172.21.15.116:49226) 2024-02-21T22:52:48.886 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:48.893+0000 7fd168ef1640 1 -- 172.21.15.116:0/2850111160 learned_addr learned my addr 172.21.15.116:0/2850111160 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:52:48.886 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:48.894+0000 7fd1696f2640 1 -- 172.21.15.116:0/2850111160 >> v2:172.21.15.142:3300/0 conn(0x7fd164161f90 msgr2=0x7fd16406cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:52:48.886 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:48.894+0000 7fd1696f2640 1 --2- 172.21.15.116:0/2850111160 >> v2:172.21.15.142:3300/0 conn(0x7fd164161f90 0x7fd16406cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:48.886 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:48.894+0000 7fd1696f2640 1 -- 172.21.15.116:0/2850111160 >> v1:172.21.15.142:6789/0 conn(0x7fd16406d140 legacy=0x7fd1640ce3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:48.887 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:48.894+0000 7fd1696f2640 1 -- 172.21.15.116:0/2850111160 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1640d00b0 con 0x7fd164162370 2024-02-21T22:52:48.887 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:48.894+0000 7fd168ef1640 1 --2- 172.21.15.116:0/2850111160 >> v2:172.21.15.142:3300/0 conn(0x7fd164161f90 0x7fd16406cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T22:52:48.887 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:48.895+0000 7fd1696f2640 1 --2- 172.21.15.116:0/2850111160 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd164162370 0x7fd1640ceaf0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fd15c009d90 tx=0x7fd15c02bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c11175d1be599996 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:52:48.887 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:48.895+0000 7fd1637fe640 1 -- 172.21.15.116:0/2850111160 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd15c039070 con 0x7fd164162370 2024-02-21T22:52:48.887 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:48.895+0000 7fd1637fe640 1 -- 172.21.15.116:0/2850111160 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd15c02cc50 con 0x7fd164162370 2024-02-21T22:52:48.887 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:48.895+0000 7fd1637fe640 1 -- 172.21.15.116:0/2850111160 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd15c034440 con 0x7fd164162370 2024-02-21T22:52:48.891 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:48.895+0000 7fd16b155640 1 -- 172.21.15.116:0/2850111160 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd164162370 msgr2=0x7fd1640ceaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:48.891 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:48.895+0000 7fd16b155640 1 --2- 172.21.15.116:0/2850111160 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd164162370 0x7fd1640ceaf0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fd15c009d90 tx=0x7fd15c02bea0 comp rx=0 tx=0).stop 2024-02-21T22:52:48.891 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:48.895+0000 7fd16b155640 1 -- 172.21.15.116:0/2850111160 shutdown_connections 2024-02-21T22:52:48.891 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:48.895+0000 7fd16b155640 1 --2- 172.21.15.116:0/2850111160 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd164162370 0x7fd1640ceaf0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:48.891 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:48.895+0000 7fd16b155640 1 --2- 172.21.15.116:0/2850111160 >> v2:172.21.15.142:3300/0 conn(0x7fd164161f90 0x7fd16406cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:48.892 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:48.895+0000 7fd16b155640 1 -- 172.21.15.116:0/2850111160 >> 172.21.15.116:0/2850111160 conn(0x7fd1640d1b60 msgr2=0x7fd1640d1f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:52:48.892 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:48.895+0000 7fd16b155640 1 -- 172.21.15.116:0/2850111160 shutdown_connections 2024-02-21T22:52:48.892 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:48.895+0000 7fd16b155640 1 -- 172.21.15.116:0/2850111160 wait complete. 2024-02-21T22:52:48.892 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:48.896+0000 7fd16b155640 1 Processor -- start 2024-02-21T22:52:48.892 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:48.896+0000 7fd16b155640 1 -- start start 2024-02-21T22:52:48.892 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:48.897+0000 7fd16b155640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd16406d140 0x7fd1641545b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:48.892 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:48.897+0000 7fd16b155640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd164161f90 0x7fd1640c9640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:48.892 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:48.897+0000 7fd16b155640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd164162370 0x7fd1640c7ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:48.892 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:48.897+0000 7fd16b155640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1640d0950 con 0x7fd164161f90 2024-02-21T22:52:48.892 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:48.897+0000 7fd16b155640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1640d0670 con 0x7fd164162370 2024-02-21T22:52:48.893 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:48.897+0000 7fd16b155640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1640cfda0 con 0x7fd16406d140 2024-02-21T22:52:48.893 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:48.897+0000 7fd163fff640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd164161f90 0x7fd1640c9640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:48.893 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:48.897+0000 7fd163fff640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd164161f90 0x7fd1640c9640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:50878/0 (socket says 172.21.15.116:50878) 2024-02-21T22:52:48.893 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:48.897+0000 7fd163fff640 1 -- 172.21.15.116:0/641275812 learned_addr learned my addr 172.21.15.116:0/641275812 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:52:48.893 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:48.898+0000 7fd168ef1640 1 --2- 172.21.15.116:0/641275812 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd16406d140 0x7fd1641545b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:48.893 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:48.898+0000 7fd1696f2640 1 --2- 172.21.15.116:0/641275812 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd164162370 0x7fd1640c7ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:48.893 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:48.898+0000 7fd163fff640 1 -- 172.21.15.116:0/641275812 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd16406d140 msgr2=0x7fd1641545b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:48.893 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:48.898+0000 7fd163fff640 1 --2- 172.21.15.116:0/641275812 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd16406d140 0x7fd1641545b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:48.893 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:48.898+0000 7fd163fff640 1 -- 172.21.15.116:0/641275812 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd164162370 msgr2=0x7fd1640c7ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:48.893 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:48.898+0000 7fd163fff640 1 --2- 172.21.15.116:0/641275812 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd164162370 0x7fd1640c7ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:48.893 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:48.898+0000 7fd163fff640 1 -- 172.21.15.116:0/641275812 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1640c9f40 con 0x7fd164161f90 2024-02-21T22:52:48.893 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:48.898+0000 7fd168ef1640 1 --2- 172.21.15.116:0/641275812 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd16406d140 0x7fd1641545b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T22:52:48.894 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:48.898+0000 7fd1696f2640 1 --2- 172.21.15.116:0/641275812 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd164162370 0x7fd1640c7ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T22:52:48.894 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:48.898+0000 7fd163fff640 1 --2- 172.21.15.116:0/641275812 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd164161f90 0x7fd1640c9640 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd15800c400 tx=0x7fd15800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:52:48.894 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:48.898+0000 7fd1617fa640 1 -- 172.21.15.116:0/641275812 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1580074e0 con 0x7fd164161f90 2024-02-21T22:52:48.894 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:48.898+0000 7fd1617fa640 1 -- 172.21.15.116:0/641275812 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd158007680 con 0x7fd164161f90 2024-02-21T22:52:48.894 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:48.898+0000 7fd16b155640 1 -- 172.21.15.116:0/641275812 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1640c57f0 con 0x7fd164161f90 2024-02-21T22:52:48.894 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:48.898+0000 7fd1617fa640 1 -- 172.21.15.116:0/641275812 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd158004a00 con 0x7fd164161f90 2024-02-21T22:52:48.894 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:48.898+0000 7fd16b155640 1 -- 172.21.15.116:0/641275812 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1640c9b80 con 0x7fd164161f90 2024-02-21T22:52:48.894 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:48.899+0000 7fd16b155640 1 -- 172.21.15.116:0/641275812 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1640752f0 con 0x7fd164161f90 2024-02-21T22:52:48.894 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:48.899+0000 7fd1617fa640 1 -- 172.21.15.116:0/641275812 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fd15801a020 con 0x7fd164161f90 2024-02-21T22:52:48.894 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:48.900+0000 7fd1617fa640 1 --2- 172.21.15.116:0/641275812 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fd15006b4d0 0x7fd15006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:48.894 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:48.900+0000 7fd1617fa640 1 -- 172.21.15.116:0/641275812 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5227+0+0 (secure 0 0 0) 0x7fd1580897b0 con 0x7fd164161f90 2024-02-21T22:52:48.894 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:48.900+0000 7fd168ef1640 1 --2- 172.21.15.116:0/641275812 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fd15006b4d0 0x7fd15006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:48.895 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:48.900+0000 7fd168ef1640 1 --2- 172.21.15.116:0/641275812 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fd15006b4d0 0x7fd15006d990 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd154009630 tx=0x7fd154008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:52:48.895 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:48.904+0000 7fd1617fa640 1 -- 172.21.15.116:0/641275812 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7fd1580588a0 con 0x7fd164161f90 2024-02-21T22:52:49.069 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:49.078+0000 7fd16b155640 1 -- 172.21.15.116:0/641275812 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fd16409f7a0 con 0x7fd164161f90 2024-02-21T22:52:49.761 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:49.771+0000 7fd1617fa640 1 -- 172.21.15.116:0/641275812 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v18) v1 ==== 170+0+0 (secure 0 0 0) 0x7fd1580581a0 con 0x7fd164161f90 2024-02-21T22:52:49.762 INFO:teuthology.orchestra.run.smithi116.stderr:pool 'cephfs_data' created 2024-02-21T22:52:49.765 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:49.774+0000 7fd16b155640 1 -- 172.21.15.116:0/641275812 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fd15006b4d0 msgr2=0x7fd15006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:49.765 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:49.774+0000 7fd16b155640 1 --2- 172.21.15.116:0/641275812 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fd15006b4d0 0x7fd15006d990 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd154009630 tx=0x7fd154008040 comp rx=0 tx=0).stop 2024-02-21T22:52:49.765 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:49.774+0000 7fd16b155640 1 -- 172.21.15.116:0/641275812 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd164161f90 msgr2=0x7fd1640c9640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:49.765 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:49.774+0000 7fd16b155640 1 --2- 172.21.15.116:0/641275812 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd164161f90 0x7fd1640c9640 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd15800c400 tx=0x7fd15800c8c0 comp rx=0 tx=0).stop 2024-02-21T22:52:49.765 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:49.774+0000 7fd16b155640 1 -- 172.21.15.116:0/641275812 shutdown_connections 2024-02-21T22:52:49.766 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:49.774+0000 7fd16b155640 1 --2- 172.21.15.116:0/641275812 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd164162370 0x7fd1640c7ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:49.766 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:49.774+0000 7fd16b155640 1 --2- 172.21.15.116:0/641275812 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd164161f90 0x7fd1640c9640 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:49.766 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:49.774+0000 7fd16b155640 1 --2- 172.21.15.116:0/641275812 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fd15006b4d0 0x7fd15006d990 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:49.766 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:49.774+0000 7fd16b155640 1 --2- 172.21.15.116:0/641275812 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd16406d140 0x7fd1641545b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:49.766 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:49.774+0000 7fd16b155640 1 -- 172.21.15.116:0/641275812 >> 172.21.15.116:0/641275812 conn(0x7fd1640d1b60 msgr2=0x7fd16415fd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:52:49.766 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:49.775+0000 7fd16b155640 1 -- 172.21.15.116:0/641275812 shutdown_connections 2024-02-21T22:52:49.766 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:49.775+0000 7fd16b155640 1 -- 172.21.15.116:0/641275812 wait complete. 2024-02-21T22:52:49.789 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-02-21T22:52:49.897 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:49.906+0000 7f7a33daa640 1 Processor -- start 2024-02-21T22:52:49.897 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:49.906+0000 7f7a33daa640 1 -- start start 2024-02-21T22:52:49.897 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:49.907+0000 7f7a33daa640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7a2c1456c0 0x7f7a2c0b2260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:49.897 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:49.907+0000 7f7a33daa640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f7a2c15f920 0x7f7a2c15fd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:49.898 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:49.907+0000 7f7a33daa640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a2c0b3c30 con 0x7f7a2c1602a0 2024-02-21T22:52:49.898 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:49.907+0000 7f7a33daa640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a2c0b3f10 con 0x7f7a2c15f920 2024-02-21T22:52:49.898 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:49.907+0000 7f7a33daa640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a2c0b41f0 con 0x7f7a2c1456c0 2024-02-21T22:52:49.899 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:49.907+0000 7f7a31345640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f7a2c15f920 0x7f7a2c15fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:49.899 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:49.907+0000 7f7a31b46640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7a2c1456c0 0x7f7a2c0b2260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:49.899 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:49.907+0000 7f7a32347640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f7a2c1602a0 0x7f7a2c0ce090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.116:49230/0 (socket says 172.21.15.116:49230) 2024-02-21T22:52:49.899 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:49.907+0000 7f7a31345640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f7a2c15f920 0x7f7a2c15fd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.116:46604/0 (socket says 172.21.15.116:46604) 2024-02-21T22:52:49.899 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:49.907+0000 7f7a32347640 1 -- 172.21.15.116:0/3028941927 learned_addr learned my addr 172.21.15.116:0/3028941927 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-02-21T22:52:49.899 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:49.907+0000 7f7a31b46640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7a2c1456c0 0x7f7a2c0b2260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.116:44172/0 (socket says 172.21.15.116:44172) 2024-02-21T22:52:49.899 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:49.908+0000 7f7a31b46640 1 -- 172.21.15.116:0/3028941927 >> v2:172.21.15.142:3300/0 conn(0x7f7a2c15f920 msgr2=0x7f7a2c15fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:52:49.900 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:49.908+0000 7f7a31b46640 1 --2- 172.21.15.116:0/3028941927 >> v2:172.21.15.142:3300/0 conn(0x7f7a2c15f920 0x7f7a2c15fd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:49.900 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:49.908+0000 7f7a31b46640 1 -- 172.21.15.116:0/3028941927 >> v1:172.21.15.142:6789/0 conn(0x7f7a2c1602a0 legacy=0x7f7a2c0ce090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:49.900 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:49.908+0000 7f7a31b46640 1 -- 172.21.15.116:0/3028941927 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a2c06cb10 con 0x7f7a2c1456c0 2024-02-21T22:52:49.900 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:49.908+0000 7f7a31345640 1 --2- 172.21.15.116:0/3028941927 >> v2:172.21.15.142:3300/0 conn(0x7f7a2c15f920 0x7f7a2c15fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T22:52:49.900 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:49.908+0000 7f7a31b46640 1 --2- 172.21.15.116:0/3028941927 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7a2c1456c0 0x7f7a2c0b2260 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f7a28009d90 tx=0x7f7a2802be10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d3c920bfa3e8df95 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:52:49.900 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:49.909+0000 7f7a30b44640 1 -- 172.21.15.116:0/3028941927 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a28039070 con 0x7f7a2c1456c0 2024-02-21T22:52:49.900 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:49.909+0000 7f7a30b44640 1 -- 172.21.15.116:0/3028941927 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a2802cbc0 con 0x7f7a2c1456c0 2024-02-21T22:52:49.900 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:49.909+0000 7f7a30b44640 1 -- 172.21.15.116:0/3028941927 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a28034440 con 0x7f7a2c1456c0 2024-02-21T22:52:49.903 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:49.909+0000 7f7a33daa640 1 -- 172.21.15.116:0/3028941927 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7a2c1456c0 msgr2=0x7f7a2c0b2260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:49.903 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:49.909+0000 7f7a33daa640 1 --2- 172.21.15.116:0/3028941927 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7a2c1456c0 0x7f7a2c0b2260 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f7a28009d90 tx=0x7f7a2802be10 comp rx=0 tx=0).stop 2024-02-21T22:52:49.903 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:49.909+0000 7f7a33daa640 1 -- 172.21.15.116:0/3028941927 shutdown_connections 2024-02-21T22:52:49.903 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:49.909+0000 7f7a33daa640 1 --2- 172.21.15.116:0/3028941927 >> v2:172.21.15.142:3300/0 conn(0x7f7a2c15f920 0x7f7a2c15fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:49.903 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:49.909+0000 7f7a33daa640 1 --2- 172.21.15.116:0/3028941927 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7a2c1456c0 0x7f7a2c0b2260 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:49.903 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:49.909+0000 7f7a33daa640 1 -- 172.21.15.116:0/3028941927 >> 172.21.15.116:0/3028941927 conn(0x7f7a2c0b1740 msgr2=0x7f7a2c0b1b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:52:49.903 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:49.909+0000 7f7a33daa640 1 -- 172.21.15.116:0/3028941927 shutdown_connections 2024-02-21T22:52:49.903 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:49.909+0000 7f7a33daa640 1 -- 172.21.15.116:0/3028941927 wait complete. 2024-02-21T22:52:49.903 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:49.910+0000 7f7a33daa640 1 Processor -- start 2024-02-21T22:52:49.903 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:49.910+0000 7f7a33daa640 1 -- start start 2024-02-21T22:52:49.903 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:49.911+0000 7f7a33daa640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7a2c1456c0 0x7f7a2c1f3220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:49.903 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:49.911+0000 7f7a33daa640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7a2c15f920 0x7f7a2c1f4270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:49.903 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:49.911+0000 7f7a33daa640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7a2c1602a0 0x7f7a2c0ce8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:49.904 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:49.911+0000 7f7a33daa640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a2c06e040 con 0x7f7a2c15f920 2024-02-21T22:52:49.904 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:49.911+0000 7f7a33daa640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a2c145aa0 con 0x7f7a2c1602a0 2024-02-21T22:52:49.904 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:49.911+0000 7f7a33daa640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a2c06e1c0 con 0x7f7a2c1456c0 2024-02-21T22:52:49.904 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:49.911+0000 7f7a31345640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7a2c15f920 0x7f7a2c1f4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:49.904 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:49.911+0000 7f7a31345640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7a2c15f920 0x7f7a2c1f4270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:50890/0 (socket says 172.21.15.116:50890) 2024-02-21T22:52:49.904 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:49.911+0000 7f7a31345640 1 -- 172.21.15.116:0/2092057691 learned_addr learned my addr 172.21.15.116:0/2092057691 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:52:49.904 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:49.911+0000 7f7a31b46640 1 --2- 172.21.15.116:0/2092057691 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7a2c1456c0 0x7f7a2c1f3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:49.904 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:49.911+0000 7f7a32347640 1 --2- 172.21.15.116:0/2092057691 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7a2c1602a0 0x7f7a2c0ce8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:49.904 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:49.911+0000 7f7a31345640 1 -- 172.21.15.116:0/2092057691 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7a2c1456c0 msgr2=0x7f7a2c1f3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:49.904 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:49.912+0000 7f7a31345640 1 --2- 172.21.15.116:0/2092057691 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7a2c1456c0 0x7f7a2c1f3220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:49.904 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:49.912+0000 7f7a31345640 1 -- 172.21.15.116:0/2092057691 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7a2c1602a0 msgr2=0x7f7a2c0ce8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:49.904 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:49.912+0000 7f7a31345640 1 --2- 172.21.15.116:0/2092057691 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7a2c1602a0 0x7f7a2c0ce8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:49.904 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:49.912+0000 7f7a31345640 1 -- 172.21.15.116:0/2092057691 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a2c1f7130 con 0x7f7a2c15f920 2024-02-21T22:52:49.905 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:49.912+0000 7f7a31345640 1 --2- 172.21.15.116:0/2092057691 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7a2c15f920 0x7f7a2c1f4270 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7a1c00ebe0 tx=0x7f7a1c00c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:52:49.905 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:49.912+0000 7f7a227fc640 1 -- 172.21.15.116:0/2092057691 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a1c017070 con 0x7f7a2c15f920 2024-02-21T22:52:49.905 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:49.912+0000 7f7a227fc640 1 -- 172.21.15.116:0/2092057691 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a1c00cc30 con 0x7f7a2c15f920 2024-02-21T22:52:49.905 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:49.912+0000 7f7a227fc640 1 -- 172.21.15.116:0/2092057691 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a1c013470 con 0x7f7a2c15f920 2024-02-21T22:52:49.905 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:49.912+0000 7f7a33daa640 1 -- 172.21.15.116:0/2092057691 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a2c1f7410 con 0x7f7a2c15f920 2024-02-21T22:52:49.905 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:49.912+0000 7f7a33daa640 1 -- 172.21.15.116:0/2092057691 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a2c1f79d0 con 0x7f7a2c15f920 2024-02-21T22:52:49.906 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:49.913+0000 7f7a33daa640 1 -- 172.21.15.116:0/2092057691 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a2c0752f0 con 0x7f7a2c15f920 2024-02-21T22:52:49.906 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:49.913+0000 7f7a227fc640 1 -- 172.21.15.116:0/2092057691 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f7a1c01a070 con 0x7f7a2c15f920 2024-02-21T22:52:49.906 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:49.914+0000 7f7a227fc640 1 --2- 172.21.15.116:0/2092057691 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f7a1006b4d0 0x7f7a1006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:49.906 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:49.914+0000 7f7a227fc640 1 -- 172.21.15.116:0/2092057691 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f7a1c08a3f0 con 0x7f7a2c15f920 2024-02-21T22:52:49.906 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:49.914+0000 7f7a31b46640 1 --2- 172.21.15.116:0/2092057691 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f7a1006b4d0 0x7f7a1006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:49.906 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:49.915+0000 7f7a31b46640 1 --2- 172.21.15.116:0/2092057691 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f7a1006b4d0 0x7f7a1006d990 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7a28036000 tx=0x7f7a28030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:52:49.909 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:49.918+0000 7f7a227fc640 1 -- 172.21.15.116:0/2092057691 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f7a1c058c80 con 0x7f7a2c15f920 2024-02-21T22:52:50.117 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:50.127+0000 7f7a33daa640 1 -- 172.21.15.116:0/2092057691 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f7a2c074a90 con 0x7f7a2c15f920 2024-02-21T22:52:50.778 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:50.787+0000 7f7a227fc640 1 -- 172.21.15.116:0/2092057691 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f7a1c05cd20 con 0x7f7a2c15f920 2024-02-21T22:52:50.778 INFO:teuthology.orchestra.run.smithi116.stderr:new fs with metadata pool 2 and data pool 3 2024-02-21T22:52:50.784 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:50.793+0000 7f7a33daa640 1 -- 172.21.15.116:0/2092057691 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f7a1006b4d0 msgr2=0x7f7a1006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:50.784 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:50.793+0000 7f7a33daa640 1 --2- 172.21.15.116:0/2092057691 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f7a1006b4d0 0x7f7a1006d990 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7a28036000 tx=0x7f7a28030000 comp rx=0 tx=0).stop 2024-02-21T22:52:50.785 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:50.793+0000 7f7a33daa640 1 -- 172.21.15.116:0/2092057691 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7a2c15f920 msgr2=0x7f7a2c1f4270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:50.785 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:50.793+0000 7f7a33daa640 1 --2- 172.21.15.116:0/2092057691 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7a2c15f920 0x7f7a2c1f4270 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7a1c00ebe0 tx=0x7f7a1c00c520 comp rx=0 tx=0).stop 2024-02-21T22:52:50.785 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:50.793+0000 7f7a33daa640 1 -- 172.21.15.116:0/2092057691 shutdown_connections 2024-02-21T22:52:50.785 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:50.793+0000 7f7a33daa640 1 --2- 172.21.15.116:0/2092057691 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7a2c1602a0 0x7f7a2c0ce8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:50.785 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:50.793+0000 7f7a33daa640 1 --2- 172.21.15.116:0/2092057691 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7a2c15f920 0x7f7a2c1f4270 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:50.785 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:50.793+0000 7f7a33daa640 1 --2- 172.21.15.116:0/2092057691 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f7a1006b4d0 0x7f7a1006d990 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:50.786 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:50.793+0000 7f7a33daa640 1 --2- 172.21.15.116:0/2092057691 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7a2c1456c0 0x7f7a2c1f3220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:50.786 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:50.793+0000 7f7a33daa640 1 -- 172.21.15.116:0/2092057691 >> 172.21.15.116:0/2092057691 conn(0x7f7a2c0b1740 msgr2=0x7f7a2c142fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:52:50.786 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:50.793+0000 7f7a33daa640 1 -- 172.21.15.116:0/2092057691 shutdown_connections 2024-02-21T22:52:50.786 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:50.794+0000 7f7a33daa640 1 -- 172.21.15.116:0/2092057691 wait complete. 2024-02-21T22:52:50.804 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-21T22:52:50.908 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:50.918+0000 7f616de05640 1 Processor -- start 2024-02-21T22:52:50.909 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:50.918+0000 7f616de05640 1 -- start start 2024-02-21T22:52:50.916 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:50.919+0000 7f616de05640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f6168160530 0x7f61680cfcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:50.916 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:50.919+0000 7f616de05640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61680b26d0 con 0x7f616815c190 2024-02-21T22:52:50.917 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:50.919+0000 7f616de05640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61680b29b0 con 0x7f61680cc990 2024-02-21T22:52:50.917 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:50.919+0000 7f616de05640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61680b2d50 con 0x7f6168160530 2024-02-21T22:52:50.917 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:50.919+0000 7f61677fe640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f616815c190 0x7f616815fe20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:56846/0 (socket says 172.21.15.116:56846) 2024-02-21T22:52:50.917 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:50.919+0000 7f61677fe640 1 -- 172.21.15.116:0/327011548 learned_addr learned my addr 172.21.15.116:0/327011548 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-02-21T22:52:50.917 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:50.919+0000 7f615ffff640 1 --2- 172.21.15.116:0/327011548 >> v2:172.21.15.142:3300/0 conn(0x7f6168160530 0x7f61680cfcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:50.917 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:50.919+0000 7f6166ffd640 1 -- 172.21.15.116:0/327011548 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 134666222 0 0) 0x7f61680b26d0 con 0x7f616815c190 2024-02-21T22:52:50.917 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:50.919+0000 7f6166ffd640 1 -- 172.21.15.116:0/327011548 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6154003520 con 0x7f616815c190 2024-02-21T22:52:50.917 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:50.919+0000 7f6166ffd640 1 -- 172.21.15.116:0/327011548 <== mon.0 v1:172.21.15.116:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3856527123 0 0) 0x7f6154003520 con 0x7f616815c190 2024-02-21T22:52:50.917 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:50.919+0000 7f6166ffd640 1 -- 172.21.15.116:0/327011548 >> v2:172.21.15.142:3300/0 conn(0x7f6168160530 msgr2=0x7f61680cfcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:52:50.917 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:50.919+0000 7f6166ffd640 1 --2- 172.21.15.116:0/327011548 >> v2:172.21.15.142:3300/0 conn(0x7f6168160530 0x7f61680cfcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:50.917 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:50.919+0000 7f6166ffd640 1 -- 172.21.15.116:0/327011548 >> v1:172.21.15.142:6789/0 conn(0x7f61680cc990 legacy=0x7f61680ce520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:50.917 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:50.919+0000 7f6166ffd640 1 -- 172.21.15.116:0/327011548 --> v1:172.21.15.116:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61680b2fa0 con 0x7f616815c190 2024-02-21T22:52:50.917 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:50.919+0000 7f6166ffd640 1 -- 172.21.15.116:0/327011548 <== mon.0 v1:172.21.15.116:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1101981580 0 0) 0x7f6158001670 con 0x7f616815c190 2024-02-21T22:52:50.917 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:50.919+0000 7f6166ffd640 1 -- 172.21.15.116:0/327011548 >> v1:172.21.15.116:6789/0 conn(0x7f616815c190 legacy=0x7f616815fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:50.918 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:50.919+0000 7f6166ffd640 1 --2- 172.21.15.116:0/327011548 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f61540039b0 0x7f6154003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:50.918 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:50.919+0000 7f6166ffd640 1 --2- 172.21.15.116:0/327011548 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f61540043b0 0x7f6154004880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:50.918 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:50.919+0000 7f6166ffd640 1 --2- 172.21.15.116:0/327011548 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6154005080 0x7f615400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:50.918 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:50.919+0000 7f6166ffd640 1 -- 172.21.15.116:0/327011548 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61680b2d50 con 0x7f61540039b0 2024-02-21T22:52:50.918 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:50.919+0000 7f6166ffd640 1 -- 172.21.15.116:0/327011548 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f615400bfe0 con 0x7f6154005080 2024-02-21T22:52:50.918 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:50.919+0000 7f6166ffd640 1 -- 172.21.15.116:0/327011548 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f615400c1e0 con 0x7f61540043b0 2024-02-21T22:52:50.918 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:50.919+0000 7f61677fe640 1 --2- 172.21.15.116:0/327011548 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f61540039b0 0x7f6154003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:50.918 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:50.919+0000 7f6167fff640 1 --2- 172.21.15.116:0/327011548 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6154005080 0x7f615400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:50.918 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:50.919+0000 7f615ffff640 1 --2- 172.21.15.116:0/327011548 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f61540043b0 0x7f6154004880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:50.918 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:50.920+0000 7f61677fe640 1 -- 172.21.15.116:0/327011548 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f61540043b0 msgr2=0x7f6154004880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:52:50.918 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:50.920+0000 7f61677fe640 1 --2- 172.21.15.116:0/327011548 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f61540043b0 0x7f6154004880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:50.918 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:50.920+0000 7f61677fe640 1 -- 172.21.15.116:0/327011548 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6154005080 msgr2=0x7f615400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:52:50.918 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:50.920+0000 7f61677fe640 1 --2- 172.21.15.116:0/327011548 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6154005080 0x7f615400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:50.918 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:50.920+0000 7f6167fff640 1 -- 172.21.15.116:0/327011548 reap_dead start 2024-02-21T22:52:50.918 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:50.920+0000 7f61677fe640 1 -- 172.21.15.116:0/327011548 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6154003520 con 0x7f61540039b0 2024-02-21T22:52:50.919 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:50.920+0000 7f615ffff640 1 --2- 172.21.15.116:0/327011548 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f61540043b0 0x7f6154004880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T22:52:50.919 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:50.920+0000 7f61677fe640 1 --2- 172.21.15.116:0/327011548 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f61540039b0 0x7f6154003d90 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f615800c190 tx=0x7f6154005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cfdeb2350ba88bf server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:52:50.919 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:50.920+0000 7f6166ffd640 1 -- 172.21.15.116:0/327011548 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6158007cc0 con 0x7f61540039b0 2024-02-21T22:52:50.919 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:50.920+0000 7f6166ffd640 1 -- 172.21.15.116:0/327011548 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6158030070 con 0x7f61540039b0 2024-02-21T22:52:50.919 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:50.920+0000 7f6166ffd640 1 -- 172.21.15.116:0/327011548 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6158005d50 con 0x7f61540039b0 2024-02-21T22:52:50.919 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:50.921+0000 7f616de05640 1 -- 172.21.15.116:0/327011548 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f61540039b0 msgr2=0x7f6154003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:50.919 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:50.921+0000 7f616de05640 1 --2- 172.21.15.116:0/327011548 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f61540039b0 0x7f6154003d90 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f615800c190 tx=0x7f6154005830 comp rx=0 tx=0).stop 2024-02-21T22:52:50.919 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:50.921+0000 7f616de05640 1 -- 172.21.15.116:0/327011548 shutdown_connections 2024-02-21T22:52:50.919 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:50.921+0000 7f616de05640 1 --2- 172.21.15.116:0/327011548 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f61540039b0 0x7f6154003d90 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:50.919 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:50.921+0000 7f616de05640 1 -- 172.21.15.116:0/327011548 >> 172.21.15.116:0/327011548 conn(0x7f61680d1be0 msgr2=0x7f61680d1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:52:50.919 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:50.921+0000 7f616de05640 1 -- 172.21.15.116:0/327011548 shutdown_connections 2024-02-21T22:52:50.919 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:50.921+0000 7f616de05640 1 -- 172.21.15.116:0/327011548 wait complete. 2024-02-21T22:52:50.919 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:50.922+0000 7f616de05640 1 Processor -- start 2024-02-21T22:52:50.920 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:50.922+0000 7f616de05640 1 -- start start 2024-02-21T22:52:50.920 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:50.923+0000 7f616de05640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f61540039b0 0x7f61681588c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:50.920 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:50.923+0000 7f616de05640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f61680b4870 0x7f61680b6f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:50.920 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:50.923+0000 7f616de05640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f61681f3410 0x7f616815ea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:50.920 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:50.923+0000 7f616de05640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61680b3310 con 0x7f61680b4870 2024-02-21T22:52:50.920 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:50.923+0000 7f616de05640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f616815c780 con 0x7f61681f3410 2024-02-21T22:52:50.920 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:50.923+0000 7f616de05640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61680d28d0 con 0x7f61540039b0 2024-02-21T22:52:50.920 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:50.923+0000 7f615ffff640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f61680b4870 0x7f61680b6f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:50.921 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:50.923+0000 7f615ffff640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f61680b4870 0x7f61680b6f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:50908/0 (socket says 172.21.15.116:50908) 2024-02-21T22:52:50.921 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:50.923+0000 7f615ffff640 1 -- 172.21.15.116:0/1238724264 learned_addr learned my addr 172.21.15.116:0/1238724264 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:52:50.921 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:50.923+0000 7f615ffff640 1 -- 172.21.15.116:0/1238724264 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f61540039b0 msgr2=0x7f61681588c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:50.921 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:50.923+0000 7f615ffff640 1 --2- 172.21.15.116:0/1238724264 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f61540039b0 0x7f61681588c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:50.921 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:50.923+0000 7f615ffff640 1 -- 172.21.15.116:0/1238724264 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f61681f3410 msgr2=0x7f616815ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:50.921 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:50.923+0000 7f615ffff640 1 --2- 172.21.15.116:0/1238724264 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f61681f3410 0x7f616815ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:50.921 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:50.923+0000 7f615ffff640 1 -- 172.21.15.116:0/1238724264 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6168157b00 con 0x7f61680b4870 2024-02-21T22:52:50.921 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:50.923+0000 7f615ffff640 1 --2- 172.21.15.116:0/1238724264 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f61680b4870 0x7f61680b6f10 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f6150011510 tx=0x7f61500119d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:52:50.921 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:50.923+0000 7f6164ff9640 1 -- 172.21.15.116:0/1238724264 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6150015870 con 0x7f61680b4870 2024-02-21T22:52:50.921 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:50.924+0000 7f6164ff9640 1 -- 172.21.15.116:0/1238724264 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6150015a10 con 0x7f61680b4870 2024-02-21T22:52:50.921 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:50.924+0000 7f616de05640 1 -- 172.21.15.116:0/1238724264 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6168157de0 con 0x7f61680b4870 2024-02-21T22:52:50.922 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:50.924+0000 7f6164ff9640 1 -- 172.21.15.116:0/1238724264 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6150015e00 con 0x7f61680b4870 2024-02-21T22:52:50.922 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:50.924+0000 7f616de05640 1 -- 172.21.15.116:0/1238724264 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61681583a0 con 0x7f61680b4870 2024-02-21T22:52:50.922 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:50.924+0000 7f616de05640 1 -- 172.21.15.116:0/1238724264 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61680752f0 con 0x7f61680b4870 2024-02-21T22:52:50.922 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:50.925+0000 7f6164ff9640 1 -- 172.21.15.116:0/1238724264 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f615001d400 con 0x7f61680b4870 2024-02-21T22:52:50.922 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:50.925+0000 7f6164ff9640 1 --2- 172.21.15.116:0/1238724264 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f614806b4d0 0x7f614806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:50.922 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:50.925+0000 7f6164ff9640 1 -- 172.21.15.116:0/1238724264 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f615008a960 con 0x7f61680b4870 2024-02-21T22:52:50.922 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:50.926+0000 7f61677fe640 1 --2- 172.21.15.116:0/1238724264 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f614806b4d0 0x7f614806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:50.922 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:50.926+0000 7f61677fe640 1 --2- 172.21.15.116:0/1238724264 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f614806b4d0 0x7f614806d990 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f6158034000 tx=0x7f6158007000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:52:50.922 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:50.929+0000 7f6164ff9640 1 -- 172.21.15.116:0/1238724264 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f6150019030 con 0x7f61680b4870 2024-02-21T22:52:51.093 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.103+0000 7f616de05640 1 -- 172.21.15.116:0/1238724264 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f61680b7b60 con 0x7f61680b4870 2024-02-21T22:52:51.094 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.104+0000 7f6164ff9640 1 -- 172.21.15.116:0/1238724264 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+16666 (secure 0 0 0) 0x7f61500597e0 con 0x7f61680b4870 2024-02-21T22:52:51.095 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-02-21T22:52:51.095 INFO:teuthology.orchestra.run.smithi116.stdout:{"epoch":19,"fsid":"7c298660-5f63-4b5c-a800-58c5be9a8445","created":"2024-02-21T22:52:25.994613+0000","modified":"2024-02-21T22:52:50.128391+0000","last_up_change":"2024-02-21T22:52:37.313595+0000","last_in_change":"2024-02-21T22:52:28.176031+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-21T22:52:38.328796+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-21T22:52:48.145152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-21T22:52:49.096955+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4f09126b-b5e4-4876-8b08-f5cbb967388a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":1613202231},{"type":"v1","addr":"172.21.15.116:6809","nonce":1613202231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":1613202231},{"type":"v1","addr":"172.21.15.116:6811","nonce":1613202231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":1613202231},{"type":"v1","addr":"172.21.15.116:6815","nonce":1613202231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":1613202231},{"type":"v1","addr":"172.21.15.116:6813","nonce":1613202231}]},"public_addr":"172.21.15.116:6809/1613202231","cluster_addr":"172.21.15.116:6811/1613202231","heartbeat_back_addr":"172.21.15.116:6815/1613202231","heartbeat_front_addr":"172.21.15.116:6813/1613202231","state":["exists","up"]},{"osd":1,"uuid":"7272c51d-51f9-4536-931d-33ad7a4b377e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6816","nonce":172614746},{"type":"v1","addr":"172.21.15.116:6817","nonce":172614746}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":172614746},{"type":"v1","addr":"172.21.15.116:6819","nonce":172614746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":172614746},{"type":"v1","addr":"172.21.15.116:6823","nonce":172614746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":172614746},{"type":"v1","addr":"172.21.15.116:6821","nonce":172614746}]},"public_addr":"172.21.15.116:6817/172614746","cluster_addr":"172.21.15.116:6819/172614746","heartbeat_back_addr":"172.21.15.116:6823/172614746","heartbeat_front_addr":"172.21.15.116:6821/172614746","state":["exists","up"]},{"osd":2,"uuid":"2589616c-adf1-4187-aac3-735256cf624b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":1029280577},{"type":"v1","addr":"172.21.15.116:6825","nonce":1029280577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":1029280577},{"type":"v1","addr":"172.21.15.116:6827","nonce":1029280577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":1029280577},{"type":"v1","addr":"172.21.15.116:6831","nonce":1029280577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":1029280577},{"type":"v1","addr":"172.21.15.116:6829","nonce":1029280577}]},"public_addr":"172.21.15.116:6825/1029280577","cluster_addr":"172.21.15.116:6827/1029280577","heartbeat_back_addr":"172.21.15.116:6831/1029280577","heartbeat_front_addr":"172.21.15.116:6829/1029280577","state":["exists","up"]},{"osd":3,"uuid":"0fd2e563-7c5b-46f6-82c2-b60c86072c93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":3106627557},{"type":"v1","addr":"172.21.15.116:6801","nonce":3106627557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":3106627557},{"type":"v1","addr":"172.21.15.116:6803","nonce":3106627557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":3106627557},{"type":"v1","addr":"172.21.15.116:6807","nonce":3106627557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":3106627557},{"type":"v1","addr":"172.21.15.116:6805","nonce":3106627557}]},"public_addr":"172.21.15.116:6801/3106627557","cluster_addr":"172.21.15.116:6803/3106627557","heartbeat_back_addr":"172.21.15.116:6807/3106627557","heartbeat_front_addr":"172.21.15.116:6805/3106627557","state":["exists","up"]},{"osd":4,"uuid":"79ae35b7-dda8-4ab8-96ce-47515afde082","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":3231407772},{"type":"v1","addr":"172.21.15.142:6825","nonce":3231407772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":3231407772},{"type":"v1","addr":"172.21.15.142:6827","nonce":3231407772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":3231407772},{"type":"v1","addr":"172.21.15.142:6831","nonce":3231407772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":3231407772},{"type":"v1","addr":"172.21.15.142:6829","nonce":3231407772}]},"public_addr":"172.21.15.142:6825/3231407772","cluster_addr":"172.21.15.142:6827/3231407772","heartbeat_back_addr":"172.21.15.142:6831/3231407772","heartbeat_front_addr":"172.21.15.142:6829/3231407772","state":["exists","up"]},{"osd":5,"uuid":"3166eb2c-3fcf-41c8-9362-45bafaabaa39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":1184158716},{"type":"v1","addr":"172.21.15.142:6817","nonce":1184158716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":1184158716},{"type":"v1","addr":"172.21.15.142:6819","nonce":1184158716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":1184158716},{"type":"v1","addr":"172.21.15.142:6823","nonce":1184158716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":1184158716},{"type":"v1","addr":"172.21.15.142:6821","nonce":1184158716}]},"public_addr":"172.21.15.142:6817/1184158716","cluster_addr":"172.21.15.142:6819/1184158716","heartbeat_back_addr":"172.21.15.142:6823/1184158716","heartbeat_front_addr":"172.21.15.142:6821/1184158716","state":["exists","up"]},{"osd":6,"uuid":"f9aa9672-7527-43e2-963e-b61868e5e63f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":1987868911},{"type":"v1","addr":"172.21.15.142:6801","nonce":1987868911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":1987868911},{"type":"v1","addr":"172.21.15.142:6803","nonce":1987868911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":1987868911},{"type":"v1","addr":"172.21.15.142:6807","nonce":1987868911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":1987868911},{"type":"v1","addr":"172.21.15.142:6805","nonce":1987868911}]},"public_addr":"172.21.15.142:6801/1987868911","cluster_addr":"172.21.15.142:6803/1987868911","heartbeat_back_addr":"172.21.15.142:6807/1987868911","heartbeat_front_addr":"172.21.15.142:6805/1987868911","state":["exists","up"]},{"osd":7,"uuid":"7ed29226-fc42-4382-a91a-fa50f7ec5426","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":1272081937},{"type":"v1","addr":"172.21.15.142:6809","nonce":1272081937}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":1272081937},{"type":"v1","addr":"172.21.15.142:6811","nonce":1272081937}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":1272081937},{"type":"v1","addr":"172.21.15.142:6815","nonce":1272081937}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":1272081937},{"type":"v1","addr":"172.21.15.142:6813","nonce":1272081937}]},"public_addr":"172.21.15.142:6809/1272081937","cluster_addr":"172.21.15.142:6811/1272081937","heartbeat_back_addr":"172.21.15.142:6815/1272081937","heartbeat_front_addr":"172.21.15.142:6813/1272081937","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.350998+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.307201+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.289112+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.243888+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.312091+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.370472+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.275659+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.289297+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-21T22:52:51.097 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.106+0000 7f616de05640 1 -- 172.21.15.116:0/1238724264 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f614806b4d0 msgr2=0x7f614806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:51.097 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.106+0000 7f616de05640 1 --2- 172.21.15.116:0/1238724264 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f614806b4d0 0x7f614806d990 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f6158034000 tx=0x7f6158007000 comp rx=0 tx=0).stop 2024-02-21T22:52:51.097 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.106+0000 7f616de05640 1 -- 172.21.15.116:0/1238724264 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f61680b4870 msgr2=0x7f61680b6f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:51.097 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.106+0000 7f616de05640 1 --2- 172.21.15.116:0/1238724264 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f61680b4870 0x7f61680b6f10 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f6150011510 tx=0x7f61500119d0 comp rx=0 tx=0).stop 2024-02-21T22:52:51.097 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.106+0000 7f616de05640 1 -- 172.21.15.116:0/1238724264 shutdown_connections 2024-02-21T22:52:51.097 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.106+0000 7f616de05640 1 --2- 172.21.15.116:0/1238724264 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f61681f3410 0x7f616815ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:51.097 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.106+0000 7f616de05640 1 --2- 172.21.15.116:0/1238724264 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f61680b4870 0x7f61680b6f10 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:51.097 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.106+0000 7f616de05640 1 --2- 172.21.15.116:0/1238724264 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f614806b4d0 0x7f614806d990 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:51.097 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.106+0000 7f616de05640 1 --2- 172.21.15.116:0/1238724264 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f61540039b0 0x7f61681588c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:51.097 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.106+0000 7f616de05640 1 -- 172.21.15.116:0/1238724264 >> 172.21.15.116:0/1238724264 conn(0x7f61680d1be0 msgr2=0x7f61680d0470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:52:51.097 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.106+0000 7f616de05640 1 -- 172.21.15.116:0/1238724264 shutdown_connections 2024-02-21T22:52:51.098 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.106+0000 7f616de05640 1 -- 172.21.15.116:0/1238724264 wait complete. 2024-02-21T22:52:51.108 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-21T22:52:51.208 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.217+0000 7fde65f5e640 1 Processor -- start 2024-02-21T22:52:51.208 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.217+0000 7fde65f5e640 1 -- start start 2024-02-21T22:52:51.209 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.218+0000 7fde65f5e640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fde60070b70 0x7fde60071580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:51.209 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.218+0000 7fde65f5e640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde600710e0 con 0x7fde60071ac0 2024-02-21T22:52:51.210 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.218+0000 7fde65f5e640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde600b2d80 con 0x7fde6015afb0 2024-02-21T22:52:51.210 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.218+0000 7fde65f5e640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde6015b390 con 0x7fde60070b70 2024-02-21T22:52:51.210 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.218+0000 7fde5effd640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fde60070b70 0x7fde60071580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:51.210 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.218+0000 7fde5ffff640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7fde60071ac0 0x7fde600b3860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:56850/0 (socket says 172.21.15.116:56850) 2024-02-21T22:52:51.210 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.218+0000 7fde5ffff640 1 -- 172.21.15.116:0/755926100 learned_addr learned my addr 172.21.15.116:0/755926100 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-02-21T22:52:51.210 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.218+0000 7fde5effd640 1 -- 172.21.15.116:0/755926100 >> v1:172.21.15.142:6789/0 conn(0x7fde6015afb0 legacy=0x7fde600af080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:52:51.210 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.218+0000 7fde5effd640 1 -- 172.21.15.116:0/755926100 >> v1:172.21.15.116:6789/0 conn(0x7fde60071ac0 legacy=0x7fde600b3860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:51.210 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.218+0000 7fde5effd640 1 -- 172.21.15.116:0/755926100 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde600b3060 con 0x7fde60070b70 2024-02-21T22:52:51.210 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.218+0000 7fde5e7fc640 1 -- 172.21.15.116:0/755926100 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2299720896 0 0) 0x7fde600710e0 con 0x7fde60071ac0 2024-02-21T22:52:51.210 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.219+0000 7fde5effd640 1 --2- 172.21.15.116:0/755926100 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fde60070b70 0x7fde60071580 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fde540097d0 tx=0x7fde5402b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8b68abe2dc715c3 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:52:51.210 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.219+0000 7fde5e7fc640 1 -- 172.21.15.116:0/755926100 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde54034070 con 0x7fde60070b70 2024-02-21T22:52:51.210 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.219+0000 7fde5e7fc640 1 -- 172.21.15.116:0/755926100 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde54030610 con 0x7fde60070b70 2024-02-21T22:52:51.210 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.219+0000 7fde5e7fc640 1 -- 172.21.15.116:0/755926100 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde540309e0 con 0x7fde60070b70 2024-02-21T22:52:51.213 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.219+0000 7fde65f5e640 1 -- 172.21.15.116:0/755926100 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fde60070b70 msgr2=0x7fde60071580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:51.213 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.219+0000 7fde65f5e640 1 --2- 172.21.15.116:0/755926100 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fde60070b70 0x7fde60071580 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fde540097d0 tx=0x7fde5402b960 comp rx=0 tx=0).stop 2024-02-21T22:52:51.214 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.219+0000 7fde65f5e640 1 -- 172.21.15.116:0/755926100 shutdown_connections 2024-02-21T22:52:51.214 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.219+0000 7fde65f5e640 1 --2- 172.21.15.116:0/755926100 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fde60070b70 0x7fde60071580 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:51.214 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.219+0000 7fde65f5e640 1 -- 172.21.15.116:0/755926100 >> 172.21.15.116:0/755926100 conn(0x7fde600b18e0 msgr2=0x7fde600b1cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:52:51.214 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.220+0000 7fde65f5e640 1 -- 172.21.15.116:0/755926100 shutdown_connections 2024-02-21T22:52:51.214 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.220+0000 7fde65f5e640 1 -- 172.21.15.116:0/755926100 wait complete. 2024-02-21T22:52:51.214 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.221+0000 7fde65f5e640 1 Processor -- start 2024-02-21T22:52:51.214 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.221+0000 7fde65f5e640 1 -- start start 2024-02-21T22:52:51.214 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.221+0000 7fde65f5e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fde60070b70 0x7fde601520b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:51.214 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.221+0000 7fde65f5e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fde60071ac0 0x7fde60157080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:51.214 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.221+0000 7fde65f5e640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fde6015afb0 0x7fde601575c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:51.214 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.221+0000 7fde65f5e640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde600713c0 con 0x7fde6015afb0 2024-02-21T22:52:51.214 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.221+0000 7fde65f5e640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde60071f30 con 0x7fde60070b70 2024-02-21T22:52:51.214 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.221+0000 7fde65f5e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde600b3f70 con 0x7fde60071ac0 2024-02-21T22:52:51.214 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.222+0000 7fde5ffff640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fde6015afb0 0x7fde601575c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:51.214 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.222+0000 7fde5ffff640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fde6015afb0 0x7fde601575c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:50912/0 (socket says 172.21.15.116:50912) 2024-02-21T22:52:51.215 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.222+0000 7fde5ffff640 1 -- 172.21.15.116:0/3112766105 learned_addr learned my addr 172.21.15.116:0/3112766105 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:52:51.215 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.222+0000 7fde5ffff640 1 -- 172.21.15.116:0/3112766105 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fde60071ac0 msgr2=0x7fde60157080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:51.215 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.222+0000 7fde5ffff640 1 --2- 172.21.15.116:0/3112766105 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fde60071ac0 0x7fde60157080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:51.215 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.222+0000 7fde5ffff640 1 -- 172.21.15.116:0/3112766105 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fde60070b70 msgr2=0x7fde601520b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:51.215 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.222+0000 7fde5ffff640 1 --2- 172.21.15.116:0/3112766105 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fde60070b70 0x7fde601520b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:51.215 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.222+0000 7fde5ffff640 1 -- 172.21.15.116:0/3112766105 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde6009c1c0 con 0x7fde6015afb0 2024-02-21T22:52:51.215 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.222+0000 7fde5ffff640 1 --2- 172.21.15.116:0/3112766105 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fde6015afb0 0x7fde601575c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fde5800c7a0 tx=0x7fde5800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:52:51.215 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.222+0000 7fde47fff640 1 -- 172.21.15.116:0/3112766105 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde58018070 con 0x7fde6015afb0 2024-02-21T22:52:51.215 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.222+0000 7fde47fff640 1 -- 172.21.15.116:0/3112766105 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde5800a640 con 0x7fde6015afb0 2024-02-21T22:52:51.215 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.222+0000 7fde65f5e640 1 -- 172.21.15.116:0/3112766105 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde600cea50 con 0x7fde6015afb0 2024-02-21T22:52:51.215 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.222+0000 7fde47fff640 1 -- 172.21.15.116:0/3112766105 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde5800aab0 con 0x7fde6015afb0 2024-02-21T22:52:51.215 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.222+0000 7fde65f5e640 1 -- 172.21.15.116:0/3112766105 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde6009c720 con 0x7fde6015afb0 2024-02-21T22:52:51.215 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.223+0000 7fde65f5e640 1 -- 172.21.15.116:0/3112766105 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde600752f0 con 0x7fde6015afb0 2024-02-21T22:52:51.216 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.223+0000 7fde47fff640 1 -- 172.21.15.116:0/3112766105 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fde5801b070 con 0x7fde6015afb0 2024-02-21T22:52:51.216 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.224+0000 7fde47fff640 1 --2- 172.21.15.116:0/3112766105 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fde4c06b4d0 0x7fde4c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:51.216 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.224+0000 7fde47fff640 1 -- 172.21.15.116:0/3112766105 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fde58089820 con 0x7fde6015afb0 2024-02-21T22:52:51.216 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.224+0000 7fde5f7fe640 1 --2- 172.21.15.116:0/3112766105 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fde4c06b4d0 0x7fde4c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:51.216 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.225+0000 7fde5f7fe640 1 --2- 172.21.15.116:0/3112766105 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fde4c06b4d0 0x7fde4c06d990 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fde50009650 tx=0x7fde50006ba0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:52:51.218 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.228+0000 7fde47fff640 1 -- 172.21.15.116:0/3112766105 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7fde6009c1c0 con 0x7fde6015afb0 2024-02-21T22:52:51.390 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.400+0000 7fde65f5e640 1 -- 172.21.15.116:0/3112766105 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fde6015a1f0 con 0x7fde6015afb0 2024-02-21T22:52:51.391 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.401+0000 7fde47fff640 1 -- 172.21.15.116:0/3112766105 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+16666 (secure 0 0 0) 0x7fde580586a0 con 0x7fde6015afb0 2024-02-21T22:52:51.392 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-02-21T22:52:51.392 INFO:teuthology.orchestra.run.smithi116.stdout:{"epoch":19,"fsid":"7c298660-5f63-4b5c-a800-58c5be9a8445","created":"2024-02-21T22:52:25.994613+0000","modified":"2024-02-21T22:52:50.128391+0000","last_up_change":"2024-02-21T22:52:37.313595+0000","last_in_change":"2024-02-21T22:52:28.176031+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-21T22:52:38.328796+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-21T22:52:48.145152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-21T22:52:49.096955+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4f09126b-b5e4-4876-8b08-f5cbb967388a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":1613202231},{"type":"v1","addr":"172.21.15.116:6809","nonce":1613202231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":1613202231},{"type":"v1","addr":"172.21.15.116:6811","nonce":1613202231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":1613202231},{"type":"v1","addr":"172.21.15.116:6815","nonce":1613202231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":1613202231},{"type":"v1","addr":"172.21.15.116:6813","nonce":1613202231}]},"public_addr":"172.21.15.116:6809/1613202231","cluster_addr":"172.21.15.116:6811/1613202231","heartbeat_back_addr":"172.21.15.116:6815/1613202231","heartbeat_front_addr":"172.21.15.116:6813/1613202231","state":["exists","up"]},{"osd":1,"uuid":"7272c51d-51f9-4536-931d-33ad7a4b377e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6816","nonce":172614746},{"type":"v1","addr":"172.21.15.116:6817","nonce":172614746}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":172614746},{"type":"v1","addr":"172.21.15.116:6819","nonce":172614746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":172614746},{"type":"v1","addr":"172.21.15.116:6823","nonce":172614746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":172614746},{"type":"v1","addr":"172.21.15.116:6821","nonce":172614746}]},"public_addr":"172.21.15.116:6817/172614746","cluster_addr":"172.21.15.116:6819/172614746","heartbeat_back_addr":"172.21.15.116:6823/172614746","heartbeat_front_addr":"172.21.15.116:6821/172614746","state":["exists","up"]},{"osd":2,"uuid":"2589616c-adf1-4187-aac3-735256cf624b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":1029280577},{"type":"v1","addr":"172.21.15.116:6825","nonce":1029280577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":1029280577},{"type":"v1","addr":"172.21.15.116:6827","nonce":1029280577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":1029280577},{"type":"v1","addr":"172.21.15.116:6831","nonce":1029280577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":1029280577},{"type":"v1","addr":"172.21.15.116:6829","nonce":1029280577}]},"public_addr":"172.21.15.116:6825/1029280577","cluster_addr":"172.21.15.116:6827/1029280577","heartbeat_back_addr":"172.21.15.116:6831/1029280577","heartbeat_front_addr":"172.21.15.116:6829/1029280577","state":["exists","up"]},{"osd":3,"uuid":"0fd2e563-7c5b-46f6-82c2-b60c86072c93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":3106627557},{"type":"v1","addr":"172.21.15.116:6801","nonce":3106627557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":3106627557},{"type":"v1","addr":"172.21.15.116:6803","nonce":3106627557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":3106627557},{"type":"v1","addr":"172.21.15.116:6807","nonce":3106627557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":3106627557},{"type":"v1","addr":"172.21.15.116:6805","nonce":3106627557}]},"public_addr":"172.21.15.116:6801/3106627557","cluster_addr":"172.21.15.116:6803/3106627557","heartbeat_back_addr":"172.21.15.116:6807/3106627557","heartbeat_front_addr":"172.21.15.116:6805/3106627557","state":["exists","up"]},{"osd":4,"uuid":"79ae35b7-dda8-4ab8-96ce-47515afde082","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":3231407772},{"type":"v1","addr":"172.21.15.142:6825","nonce":3231407772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":3231407772},{"type":"v1","addr":"172.21.15.142:6827","nonce":3231407772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":3231407772},{"type":"v1","addr":"172.21.15.142:6831","nonce":3231407772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":3231407772},{"type":"v1","addr":"172.21.15.142:6829","nonce":3231407772}]},"public_addr":"172.21.15.142:6825/3231407772","cluster_addr":"172.21.15.142:6827/3231407772","heartbeat_back_addr":"172.21.15.142:6831/3231407772","heartbeat_front_addr":"172.21.15.142:6829/3231407772","state":["exists","up"]},{"osd":5,"uuid":"3166eb2c-3fcf-41c8-9362-45bafaabaa39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":1184158716},{"type":"v1","addr":"172.21.15.142:6817","nonce":1184158716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":1184158716},{"type":"v1","addr":"172.21.15.142:6819","nonce":1184158716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":1184158716},{"type":"v1","addr":"172.21.15.142:6823","nonce":1184158716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":1184158716},{"type":"v1","addr":"172.21.15.142:6821","nonce":1184158716}]},"public_addr":"172.21.15.142:6817/1184158716","cluster_addr":"172.21.15.142:6819/1184158716","heartbeat_back_addr":"172.21.15.142:6823/1184158716","heartbeat_front_addr":"172.21.15.142:6821/1184158716","state":["exists","up"]},{"osd":6,"uuid":"f9aa9672-7527-43e2-963e-b61868e5e63f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":1987868911},{"type":"v1","addr":"172.21.15.142:6801","nonce":1987868911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":1987868911},{"type":"v1","addr":"172.21.15.142:6803","nonce":1987868911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":1987868911},{"type":"v1","addr":"172.21.15.142:6807","nonce":1987868911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":1987868911},{"type":"v1","addr":"172.21.15.142:6805","nonce":1987868911}]},"public_addr":"172.21.15.142:6801/1987868911","cluster_addr":"172.21.15.142:6803/1987868911","heartbeat_back_addr":"172.21.15.142:6807/1987868911","heartbeat_front_addr":"172.21.15.142:6805/1987868911","state":["exists","up"]},{"osd":7,"uuid":"7ed29226-fc42-4382-a91a-fa50f7ec5426","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":1272081937},{"type":"v1","addr":"172.21.15.142:6809","nonce":1272081937}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":1272081937},{"type":"v1","addr":"172.21.15.142:6811","nonce":1272081937}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":1272081937},{"type":"v1","addr":"172.21.15.142:6815","nonce":1272081937}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":1272081937},{"type":"v1","addr":"172.21.15.142:6813","nonce":1272081937}]},"public_addr":"172.21.15.142:6809/1272081937","cluster_addr":"172.21.15.142:6811/1272081937","heartbeat_back_addr":"172.21.15.142:6815/1272081937","heartbeat_front_addr":"172.21.15.142:6813/1272081937","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.350998+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.307201+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.289112+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.243888+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.312091+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.370472+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.275659+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.289297+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-21T22:52:51.394 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.403+0000 7fde65f5e640 1 -- 172.21.15.116:0/3112766105 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fde4c06b4d0 msgr2=0x7fde4c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:51.394 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.403+0000 7fde65f5e640 1 --2- 172.21.15.116:0/3112766105 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fde4c06b4d0 0x7fde4c06d990 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fde50009650 tx=0x7fde50006ba0 comp rx=0 tx=0).stop 2024-02-21T22:52:51.394 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.403+0000 7fde65f5e640 1 -- 172.21.15.116:0/3112766105 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fde6015afb0 msgr2=0x7fde601575c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:51.394 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.403+0000 7fde65f5e640 1 --2- 172.21.15.116:0/3112766105 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fde6015afb0 0x7fde601575c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fde5800c7a0 tx=0x7fde5800cc60 comp rx=0 tx=0).stop 2024-02-21T22:52:51.394 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.403+0000 7fde65f5e640 1 -- 172.21.15.116:0/3112766105 shutdown_connections 2024-02-21T22:52:51.394 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.403+0000 7fde65f5e640 1 --2- 172.21.15.116:0/3112766105 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fde6015afb0 0x7fde601575c0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:51.394 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.403+0000 7fde65f5e640 1 --2- 172.21.15.116:0/3112766105 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fde4c06b4d0 0x7fde4c06d990 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:51.394 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.403+0000 7fde65f5e640 1 --2- 172.21.15.116:0/3112766105 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fde60071ac0 0x7fde60157080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:51.394 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.403+0000 7fde65f5e640 1 --2- 172.21.15.116:0/3112766105 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fde60070b70 0x7fde601520b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:51.395 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.403+0000 7fde65f5e640 1 -- 172.21.15.116:0/3112766105 >> 172.21.15.116:0/3112766105 conn(0x7fde600b18e0 msgr2=0x7fde600caf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:52:51.395 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.403+0000 7fde65f5e640 1 -- 172.21.15.116:0/3112766105 shutdown_connections 2024-02-21T22:52:51.395 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.403+0000 7fde65f5e640 1 -- 172.21.15.116:0/3112766105 wait complete. 2024-02-21T22:52:51.404 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-02-21T22:52:51.508 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.517+0000 7fab567ed640 1 Processor -- start 2024-02-21T22:52:51.508 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.517+0000 7fab567ed640 1 -- start start 2024-02-21T22:52:51.512 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.518+0000 7fab567ed640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fab50161630 0x7fab500cf720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:51.512 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.518+0000 7fab567ed640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab50161a10 con 0x7fab500cda60 2024-02-21T22:52:51.512 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.518+0000 7fab567ed640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab500d07f0 con 0x7fab500b14b0 2024-02-21T22:52:51.513 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.518+0000 7fab567ed640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab500ccec0 con 0x7fab50161630 2024-02-21T22:52:51.513 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.518+0000 7fab4ffff640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fab50161630 0x7fab500cf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:51.513 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.518+0000 7fab54d8a640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7fab500cda60 0x7fab500ce4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:56854/0 (socket says 172.21.15.116:56854) 2024-02-21T22:52:51.513 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.518+0000 7fab54d8a640 1 -- 172.21.15.116:0/500387841 learned_addr learned my addr 172.21.15.116:0/500387841 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-02-21T22:52:51.513 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.518+0000 7fab4effd640 1 -- 172.21.15.116:0/500387841 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2424088731 0 0) 0x7fab48001490 con 0x7fab500cda60 2024-02-21T22:52:51.513 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.518+0000 7fab4effd640 1 -- 172.21.15.116:0/500387841 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab38003520 con 0x7fab500cda60 2024-02-21T22:52:51.513 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.519+0000 7fab4ffff640 1 -- 172.21.15.116:0/500387841 >> v1:172.21.15.142:6789/0 conn(0x7fab500b14b0 legacy=0x7fab500cd350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:51.514 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.519+0000 7fab4ffff640 1 -- 172.21.15.116:0/500387841 >> v1:172.21.15.116:6789/0 conn(0x7fab500cda60 legacy=0x7fab500ce4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:51.514 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.519+0000 7fab4ffff640 1 -- 172.21.15.116:0/500387841 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab500d0ad0 con 0x7fab50161630 2024-02-21T22:52:51.514 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.519+0000 7fab4ffff640 1 --2- 172.21.15.116:0/500387841 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fab50161630 0x7fab500cf720 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fab400097a0 tx=0x7fab4002b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cf65b6cf0009a76 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:52:51.514 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.519+0000 7fab4effd640 1 -- 172.21.15.116:0/500387841 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab40034070 con 0x7fab50161630 2024-02-21T22:52:51.514 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.519+0000 7fab4effd640 1 -- 172.21.15.116:0/500387841 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab40030610 con 0x7fab50161630 2024-02-21T22:52:51.514 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.519+0000 7fab4effd640 1 -- 172.21.15.116:0/500387841 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab400309e0 con 0x7fab50161630 2024-02-21T22:52:51.515 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.520+0000 7fab567ed640 1 -- 172.21.15.116:0/500387841 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fab50161630 msgr2=0x7fab500cf720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:51.515 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.520+0000 7fab567ed640 1 --2- 172.21.15.116:0/500387841 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fab50161630 0x7fab500cf720 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fab400097a0 tx=0x7fab4002b960 comp rx=0 tx=0).stop 2024-02-21T22:52:51.515 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.520+0000 7fab567ed640 1 -- 172.21.15.116:0/500387841 shutdown_connections 2024-02-21T22:52:51.515 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.520+0000 7fab567ed640 1 --2- 172.21.15.116:0/500387841 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fab50161630 0x7fab500cf720 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:51.515 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.520+0000 7fab567ed640 1 -- 172.21.15.116:0/500387841 >> 172.21.15.116:0/500387841 conn(0x7fab500d1b50 msgr2=0x7fab500d1f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:52:51.515 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.520+0000 7fab567ed640 1 -- 172.21.15.116:0/500387841 shutdown_connections 2024-02-21T22:52:51.516 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.520+0000 7fab567ed640 1 -- 172.21.15.116:0/500387841 wait complete. 2024-02-21T22:52:51.516 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.521+0000 7fab567ed640 1 Processor -- start 2024-02-21T22:52:51.516 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.521+0000 7fab567ed640 1 -- start start 2024-02-21T22:52:51.523 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.522+0000 7fab567ed640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fab500b14b0 0x7fab501510e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:51.524 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.522+0000 7fab567ed640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fab500cda60 0x7fab500c8c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:51.524 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.522+0000 7fab567ed640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fab50161630 0x7fab5015f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:51.524 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.522+0000 7fab567ed640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab500d0db0 con 0x7fab50161630 2024-02-21T22:52:51.524 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.522+0000 7fab567ed640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab500b11a0 con 0x7fab500b14b0 2024-02-21T22:52:51.524 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.522+0000 7fab567ed640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab500b1910 con 0x7fab500cda60 2024-02-21T22:52:51.525 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.522+0000 7fab54d8a640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fab50161630 0x7fab5015f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:51.525 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.522+0000 7fab54d8a640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fab50161630 0x7fab5015f550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:50934/0 (socket says 172.21.15.116:50934) 2024-02-21T22:52:51.525 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.522+0000 7fab54d8a640 1 -- 172.21.15.116:0/2192224671 learned_addr learned my addr 172.21.15.116:0/2192224671 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:52:51.525 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.522+0000 7fab4f7fe640 1 --2- 172.21.15.116:0/2192224671 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fab500cda60 0x7fab500c8c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:51.525 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.522+0000 7fab4ffff640 1 --2- 172.21.15.116:0/2192224671 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fab500b14b0 0x7fab501510e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:51.525 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.522+0000 7fab54d8a640 1 -- 172.21.15.116:0/2192224671 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fab500cda60 msgr2=0x7fab500c8c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:51.525 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.522+0000 7fab54d8a640 1 --2- 172.21.15.116:0/2192224671 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fab500cda60 0x7fab500c8c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:51.526 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.522+0000 7fab54d8a640 1 -- 172.21.15.116:0/2192224671 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fab500b14b0 msgr2=0x7fab501510e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:51.526 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.522+0000 7fab54d8a640 1 --2- 172.21.15.116:0/2192224671 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fab500b14b0 0x7fab501510e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:51.526 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.522+0000 7fab54d8a640 1 -- 172.21.15.116:0/2192224671 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab500c9370 con 0x7fab50161630 2024-02-21T22:52:51.526 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.522+0000 7fab54d8a640 1 --2- 172.21.15.116:0/2192224671 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fab50161630 0x7fab5015f550 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fab4800cb50 tx=0x7fab4800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:52:51.526 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.523+0000 7fab4cff9640 1 -- 172.21.15.116:0/2192224671 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab48017070 con 0x7fab50161630 2024-02-21T22:52:51.526 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.523+0000 7fab4cff9640 1 -- 172.21.15.116:0/2192224671 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab4800ad40 con 0x7fab50161630 2024-02-21T22:52:51.526 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.523+0000 7fab567ed640 1 -- 172.21.15.116:0/2192224671 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab500c9650 con 0x7fab50161630 2024-02-21T22:52:51.526 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.523+0000 7fab4cff9640 1 -- 172.21.15.116:0/2192224671 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab48012620 con 0x7fab50161630 2024-02-21T22:52:51.526 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.523+0000 7fab567ed640 1 -- 172.21.15.116:0/2192224671 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab500c9c10 con 0x7fab50161630 2024-02-21T22:52:51.526 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.524+0000 7fab567ed640 1 -- 172.21.15.116:0/2192224671 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab500752f0 con 0x7fab50161630 2024-02-21T22:52:51.526 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.524+0000 7fab4cff9640 1 -- 172.21.15.116:0/2192224671 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fab4801a070 con 0x7fab50161630 2024-02-21T22:52:51.526 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.524+0000 7fab4cff9640 1 --2- 172.21.15.116:0/2192224671 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fab3c06b4d0 0x7fab3c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:51.526 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.524+0000 7fab4cff9640 1 -- 172.21.15.116:0/2192224671 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fab4808a0e0 con 0x7fab50161630 2024-02-21T22:52:51.527 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.525+0000 7fab4ffff640 1 --2- 172.21.15.116:0/2192224671 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fab3c06b4d0 0x7fab3c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:51.527 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.525+0000 7fab4ffff640 1 --2- 172.21.15.116:0/2192224671 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fab3c06b4d0 0x7fab3c06d990 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fab40036000 tx=0x7fab4003b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:52:51.527 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.528+0000 7fab4cff9640 1 -- 172.21.15.116:0/2192224671 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7fab50161a10 con 0x7fab50161630 2024-02-21T22:52:51.728 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.737+0000 7fab567ed640 1 -- 172.21.15.116:0/2192224671 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fab5006df40 con 0x7fab50161630 2024-02-21T22:52:51.776 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.786+0000 7fab4cff9640 1 -- 172.21.15.116:0/2192224671 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v5) v1 ==== 118+0+0 (secure 0 0 0) 0x7fab48058ed0 con 0x7fab50161630 2024-02-21T22:52:51.779 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.788+0000 7fab567ed640 1 -- 172.21.15.116:0/2192224671 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fab3c06b4d0 msgr2=0x7fab3c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:51.779 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.788+0000 7fab567ed640 1 --2- 172.21.15.116:0/2192224671 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fab3c06b4d0 0x7fab3c06d990 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fab40036000 tx=0x7fab4003b040 comp rx=0 tx=0).stop 2024-02-21T22:52:51.779 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.788+0000 7fab567ed640 1 -- 172.21.15.116:0/2192224671 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fab50161630 msgr2=0x7fab5015f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:51.779 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.788+0000 7fab567ed640 1 --2- 172.21.15.116:0/2192224671 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fab50161630 0x7fab5015f550 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fab4800cb50 tx=0x7fab4800a430 comp rx=0 tx=0).stop 2024-02-21T22:52:51.779 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.788+0000 7fab567ed640 1 -- 172.21.15.116:0/2192224671 shutdown_connections 2024-02-21T22:52:51.779 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.788+0000 7fab567ed640 1 --2- 172.21.15.116:0/2192224671 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fab50161630 0x7fab5015f550 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:51.779 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.788+0000 7fab567ed640 1 --2- 172.21.15.116:0/2192224671 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fab3c06b4d0 0x7fab3c06d990 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:51.779 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.788+0000 7fab567ed640 1 --2- 172.21.15.116:0/2192224671 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fab500cda60 0x7fab500c8c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:51.779 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.788+0000 7fab567ed640 1 --2- 172.21.15.116:0/2192224671 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fab500b14b0 0x7fab501510e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:51.779 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.788+0000 7fab567ed640 1 -- 172.21.15.116:0/2192224671 >> 172.21.15.116:0/2192224671 conn(0x7fab500d1b50 msgr2=0x7fab5015c990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:52:51.779 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.788+0000 7fab567ed640 1 -- 172.21.15.116:0/2192224671 shutdown_connections 2024-02-21T22:52:51.780 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.788+0000 7fab567ed640 1 -- 172.21.15.116:0/2192224671 wait complete. 2024-02-21T22:52:51.790 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-02-21T22:52:51.790 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-02-21T22:52:51.894 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.903+0000 7f5d86d84640 1 Processor -- start 2024-02-21T22:52:51.894 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.903+0000 7f5d86d84640 1 -- start start 2024-02-21T22:52:51.897 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.904+0000 7f5d86d84640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5d801445d0 0x7f5d8006d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:51.897 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.904+0000 7f5d86d84640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f5d800b57c0 0x7f5d800cdfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:51.897 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.904+0000 7f5d86d84640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d800b5c00 con 0x7f5d8015e8e0 2024-02-21T22:52:51.897 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.904+0000 7f5d86d84640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d8006e8d0 con 0x7f5d800b57c0 2024-02-21T22:52:51.898 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.904+0000 7f5d86d84640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d800ce500 con 0x7f5d801445d0 2024-02-21T22:52:51.898 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.904+0000 7f5d7ffff640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f5d800b57c0 0x7f5d800cdfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:51.898 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.904+0000 7f5d85321640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f5d8015e8e0 0x7f5d8006ed60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:56868/0 (socket says 172.21.15.116:56868) 2024-02-21T22:52:51.898 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.904+0000 7f5d85321640 1 -- 172.21.15.116:0/3136206318 learned_addr learned my addr 172.21.15.116:0/3136206318 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-02-21T22:52:51.898 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.905+0000 7f5d84b20640 1 --2- 172.21.15.116:0/3136206318 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5d801445d0 0x7f5d8006d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:51.898 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.905+0000 7f5d7ffff640 1 -- 172.21.15.116:0/3136206318 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5d801445d0 msgr2=0x7f5d8006d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:52:51.898 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.905+0000 7f5d7ffff640 1 --2- 172.21.15.116:0/3136206318 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5d801445d0 0x7f5d8006d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:51.898 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.905+0000 7f5d7ffff640 1 -- 172.21.15.116:0/3136206318 >> v1:172.21.15.116:6789/0 conn(0x7f5d8015e8e0 legacy=0x7f5d8006ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:51.898 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.905+0000 7f5d7ffff640 1 -- 172.21.15.116:0/3136206318 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d8006dcc0 con 0x7f5d800b57c0 2024-02-21T22:52:51.898 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.905+0000 7f5d7f7fe640 1 -- 172.21.15.116:0/3136206318 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2602314527 0 0) 0x7f5d800b5c00 con 0x7f5d8015e8e0 2024-02-21T22:52:51.898 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.905+0000 7f5d84b20640 1 --2- 172.21.15.116:0/3136206318 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5d801445d0 0x7f5d8006d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T22:52:51.898 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.905+0000 7f5d7ffff640 1 --2- 172.21.15.116:0/3136206318 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5d800b57c0 0x7f5d800cdfc0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f5d740097a0 tx=0x7f5d7402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4becfe8838f6d02 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:52:51.898 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.906+0000 7f5d7f7fe640 1 -- 172.21.15.116:0/3136206318 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d740315a0 con 0x7f5d800b57c0 2024-02-21T22:52:51.898 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.906+0000 7f5d7f7fe640 1 -- 172.21.15.116:0/3136206318 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d74037070 con 0x7f5d800b57c0 2024-02-21T22:52:51.898 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.906+0000 7f5d7f7fe640 1 -- 172.21.15.116:0/3136206318 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d74031960 con 0x7f5d800b57c0 2024-02-21T22:52:51.899 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.906+0000 7f5d86d84640 1 -- 172.21.15.116:0/3136206318 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5d800b57c0 msgr2=0x7f5d800cdfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:51.899 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.906+0000 7f5d86d84640 1 --2- 172.21.15.116:0/3136206318 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5d800b57c0 0x7f5d800cdfc0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f5d740097a0 tx=0x7f5d7402b840 comp rx=0 tx=0).stop 2024-02-21T22:52:51.899 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.906+0000 7f5d86d84640 1 -- 172.21.15.116:0/3136206318 shutdown_connections 2024-02-21T22:52:51.899 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.906+0000 7f5d86d84640 1 --2- 172.21.15.116:0/3136206318 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5d800b57c0 0x7f5d800cdfc0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:51.899 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.906+0000 7f5d86d84640 1 --2- 172.21.15.116:0/3136206318 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5d801445d0 0x7f5d8006d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:51.899 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.906+0000 7f5d86d84640 1 -- 172.21.15.116:0/3136206318 >> 172.21.15.116:0/3136206318 conn(0x7f5d800d0b00 msgr2=0x7f5d800d0f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:52:51.899 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.906+0000 7f5d86d84640 1 -- 172.21.15.116:0/3136206318 shutdown_connections 2024-02-21T22:52:51.899 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.906+0000 7f5d86d84640 1 -- 172.21.15.116:0/3136206318 wait complete. 2024-02-21T22:52:51.902 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.907+0000 7f5d86d84640 1 Processor -- start 2024-02-21T22:52:51.902 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.907+0000 7f5d86d84640 1 -- start start 2024-02-21T22:52:51.902 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.908+0000 7f5d86d84640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5d800b57c0 0x7f5d800afe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:51.902 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.908+0000 7f5d86d84640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5d801445d0 0x7f5d8015d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:51.902 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.908+0000 7f5d86d84640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5d8015e8e0 0x7f5d800718b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:51.902 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.908+0000 7f5d86d84640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d8006e560 con 0x7f5d800b57c0 2024-02-21T22:52:51.902 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.908+0000 7f5d86d84640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d8006e280 con 0x7f5d8015e8e0 2024-02-21T22:52:51.902 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.908+0000 7f5d86d84640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d801449b0 con 0x7f5d801445d0 2024-02-21T22:52:51.902 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.908+0000 7f5d84b20640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5d800b57c0 0x7f5d800afe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:51.902 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.908+0000 7f5d84b20640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5d800b57c0 0x7f5d800afe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:50954/0 (socket says 172.21.15.116:50954) 2024-02-21T22:52:51.903 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.908+0000 7f5d84b20640 1 -- 172.21.15.116:0/200256249 learned_addr learned my addr 172.21.15.116:0/200256249 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:52:51.903 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.908+0000 7f5d7ffff640 1 --2- 172.21.15.116:0/200256249 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5d801445d0 0x7f5d8015d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:51.903 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.908+0000 7f5d85321640 1 --2- 172.21.15.116:0/200256249 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5d8015e8e0 0x7f5d800718b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:51.903 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.909+0000 7f5d84b20640 1 -- 172.21.15.116:0/200256249 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5d801445d0 msgr2=0x7f5d8015d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:51.903 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.909+0000 7f5d84b20640 1 --2- 172.21.15.116:0/200256249 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5d801445d0 0x7f5d8015d3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:51.903 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.909+0000 7f5d84b20640 1 -- 172.21.15.116:0/200256249 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5d8015e8e0 msgr2=0x7f5d800718b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:51.903 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.909+0000 7f5d84b20640 1 --2- 172.21.15.116:0/200256249 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5d8015e8e0 0x7f5d800718b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:51.903 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.909+0000 7f5d84b20640 1 -- 172.21.15.116:0/200256249 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d800b0390 con 0x7f5d800b57c0 2024-02-21T22:52:51.903 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.909+0000 7f5d85321640 1 --2- 172.21.15.116:0/200256249 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5d8015e8e0 0x7f5d800718b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T22:52:51.903 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.909+0000 7f5d84b20640 1 --2- 172.21.15.116:0/200256249 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5d800b57c0 0x7f5d800afe50 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f5d7000c7f0 tx=0x7f5d7000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:52:51.903 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.909+0000 7f5d7d7fa640 1 -- 172.21.15.116:0/200256249 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d70015070 con 0x7f5d800b57c0 2024-02-21T22:52:51.903 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.909+0000 7f5d7d7fa640 1 -- 172.21.15.116:0/200256249 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d70007a30 con 0x7f5d800b57c0 2024-02-21T22:52:51.903 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.909+0000 7f5d7d7fa640 1 -- 172.21.15.116:0/200256249 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d70007e00 con 0x7f5d800b57c0 2024-02-21T22:52:51.903 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.909+0000 7f5d86d84640 1 -- 172.21.15.116:0/200256249 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d8015d930 con 0x7f5d800b57c0 2024-02-21T22:52:51.904 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.909+0000 7f5d86d84640 1 -- 172.21.15.116:0/200256249 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d8015bb20 con 0x7f5d800b57c0 2024-02-21T22:52:51.904 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.910+0000 7f5d86d84640 1 -- 172.21.15.116:0/200256249 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d800752f0 con 0x7f5d800b57c0 2024-02-21T22:52:51.904 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.910+0000 7f5d7d7fa640 1 -- 172.21.15.116:0/200256249 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f5d70018070 con 0x7f5d800b57c0 2024-02-21T22:52:51.904 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.911+0000 7f5d7d7fa640 1 --2- 172.21.15.116:0/200256249 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f5d6c06b4d0 0x7f5d6c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:51.904 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.911+0000 7f5d7d7fa640 1 -- 172.21.15.116:0/200256249 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5d7008a0a0 con 0x7f5d800b57c0 2024-02-21T22:52:51.904 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.911+0000 7f5d7ffff640 1 --2- 172.21.15.116:0/200256249 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f5d6c06b4d0 0x7f5d6c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:51.904 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.911+0000 7f5d7ffff640 1 --2- 172.21.15.116:0/200256249 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f5d6c06b4d0 0x7f5d6c06d990 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5d74036000 tx=0x7f5d7403d040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:52:51.905 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:51.915+0000 7f5d7d7fa640 1 -- 172.21.15.116:0/200256249 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f5d700588d0 con 0x7f5d800b57c0 2024-02-21T22:52:52.114 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:52.124+0000 7f5d86d84640 1 -- 172.21.15.116:0/200256249 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f5d800701f0 con 0x7f5d800b57c0 2024-02-21T22:52:52.784 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:52.794+0000 7f5d7d7fa640 1 -- 172.21.15.116:0/200256249 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v6) v1 ==== 122+0+0 (secure 0 0 0) 0x7f5d7005c970 con 0x7f5d800b57c0 2024-02-21T22:52:52.787 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:52.796+0000 7f5d86d84640 1 -- 172.21.15.116:0/200256249 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f5d6c06b4d0 msgr2=0x7f5d6c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:52.787 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:52.796+0000 7f5d86d84640 1 --2- 172.21.15.116:0/200256249 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f5d6c06b4d0 0x7f5d6c06d990 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5d74036000 tx=0x7f5d7403d040 comp rx=0 tx=0).stop 2024-02-21T22:52:52.787 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:52.796+0000 7f5d86d84640 1 -- 172.21.15.116:0/200256249 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5d800b57c0 msgr2=0x7f5d800afe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:52.787 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:52.796+0000 7f5d86d84640 1 --2- 172.21.15.116:0/200256249 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5d800b57c0 0x7f5d800afe50 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f5d7000c7f0 tx=0x7f5d7000cbf0 comp rx=0 tx=0).stop 2024-02-21T22:52:52.787 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:52.796+0000 7f5d86d84640 1 -- 172.21.15.116:0/200256249 shutdown_connections 2024-02-21T22:52:52.788 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:52.796+0000 7f5d86d84640 1 --2- 172.21.15.116:0/200256249 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5d8015e8e0 0x7f5d800718b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:52.788 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:52.796+0000 7f5d86d84640 1 --2- 172.21.15.116:0/200256249 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f5d6c06b4d0 0x7f5d6c06d990 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:52.788 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:52.796+0000 7f5d86d84640 1 --2- 172.21.15.116:0/200256249 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5d801445d0 0x7f5d8015d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:52.788 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:52.796+0000 7f5d86d84640 1 --2- 172.21.15.116:0/200256249 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5d800b57c0 0x7f5d800afe50 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:52.788 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:52.796+0000 7f5d86d84640 1 -- 172.21.15.116:0/200256249 >> 172.21.15.116:0/200256249 conn(0x7f5d800d0b00 msgr2=0x7f5d800b06e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:52:52.788 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:52.796+0000 7f5d86d84640 1 -- 172.21.15.116:0/200256249 shutdown_connections 2024-02-21T22:52:52.788 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:52.796+0000 7f5d86d84640 1 -- 172.21.15.116:0/200256249 wait complete. 2024-02-21T22:52:52.799 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-02-21T22:52:52.799 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-21T22:52:52.904 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:52.914+0000 7f6ac178c640 1 Processor -- start 2024-02-21T22:52:52.905 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:52.914+0000 7f6ac178c640 1 -- start start 2024-02-21T22:52:52.906 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:52.915+0000 7f6ac178c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6abc0d0510 0x7f6abc0d08f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:52.906 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:52.915+0000 7f6ac178c640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f6abc0cb930 0x7f6abc0cbdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:52.906 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:52.915+0000 7f6ac178c640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6abc0cfa50 con 0x7f6abc0d1c30 2024-02-21T22:52:52.906 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:52.915+0000 7f6ac178c640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6abc0d1450 con 0x7f6abc0cb930 2024-02-21T22:52:52.906 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:52.915+0000 7f6ac178c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6abc0d0e30 con 0x7f6abc0d0510 2024-02-21T22:52:52.906 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:52.915+0000 7f6abb7fe640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f6abc0cb930 0x7f6abc0cbdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:52.906 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:52.915+0000 7f6abaffd640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6abc0d0510 0x7f6abc0d08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:52.906 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:52.915+0000 7f6abb7fe640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f6abc0cb930 0x7f6abc0cbdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.116:46652/0 (socket says 172.21.15.116:46652) 2024-02-21T22:52:52.906 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:52.915+0000 7f6abaffd640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6abc0d0510 0x7f6abc0d08f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.116:44252/0 (socket says 172.21.15.116:44252) 2024-02-21T22:52:52.907 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:52.915+0000 7f6abb7fe640 1 -- 172.21.15.116:0/1572883517 learned_addr learned my addr 172.21.15.116:0/1572883517 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:52:52.907 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:52.915+0000 7f6abb7fe640 1 -- 172.21.15.116:0/1572883517 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6abc0d0510 msgr2=0x7f6abc0d08f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:52:52.907 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:52.915+0000 7f6abb7fe640 1 --2- 172.21.15.116:0/1572883517 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6abc0d0510 0x7f6abc0d08f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:52.907 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:52.915+0000 7f6abb7fe640 1 -- 172.21.15.116:0/1572883517 >> v1:172.21.15.142:6789/0 conn(0x7f6abc0d1c30 legacy=0x7f6abc0d2430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:52:52.907 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:52.915+0000 7f6abb7fe640 1 -- 172.21.15.116:0/1572883517 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6abc0cfcc0 con 0x7f6abc0cb930 2024-02-21T22:52:52.907 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:52.915+0000 7f6abaffd640 1 --2- 172.21.15.116:0/1572883517 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6abc0d0510 0x7f6abc0d08f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T22:52:52.908 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:52.916+0000 7f6abb7fe640 1 --2- 172.21.15.116:0/1572883517 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6abc0cb930 0x7f6abc0cbdc0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6ab4009e50 tx=0x7f6ab402be40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=412a36c3703ae6ce server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:52:52.908 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:52.916+0000 7f6aba7fc640 1 -- 172.21.15.116:0/1572883517 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ab402c9e0 con 0x7f6abc0cb930 2024-02-21T22:52:52.908 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:52.916+0000 7f6aba7fc640 1 -- 172.21.15.116:0/1572883517 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ab402cb80 con 0x7f6abc0cb930 2024-02-21T22:52:52.909 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:52.916+0000 7f6aba7fc640 1 -- 172.21.15.116:0/1572883517 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ab40343f0 con 0x7f6abc0cb930 2024-02-21T22:52:52.909 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:52.917+0000 7f6ac178c640 1 -- 172.21.15.116:0/1572883517 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6abc0cb930 msgr2=0x7f6abc0cbdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:52.909 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:52.917+0000 7f6ac178c640 1 --2- 172.21.15.116:0/1572883517 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6abc0cb930 0x7f6abc0cbdc0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6ab4009e50 tx=0x7f6ab402be40 comp rx=0 tx=0).stop 2024-02-21T22:52:52.909 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:52.917+0000 7f6ac178c640 1 -- 172.21.15.116:0/1572883517 shutdown_connections 2024-02-21T22:52:52.909 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:52.917+0000 7f6ac178c640 1 --2- 172.21.15.116:0/1572883517 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6abc0cb930 0x7f6abc0cbdc0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:52.909 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:52.917+0000 7f6ac178c640 1 --2- 172.21.15.116:0/1572883517 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6abc0d0510 0x7f6abc0d08f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:52.909 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:52.917+0000 7f6ac178c640 1 -- 172.21.15.116:0/1572883517 >> 172.21.15.116:0/1572883517 conn(0x7f6abc0d3e50 msgr2=0x7f6abc0d4260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:52:52.909 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:52.917+0000 7f6ac178c640 1 -- 172.21.15.116:0/1572883517 shutdown_connections 2024-02-21T22:52:52.909 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:52.917+0000 7f6ac178c640 1 -- 172.21.15.116:0/1572883517 wait complete. 2024-02-21T22:52:52.909 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:52.918+0000 7f6ac178c640 1 Processor -- start 2024-02-21T22:52:52.909 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:52.918+0000 7f6ac178c640 1 -- start start 2024-02-21T22:52:52.911 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:52.919+0000 7f6ac178c640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6abc0cb930 0x7f6abc1e92d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:52.911 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:52.919+0000 7f6ac178c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6abc0d0510 0x7f6abc0c9210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:52.911 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:52.919+0000 7f6ac178c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6abc0d1c30 0x7f6abc15a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:52.912 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:52.919+0000 7f6ac178c640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6abc15e640 con 0x7f6abc0cb930 2024-02-21T22:52:52.912 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:52.919+0000 7f6ac178c640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6abc0d10e0 con 0x7f6abc0d1c30 2024-02-21T22:52:52.912 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:52.919+0000 7f6ac178c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6abc0cc300 con 0x7f6abc0d0510 2024-02-21T22:52:52.912 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:52.919+0000 7f6abaffd640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6abc0cb930 0x7f6abc1e92d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:52.912 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:52.919+0000 7f6abaffd640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6abc0cb930 0x7f6abc1e92d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:50968/0 (socket says 172.21.15.116:50968) 2024-02-21T22:52:52.912 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:52.919+0000 7f6abaffd640 1 -- 172.21.15.116:0/797201886 learned_addr learned my addr 172.21.15.116:0/797201886 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:52:52.912 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:52.919+0000 7f6abb7fe640 1 --2- 172.21.15.116:0/797201886 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6abc0d1c30 0x7f6abc15a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:52.912 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:52.919+0000 7f6ab3fff640 1 --2- 172.21.15.116:0/797201886 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6abc0d0510 0x7f6abc0c9210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:52.912 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:52.919+0000 7f6abaffd640 1 -- 172.21.15.116:0/797201886 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6abc0d0510 msgr2=0x7f6abc0c9210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:52.912 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:52.919+0000 7f6abaffd640 1 --2- 172.21.15.116:0/797201886 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6abc0d0510 0x7f6abc0c9210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:52.912 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:52.919+0000 7f6abaffd640 1 -- 172.21.15.116:0/797201886 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6abc0d1c30 msgr2=0x7f6abc15a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:52.912 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:52.919+0000 7f6abaffd640 1 --2- 172.21.15.116:0/797201886 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6abc0d1c30 0x7f6abc15a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:52.912 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:52.919+0000 7f6abaffd640 1 -- 172.21.15.116:0/797201886 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6abc0c9b80 con 0x7f6abc0cb930 2024-02-21T22:52:52.912 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:52.919+0000 7f6abaffd640 1 --2- 172.21.15.116:0/797201886 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6abc0cb930 0x7f6abc1e92d0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6aac00ec10 tx=0x7f6aac00c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:52:52.912 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:52.919+0000 7f6ab37fe640 1 -- 172.21.15.116:0/797201886 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aac017070 con 0x7f6abc0cb930 2024-02-21T22:52:52.913 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:52.919+0000 7f6ab37fe640 1 -- 172.21.15.116:0/797201886 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6aac00cbd0 con 0x7f6abc0cb930 2024-02-21T22:52:52.913 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:52.919+0000 7f6ac178c640 1 -- 172.21.15.116:0/797201886 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6abc0c9e60 con 0x7f6abc0cb930 2024-02-21T22:52:52.913 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:52.919+0000 7f6ab37fe640 1 -- 172.21.15.116:0/797201886 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aac013470 con 0x7f6abc0cb930 2024-02-21T22:52:52.913 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:52.920+0000 7f6ac178c640 1 -- 172.21.15.116:0/797201886 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6abc09e900 con 0x7f6abc0cb930 2024-02-21T22:52:52.913 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:52.920+0000 7f6ac178c640 1 -- 172.21.15.116:0/797201886 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6abc0752f0 con 0x7f6abc0cb930 2024-02-21T22:52:52.913 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:52.921+0000 7f6ab37fe640 1 -- 172.21.15.116:0/797201886 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f6aac01a070 con 0x7f6abc0cb930 2024-02-21T22:52:52.914 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:52.921+0000 7f6ab37fe640 1 --2- 172.21.15.116:0/797201886 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f6a9c06b4d0 0x7f6a9c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:52.914 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:52.922+0000 7f6ab37fe640 1 -- 172.21.15.116:0/797201886 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6aac08a390 con 0x7f6abc0cb930 2024-02-21T22:52:52.914 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:52.922+0000 7f6ab3fff640 1 --2- 172.21.15.116:0/797201886 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f6a9c06b4d0 0x7f6a9c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:52.914 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:52.922+0000 7f6ab3fff640 1 --2- 172.21.15.116:0/797201886 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f6a9c06b4d0 0x7f6a9c06d990 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f6abc0caa00 tx=0x7f6aa4009060 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:52:52.916 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:52.926+0000 7f6ab37fe640 1 -- 172.21.15.116:0/797201886 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f6aac058c50 con 0x7f6abc0cb930 2024-02-21T22:52:53.126 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.136+0000 7f6ac178c640 1 -- 172.21.15.116:0/797201886 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6abc0d2210 con 0x7f6abc0cb930 2024-02-21T22:52:53.127 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.136+0000 7f6ab37fe640 1 -- 172.21.15.116:0/797201886 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4941 (secure 0 0 0) 0x7f6aac05ccf0 con 0x7f6abc0cb930 2024-02-21T22:52:53.127 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-02-21T22:52:53.127 INFO:teuthology.orchestra.run.smithi116.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6834/1717961923","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":1717961923},{"type":"v1","addr":"172.21.15.116:6834","nonce":1717961923}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6835/2228298220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6833","nonce":2228298220},{"type":"v1","addr":"172.21.15.116:6835","nonce":2228298220}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4285,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/1675920719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":1675920719},{"type":"v1","addr":"172.21.15.142:6837","nonce":1675920719}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-21T22:52:50.128732+0000","modified":"2024-02-21T22:52:52.125495+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6836/939436511","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":939436511},{"type":"v1","addr":"172.21.15.142:6836","nonce":939436511}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-02-21T22:52:53.128 INFO:teuthology.orchestra.run.smithi116.stderr:dumped fsmap epoch 6 2024-02-21T22:52:53.129 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.138+0000 7f6ac178c640 1 -- 172.21.15.116:0/797201886 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f6a9c06b4d0 msgr2=0x7f6a9c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:53.129 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.138+0000 7f6ac178c640 1 --2- 172.21.15.116:0/797201886 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f6a9c06b4d0 0x7f6a9c06d990 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f6abc0caa00 tx=0x7f6aa4009060 comp rx=0 tx=0).stop 2024-02-21T22:52:53.129 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.138+0000 7f6ac178c640 1 -- 172.21.15.116:0/797201886 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6abc0cb930 msgr2=0x7f6abc1e92d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:53.130 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.138+0000 7f6ac178c640 1 --2- 172.21.15.116:0/797201886 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6abc0cb930 0x7f6abc1e92d0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6aac00ec10 tx=0x7f6aac00c520 comp rx=0 tx=0).stop 2024-02-21T22:52:53.130 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.138+0000 7f6ac178c640 1 -- 172.21.15.116:0/797201886 shutdown_connections 2024-02-21T22:52:53.130 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.138+0000 7f6ac178c640 1 --2- 172.21.15.116:0/797201886 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6abc0d1c30 0x7f6abc15a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:53.130 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.138+0000 7f6ac178c640 1 --2- 172.21.15.116:0/797201886 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f6a9c06b4d0 0x7f6a9c06d990 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:53.130 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.138+0000 7f6ac178c640 1 --2- 172.21.15.116:0/797201886 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6abc0d0510 0x7f6abc0c9210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:53.130 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.139+0000 7f6ac178c640 1 --2- 172.21.15.116:0/797201886 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6abc0cb930 0x7f6abc1e92d0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:53.130 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.139+0000 7f6ac178c640 1 -- 172.21.15.116:0/797201886 >> 172.21.15.116:0/797201886 conn(0x7f6abc0d3e50 msgr2=0x7f6abc0cc730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:52:53.130 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.139+0000 7f6ac178c640 1 -- 172.21.15.116:0/797201886 shutdown_connections 2024-02-21T22:52:53.130 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.139+0000 7f6ac178c640 1 -- 172.21.15.116:0/797201886 wait complete. 2024-02-21T22:52:53.140 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-21T22:52:53.240 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.249+0000 7f981d8c8640 1 Processor -- start 2024-02-21T22:52:53.240 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.249+0000 7f981d8c8640 1 -- start start 2024-02-21T22:52:53.243 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.250+0000 7f981d8c8640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f981806ee20 0x7f981806f620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:53.243 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.250+0000 7f981d8c8640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98180d1180 con 0x7f981806fb60 2024-02-21T22:52:53.243 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.250+0000 7f981d8c8640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f981806bf50 con 0x7f981815e2d0 2024-02-21T22:52:53.243 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.250+0000 7f981d8c8640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f981806ffb0 con 0x7f981806ee20 2024-02-21T22:52:53.243 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.250+0000 7f98167fc640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f981806ee20 0x7f981806f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:53.244 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.250+0000 7f9816ffd640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f981815e2d0 0x7f98180d0930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.116:49264/0 (socket says 172.21.15.116:49264) 2024-02-21T22:52:53.244 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.250+0000 7f98177fe640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f981806fb60 0x7f981806cd10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:56870/0 (socket says 172.21.15.116:56870) 2024-02-21T22:52:53.244 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.250+0000 7f9816ffd640 1 -- 172.21.15.116:0/3723873717 learned_addr learned my addr 172.21.15.116:0/3723873717 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-02-21T22:52:53.244 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.250+0000 7f98167fc640 1 -- 172.21.15.116:0/3723873717 >> v1:172.21.15.142:6789/0 conn(0x7f981815e2d0 legacy=0x7f98180d0930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:53.244 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.250+0000 7f9815ffb640 1 -- 172.21.15.116:0/3723873717 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1586049448 0 0) 0x7f98180d1180 con 0x7f981806fb60 2024-02-21T22:52:53.244 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.250+0000 7f98167fc640 1 -- 172.21.15.116:0/3723873717 >> v1:172.21.15.116:6789/0 conn(0x7f981806fb60 legacy=0x7f981806cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:53.244 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.250+0000 7f98167fc640 1 -- 172.21.15.116:0/3723873717 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f981806c230 con 0x7f981806ee20 2024-02-21T22:52:53.244 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.251+0000 7f98167fc640 1 --2- 172.21.15.116:0/3723873717 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f981806ee20 0x7f981806f620 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f980c009750 tx=0x7f980c02b730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df7bd018754a264f server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:52:53.244 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.251+0000 7f9815ffb640 1 -- 172.21.15.116:0/3723873717 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f980c037070 con 0x7f981806ee20 2024-02-21T22:52:53.245 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.251+0000 7f9815ffb640 1 -- 172.21.15.116:0/3723873717 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f980c030710 con 0x7f981806ee20 2024-02-21T22:52:53.245 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.251+0000 7f9815ffb640 1 -- 172.21.15.116:0/3723873717 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f980c030ae0 con 0x7f981806ee20 2024-02-21T22:52:53.245 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.252+0000 7f981d8c8640 1 -- 172.21.15.116:0/3723873717 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f981806ee20 msgr2=0x7f981806f620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:53.245 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.252+0000 7f981d8c8640 1 --2- 172.21.15.116:0/3723873717 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f981806ee20 0x7f981806f620 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f980c009750 tx=0x7f980c02b730 comp rx=0 tx=0).stop 2024-02-21T22:52:53.245 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.252+0000 7f981d8c8640 1 -- 172.21.15.116:0/3723873717 shutdown_connections 2024-02-21T22:52:53.245 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.252+0000 7f981d8c8640 1 --2- 172.21.15.116:0/3723873717 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f981806ee20 0x7f981806f620 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:53.245 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.252+0000 7f981d8c8640 1 -- 172.21.15.116:0/3723873717 >> 172.21.15.116:0/3723873717 conn(0x7f98180b3730 msgr2=0x7f98180b3b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:52:53.245 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.252+0000 7f981d8c8640 1 -- 172.21.15.116:0/3723873717 shutdown_connections 2024-02-21T22:52:53.245 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.252+0000 7f981d8c8640 1 -- 172.21.15.116:0/3723873717 wait complete. 2024-02-21T22:52:53.249 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.253+0000 7f981d8c8640 1 Processor -- start 2024-02-21T22:52:53.249 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.253+0000 7f981d8c8640 1 -- start start 2024-02-21T22:52:53.250 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.254+0000 7f981d8c8640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f981806ee20 0x7f98181f3e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:53.250 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.254+0000 7f981d8c8640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f981806fb60 0x7f981815a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:53.250 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.254+0000 7f981d8c8640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f981815e2d0 0x7f98180b5970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:53.250 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.254+0000 7f981d8c8640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f981806d420 con 0x7f981806fb60 2024-02-21T22:52:53.250 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.254+0000 7f981d8c8640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f981806c7f0 con 0x7f981806ee20 2024-02-21T22:52:53.251 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.254+0000 7f981d8c8640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f981806d5a0 con 0x7f981815e2d0 2024-02-21T22:52:53.251 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.254+0000 7f98167fc640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f981806fb60 0x7f981815a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:53.251 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.254+0000 7f98167fc640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f981806fb60 0x7f981815a650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:50988/0 (socket says 172.21.15.116:50988) 2024-02-21T22:52:53.251 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.254+0000 7f98167fc640 1 -- 172.21.15.116:0/935749776 learned_addr learned my addr 172.21.15.116:0/935749776 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:52:53.251 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.254+0000 7f98177fe640 1 --2- 172.21.15.116:0/935749776 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f981815e2d0 0x7f98180b5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:53.251 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.254+0000 7f9816ffd640 1 --2- 172.21.15.116:0/935749776 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f981806ee20 0x7f98181f3e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:53.251 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.254+0000 7f98167fc640 1 -- 172.21.15.116:0/935749776 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f981815e2d0 msgr2=0x7f98180b5970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:53.251 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.254+0000 7f98167fc640 1 --2- 172.21.15.116:0/935749776 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f981815e2d0 0x7f98180b5970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:53.251 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.254+0000 7f98167fc640 1 -- 172.21.15.116:0/935749776 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f981806ee20 msgr2=0x7f98181f3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:53.251 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.254+0000 7f98167fc640 1 --2- 172.21.15.116:0/935749776 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f981806ee20 0x7f98181f3e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:53.252 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.254+0000 7f98167fc640 1 -- 172.21.15.116:0/935749776 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f981815ab90 con 0x7f981806fb60 2024-02-21T22:52:53.252 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.254+0000 7f98167fc640 1 --2- 172.21.15.116:0/935749776 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f981806fb60 0x7f981815a650 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f980c009870 tx=0x7f980c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:52:53.252 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.255+0000 7f97fffff640 1 -- 172.21.15.116:0/935749776 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f980c042070 con 0x7f981806fb60 2024-02-21T22:52:53.252 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.255+0000 7f97fffff640 1 -- 172.21.15.116:0/935749776 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f980c0329c0 con 0x7f981806fb60 2024-02-21T22:52:53.252 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.255+0000 7f981d8c8640 1 -- 172.21.15.116:0/935749776 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98181f44e0 con 0x7f981806fb60 2024-02-21T22:52:53.252 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.255+0000 7f97fffff640 1 -- 172.21.15.116:0/935749776 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f980c037040 con 0x7f981806fb60 2024-02-21T22:52:53.252 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.255+0000 7f981d8c8640 1 -- 172.21.15.116:0/935749776 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98181f4aa0 con 0x7f981806fb60 2024-02-21T22:52:53.252 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.256+0000 7f981d8c8640 1 -- 172.21.15.116:0/935749776 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98180752f0 con 0x7f981806fb60 2024-02-21T22:52:53.252 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.256+0000 7f97fffff640 1 -- 172.21.15.116:0/935749776 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f980c045070 con 0x7f981806fb60 2024-02-21T22:52:53.253 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.256+0000 7f97fffff640 1 --2- 172.21.15.116:0/935749776 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f980406b500 0x7f980406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:53.253 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.256+0000 7f97fffff640 1 -- 172.21.15.116:0/935749776 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f980c0ac240 con 0x7f981806fb60 2024-02-21T22:52:53.253 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.257+0000 7f9816ffd640 1 --2- 172.21.15.116:0/935749776 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f980406b500 0x7f980406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:53.253 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.257+0000 7f9816ffd640 1 --2- 172.21.15.116:0/935749776 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f980406b500 0x7f980406d9c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f98080012e0 tx=0x7f98080017c0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:52:53.253 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.261+0000 7f97fffff640 1 -- 172.21.15.116:0/935749776 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f980c07ab00 con 0x7f981806fb60 2024-02-21T22:52:53.425 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.434+0000 7f981d8c8640 1 -- 172.21.15.116:0/935749776 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f98180b0d60 con 0x7f981806fb60 2024-02-21T22:52:53.426 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.435+0000 7f97fffff640 1 -- 172.21.15.116:0/935749776 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16653 (secure 0 0 0) 0x7f980c07eba0 con 0x7f981806fb60 2024-02-21T22:52:53.426 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-02-21T22:52:53.426 INFO:teuthology.orchestra.run.smithi116.stdout:{"epoch":20,"fsid":"7c298660-5f63-4b5c-a800-58c5be9a8445","created":"2024-02-21T22:52:25.994613+0000","modified":"2024-02-21T22:52:51.786454+0000","last_up_change":"2024-02-21T22:52:37.313595+0000","last_in_change":"2024-02-21T22:52:28.176031+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-21T22:52:38.328796+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-21T22:52:48.145152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-21T22:52:49.096955+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4f09126b-b5e4-4876-8b08-f5cbb967388a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":1613202231},{"type":"v1","addr":"172.21.15.116:6809","nonce":1613202231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":1613202231},{"type":"v1","addr":"172.21.15.116:6811","nonce":1613202231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":1613202231},{"type":"v1","addr":"172.21.15.116:6815","nonce":1613202231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":1613202231},{"type":"v1","addr":"172.21.15.116:6813","nonce":1613202231}]},"public_addr":"172.21.15.116:6809/1613202231","cluster_addr":"172.21.15.116:6811/1613202231","heartbeat_back_addr":"172.21.15.116:6815/1613202231","heartbeat_front_addr":"172.21.15.116:6813/1613202231","state":["exists","up"]},{"osd":1,"uuid":"7272c51d-51f9-4536-931d-33ad7a4b377e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6816","nonce":172614746},{"type":"v1","addr":"172.21.15.116:6817","nonce":172614746}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":172614746},{"type":"v1","addr":"172.21.15.116:6819","nonce":172614746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":172614746},{"type":"v1","addr":"172.21.15.116:6823","nonce":172614746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":172614746},{"type":"v1","addr":"172.21.15.116:6821","nonce":172614746}]},"public_addr":"172.21.15.116:6817/172614746","cluster_addr":"172.21.15.116:6819/172614746","heartbeat_back_addr":"172.21.15.116:6823/172614746","heartbeat_front_addr":"172.21.15.116:6821/172614746","state":["exists","up"]},{"osd":2,"uuid":"2589616c-adf1-4187-aac3-735256cf624b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":1029280577},{"type":"v1","addr":"172.21.15.116:6825","nonce":1029280577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":1029280577},{"type":"v1","addr":"172.21.15.116:6827","nonce":1029280577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":1029280577},{"type":"v1","addr":"172.21.15.116:6831","nonce":1029280577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":1029280577},{"type":"v1","addr":"172.21.15.116:6829","nonce":1029280577}]},"public_addr":"172.21.15.116:6825/1029280577","cluster_addr":"172.21.15.116:6827/1029280577","heartbeat_back_addr":"172.21.15.116:6831/1029280577","heartbeat_front_addr":"172.21.15.116:6829/1029280577","state":["exists","up"]},{"osd":3,"uuid":"0fd2e563-7c5b-46f6-82c2-b60c86072c93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":3106627557},{"type":"v1","addr":"172.21.15.116:6801","nonce":3106627557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":3106627557},{"type":"v1","addr":"172.21.15.116:6803","nonce":3106627557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":3106627557},{"type":"v1","addr":"172.21.15.116:6807","nonce":3106627557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":3106627557},{"type":"v1","addr":"172.21.15.116:6805","nonce":3106627557}]},"public_addr":"172.21.15.116:6801/3106627557","cluster_addr":"172.21.15.116:6803/3106627557","heartbeat_back_addr":"172.21.15.116:6807/3106627557","heartbeat_front_addr":"172.21.15.116:6805/3106627557","state":["exists","up"]},{"osd":4,"uuid":"79ae35b7-dda8-4ab8-96ce-47515afde082","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":3231407772},{"type":"v1","addr":"172.21.15.142:6825","nonce":3231407772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":3231407772},{"type":"v1","addr":"172.21.15.142:6827","nonce":3231407772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":3231407772},{"type":"v1","addr":"172.21.15.142:6831","nonce":3231407772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":3231407772},{"type":"v1","addr":"172.21.15.142:6829","nonce":3231407772}]},"public_addr":"172.21.15.142:6825/3231407772","cluster_addr":"172.21.15.142:6827/3231407772","heartbeat_back_addr":"172.21.15.142:6831/3231407772","heartbeat_front_addr":"172.21.15.142:6829/3231407772","state":["exists","up"]},{"osd":5,"uuid":"3166eb2c-3fcf-41c8-9362-45bafaabaa39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":1184158716},{"type":"v1","addr":"172.21.15.142:6817","nonce":1184158716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":1184158716},{"type":"v1","addr":"172.21.15.142:6819","nonce":1184158716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":1184158716},{"type":"v1","addr":"172.21.15.142:6823","nonce":1184158716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":1184158716},{"type":"v1","addr":"172.21.15.142:6821","nonce":1184158716}]},"public_addr":"172.21.15.142:6817/1184158716","cluster_addr":"172.21.15.142:6819/1184158716","heartbeat_back_addr":"172.21.15.142:6823/1184158716","heartbeat_front_addr":"172.21.15.142:6821/1184158716","state":["exists","up"]},{"osd":6,"uuid":"f9aa9672-7527-43e2-963e-b61868e5e63f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":1987868911},{"type":"v1","addr":"172.21.15.142:6801","nonce":1987868911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":1987868911},{"type":"v1","addr":"172.21.15.142:6803","nonce":1987868911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":1987868911},{"type":"v1","addr":"172.21.15.142:6807","nonce":1987868911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":1987868911},{"type":"v1","addr":"172.21.15.142:6805","nonce":1987868911}]},"public_addr":"172.21.15.142:6801/1987868911","cluster_addr":"172.21.15.142:6803/1987868911","heartbeat_back_addr":"172.21.15.142:6807/1987868911","heartbeat_front_addr":"172.21.15.142:6805/1987868911","state":["exists","up"]},{"osd":7,"uuid":"7ed29226-fc42-4382-a91a-fa50f7ec5426","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":1272081937},{"type":"v1","addr":"172.21.15.142:6809","nonce":1272081937}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":1272081937},{"type":"v1","addr":"172.21.15.142:6811","nonce":1272081937}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":1272081937},{"type":"v1","addr":"172.21.15.142:6815","nonce":1272081937}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":1272081937},{"type":"v1","addr":"172.21.15.142:6813","nonce":1272081937}]},"public_addr":"172.21.15.142:6809/1272081937","cluster_addr":"172.21.15.142:6811/1272081937","heartbeat_back_addr":"172.21.15.142:6815/1272081937","heartbeat_front_addr":"172.21.15.142:6813/1272081937","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.350998+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.307201+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.289112+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.243888+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.312091+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.370472+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.275659+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.289297+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-21T22:52:53.428 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.437+0000 7f981d8c8640 1 -- 172.21.15.116:0/935749776 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f980406b500 msgr2=0x7f980406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:53.428 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.437+0000 7f981d8c8640 1 --2- 172.21.15.116:0/935749776 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f980406b500 0x7f980406d9c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f98080012e0 tx=0x7f98080017c0 comp rx=0 tx=0).stop 2024-02-21T22:52:53.428 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.437+0000 7f981d8c8640 1 -- 172.21.15.116:0/935749776 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f981806fb60 msgr2=0x7f981815a650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:53.428 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.437+0000 7f981d8c8640 1 --2- 172.21.15.116:0/935749776 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f981806fb60 0x7f981815a650 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f980c009870 tx=0x7f980c0046c0 comp rx=0 tx=0).stop 2024-02-21T22:52:53.428 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.437+0000 7f981d8c8640 1 -- 172.21.15.116:0/935749776 shutdown_connections 2024-02-21T22:52:53.428 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.437+0000 7f981d8c8640 1 --2- 172.21.15.116:0/935749776 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f980406b500 0x7f980406d9c0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:53.428 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.437+0000 7f981d8c8640 1 --2- 172.21.15.116:0/935749776 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f981815e2d0 0x7f98180b5970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:53.429 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.437+0000 7f981d8c8640 1 --2- 172.21.15.116:0/935749776 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f981806fb60 0x7f981815a650 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:53.429 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.437+0000 7f981d8c8640 1 --2- 172.21.15.116:0/935749776 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f981806ee20 0x7f98181f3e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:53.429 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.437+0000 7f981d8c8640 1 -- 172.21.15.116:0/935749776 >> 172.21.15.116:0/935749776 conn(0x7f98180b3730 msgr2=0x7f981806cd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:52:53.429 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.437+0000 7f981d8c8640 1 -- 172.21.15.116:0/935749776 shutdown_connections 2024-02-21T22:52:53.429 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.437+0000 7f981d8c8640 1 -- 172.21.15.116:0/935749776 wait complete. 2024-02-21T22:52:53.439 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-02-21T22:52:53.439 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-21T22:52:53.541 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.549+0000 7f8b21168640 1 Processor -- start 2024-02-21T22:52:53.541 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.549+0000 7f8b21168640 1 -- start start 2024-02-21T22:52:53.541 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.550+0000 7f8b21168640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f8b1c15e180 0x7f8b1c0d1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:53.541 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.550+0000 7f8b21168640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8b1c0d0fc0 0x7f8b1c0b0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:53.541 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.550+0000 7f8b21168640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b1c0ce8f0 con 0x7f8b1c15e560 2024-02-21T22:52:53.541 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.550+0000 7f8b21168640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b1c0b31b0 con 0x7f8b1c15e180 2024-02-21T22:52:53.541 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.550+0000 7f8b21168640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b1c0d2100 con 0x7f8b1c0d0fc0 2024-02-21T22:52:53.541 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.550+0000 7f8b1ad9d640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f8b1c15e180 0x7f8b1c0d1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:53.542 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.550+0000 7f8b1b59e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8b1c0d0fc0 0x7f8b1c0b0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:53.542 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.550+0000 7f8b1ad9d640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f8b1c15e180 0x7f8b1c0d1bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.116:46692/0 (socket says 172.21.15.116:46692) 2024-02-21T22:52:53.542 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.550+0000 7f8b1b59e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8b1c0d0fc0 0x7f8b1c0b0a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.116:44276/0 (socket says 172.21.15.116:44276) 2024-02-21T22:52:53.542 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.550+0000 7f8b13fff640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f8b1c15e560 0x7f8b1c0cf650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.116:49278/0 (socket says 172.21.15.116:49278) 2024-02-21T22:52:53.542 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.550+0000 7f8b1ad9d640 1 -- 172.21.15.116:0/2565557538 learned_addr learned my addr 172.21.15.116:0/2565557538 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:52:53.542 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.550+0000 7f8b1b59e640 1 -- 172.21.15.116:0/2565557538 >> v2:172.21.15.142:3300/0 conn(0x7f8b1c15e180 msgr2=0x7f8b1c0d1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:52:53.542 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.550+0000 7f8b1b59e640 1 --2- 172.21.15.116:0/2565557538 >> v2:172.21.15.142:3300/0 conn(0x7f8b1c15e180 0x7f8b1c0d1bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:53.543 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.550+0000 7f8b1b59e640 1 -- 172.21.15.116:0/2565557538 >> v1:172.21.15.142:6789/0 conn(0x7f8b1c15e560 legacy=0x7f8b1c0cf650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:53.543 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.550+0000 7f8b1b59e640 1 -- 172.21.15.116:0/2565557538 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b1c0d1530 con 0x7f8b1c0d0fc0 2024-02-21T22:52:53.543 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.550+0000 7f8b1a59c640 1 -- 172.21.15.116:0/2565557538 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 145847320 0 0) 0x7f8b04001110 con 0x7f8b1c15e560 2024-02-21T22:52:53.543 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.550+0000 7f8b1ad9d640 1 --2- 172.21.15.116:0/2565557538 >> v2:172.21.15.142:3300/0 conn(0x7f8b1c15e180 0x7f8b1c0d1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T22:52:53.547 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.551+0000 7f8b1b59e640 1 --2- 172.21.15.116:0/2565557538 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8b1c0d0fc0 0x7f8b1c0b0a10 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f8b14009d90 tx=0x7f8b1402bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1eda403719f357d8 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:52:53.547 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.551+0000 7f8b1a59c640 1 -- 172.21.15.116:0/2565557538 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b14039070 con 0x7f8b1c0d0fc0 2024-02-21T22:52:53.548 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.551+0000 7f8b1a59c640 1 -- 172.21.15.116:0/2565557538 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b1402cc50 con 0x7f8b1c0d0fc0 2024-02-21T22:52:53.548 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.551+0000 7f8b1a59c640 1 -- 172.21.15.116:0/2565557538 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b14034440 con 0x7f8b1c0d0fc0 2024-02-21T22:52:53.548 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.551+0000 7f8b21168640 1 -- 172.21.15.116:0/2565557538 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8b1c0d0fc0 msgr2=0x7f8b1c0b0a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:53.548 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.551+0000 7f8b21168640 1 --2- 172.21.15.116:0/2565557538 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8b1c0d0fc0 0x7f8b1c0b0a10 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f8b14009d90 tx=0x7f8b1402bea0 comp rx=0 tx=0).stop 2024-02-21T22:52:53.548 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.552+0000 7f8b21168640 1 -- 172.21.15.116:0/2565557538 shutdown_connections 2024-02-21T22:52:53.548 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.552+0000 7f8b21168640 1 --2- 172.21.15.116:0/2565557538 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8b1c0d0fc0 0x7f8b1c0b0a10 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:53.548 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.552+0000 7f8b21168640 1 --2- 172.21.15.116:0/2565557538 >> v2:172.21.15.142:3300/0 conn(0x7f8b1c15e180 0x7f8b1c0d1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:53.548 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.552+0000 7f8b21168640 1 -- 172.21.15.116:0/2565557538 >> 172.21.15.116:0/2565557538 conn(0x7f8b1c0d3de0 msgr2=0x7f8b1c0d41f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:52:53.548 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.552+0000 7f8b21168640 1 -- 172.21.15.116:0/2565557538 shutdown_connections 2024-02-21T22:52:53.548 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.552+0000 7f8b21168640 1 -- 172.21.15.116:0/2565557538 wait complete. 2024-02-21T22:52:53.548 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.553+0000 7f8b21168640 1 Processor -- start 2024-02-21T22:52:53.548 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.553+0000 7f8b21168640 1 -- start start 2024-02-21T22:52:53.548 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.553+0000 7f8b21168640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8b1c0d0fc0 0x7f8b1c0b3330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:53.548 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.553+0000 7f8b21168640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8b1c15e180 0x7f8b1c14e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:53.548 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.553+0000 7f8b21168640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8b1c15e560 0x7f8b1c1e8710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:53.549 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.553+0000 7f8b21168640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b1c0cee50 con 0x7f8b1c15e180 2024-02-21T22:52:53.549 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.553+0000 7f8b21168640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b1c0cf1c0 con 0x7f8b1c0d0fc0 2024-02-21T22:52:53.549 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.553+0000 7f8b21168640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b1c0cfd60 con 0x7f8b1c15e560 2024-02-21T22:52:53.549 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.554+0000 7f8b13fff640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8b1c15e180 0x7f8b1c14e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:53.549 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.554+0000 7f8b13fff640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8b1c15e180 0x7f8b1c14e060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:51004/0 (socket says 172.21.15.116:51004) 2024-02-21T22:52:53.549 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.554+0000 7f8b13fff640 1 -- 172.21.15.116:0/1238570375 learned_addr learned my addr 172.21.15.116:0/1238570375 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:52:53.549 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.554+0000 7f8b1ad9d640 1 --2- 172.21.15.116:0/1238570375 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8b1c0d0fc0 0x7f8b1c0b3330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:53.549 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.554+0000 7f8b1b59e640 1 --2- 172.21.15.116:0/1238570375 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8b1c15e560 0x7f8b1c1e8710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:53.549 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.554+0000 7f8b13fff640 1 -- 172.21.15.116:0/1238570375 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8b1c15e560 msgr2=0x7f8b1c1e8710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:53.549 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.554+0000 7f8b13fff640 1 --2- 172.21.15.116:0/1238570375 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8b1c15e560 0x7f8b1c1e8710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:53.549 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.554+0000 7f8b13fff640 1 -- 172.21.15.116:0/1238570375 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8b1c0d0fc0 msgr2=0x7f8b1c0b3330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:53.549 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.554+0000 7f8b13fff640 1 --2- 172.21.15.116:0/1238570375 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8b1c0d0fc0 0x7f8b1c0b3330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:53.549 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.554+0000 7f8b13fff640 1 -- 172.21.15.116:0/1238570375 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b1c0b3870 con 0x7f8b1c15e180 2024-02-21T22:52:53.549 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.554+0000 7f8b1b59e640 1 --2- 172.21.15.116:0/1238570375 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8b1c15e560 0x7f8b1c1e8710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T22:52:53.549 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.554+0000 7f8b13fff640 1 --2- 172.21.15.116:0/1238570375 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8b1c15e180 0x7f8b1c14e060 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f8b0400c780 tx=0x7f8b0400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:52:53.550 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.554+0000 7f8b137fe640 1 -- 172.21.15.116:0/1238570375 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b04018070 con 0x7f8b1c15e180 2024-02-21T22:52:53.550 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.554+0000 7f8b137fe640 1 -- 172.21.15.116:0/1238570375 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b040072d0 con 0x7f8b1c15e180 2024-02-21T22:52:53.550 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.554+0000 7f8b21168640 1 -- 172.21.15.116:0/1238570375 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b1c14e5a0 con 0x7f8b1c15e180 2024-02-21T22:52:53.550 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.554+0000 7f8b137fe640 1 -- 172.21.15.116:0/1238570375 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b040047e0 con 0x7f8b1c15e180 2024-02-21T22:52:53.550 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.554+0000 7f8b21168640 1 -- 172.21.15.116:0/1238570375 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b1c1e8200 con 0x7f8b1c15e180 2024-02-21T22:52:53.550 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.555+0000 7f8b21168640 1 -- 172.21.15.116:0/1238570375 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b1c0752f0 con 0x7f8b1c15e180 2024-02-21T22:52:53.550 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.556+0000 7f8b137fe640 1 -- 172.21.15.116:0/1238570375 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f8b0401b070 con 0x7f8b1c15e180 2024-02-21T22:52:53.550 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.556+0000 7f8b137fe640 1 --2- 172.21.15.116:0/1238570375 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f8afc06b520 0x7f8afc06d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:53.550 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.556+0000 7f8b137fe640 1 -- 172.21.15.116:0/1238570375 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8b04089500 con 0x7f8b1c15e180 2024-02-21T22:52:53.550 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.556+0000 7f8b1ad9d640 1 --2- 172.21.15.116:0/1238570375 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f8afc06b520 0x7f8afc06d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:53.550 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.556+0000 7f8b1ad9d640 1 --2- 172.21.15.116:0/1238570375 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f8afc06b520 0x7f8afc06d9e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f8b0c006ca0 tx=0x7f8b0c009240 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:52:53.551 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.560+0000 7f8b137fe640 1 -- 172.21.15.116:0/1238570375 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f8b1c0ce8f0 con 0x7f8b1c15e180 2024-02-21T22:52:53.718 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.727+0000 7f8b21168640 1 -- 172.21.15.116:0/1238570375 --> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8b1c08d5a0 con 0x7f8afc06b520 2024-02-21T22:52:53.724 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.734+0000 7f8b137fe640 1 -- 172.21.15.116:0/1238570375 <== mgr.4103 v2:172.21.15.142:6832/1381484782 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+237079 (secure 0 0 0) 0x7f8b1c08d5a0 con 0x7f8afc06b520 2024-02-21T22:52:53.727 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-02-21T22:52:53.728 INFO:teuthology.orchestra.run.smithi116.stderr:dumped all 2024-02-21T22:52:53.730 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.736+0000 7f8b21168640 1 -- 172.21.15.116:0/1238570375 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f8afc06b520 msgr2=0x7f8afc06d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:53.730 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.736+0000 7f8b21168640 1 --2- 172.21.15.116:0/1238570375 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f8afc06b520 0x7f8afc06d9e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f8b0c006ca0 tx=0x7f8b0c009240 comp rx=0 tx=0).stop 2024-02-21T22:52:53.730 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.736+0000 7f8b21168640 1 -- 172.21.15.116:0/1238570375 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8b1c15e180 msgr2=0x7f8b1c14e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:53.730 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.736+0000 7f8b21168640 1 --2- 172.21.15.116:0/1238570375 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8b1c15e180 0x7f8b1c14e060 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f8b0400c780 tx=0x7f8b0400cc40 comp rx=0 tx=0).stop 2024-02-21T22:52:53.730 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.736+0000 7f8b21168640 1 -- 172.21.15.116:0/1238570375 shutdown_connections 2024-02-21T22:52:53.730 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.736+0000 7f8b21168640 1 --2- 172.21.15.116:0/1238570375 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f8afc06b520 0x7f8afc06d9e0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:53.731 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.736+0000 7f8b21168640 1 --2- 172.21.15.116:0/1238570375 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8b1c15e560 0x7f8b1c1e8710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:53.731 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.736+0000 7f8b21168640 1 --2- 172.21.15.116:0/1238570375 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8b1c15e180 0x7f8b1c14e060 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:53.731 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.736+0000 7f8b21168640 1 --2- 172.21.15.116:0/1238570375 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8b1c0d0fc0 0x7f8b1c0b3330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:53.731 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.736+0000 7f8b21168640 1 -- 172.21.15.116:0/1238570375 >> 172.21.15.116:0/1238570375 conn(0x7f8b1c0d3de0 msgr2=0x7f8b1c0d41c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:52:53.731 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.737+0000 7f8b21168640 1 -- 172.21.15.116:0/1238570375 shutdown_connections 2024-02-21T22:52:53.731 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.737+0000 7f8b21168640 1 -- 172.21.15.116:0/1238570375 wait complete. 2024-02-21T22:52:53.738 INFO:teuthology.orchestra.run.smithi116.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2024-02-21T22:52:52.287953+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":219664,"kb_used_data":2376,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755056,"statfs":{"total":773094113280,"available":772869177344,"internally_reserved":0,"allocated":2433024,"data_stored":1546872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000857"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:49.766243+0000","last_change":"2024-02-21T22:52:49.766243+0000","last_active":"2024-02-21T22:52:49.766243+0000","last_peered":"2024-02-21T22:52:49.766243+0000","last_clean":"2024-02-21T22:52:49.766243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:49.766243+0000","last_undegraded":"2024-02-21T22:52:49.766243+0000","last_fullsized":"2024-02-21T22:52:49.766243+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:49.766243+0000","last_change":"2024-02-21T22:52:49.766243+0000","last_active":"2024-02-21T22:52:49.766243+0000","last_peered":"2024-02-21T22:52:49.766243+0000","last_clean":"2024-02-21T22:52:49.766243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:49.766243+0000","last_undegraded":"2024-02-21T22:52:49.766243+0000","last_fullsized":"2024-02-21T22:52:49.766243+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:49.766243+0000","last_change":"2024-02-21T22:52:49.766243+0000","last_active":"2024-02-21T22:52:49.766243+0000","last_peered":"2024-02-21T22:52:49.766243+0000","last_clean":"2024-02-21T22:52:49.766243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:49.766243+0000","last_undegraded":"2024-02-21T22:52:49.766243+0000","last_fullsized":"2024-02-21T22:52:49.766243+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:49.766243+0000","last_change":"2024-02-21T22:52:49.766243+0000","last_active":"2024-02-21T22:52:49.766243+0000","last_peered":"2024-02-21T22:52:49.766243+0000","last_clean":"2024-02-21T22:52:49.766243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:49.766243+0000","last_undegraded":"2024-02-21T22:52:49.766243+0000","last_fullsized":"2024-02-21T22:52:49.766243+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:49.766243+0000","last_change":"2024-02-21T22:52:49.766243+0000","last_active":"2024-02-21T22:52:49.766243+0000","last_peered":"2024-02-21T22:52:49.766243+0000","last_clean":"2024-02-21T22:52:49.766243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:49.766243+0000","last_undegraded":"2024-02-21T22:52:49.766243+0000","last_fullsized":"2024-02-21T22:52:49.766243+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:49.766243+0000","last_change":"2024-02-21T22:52:49.766243+0000","last_active":"2024-02-21T22:52:49.766243+0000","last_peered":"2024-02-21T22:52:49.766243+0000","last_clean":"2024-02-21T22:52:49.766243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:49.766243+0000","last_undegraded":"2024-02-21T22:52:49.766243+0000","last_fullsized":"2024-02-21T22:52:49.766243+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:49.766243+0000","last_change":"2024-02-21T22:52:49.766243+0000","last_active":"2024-02-21T22:52:49.766243+0000","last_peered":"2024-02-21T22:52:49.766243+0000","last_clean":"2024-02-21T22:52:49.766243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:49.766243+0000","last_undegraded":"2024-02-21T22:52:49.766243+0000","last_fullsized":"2024-02-21T22:52:49.766243+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:49.766243+0000","last_change":"2024-02-21T22:52:49.766243+0000","last_active":"2024-02-21T22:52:49.766243+0000","last_peered":"2024-02-21T22:52:49.766243+0000","last_clean":"2024-02-21T22:52:49.766243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:49.766243+0000","last_undegraded":"2024-02-21T22:52:49.766243+0000","last_fullsized":"2024-02-21T22:52:49.766243+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:49.766243+0000","last_change":"2024-02-21T22:52:49.766243+0000","last_active":"2024-02-21T22:52:49.766243+0000","last_peered":"2024-02-21T22:52:49.766243+0000","last_clean":"2024-02-21T22:52:49.766243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:49.766243+0000","last_undegraded":"2024-02-21T22:52:49.766243+0000","last_fullsized":"2024-02-21T22:52:49.766243+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:49.766243+0000","last_change":"2024-02-21T22:52:49.766243+0000","last_active":"2024-02-21T22:52:49.766243+0000","last_peered":"2024-02-21T22:52:49.766243+0000","last_clean":"2024-02-21T22:52:49.766243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:49.766243+0000","last_undegraded":"2024-02-21T22:52:49.766243+0000","last_fullsized":"2024-02-21T22:52:49.766243+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:49.766243+0000","last_change":"2024-02-21T22:52:49.766243+0000","last_active":"2024-02-21T22:52:49.766243+0000","last_peered":"2024-02-21T22:52:49.766243+0000","last_clean":"2024-02-21T22:52:49.766243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:49.766243+0000","last_undegraded":"2024-02-21T22:52:49.766243+0000","last_fullsized":"2024-02-21T22:52:49.766243+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:49.766243+0000","last_change":"2024-02-21T22:52:49.766243+0000","last_active":"2024-02-21T22:52:49.766243+0000","last_peered":"2024-02-21T22:52:49.766243+0000","last_clean":"2024-02-21T22:52:49.766243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:49.766243+0000","last_undegraded":"2024-02-21T22:52:49.766243+0000","last_fullsized":"2024-02-21T22:52:49.766243+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:49.766243+0000","last_change":"2024-02-21T22:52:49.766243+0000","last_active":"2024-02-21T22:52:49.766243+0000","last_peered":"2024-02-21T22:52:49.766243+0000","last_clean":"2024-02-21T22:52:49.766243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:49.766243+0000","last_undegraded":"2024-02-21T22:52:49.766243+0000","last_fullsized":"2024-02-21T22:52:49.766243+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:49.766243+0000","last_change":"2024-02-21T22:52:49.766243+0000","last_active":"2024-02-21T22:52:49.766243+0000","last_peered":"2024-02-21T22:52:49.766243+0000","last_clean":"2024-02-21T22:52:49.766243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:49.766243+0000","last_undegraded":"2024-02-21T22:52:49.766243+0000","last_fullsized":"2024-02-21T22:52:49.766243+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:49.766243+0000","last_change":"2024-02-21T22:52:49.766243+0000","last_active":"2024-02-21T22:52:49.766243+0000","last_peered":"2024-02-21T22:52:49.766243+0000","last_clean":"2024-02-21T22:52:49.766243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:49.766243+0000","last_undegraded":"2024-02-21T22:52:49.766243+0000","last_fullsized":"2024-02-21T22:52:49.766243+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:49.766243+0000","last_change":"2024-02-21T22:52:49.766243+0000","last_active":"2024-02-21T22:52:49.766243+0000","last_peered":"2024-02-21T22:52:49.766243+0000","last_clean":"2024-02-21T22:52:49.766243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:49.766243+0000","last_undegraded":"2024-02-21T22:52:49.766243+0000","last_fullsized":"2024-02-21T22:52:49.766243+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:49.766243+0000","last_change":"2024-02-21T22:52:49.766243+0000","last_active":"2024-02-21T22:52:49.766243+0000","last_peered":"2024-02-21T22:52:49.766243+0000","last_clean":"2024-02-21T22:52:49.766243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:49.766243+0000","last_undegraded":"2024-02-21T22:52:49.766243+0000","last_fullsized":"2024-02-21T22:52:49.766243+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:49.766243+0000","last_change":"2024-02-21T22:52:49.766243+0000","last_active":"2024-02-21T22:52:49.766243+0000","last_peered":"2024-02-21T22:52:49.766243+0000","last_clean":"2024-02-21T22:52:49.766243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:49.766243+0000","last_undegraded":"2024-02-21T22:52:49.766243+0000","last_fullsized":"2024-02-21T22:52:49.766243+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:49.766243+0000","last_change":"2024-02-21T22:52:49.766243+0000","last_active":"2024-02-21T22:52:49.766243+0000","last_peered":"2024-02-21T22:52:49.766243+0000","last_clean":"2024-02-21T22:52:49.766243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:49.766243+0000","last_undegraded":"2024-02-21T22:52:49.766243+0000","last_fullsized":"2024-02-21T22:52:49.766243+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:49.766243+0000","last_change":"2024-02-21T22:52:49.766243+0000","last_active":"2024-02-21T22:52:49.766243+0000","last_peered":"2024-02-21T22:52:49.766243+0000","last_clean":"2024-02-21T22:52:49.766243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:49.766243+0000","last_undegraded":"2024-02-21T22:52:49.766243+0000","last_fullsized":"2024-02-21T22:52:49.766243+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:49.766243+0000","last_change":"2024-02-21T22:52:49.766243+0000","last_active":"2024-02-21T22:52:49.766243+0000","last_peered":"2024-02-21T22:52:49.766243+0000","last_clean":"2024-02-21T22:52:49.766243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:49.766243+0000","last_undegraded":"2024-02-21T22:52:49.766243+0000","last_fullsized":"2024-02-21T22:52:49.766243+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:49.766243+0000","last_change":"2024-02-21T22:52:49.766243+0000","last_active":"2024-02-21T22:52:49.766243+0000","last_peered":"2024-02-21T22:52:49.766243+0000","last_clean":"2024-02-21T22:52:49.766243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:49.766243+0000","last_undegraded":"2024-02-21T22:52:49.766243+0000","last_fullsized":"2024-02-21T22:52:49.766243+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:49.766243+0000","last_change":"2024-02-21T22:52:49.766243+0000","last_active":"2024-02-21T22:52:49.766243+0000","last_peered":"2024-02-21T22:52:49.766243+0000","last_clean":"2024-02-21T22:52:49.766243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:49.766243+0000","last_undegraded":"2024-02-21T22:52:49.766243+0000","last_fullsized":"2024-02-21T22:52:49.766243+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:49.766243+0000","last_change":"2024-02-21T22:52:49.766243+0000","last_active":"2024-02-21T22:52:49.766243+0000","last_peered":"2024-02-21T22:52:49.766243+0000","last_clean":"2024-02-21T22:52:49.766243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:49.766243+0000","last_undegraded":"2024-02-21T22:52:49.766243+0000","last_fullsized":"2024-02-21T22:52:49.766243+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:49.766243+0000","last_change":"2024-02-21T22:52:49.766243+0000","last_active":"2024-02-21T22:52:49.766243+0000","last_peered":"2024-02-21T22:52:49.766243+0000","last_clean":"2024-02-21T22:52:49.766243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:49.766243+0000","last_undegraded":"2024-02-21T22:52:49.766243+0000","last_fullsized":"2024-02-21T22:52:49.766243+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:49.766243+0000","last_change":"2024-02-21T22:52:49.766243+0000","last_active":"2024-02-21T22:52:49.766243+0000","last_peered":"2024-02-21T22:52:49.766243+0000","last_clean":"2024-02-21T22:52:49.766243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:49.766243+0000","last_undegraded":"2024-02-21T22:52:49.766243+0000","last_fullsized":"2024-02-21T22:52:49.766243+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:49.766243+0000","last_change":"2024-02-21T22:52:49.766243+0000","last_active":"2024-02-21T22:52:49.766243+0000","last_peered":"2024-02-21T22:52:49.766243+0000","last_clean":"2024-02-21T22:52:49.766243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:49.766243+0000","last_undegraded":"2024-02-21T22:52:49.766243+0000","last_fullsized":"2024-02-21T22:52:49.766243+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:49.766243+0000","last_change":"2024-02-21T22:52:49.766243+0000","last_active":"2024-02-21T22:52:49.766243+0000","last_peered":"2024-02-21T22:52:49.766243+0000","last_clean":"2024-02-21T22:52:49.766243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:49.766243+0000","last_undegraded":"2024-02-21T22:52:49.766243+0000","last_fullsized":"2024-02-21T22:52:49.766243+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:49.766243+0000","last_change":"2024-02-21T22:52:49.766243+0000","last_active":"2024-02-21T22:52:49.766243+0000","last_peered":"2024-02-21T22:52:49.766243+0000","last_clean":"2024-02-21T22:52:49.766243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:49.766243+0000","last_undegraded":"2024-02-21T22:52:49.766243+0000","last_fullsized":"2024-02-21T22:52:49.766243+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:49.766243+0000","last_change":"2024-02-21T22:52:49.766243+0000","last_active":"2024-02-21T22:52:49.766243+0000","last_peered":"2024-02-21T22:52:49.766243+0000","last_clean":"2024-02-21T22:52:49.766243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:49.766243+0000","last_undegraded":"2024-02-21T22:52:49.766243+0000","last_fullsized":"2024-02-21T22:52:49.766243+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:49.766243+0000","last_change":"2024-02-21T22:52:49.766243+0000","last_active":"2024-02-21T22:52:49.766243+0000","last_peered":"2024-02-21T22:52:49.766243+0000","last_clean":"2024-02-21T22:52:49.766243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:49.766243+0000","last_undegraded":"2024-02-21T22:52:49.766243+0000","last_fullsized":"2024-02-21T22:52:49.766243+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:49.766243+0000","last_change":"2024-02-21T22:52:49.766243+0000","last_active":"2024-02-21T22:52:49.766243+0000","last_peered":"2024-02-21T22:52:49.766243+0000","last_clean":"2024-02-21T22:52:49.766243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:49.766243+0000","last_undegraded":"2024-02-21T22:52:49.766243+0000","last_fullsized":"2024-02-21T22:52:49.766243+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:49.766243+0000","last_change":"2024-02-21T22:52:49.766243+0000","last_active":"2024-02-21T22:52:49.766243+0000","last_peered":"2024-02-21T22:52:49.766243+0000","last_clean":"2024-02-21T22:52:49.766243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:49.766243+0000","last_undegraded":"2024-02-21T22:52:49.766243+0000","last_fullsized":"2024-02-21T22:52:49.766243+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:48.759135+0000","last_change":"2024-02-21T22:52:48.759135+0000","last_active":"2024-02-21T22:52:48.759135+0000","last_peered":"2024-02-21T22:52:48.759135+0000","last_clean":"2024-02-21T22:52:48.759135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:48.759135+0000","last_undegraded":"2024-02-21T22:52:48.759135+0000","last_fullsized":"2024-02-21T22:52:48.759135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:49.766243+0000","last_change":"2024-02-21T22:52:49.766243+0000","last_active":"2024-02-21T22:52:49.766243+0000","last_peered":"2024-02-21T22:52:49.766243+0000","last_clean":"2024-02-21T22:52:49.766243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:49.766243+0000","last_undegraded":"2024-02-21T22:52:49.766243+0000","last_fullsized":"2024-02-21T22:52:49.766243+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:48.759135+0000","last_change":"2024-02-21T22:52:48.759135+0000","last_active":"2024-02-21T22:52:48.759135+0000","last_peered":"2024-02-21T22:52:48.759135+0000","last_clean":"2024-02-21T22:52:48.759135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:48.759135+0000","last_undegraded":"2024-02-21T22:52:48.759135+0000","last_fullsized":"2024-02-21T22:52:48.759135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:48.759135+0000","last_change":"2024-02-21T22:52:48.759135+0000","last_active":"2024-02-21T22:52:48.759135+0000","last_peered":"2024-02-21T22:52:48.759135+0000","last_clean":"2024-02-21T22:52:48.759135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:48.759135+0000","last_undegraded":"2024-02-21T22:52:48.759135+0000","last_fullsized":"2024-02-21T22:52:48.759135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:49.766243+0000","last_change":"2024-02-21T22:52:49.766243+0000","last_active":"2024-02-21T22:52:49.766243+0000","last_peered":"2024-02-21T22:52:49.766243+0000","last_clean":"2024-02-21T22:52:49.766243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:49.766243+0000","last_undegraded":"2024-02-21T22:52:49.766243+0000","last_fullsized":"2024-02-21T22:52:49.766243+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:48.759135+0000","last_change":"2024-02-21T22:52:48.759135+0000","last_active":"2024-02-21T22:52:48.759135+0000","last_peered":"2024-02-21T22:52:48.759135+0000","last_clean":"2024-02-21T22:52:48.759135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:48.759135+0000","last_undegraded":"2024-02-21T22:52:48.759135+0000","last_fullsized":"2024-02-21T22:52:48.759135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:49.766243+0000","last_change":"2024-02-21T22:52:49.766243+0000","last_active":"2024-02-21T22:52:49.766243+0000","last_peered":"2024-02-21T22:52:49.766243+0000","last_clean":"2024-02-21T22:52:49.766243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:49.766243+0000","last_undegraded":"2024-02-21T22:52:49.766243+0000","last_fullsized":"2024-02-21T22:52:49.766243+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:48.759135+0000","last_change":"2024-02-21T22:52:48.759135+0000","last_active":"2024-02-21T22:52:48.759135+0000","last_peered":"2024-02-21T22:52:48.759135+0000","last_clean":"2024-02-21T22:52:48.759135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:48.759135+0000","last_undegraded":"2024-02-21T22:52:48.759135+0000","last_fullsized":"2024-02-21T22:52:48.759135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:49.766243+0000","last_change":"2024-02-21T22:52:49.766243+0000","last_active":"2024-02-21T22:52:49.766243+0000","last_peered":"2024-02-21T22:52:49.766243+0000","last_clean":"2024-02-21T22:52:49.766243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:49.766243+0000","last_undegraded":"2024-02-21T22:52:49.766243+0000","last_fullsized":"2024-02-21T22:52:49.766243+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:48.759135+0000","last_change":"2024-02-21T22:52:48.759135+0000","last_active":"2024-02-21T22:52:48.759135+0000","last_peered":"2024-02-21T22:52:48.759135+0000","last_clean":"2024-02-21T22:52:48.759135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:48.759135+0000","last_undegraded":"2024-02-21T22:52:48.759135+0000","last_fullsized":"2024-02-21T22:52:48.759135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:49.766243+0000","last_change":"2024-02-21T22:52:49.766243+0000","last_active":"2024-02-21T22:52:49.766243+0000","last_peered":"2024-02-21T22:52:49.766243+0000","last_clean":"2024-02-21T22:52:49.766243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:49.766243+0000","last_undegraded":"2024-02-21T22:52:49.766243+0000","last_fullsized":"2024-02-21T22:52:49.766243+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:48.759135+0000","last_change":"2024-02-21T22:52:48.759135+0000","last_active":"2024-02-21T22:52:48.759135+0000","last_peered":"2024-02-21T22:52:48.759135+0000","last_clean":"2024-02-21T22:52:48.759135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:48.759135+0000","last_undegraded":"2024-02-21T22:52:48.759135+0000","last_fullsized":"2024-02-21T22:52:48.759135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:49.766243+0000","last_change":"2024-02-21T22:52:49.766243+0000","last_active":"2024-02-21T22:52:49.766243+0000","last_peered":"2024-02-21T22:52:49.766243+0000","last_clean":"2024-02-21T22:52:49.766243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:49.766243+0000","last_undegraded":"2024-02-21T22:52:49.766243+0000","last_fullsized":"2024-02-21T22:52:49.766243+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:48.759135+0000","last_change":"2024-02-21T22:52:48.759135+0000","last_active":"2024-02-21T22:52:48.759135+0000","last_peered":"2024-02-21T22:52:48.759135+0000","last_clean":"2024-02-21T22:52:48.759135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:48.759135+0000","last_undegraded":"2024-02-21T22:52:48.759135+0000","last_fullsized":"2024-02-21T22:52:48.759135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:49.766243+0000","last_change":"2024-02-21T22:52:49.766243+0000","last_active":"2024-02-21T22:52:49.766243+0000","last_peered":"2024-02-21T22:52:49.766243+0000","last_clean":"2024-02-21T22:52:49.766243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:49.766243+0000","last_undegraded":"2024-02-21T22:52:49.766243+0000","last_fullsized":"2024-02-21T22:52:49.766243+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:48.759135+0000","last_change":"2024-02-21T22:52:48.759135+0000","last_active":"2024-02-21T22:52:48.759135+0000","last_peered":"2024-02-21T22:52:48.759135+0000","last_clean":"2024-02-21T22:52:48.759135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:48.759135+0000","last_undegraded":"2024-02-21T22:52:48.759135+0000","last_fullsized":"2024-02-21T22:52:48.759135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:49.766243+0000","last_change":"2024-02-21T22:52:49.766243+0000","last_active":"2024-02-21T22:52:49.766243+0000","last_peered":"2024-02-21T22:52:49.766243+0000","last_clean":"2024-02-21T22:52:49.766243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:49.766243+0000","last_undegraded":"2024-02-21T22:52:49.766243+0000","last_fullsized":"2024-02-21T22:52:49.766243+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:48.759135+0000","last_change":"2024-02-21T22:52:48.759135+0000","last_active":"2024-02-21T22:52:48.759135+0000","last_peered":"2024-02-21T22:52:48.759135+0000","last_clean":"2024-02-21T22:52:48.759135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:48.759135+0000","last_undegraded":"2024-02-21T22:52:48.759135+0000","last_fullsized":"2024-02-21T22:52:48.759135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:49.766243+0000","last_change":"2024-02-21T22:52:49.766243+0000","last_active":"2024-02-21T22:52:49.766243+0000","last_peered":"2024-02-21T22:52:49.766243+0000","last_clean":"2024-02-21T22:52:49.766243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:49.766243+0000","last_undegraded":"2024-02-21T22:52:49.766243+0000","last_fullsized":"2024-02-21T22:52:49.766243+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:48.759135+0000","last_change":"2024-02-21T22:52:48.759135+0000","last_active":"2024-02-21T22:52:48.759135+0000","last_peered":"2024-02-21T22:52:48.759135+0000","last_clean":"2024-02-21T22:52:48.759135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:48.759135+0000","last_undegraded":"2024-02-21T22:52:48.759135+0000","last_fullsized":"2024-02-21T22:52:48.759135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:49.766243+0000","last_change":"2024-02-21T22:52:49.766243+0000","last_active":"2024-02-21T22:52:49.766243+0000","last_peered":"2024-02-21T22:52:49.766243+0000","last_clean":"2024-02-21T22:52:49.766243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:49.766243+0000","last_undegraded":"2024-02-21T22:52:49.766243+0000","last_fullsized":"2024-02-21T22:52:49.766243+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:48.759135+0000","last_change":"2024-02-21T22:52:48.759135+0000","last_active":"2024-02-21T22:52:48.759135+0000","last_peered":"2024-02-21T22:52:48.759135+0000","last_clean":"2024-02-21T22:52:48.759135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:48.759135+0000","last_undegraded":"2024-02-21T22:52:48.759135+0000","last_fullsized":"2024-02-21T22:52:48.759135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:49.766243+0000","last_change":"2024-02-21T22:52:49.766243+0000","last_active":"2024-02-21T22:52:49.766243+0000","last_peered":"2024-02-21T22:52:49.766243+0000","last_clean":"2024-02-21T22:52:49.766243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:49.766243+0000","last_undegraded":"2024-02-21T22:52:49.766243+0000","last_fullsized":"2024-02-21T22:52:49.766243+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:48.759135+0000","last_change":"2024-02-21T22:52:48.759135+0000","last_active":"2024-02-21T22:52:48.759135+0000","last_peered":"2024-02-21T22:52:48.759135+0000","last_clean":"2024-02-21T22:52:48.759135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:48.759135+0000","last_undegraded":"2024-02-21T22:52:48.759135+0000","last_fullsized":"2024-02-21T22:52:48.759135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:49.766243+0000","last_change":"2024-02-21T22:52:49.766243+0000","last_active":"2024-02-21T22:52:49.766243+0000","last_peered":"2024-02-21T22:52:49.766243+0000","last_clean":"2024-02-21T22:52:49.766243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:49.766243+0000","last_undegraded":"2024-02-21T22:52:49.766243+0000","last_fullsized":"2024-02-21T22:52:49.766243+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:48.759135+0000","last_change":"2024-02-21T22:52:48.759135+0000","last_active":"2024-02-21T22:52:48.759135+0000","last_peered":"2024-02-21T22:52:48.759135+0000","last_clean":"2024-02-21T22:52:48.759135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:48.759135+0000","last_undegraded":"2024-02-21T22:52:48.759135+0000","last_fullsized":"2024-02-21T22:52:48.759135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:49.766243+0000","last_change":"2024-02-21T22:52:49.766243+0000","last_active":"2024-02-21T22:52:49.766243+0000","last_peered":"2024-02-21T22:52:49.766243+0000","last_clean":"2024-02-21T22:52:49.766243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:49.766243+0000","last_undegraded":"2024-02-21T22:52:49.766243+0000","last_fullsized":"2024-02-21T22:52:49.766243+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:48.759135+0000","last_change":"2024-02-21T22:52:48.759135+0000","last_active":"2024-02-21T22:52:48.759135+0000","last_peered":"2024-02-21T22:52:48.759135+0000","last_clean":"2024-02-21T22:52:48.759135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:48.759135+0000","last_undegraded":"2024-02-21T22:52:48.759135+0000","last_fullsized":"2024-02-21T22:52:48.759135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:49.766243+0000","last_change":"2024-02-21T22:52:49.766243+0000","last_active":"2024-02-21T22:52:49.766243+0000","last_peered":"2024-02-21T22:52:49.766243+0000","last_clean":"2024-02-21T22:52:49.766243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:49.766243+0000","last_undegraded":"2024-02-21T22:52:49.766243+0000","last_fullsized":"2024-02-21T22:52:49.766243+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:48.759135+0000","last_change":"2024-02-21T22:52:48.759135+0000","last_active":"2024-02-21T22:52:48.759135+0000","last_peered":"2024-02-21T22:52:48.759135+0000","last_clean":"2024-02-21T22:52:48.759135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:48.759135+0000","last_undegraded":"2024-02-21T22:52:48.759135+0000","last_fullsized":"2024-02-21T22:52:48.759135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:49.766243+0000","last_change":"2024-02-21T22:52:49.766243+0000","last_active":"2024-02-21T22:52:49.766243+0000","last_peered":"2024-02-21T22:52:49.766243+0000","last_clean":"2024-02-21T22:52:49.766243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:49.766243+0000","last_undegraded":"2024-02-21T22:52:49.766243+0000","last_fullsized":"2024-02-21T22:52:49.766243+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":162,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-02-21T22:52:41.715729+0000","last_change":"2024-02-21T22:52:40.336187+0000","last_active":"2024-02-21T22:52:41.715729+0000","last_peered":"2024-02-21T22:52:41.715729+0000","last_clean":"2024-02-21T22:52:41.715729+0000","last_became_active":"2024-02-21T22:52:40.335061+0000","last_became_peered":"2024-02-21T22:52:40.335061+0000","last_unstale":"2024-02-21T22:52:41.715729+0000","last_undegraded":"2024-02-21T22:52:41.715729+0000","last_fullsized":"2024-02-21T22:52:41.715729+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:38.328863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:38.328863+0000","last_clean_scrub_stamp":"2024-02-21T22:52:38.328863+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:33:53.012414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:48.759135+0000","last_change":"2024-02-21T22:52:48.759135+0000","last_active":"2024-02-21T22:52:48.759135+0000","last_peered":"2024-02-21T22:52:48.759135+0000","last_clean":"2024-02-21T22:52:48.759135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:48.759135+0000","last_undegraded":"2024-02-21T22:52:48.759135+0000","last_fullsized":"2024-02-21T22:52:48.759135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:49.766243+0000","last_change":"2024-02-21T22:52:49.766243+0000","last_active":"2024-02-21T22:52:49.766243+0000","last_peered":"2024-02-21T22:52:49.766243+0000","last_clean":"2024-02-21T22:52:49.766243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:49.766243+0000","last_undegraded":"2024-02-21T22:52:49.766243+0000","last_fullsized":"2024-02-21T22:52:49.766243+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:48.759135+0000","last_change":"2024-02-21T22:52:48.759135+0000","last_active":"2024-02-21T22:52:48.759135+0000","last_peered":"2024-02-21T22:52:48.759135+0000","last_clean":"2024-02-21T22:52:48.759135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:48.759135+0000","last_undegraded":"2024-02-21T22:52:48.759135+0000","last_fullsized":"2024-02-21T22:52:48.759135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:49.766243+0000","last_change":"2024-02-21T22:52:49.766243+0000","last_active":"2024-02-21T22:52:49.766243+0000","last_peered":"2024-02-21T22:52:49.766243+0000","last_clean":"2024-02-21T22:52:49.766243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:49.766243+0000","last_undegraded":"2024-02-21T22:52:49.766243+0000","last_fullsized":"2024-02-21T22:52:49.766243+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:48.759135+0000","last_change":"2024-02-21T22:52:48.759135+0000","last_active":"2024-02-21T22:52:48.759135+0000","last_peered":"2024-02-21T22:52:48.759135+0000","last_clean":"2024-02-21T22:52:48.759135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:48.759135+0000","last_undegraded":"2024-02-21T22:52:48.759135+0000","last_fullsized":"2024-02-21T22:52:48.759135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:49.766243+0000","last_change":"2024-02-21T22:52:49.766243+0000","last_active":"2024-02-21T22:52:49.766243+0000","last_peered":"2024-02-21T22:52:49.766243+0000","last_clean":"2024-02-21T22:52:49.766243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:49.766243+0000","last_undegraded":"2024-02-21T22:52:49.766243+0000","last_fullsized":"2024-02-21T22:52:49.766243+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:48.759135+0000","last_change":"2024-02-21T22:52:48.759135+0000","last_active":"2024-02-21T22:52:48.759135+0000","last_peered":"2024-02-21T22:52:48.759135+0000","last_clean":"2024-02-21T22:52:48.759135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:48.759135+0000","last_undegraded":"2024-02-21T22:52:48.759135+0000","last_fullsized":"2024-02-21T22:52:48.759135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:49.766243+0000","last_change":"2024-02-21T22:52:49.766243+0000","last_active":"2024-02-21T22:52:49.766243+0000","last_peered":"2024-02-21T22:52:49.766243+0000","last_clean":"2024-02-21T22:52:49.766243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:49.766243+0000","last_undegraded":"2024-02-21T22:52:49.766243+0000","last_fullsized":"2024-02-21T22:52:49.766243+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:48.759135+0000","last_change":"2024-02-21T22:52:48.759135+0000","last_active":"2024-02-21T22:52:48.759135+0000","last_peered":"2024-02-21T22:52:48.759135+0000","last_clean":"2024-02-21T22:52:48.759135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:48.759135+0000","last_undegraded":"2024-02-21T22:52:48.759135+0000","last_fullsized":"2024-02-21T22:52:48.759135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:49.766243+0000","last_change":"2024-02-21T22:52:49.766243+0000","last_active":"2024-02-21T22:52:49.766243+0000","last_peered":"2024-02-21T22:52:49.766243+0000","last_clean":"2024-02-21T22:52:49.766243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:49.766243+0000","last_undegraded":"2024-02-21T22:52:49.766243+0000","last_fullsized":"2024-02-21T22:52:49.766243+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:48.759135+0000","last_change":"2024-02-21T22:52:48.759135+0000","last_active":"2024-02-21T22:52:48.759135+0000","last_peered":"2024-02-21T22:52:48.759135+0000","last_clean":"2024-02-21T22:52:48.759135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:48.759135+0000","last_undegraded":"2024-02-21T22:52:48.759135+0000","last_fullsized":"2024-02-21T22:52:48.759135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:49.766243+0000","last_change":"2024-02-21T22:52:49.766243+0000","last_active":"2024-02-21T22:52:49.766243+0000","last_peered":"2024-02-21T22:52:49.766243+0000","last_clean":"2024-02-21T22:52:49.766243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:49.766243+0000","last_undegraded":"2024-02-21T22:52:49.766243+0000","last_fullsized":"2024-02-21T22:52:49.766243+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:48.759135+0000","last_change":"2024-02-21T22:52:48.759135+0000","last_active":"2024-02-21T22:52:48.759135+0000","last_peered":"2024-02-21T22:52:48.759135+0000","last_clean":"2024-02-21T22:52:48.759135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:48.759135+0000","last_undegraded":"2024-02-21T22:52:48.759135+0000","last_fullsized":"2024-02-21T22:52:48.759135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:49.766243+0000","last_change":"2024-02-21T22:52:49.766243+0000","last_active":"2024-02-21T22:52:49.766243+0000","last_peered":"2024-02-21T22:52:49.766243+0000","last_clean":"2024-02-21T22:52:49.766243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:49.766243+0000","last_undegraded":"2024-02-21T22:52:49.766243+0000","last_fullsized":"2024-02-21T22:52:49.766243+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:48.759135+0000","last_change":"2024-02-21T22:52:48.759135+0000","last_active":"2024-02-21T22:52:48.759135+0000","last_peered":"2024-02-21T22:52:48.759135+0000","last_clean":"2024-02-21T22:52:48.759135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:48.759135+0000","last_undegraded":"2024-02-21T22:52:48.759135+0000","last_fullsized":"2024-02-21T22:52:48.759135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:49.766243+0000","last_change":"2024-02-21T22:52:49.766243+0000","last_active":"2024-02-21T22:52:49.766243+0000","last_peered":"2024-02-21T22:52:49.766243+0000","last_clean":"2024-02-21T22:52:49.766243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:49.766243+0000","last_undegraded":"2024-02-21T22:52:49.766243+0000","last_fullsized":"2024-02-21T22:52:49.766243+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:48.759135+0000","last_change":"2024-02-21T22:52:48.759135+0000","last_active":"2024-02-21T22:52:48.759135+0000","last_peered":"2024-02-21T22:52:48.759135+0000","last_clean":"2024-02-21T22:52:48.759135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:48.759135+0000","last_undegraded":"2024-02-21T22:52:48.759135+0000","last_fullsized":"2024-02-21T22:52:48.759135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:49.766243+0000","last_change":"2024-02-21T22:52:49.766243+0000","last_active":"2024-02-21T22:52:49.766243+0000","last_peered":"2024-02-21T22:52:49.766243+0000","last_clean":"2024-02-21T22:52:49.766243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:49.766243+0000","last_undegraded":"2024-02-21T22:52:49.766243+0000","last_fullsized":"2024-02-21T22:52:49.766243+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:48.759135+0000","last_change":"2024-02-21T22:52:48.759135+0000","last_active":"2024-02-21T22:52:48.759135+0000","last_peered":"2024-02-21T22:52:48.759135+0000","last_clean":"2024-02-21T22:52:48.759135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:48.759135+0000","last_undegraded":"2024-02-21T22:52:48.759135+0000","last_fullsized":"2024-02-21T22:52:48.759135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:49.766243+0000","last_change":"2024-02-21T22:52:49.766243+0000","last_active":"2024-02-21T22:52:49.766243+0000","last_peered":"2024-02-21T22:52:49.766243+0000","last_clean":"2024-02-21T22:52:49.766243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:49.766243+0000","last_undegraded":"2024-02-21T22:52:49.766243+0000","last_fullsized":"2024-02-21T22:52:49.766243+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:48.759135+0000","last_change":"2024-02-21T22:52:48.759135+0000","last_active":"2024-02-21T22:52:48.759135+0000","last_peered":"2024-02-21T22:52:48.759135+0000","last_clean":"2024-02-21T22:52:48.759135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:48.759135+0000","last_undegraded":"2024-02-21T22:52:48.759135+0000","last_fullsized":"2024-02-21T22:52:48.759135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:49.766243+0000","last_change":"2024-02-21T22:52:49.766243+0000","last_active":"2024-02-21T22:52:49.766243+0000","last_peered":"2024-02-21T22:52:49.766243+0000","last_clean":"2024-02-21T22:52:49.766243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:49.766243+0000","last_undegraded":"2024-02-21T22:52:49.766243+0000","last_fullsized":"2024-02-21T22:52:49.766243+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:48.759135+0000","last_change":"2024-02-21T22:52:48.759135+0000","last_active":"2024-02-21T22:52:48.759135+0000","last_peered":"2024-02-21T22:52:48.759135+0000","last_clean":"2024-02-21T22:52:48.759135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:48.759135+0000","last_undegraded":"2024-02-21T22:52:48.759135+0000","last_fullsized":"2024-02-21T22:52:48.759135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:49.766243+0000","last_change":"2024-02-21T22:52:49.766243+0000","last_active":"2024-02-21T22:52:49.766243+0000","last_peered":"2024-02-21T22:52:49.766243+0000","last_clean":"2024-02-21T22:52:49.766243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:49.766243+0000","last_undegraded":"2024-02-21T22:52:49.766243+0000","last_fullsized":"2024-02-21T22:52:49.766243+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:49.766243+0000","last_change":"2024-02-21T22:52:49.766243+0000","last_active":"2024-02-21T22:52:49.766243+0000","last_peered":"2024-02-21T22:52:49.766243+0000","last_clean":"2024-02-21T22:52:49.766243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:49.766243+0000","last_undegraded":"2024-02-21T22:52:49.766243+0000","last_fullsized":"2024-02-21T22:52:49.766243+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:48.759135+0000","last_change":"2024-02-21T22:52:48.759135+0000","last_active":"2024-02-21T22:52:48.759135+0000","last_peered":"2024-02-21T22:52:48.759135+0000","last_clean":"2024-02-21T22:52:48.759135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:48.759135+0000","last_undegraded":"2024-02-21T22:52:48.759135+0000","last_fullsized":"2024-02-21T22:52:48.759135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:49.766243+0000","last_change":"2024-02-21T22:52:49.766243+0000","last_active":"2024-02-21T22:52:49.766243+0000","last_peered":"2024-02-21T22:52:49.766243+0000","last_clean":"2024-02-21T22:52:49.766243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:49.766243+0000","last_undegraded":"2024-02-21T22:52:49.766243+0000","last_fullsized":"2024-02-21T22:52:49.766243+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:48.759135+0000","last_change":"2024-02-21T22:52:48.759135+0000","last_active":"2024-02-21T22:52:48.759135+0000","last_peered":"2024-02-21T22:52:48.759135+0000","last_clean":"2024-02-21T22:52:48.759135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:48.759135+0000","last_undegraded":"2024-02-21T22:52:48.759135+0000","last_fullsized":"2024-02-21T22:52:48.759135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:49.766243+0000","last_change":"2024-02-21T22:52:49.766243+0000","last_active":"2024-02-21T22:52:49.766243+0000","last_peered":"2024-02-21T22:52:49.766243+0000","last_clean":"2024-02-21T22:52:49.766243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:49.766243+0000","last_undegraded":"2024-02-21T22:52:49.766243+0000","last_fullsized":"2024-02-21T22:52:49.766243+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:48.759135+0000","last_change":"2024-02-21T22:52:48.759135+0000","last_active":"2024-02-21T22:52:48.759135+0000","last_peered":"2024-02-21T22:52:48.759135+0000","last_clean":"2024-02-21T22:52:48.759135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:48.759135+0000","last_undegraded":"2024-02-21T22:52:48.759135+0000","last_fullsized":"2024-02-21T22:52:48.759135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:49.766243+0000","last_change":"2024-02-21T22:52:49.766243+0000","last_active":"2024-02-21T22:52:49.766243+0000","last_peered":"2024-02-21T22:52:49.766243+0000","last_clean":"2024-02-21T22:52:49.766243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:49.766243+0000","last_undegraded":"2024-02-21T22:52:49.766243+0000","last_fullsized":"2024-02-21T22:52:49.766243+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:48.759135+0000","last_change":"2024-02-21T22:52:48.759135+0000","last_active":"2024-02-21T22:52:48.759135+0000","last_peered":"2024-02-21T22:52:48.759135+0000","last_clean":"2024-02-21T22:52:48.759135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:48.759135+0000","last_undegraded":"2024-02-21T22:52:48.759135+0000","last_fullsized":"2024-02-21T22:52:48.759135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28316,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343524,"statfs":{"total":96636764160,"available":96607768576,"internally_reserved":0,"allocated":749568,"data_stored":636135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27172,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344668,"statfs":{"total":96636764160,"available":96608940032,"internally_reserved":0,"allocated":155648,"data_stored":45767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27172,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344668,"statfs":{"total":96636764160,"available":96608940032,"internally_reserved":0,"allocated":155648,"data_stored":45767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27172,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344668,"statfs":{"total":96636764160,"available":96608940032,"internally_reserved":0,"allocated":155648,"data_stored":45767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27172,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344668,"statfs":{"total":96636764160,"available":96608940032,"internally_reserved":0,"allocated":155648,"data_stored":45767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27172,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344668,"statfs":{"total":96636764160,"available":96608940032,"internally_reserved":0,"allocated":155648,"data_stored":45767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27172,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344668,"statfs":{"total":96636764160,"available":96608940032,"internally_reserved":0,"allocated":155648,"data_stored":45767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28316,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343524,"statfs":{"total":96636764160,"available":96607768576,"internally_reserved":0,"allocated":749568,"data_stored":636135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-21T22:52:53.742 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-21T22:52:53.878 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.888+0000 7f46aafc8640 1 Processor -- start 2024-02-21T22:52:53.879 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.888+0000 7f46aafc8640 1 -- start start 2024-02-21T22:52:53.880 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.888+0000 7f46aafc8640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f46a40d0510 0x7f46a40d08f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:53.880 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.888+0000 7f46aafc8640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46a40cfa50 con 0x7f46a40d1c30 2024-02-21T22:52:53.880 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.888+0000 7f46aafc8640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46a40d0e30 con 0x7f46a40cb930 2024-02-21T22:52:53.880 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.888+0000 7f46aafc8640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46a40d1450 con 0x7f46a40d0510 2024-02-21T22:52:53.880 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.889+0000 7f46a8d64640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f46a40d0510 0x7f46a40d08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:53.880 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.889+0000 7f46a3fff640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f46a40d1c30 0x7f46a40d2430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:56878/0 (socket says 172.21.15.116:56878) 2024-02-21T22:52:53.880 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.889+0000 7f46a3fff640 1 -- 172.21.15.116:0/3722309500 learned_addr learned my addr 172.21.15.116:0/3722309500 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-02-21T22:52:53.880 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.889+0000 7f46a8d64640 1 -- 172.21.15.116:0/3722309500 >> v1:172.21.15.142:6789/0 conn(0x7f46a40cb930 legacy=0x7f46a40cbd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:53.881 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.889+0000 7f46a8d64640 1 -- 172.21.15.116:0/3722309500 >> v1:172.21.15.116:6789/0 conn(0x7f46a40d1c30 legacy=0x7f46a40d2430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:53.881 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.889+0000 7f46a8d64640 1 -- 172.21.15.116:0/3722309500 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46a40cfcc0 con 0x7f46a40d0510 2024-02-21T22:52:53.881 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.889+0000 7f46a8d64640 1 --2- 172.21.15.116:0/3722309500 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f46a40d0510 0x7f46a40d08f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f469c009d90 tx=0x7f469c02beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5289e7aa6d6a920c server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:52:53.881 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.890+0000 7f46a37fe640 1 -- 172.21.15.116:0/3722309500 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f469c039070 con 0x7f46a40d0510 2024-02-21T22:52:53.881 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.890+0000 7f46a37fe640 1 -- 172.21.15.116:0/3722309500 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f469c02cc60 con 0x7f46a40d0510 2024-02-21T22:52:53.881 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.890+0000 7f46a37fe640 1 -- 172.21.15.116:0/3722309500 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f469c034660 con 0x7f46a40d0510 2024-02-21T22:52:53.882 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.890+0000 7f46aafc8640 1 -- 172.21.15.116:0/3722309500 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f46a40d0510 msgr2=0x7f46a40d08f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:53.882 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.890+0000 7f46aafc8640 1 --2- 172.21.15.116:0/3722309500 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f46a40d0510 0x7f46a40d08f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f469c009d90 tx=0x7f469c02beb0 comp rx=0 tx=0).stop 2024-02-21T22:52:53.882 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.890+0000 7f46aafc8640 1 -- 172.21.15.116:0/3722309500 shutdown_connections 2024-02-21T22:52:53.882 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.890+0000 7f46aafc8640 1 --2- 172.21.15.116:0/3722309500 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f46a40d0510 0x7f46a40d08f0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:53.882 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.890+0000 7f46aafc8640 1 -- 172.21.15.116:0/3722309500 >> 172.21.15.116:0/3722309500 conn(0x7f46a40d3e50 msgr2=0x7f46a40d4260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:52:53.882 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.890+0000 7f46aafc8640 1 -- 172.21.15.116:0/3722309500 shutdown_connections 2024-02-21T22:52:53.882 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.890+0000 7f46aafc8640 1 -- 172.21.15.116:0/3722309500 wait complete. 2024-02-21T22:52:53.882 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.891+0000 7f46aafc8640 1 Processor -- start 2024-02-21T22:52:53.883 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.891+0000 7f46aafc8640 1 -- start start 2024-02-21T22:52:53.884 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.892+0000 7f46aafc8640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f46a40cb930 0x7f46a4158000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:53.885 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.892+0000 7f46aafc8640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f46a40d0510 0x7f46a409dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:53.885 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.892+0000 7f46aafc8640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f46a40d1c30 0x7f46a415fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:53.885 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.892+0000 7f46aafc8640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46a415e640 con 0x7f46a40d1c30 2024-02-21T22:52:53.885 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.892+0000 7f46aafc8640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46a40d10e0 con 0x7f46a40cb930 2024-02-21T22:52:53.885 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.892+0000 7f46aafc8640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46a40cc490 con 0x7f46a40d0510 2024-02-21T22:52:53.885 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.892+0000 7f46a9565640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f46a40d1c30 0x7f46a415fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:53.885 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.892+0000 7f46a9565640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f46a40d1c30 0x7f46a415fcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:51028/0 (socket says 172.21.15.116:51028) 2024-02-21T22:52:53.885 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.892+0000 7f46a9565640 1 -- 172.21.15.116:0/4225062158 learned_addr learned my addr 172.21.15.116:0/4225062158 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:52:53.885 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.892+0000 7f46a3fff640 1 --2- 172.21.15.116:0/4225062158 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f46a40d0510 0x7f46a409dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:53.885 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.892+0000 7f46a8d64640 1 --2- 172.21.15.116:0/4225062158 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f46a40cb930 0x7f46a4158000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:53.885 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.893+0000 7f46a9565640 1 -- 172.21.15.116:0/4225062158 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f46a40d0510 msgr2=0x7f46a409dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:53.885 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.893+0000 7f46a9565640 1 --2- 172.21.15.116:0/4225062158 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f46a40d0510 0x7f46a409dc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:53.885 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.893+0000 7f46a9565640 1 -- 172.21.15.116:0/4225062158 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f46a40cb930 msgr2=0x7f46a4158000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:53.886 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.893+0000 7f46a9565640 1 --2- 172.21.15.116:0/4225062158 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f46a40cb930 0x7f46a4158000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:53.886 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.893+0000 7f46a9565640 1 -- 172.21.15.116:0/4225062158 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46a4158540 con 0x7f46a40d1c30 2024-02-21T22:52:53.886 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.893+0000 7f46a9565640 1 --2- 172.21.15.116:0/4225062158 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f46a40d1c30 0x7f46a415fcb0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f469400c400 tx=0x7f469400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:52:53.886 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.893+0000 7f46a17fa640 1 -- 172.21.15.116:0/4225062158 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4694017070 con 0x7f46a40d1c30 2024-02-21T22:52:53.886 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.893+0000 7f46a17fa640 1 -- 172.21.15.116:0/4225062158 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46940052d0 con 0x7f46a40d1c30 2024-02-21T22:52:53.886 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.893+0000 7f46a17fa640 1 -- 172.21.15.116:0/4225062158 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4694003810 con 0x7f46a40d1c30 2024-02-21T22:52:53.886 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.893+0000 7f46aafc8640 1 -- 172.21.15.116:0/4225062158 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46a40a1890 con 0x7f46a40d1c30 2024-02-21T22:52:53.886 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.893+0000 7f46aafc8640 1 -- 172.21.15.116:0/4225062158 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46a40a06c0 con 0x7f46a40d1c30 2024-02-21T22:52:53.886 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.894+0000 7f46aafc8640 1 -- 172.21.15.116:0/4225062158 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46a40752f0 con 0x7f46a40d1c30 2024-02-21T22:52:53.886 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.894+0000 7f46a17fa640 1 -- 172.21.15.116:0/4225062158 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f469401a070 con 0x7f46a40d1c30 2024-02-21T22:52:53.887 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.895+0000 7f46a17fa640 1 --2- 172.21.15.116:0/4225062158 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f468406b4d0 0x7f468406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:53.887 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.895+0000 7f46a17fa640 1 -- 172.21.15.116:0/4225062158 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4694089440 con 0x7f46a40d1c30 2024-02-21T22:52:53.887 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.895+0000 7f46a8d64640 1 --2- 172.21.15.116:0/4225062158 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f468406b4d0 0x7f468406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:53.887 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.895+0000 7f46a8d64640 1 --2- 172.21.15.116:0/4225062158 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f468406b4d0 0x7f468406d990 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f469c036000 tx=0x7f469c030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:52:53.889 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:53.899+0000 7f46a17fa640 1 -- 172.21.15.116:0/4225062158 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f4694057d00 con 0x7f46a40d1c30 2024-02-21T22:52:54.058 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.067+0000 7f46aafc8640 1 -- 172.21.15.116:0/4225062158 --> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f46a40d2210 con 0x7f468406b4d0 2024-02-21T22:52:54.063 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.073+0000 7f46a17fa640 1 -- 172.21.15.116:0/4225062158 <== mgr.4103 v2:172.21.15.142:6832/1381484782 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+237079 (secure 0 0 0) 0x7f46a40d2210 con 0x7f468406b4d0 2024-02-21T22:52:54.066 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-02-21T22:52:54.067 INFO:teuthology.orchestra.run.smithi116.stderr:dumped all 2024-02-21T22:52:54.068 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.076+0000 7f46aafc8640 1 -- 172.21.15.116:0/4225062158 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f468406b4d0 msgr2=0x7f468406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:54.069 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.076+0000 7f46aafc8640 1 --2- 172.21.15.116:0/4225062158 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f468406b4d0 0x7f468406d990 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f469c036000 tx=0x7f469c030000 comp rx=0 tx=0).stop 2024-02-21T22:52:54.069 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.076+0000 7f46aafc8640 1 -- 172.21.15.116:0/4225062158 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f46a40d1c30 msgr2=0x7f46a415fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:54.069 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.076+0000 7f46aafc8640 1 --2- 172.21.15.116:0/4225062158 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f46a40d1c30 0x7f46a415fcb0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f469400c400 tx=0x7f469400c8c0 comp rx=0 tx=0).stop 2024-02-21T22:52:54.069 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.076+0000 7f46aafc8640 1 -- 172.21.15.116:0/4225062158 shutdown_connections 2024-02-21T22:52:54.069 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.076+0000 7f46aafc8640 1 --2- 172.21.15.116:0/4225062158 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f46a40d1c30 0x7f46a415fcb0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:54.069 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.076+0000 7f46aafc8640 1 --2- 172.21.15.116:0/4225062158 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f468406b4d0 0x7f468406d990 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:54.069 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.076+0000 7f46aafc8640 1 --2- 172.21.15.116:0/4225062158 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f46a40d0510 0x7f46a409dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:54.069 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.076+0000 7f46aafc8640 1 --2- 172.21.15.116:0/4225062158 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f46a40cb930 0x7f46a4158000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:54.069 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.076+0000 7f46aafc8640 1 -- 172.21.15.116:0/4225062158 >> 172.21.15.116:0/4225062158 conn(0x7f46a40d3e50 msgr2=0x7f46a406b760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:52:54.069 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.076+0000 7f46aafc8640 1 -- 172.21.15.116:0/4225062158 shutdown_connections 2024-02-21T22:52:54.069 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.076+0000 7f46aafc8640 1 -- 172.21.15.116:0/4225062158 wait complete. 2024-02-21T22:52:54.077 INFO:teuthology.orchestra.run.smithi116.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2024-02-21T22:52:52.287953+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":219664,"kb_used_data":2376,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755056,"statfs":{"total":773094113280,"available":772869177344,"internally_reserved":0,"allocated":2433024,"data_stored":1546872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000857"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:49.766243+0000","last_change":"2024-02-21T22:52:49.766243+0000","last_active":"2024-02-21T22:52:49.766243+0000","last_peered":"2024-02-21T22:52:49.766243+0000","last_clean":"2024-02-21T22:52:49.766243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:49.766243+0000","last_undegraded":"2024-02-21T22:52:49.766243+0000","last_fullsized":"2024-02-21T22:52:49.766243+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:49.766243+0000","last_change":"2024-02-21T22:52:49.766243+0000","last_active":"2024-02-21T22:52:49.766243+0000","last_peered":"2024-02-21T22:52:49.766243+0000","last_clean":"2024-02-21T22:52:49.766243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:49.766243+0000","last_undegraded":"2024-02-21T22:52:49.766243+0000","last_fullsized":"2024-02-21T22:52:49.766243+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:49.766243+0000","last_change":"2024-02-21T22:52:49.766243+0000","last_active":"2024-02-21T22:52:49.766243+0000","last_peered":"2024-02-21T22:52:49.766243+0000","last_clean":"2024-02-21T22:52:49.766243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:49.766243+0000","last_undegraded":"2024-02-21T22:52:49.766243+0000","last_fullsized":"2024-02-21T22:52:49.766243+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:49.766243+0000","last_change":"2024-02-21T22:52:49.766243+0000","last_active":"2024-02-21T22:52:49.766243+0000","last_peered":"2024-02-21T22:52:49.766243+0000","last_clean":"2024-02-21T22:52:49.766243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:49.766243+0000","last_undegraded":"2024-02-21T22:52:49.766243+0000","last_fullsized":"2024-02-21T22:52:49.766243+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:49.766243+0000","last_change":"2024-02-21T22:52:49.766243+0000","last_active":"2024-02-21T22:52:49.766243+0000","last_peered":"2024-02-21T22:52:49.766243+0000","last_clean":"2024-02-21T22:52:49.766243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:49.766243+0000","last_undegraded":"2024-02-21T22:52:49.766243+0000","last_fullsized":"2024-02-21T22:52:49.766243+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:49.766243+0000","last_change":"2024-02-21T22:52:49.766243+0000","last_active":"2024-02-21T22:52:49.766243+0000","last_peered":"2024-02-21T22:52:49.766243+0000","last_clean":"2024-02-21T22:52:49.766243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:49.766243+0000","last_undegraded":"2024-02-21T22:52:49.766243+0000","last_fullsized":"2024-02-21T22:52:49.766243+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:49.766243+0000","last_change":"2024-02-21T22:52:49.766243+0000","last_active":"2024-02-21T22:52:49.766243+0000","last_peered":"2024-02-21T22:52:49.766243+0000","last_clean":"2024-02-21T22:52:49.766243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:49.766243+0000","last_undegraded":"2024-02-21T22:52:49.766243+0000","last_fullsized":"2024-02-21T22:52:49.766243+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:49.766243+0000","last_change":"2024-02-21T22:52:49.766243+0000","last_active":"2024-02-21T22:52:49.766243+0000","last_peered":"2024-02-21T22:52:49.766243+0000","last_clean":"2024-02-21T22:52:49.766243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:49.766243+0000","last_undegraded":"2024-02-21T22:52:49.766243+0000","last_fullsized":"2024-02-21T22:52:49.766243+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:49.766243+0000","last_change":"2024-02-21T22:52:49.766243+0000","last_active":"2024-02-21T22:52:49.766243+0000","last_peered":"2024-02-21T22:52:49.766243+0000","last_clean":"2024-02-21T22:52:49.766243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:49.766243+0000","last_undegraded":"2024-02-21T22:52:49.766243+0000","last_fullsized":"2024-02-21T22:52:49.766243+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:49.766243+0000","last_change":"2024-02-21T22:52:49.766243+0000","last_active":"2024-02-21T22:52:49.766243+0000","last_peered":"2024-02-21T22:52:49.766243+0000","last_clean":"2024-02-21T22:52:49.766243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:49.766243+0000","last_undegraded":"2024-02-21T22:52:49.766243+0000","last_fullsized":"2024-02-21T22:52:49.766243+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:49.766243+0000","last_change":"2024-02-21T22:52:49.766243+0000","last_active":"2024-02-21T22:52:49.766243+0000","last_peered":"2024-02-21T22:52:49.766243+0000","last_clean":"2024-02-21T22:52:49.766243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:49.766243+0000","last_undegraded":"2024-02-21T22:52:49.766243+0000","last_fullsized":"2024-02-21T22:52:49.766243+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:49.766243+0000","last_change":"2024-02-21T22:52:49.766243+0000","last_active":"2024-02-21T22:52:49.766243+0000","last_peered":"2024-02-21T22:52:49.766243+0000","last_clean":"2024-02-21T22:52:49.766243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:49.766243+0000","last_undegraded":"2024-02-21T22:52:49.766243+0000","last_fullsized":"2024-02-21T22:52:49.766243+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:49.766243+0000","last_change":"2024-02-21T22:52:49.766243+0000","last_active":"2024-02-21T22:52:49.766243+0000","last_peered":"2024-02-21T22:52:49.766243+0000","last_clean":"2024-02-21T22:52:49.766243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:49.766243+0000","last_undegraded":"2024-02-21T22:52:49.766243+0000","last_fullsized":"2024-02-21T22:52:49.766243+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:49.766243+0000","last_change":"2024-02-21T22:52:49.766243+0000","last_active":"2024-02-21T22:52:49.766243+0000","last_peered":"2024-02-21T22:52:49.766243+0000","last_clean":"2024-02-21T22:52:49.766243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:49.766243+0000","last_undegraded":"2024-02-21T22:52:49.766243+0000","last_fullsized":"2024-02-21T22:52:49.766243+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:49.766243+0000","last_change":"2024-02-21T22:52:49.766243+0000","last_active":"2024-02-21T22:52:49.766243+0000","last_peered":"2024-02-21T22:52:49.766243+0000","last_clean":"2024-02-21T22:52:49.766243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:49.766243+0000","last_undegraded":"2024-02-21T22:52:49.766243+0000","last_fullsized":"2024-02-21T22:52:49.766243+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:49.766243+0000","last_change":"2024-02-21T22:52:49.766243+0000","last_active":"2024-02-21T22:52:49.766243+0000","last_peered":"2024-02-21T22:52:49.766243+0000","last_clean":"2024-02-21T22:52:49.766243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:49.766243+0000","last_undegraded":"2024-02-21T22:52:49.766243+0000","last_fullsized":"2024-02-21T22:52:49.766243+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:49.766243+0000","last_change":"2024-02-21T22:52:49.766243+0000","last_active":"2024-02-21T22:52:49.766243+0000","last_peered":"2024-02-21T22:52:49.766243+0000","last_clean":"2024-02-21T22:52:49.766243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:49.766243+0000","last_undegraded":"2024-02-21T22:52:49.766243+0000","last_fullsized":"2024-02-21T22:52:49.766243+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:49.766243+0000","last_change":"2024-02-21T22:52:49.766243+0000","last_active":"2024-02-21T22:52:49.766243+0000","last_peered":"2024-02-21T22:52:49.766243+0000","last_clean":"2024-02-21T22:52:49.766243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:49.766243+0000","last_undegraded":"2024-02-21T22:52:49.766243+0000","last_fullsized":"2024-02-21T22:52:49.766243+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:49.766243+0000","last_change":"2024-02-21T22:52:49.766243+0000","last_active":"2024-02-21T22:52:49.766243+0000","last_peered":"2024-02-21T22:52:49.766243+0000","last_clean":"2024-02-21T22:52:49.766243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:49.766243+0000","last_undegraded":"2024-02-21T22:52:49.766243+0000","last_fullsized":"2024-02-21T22:52:49.766243+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:49.766243+0000","last_change":"2024-02-21T22:52:49.766243+0000","last_active":"2024-02-21T22:52:49.766243+0000","last_peered":"2024-02-21T22:52:49.766243+0000","last_clean":"2024-02-21T22:52:49.766243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:49.766243+0000","last_undegraded":"2024-02-21T22:52:49.766243+0000","last_fullsized":"2024-02-21T22:52:49.766243+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:49.766243+0000","last_change":"2024-02-21T22:52:49.766243+0000","last_active":"2024-02-21T22:52:49.766243+0000","last_peered":"2024-02-21T22:52:49.766243+0000","last_clean":"2024-02-21T22:52:49.766243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:49.766243+0000","last_undegraded":"2024-02-21T22:52:49.766243+0000","last_fullsized":"2024-02-21T22:52:49.766243+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:49.766243+0000","last_change":"2024-02-21T22:52:49.766243+0000","last_active":"2024-02-21T22:52:49.766243+0000","last_peered":"2024-02-21T22:52:49.766243+0000","last_clean":"2024-02-21T22:52:49.766243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:49.766243+0000","last_undegraded":"2024-02-21T22:52:49.766243+0000","last_fullsized":"2024-02-21T22:52:49.766243+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:49.766243+0000","last_change":"2024-02-21T22:52:49.766243+0000","last_active":"2024-02-21T22:52:49.766243+0000","last_peered":"2024-02-21T22:52:49.766243+0000","last_clean":"2024-02-21T22:52:49.766243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:49.766243+0000","last_undegraded":"2024-02-21T22:52:49.766243+0000","last_fullsized":"2024-02-21T22:52:49.766243+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:49.766243+0000","last_change":"2024-02-21T22:52:49.766243+0000","last_active":"2024-02-21T22:52:49.766243+0000","last_peered":"2024-02-21T22:52:49.766243+0000","last_clean":"2024-02-21T22:52:49.766243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:49.766243+0000","last_undegraded":"2024-02-21T22:52:49.766243+0000","last_fullsized":"2024-02-21T22:52:49.766243+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:49.766243+0000","last_change":"2024-02-21T22:52:49.766243+0000","last_active":"2024-02-21T22:52:49.766243+0000","last_peered":"2024-02-21T22:52:49.766243+0000","last_clean":"2024-02-21T22:52:49.766243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:49.766243+0000","last_undegraded":"2024-02-21T22:52:49.766243+0000","last_fullsized":"2024-02-21T22:52:49.766243+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:49.766243+0000","last_change":"2024-02-21T22:52:49.766243+0000","last_active":"2024-02-21T22:52:49.766243+0000","last_peered":"2024-02-21T22:52:49.766243+0000","last_clean":"2024-02-21T22:52:49.766243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:49.766243+0000","last_undegraded":"2024-02-21T22:52:49.766243+0000","last_fullsized":"2024-02-21T22:52:49.766243+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:49.766243+0000","last_change":"2024-02-21T22:52:49.766243+0000","last_active":"2024-02-21T22:52:49.766243+0000","last_peered":"2024-02-21T22:52:49.766243+0000","last_clean":"2024-02-21T22:52:49.766243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:49.766243+0000","last_undegraded":"2024-02-21T22:52:49.766243+0000","last_fullsized":"2024-02-21T22:52:49.766243+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:49.766243+0000","last_change":"2024-02-21T22:52:49.766243+0000","last_active":"2024-02-21T22:52:49.766243+0000","last_peered":"2024-02-21T22:52:49.766243+0000","last_clean":"2024-02-21T22:52:49.766243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:49.766243+0000","last_undegraded":"2024-02-21T22:52:49.766243+0000","last_fullsized":"2024-02-21T22:52:49.766243+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:49.766243+0000","last_change":"2024-02-21T22:52:49.766243+0000","last_active":"2024-02-21T22:52:49.766243+0000","last_peered":"2024-02-21T22:52:49.766243+0000","last_clean":"2024-02-21T22:52:49.766243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:49.766243+0000","last_undegraded":"2024-02-21T22:52:49.766243+0000","last_fullsized":"2024-02-21T22:52:49.766243+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:49.766243+0000","last_change":"2024-02-21T22:52:49.766243+0000","last_active":"2024-02-21T22:52:49.766243+0000","last_peered":"2024-02-21T22:52:49.766243+0000","last_clean":"2024-02-21T22:52:49.766243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:49.766243+0000","last_undegraded":"2024-02-21T22:52:49.766243+0000","last_fullsized":"2024-02-21T22:52:49.766243+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:49.766243+0000","last_change":"2024-02-21T22:52:49.766243+0000","last_active":"2024-02-21T22:52:49.766243+0000","last_peered":"2024-02-21T22:52:49.766243+0000","last_clean":"2024-02-21T22:52:49.766243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:49.766243+0000","last_undegraded":"2024-02-21T22:52:49.766243+0000","last_fullsized":"2024-02-21T22:52:49.766243+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:49.766243+0000","last_change":"2024-02-21T22:52:49.766243+0000","last_active":"2024-02-21T22:52:49.766243+0000","last_peered":"2024-02-21T22:52:49.766243+0000","last_clean":"2024-02-21T22:52:49.766243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:49.766243+0000","last_undegraded":"2024-02-21T22:52:49.766243+0000","last_fullsized":"2024-02-21T22:52:49.766243+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:49.766243+0000","last_change":"2024-02-21T22:52:49.766243+0000","last_active":"2024-02-21T22:52:49.766243+0000","last_peered":"2024-02-21T22:52:49.766243+0000","last_clean":"2024-02-21T22:52:49.766243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:49.766243+0000","last_undegraded":"2024-02-21T22:52:49.766243+0000","last_fullsized":"2024-02-21T22:52:49.766243+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:48.759135+0000","last_change":"2024-02-21T22:52:48.759135+0000","last_active":"2024-02-21T22:52:48.759135+0000","last_peered":"2024-02-21T22:52:48.759135+0000","last_clean":"2024-02-21T22:52:48.759135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:48.759135+0000","last_undegraded":"2024-02-21T22:52:48.759135+0000","last_fullsized":"2024-02-21T22:52:48.759135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:49.766243+0000","last_change":"2024-02-21T22:52:49.766243+0000","last_active":"2024-02-21T22:52:49.766243+0000","last_peered":"2024-02-21T22:52:49.766243+0000","last_clean":"2024-02-21T22:52:49.766243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:49.766243+0000","last_undegraded":"2024-02-21T22:52:49.766243+0000","last_fullsized":"2024-02-21T22:52:49.766243+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:48.759135+0000","last_change":"2024-02-21T22:52:48.759135+0000","last_active":"2024-02-21T22:52:48.759135+0000","last_peered":"2024-02-21T22:52:48.759135+0000","last_clean":"2024-02-21T22:52:48.759135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:48.759135+0000","last_undegraded":"2024-02-21T22:52:48.759135+0000","last_fullsized":"2024-02-21T22:52:48.759135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:48.759135+0000","last_change":"2024-02-21T22:52:48.759135+0000","last_active":"2024-02-21T22:52:48.759135+0000","last_peered":"2024-02-21T22:52:48.759135+0000","last_clean":"2024-02-21T22:52:48.759135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:48.759135+0000","last_undegraded":"2024-02-21T22:52:48.759135+0000","last_fullsized":"2024-02-21T22:52:48.759135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:49.766243+0000","last_change":"2024-02-21T22:52:49.766243+0000","last_active":"2024-02-21T22:52:49.766243+0000","last_peered":"2024-02-21T22:52:49.766243+0000","last_clean":"2024-02-21T22:52:49.766243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:49.766243+0000","last_undegraded":"2024-02-21T22:52:49.766243+0000","last_fullsized":"2024-02-21T22:52:49.766243+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:48.759135+0000","last_change":"2024-02-21T22:52:48.759135+0000","last_active":"2024-02-21T22:52:48.759135+0000","last_peered":"2024-02-21T22:52:48.759135+0000","last_clean":"2024-02-21T22:52:48.759135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:48.759135+0000","last_undegraded":"2024-02-21T22:52:48.759135+0000","last_fullsized":"2024-02-21T22:52:48.759135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:49.766243+0000","last_change":"2024-02-21T22:52:49.766243+0000","last_active":"2024-02-21T22:52:49.766243+0000","last_peered":"2024-02-21T22:52:49.766243+0000","last_clean":"2024-02-21T22:52:49.766243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:49.766243+0000","last_undegraded":"2024-02-21T22:52:49.766243+0000","last_fullsized":"2024-02-21T22:52:49.766243+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:48.759135+0000","last_change":"2024-02-21T22:52:48.759135+0000","last_active":"2024-02-21T22:52:48.759135+0000","last_peered":"2024-02-21T22:52:48.759135+0000","last_clean":"2024-02-21T22:52:48.759135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:48.759135+0000","last_undegraded":"2024-02-21T22:52:48.759135+0000","last_fullsized":"2024-02-21T22:52:48.759135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:49.766243+0000","last_change":"2024-02-21T22:52:49.766243+0000","last_active":"2024-02-21T22:52:49.766243+0000","last_peered":"2024-02-21T22:52:49.766243+0000","last_clean":"2024-02-21T22:52:49.766243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:49.766243+0000","last_undegraded":"2024-02-21T22:52:49.766243+0000","last_fullsized":"2024-02-21T22:52:49.766243+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:48.759135+0000","last_change":"2024-02-21T22:52:48.759135+0000","last_active":"2024-02-21T22:52:48.759135+0000","last_peered":"2024-02-21T22:52:48.759135+0000","last_clean":"2024-02-21T22:52:48.759135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:48.759135+0000","last_undegraded":"2024-02-21T22:52:48.759135+0000","last_fullsized":"2024-02-21T22:52:48.759135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:49.766243+0000","last_change":"2024-02-21T22:52:49.766243+0000","last_active":"2024-02-21T22:52:49.766243+0000","last_peered":"2024-02-21T22:52:49.766243+0000","last_clean":"2024-02-21T22:52:49.766243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:49.766243+0000","last_undegraded":"2024-02-21T22:52:49.766243+0000","last_fullsized":"2024-02-21T22:52:49.766243+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:48.759135+0000","last_change":"2024-02-21T22:52:48.759135+0000","last_active":"2024-02-21T22:52:48.759135+0000","last_peered":"2024-02-21T22:52:48.759135+0000","last_clean":"2024-02-21T22:52:48.759135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:48.759135+0000","last_undegraded":"2024-02-21T22:52:48.759135+0000","last_fullsized":"2024-02-21T22:52:48.759135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:49.766243+0000","last_change":"2024-02-21T22:52:49.766243+0000","last_active":"2024-02-21T22:52:49.766243+0000","last_peered":"2024-02-21T22:52:49.766243+0000","last_clean":"2024-02-21T22:52:49.766243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:49.766243+0000","last_undegraded":"2024-02-21T22:52:49.766243+0000","last_fullsized":"2024-02-21T22:52:49.766243+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:48.759135+0000","last_change":"2024-02-21T22:52:48.759135+0000","last_active":"2024-02-21T22:52:48.759135+0000","last_peered":"2024-02-21T22:52:48.759135+0000","last_clean":"2024-02-21T22:52:48.759135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:48.759135+0000","last_undegraded":"2024-02-21T22:52:48.759135+0000","last_fullsized":"2024-02-21T22:52:48.759135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:49.766243+0000","last_change":"2024-02-21T22:52:49.766243+0000","last_active":"2024-02-21T22:52:49.766243+0000","last_peered":"2024-02-21T22:52:49.766243+0000","last_clean":"2024-02-21T22:52:49.766243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:49.766243+0000","last_undegraded":"2024-02-21T22:52:49.766243+0000","last_fullsized":"2024-02-21T22:52:49.766243+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:48.759135+0000","last_change":"2024-02-21T22:52:48.759135+0000","last_active":"2024-02-21T22:52:48.759135+0000","last_peered":"2024-02-21T22:52:48.759135+0000","last_clean":"2024-02-21T22:52:48.759135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:48.759135+0000","last_undegraded":"2024-02-21T22:52:48.759135+0000","last_fullsized":"2024-02-21T22:52:48.759135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:49.766243+0000","last_change":"2024-02-21T22:52:49.766243+0000","last_active":"2024-02-21T22:52:49.766243+0000","last_peered":"2024-02-21T22:52:49.766243+0000","last_clean":"2024-02-21T22:52:49.766243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:49.766243+0000","last_undegraded":"2024-02-21T22:52:49.766243+0000","last_fullsized":"2024-02-21T22:52:49.766243+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:48.759135+0000","last_change":"2024-02-21T22:52:48.759135+0000","last_active":"2024-02-21T22:52:48.759135+0000","last_peered":"2024-02-21T22:52:48.759135+0000","last_clean":"2024-02-21T22:52:48.759135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:48.759135+0000","last_undegraded":"2024-02-21T22:52:48.759135+0000","last_fullsized":"2024-02-21T22:52:48.759135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:49.766243+0000","last_change":"2024-02-21T22:52:49.766243+0000","last_active":"2024-02-21T22:52:49.766243+0000","last_peered":"2024-02-21T22:52:49.766243+0000","last_clean":"2024-02-21T22:52:49.766243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:49.766243+0000","last_undegraded":"2024-02-21T22:52:49.766243+0000","last_fullsized":"2024-02-21T22:52:49.766243+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:48.759135+0000","last_change":"2024-02-21T22:52:48.759135+0000","last_active":"2024-02-21T22:52:48.759135+0000","last_peered":"2024-02-21T22:52:48.759135+0000","last_clean":"2024-02-21T22:52:48.759135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:48.759135+0000","last_undegraded":"2024-02-21T22:52:48.759135+0000","last_fullsized":"2024-02-21T22:52:48.759135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:49.766243+0000","last_change":"2024-02-21T22:52:49.766243+0000","last_active":"2024-02-21T22:52:49.766243+0000","last_peered":"2024-02-21T22:52:49.766243+0000","last_clean":"2024-02-21T22:52:49.766243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:49.766243+0000","last_undegraded":"2024-02-21T22:52:49.766243+0000","last_fullsized":"2024-02-21T22:52:49.766243+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:48.759135+0000","last_change":"2024-02-21T22:52:48.759135+0000","last_active":"2024-02-21T22:52:48.759135+0000","last_peered":"2024-02-21T22:52:48.759135+0000","last_clean":"2024-02-21T22:52:48.759135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:48.759135+0000","last_undegraded":"2024-02-21T22:52:48.759135+0000","last_fullsized":"2024-02-21T22:52:48.759135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:49.766243+0000","last_change":"2024-02-21T22:52:49.766243+0000","last_active":"2024-02-21T22:52:49.766243+0000","last_peered":"2024-02-21T22:52:49.766243+0000","last_clean":"2024-02-21T22:52:49.766243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:49.766243+0000","last_undegraded":"2024-02-21T22:52:49.766243+0000","last_fullsized":"2024-02-21T22:52:49.766243+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:48.759135+0000","last_change":"2024-02-21T22:52:48.759135+0000","last_active":"2024-02-21T22:52:48.759135+0000","last_peered":"2024-02-21T22:52:48.759135+0000","last_clean":"2024-02-21T22:52:48.759135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:48.759135+0000","last_undegraded":"2024-02-21T22:52:48.759135+0000","last_fullsized":"2024-02-21T22:52:48.759135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:49.766243+0000","last_change":"2024-02-21T22:52:49.766243+0000","last_active":"2024-02-21T22:52:49.766243+0000","last_peered":"2024-02-21T22:52:49.766243+0000","last_clean":"2024-02-21T22:52:49.766243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:49.766243+0000","last_undegraded":"2024-02-21T22:52:49.766243+0000","last_fullsized":"2024-02-21T22:52:49.766243+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:48.759135+0000","last_change":"2024-02-21T22:52:48.759135+0000","last_active":"2024-02-21T22:52:48.759135+0000","last_peered":"2024-02-21T22:52:48.759135+0000","last_clean":"2024-02-21T22:52:48.759135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:48.759135+0000","last_undegraded":"2024-02-21T22:52:48.759135+0000","last_fullsized":"2024-02-21T22:52:48.759135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:49.766243+0000","last_change":"2024-02-21T22:52:49.766243+0000","last_active":"2024-02-21T22:52:49.766243+0000","last_peered":"2024-02-21T22:52:49.766243+0000","last_clean":"2024-02-21T22:52:49.766243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:49.766243+0000","last_undegraded":"2024-02-21T22:52:49.766243+0000","last_fullsized":"2024-02-21T22:52:49.766243+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:48.759135+0000","last_change":"2024-02-21T22:52:48.759135+0000","last_active":"2024-02-21T22:52:48.759135+0000","last_peered":"2024-02-21T22:52:48.759135+0000","last_clean":"2024-02-21T22:52:48.759135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:48.759135+0000","last_undegraded":"2024-02-21T22:52:48.759135+0000","last_fullsized":"2024-02-21T22:52:48.759135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:49.766243+0000","last_change":"2024-02-21T22:52:49.766243+0000","last_active":"2024-02-21T22:52:49.766243+0000","last_peered":"2024-02-21T22:52:49.766243+0000","last_clean":"2024-02-21T22:52:49.766243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:49.766243+0000","last_undegraded":"2024-02-21T22:52:49.766243+0000","last_fullsized":"2024-02-21T22:52:49.766243+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:48.759135+0000","last_change":"2024-02-21T22:52:48.759135+0000","last_active":"2024-02-21T22:52:48.759135+0000","last_peered":"2024-02-21T22:52:48.759135+0000","last_clean":"2024-02-21T22:52:48.759135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:48.759135+0000","last_undegraded":"2024-02-21T22:52:48.759135+0000","last_fullsized":"2024-02-21T22:52:48.759135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:49.766243+0000","last_change":"2024-02-21T22:52:49.766243+0000","last_active":"2024-02-21T22:52:49.766243+0000","last_peered":"2024-02-21T22:52:49.766243+0000","last_clean":"2024-02-21T22:52:49.766243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:49.766243+0000","last_undegraded":"2024-02-21T22:52:49.766243+0000","last_fullsized":"2024-02-21T22:52:49.766243+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":162,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-02-21T22:52:41.715729+0000","last_change":"2024-02-21T22:52:40.336187+0000","last_active":"2024-02-21T22:52:41.715729+0000","last_peered":"2024-02-21T22:52:41.715729+0000","last_clean":"2024-02-21T22:52:41.715729+0000","last_became_active":"2024-02-21T22:52:40.335061+0000","last_became_peered":"2024-02-21T22:52:40.335061+0000","last_unstale":"2024-02-21T22:52:41.715729+0000","last_undegraded":"2024-02-21T22:52:41.715729+0000","last_fullsized":"2024-02-21T22:52:41.715729+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:38.328863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:38.328863+0000","last_clean_scrub_stamp":"2024-02-21T22:52:38.328863+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:33:53.012414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:48.759135+0000","last_change":"2024-02-21T22:52:48.759135+0000","last_active":"2024-02-21T22:52:48.759135+0000","last_peered":"2024-02-21T22:52:48.759135+0000","last_clean":"2024-02-21T22:52:48.759135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:48.759135+0000","last_undegraded":"2024-02-21T22:52:48.759135+0000","last_fullsized":"2024-02-21T22:52:48.759135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:49.766243+0000","last_change":"2024-02-21T22:52:49.766243+0000","last_active":"2024-02-21T22:52:49.766243+0000","last_peered":"2024-02-21T22:52:49.766243+0000","last_clean":"2024-02-21T22:52:49.766243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:49.766243+0000","last_undegraded":"2024-02-21T22:52:49.766243+0000","last_fullsized":"2024-02-21T22:52:49.766243+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:48.759135+0000","last_change":"2024-02-21T22:52:48.759135+0000","last_active":"2024-02-21T22:52:48.759135+0000","last_peered":"2024-02-21T22:52:48.759135+0000","last_clean":"2024-02-21T22:52:48.759135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:48.759135+0000","last_undegraded":"2024-02-21T22:52:48.759135+0000","last_fullsized":"2024-02-21T22:52:48.759135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:49.766243+0000","last_change":"2024-02-21T22:52:49.766243+0000","last_active":"2024-02-21T22:52:49.766243+0000","last_peered":"2024-02-21T22:52:49.766243+0000","last_clean":"2024-02-21T22:52:49.766243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:49.766243+0000","last_undegraded":"2024-02-21T22:52:49.766243+0000","last_fullsized":"2024-02-21T22:52:49.766243+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:48.759135+0000","last_change":"2024-02-21T22:52:48.759135+0000","last_active":"2024-02-21T22:52:48.759135+0000","last_peered":"2024-02-21T22:52:48.759135+0000","last_clean":"2024-02-21T22:52:48.759135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:48.759135+0000","last_undegraded":"2024-02-21T22:52:48.759135+0000","last_fullsized":"2024-02-21T22:52:48.759135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:49.766243+0000","last_change":"2024-02-21T22:52:49.766243+0000","last_active":"2024-02-21T22:52:49.766243+0000","last_peered":"2024-02-21T22:52:49.766243+0000","last_clean":"2024-02-21T22:52:49.766243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:49.766243+0000","last_undegraded":"2024-02-21T22:52:49.766243+0000","last_fullsized":"2024-02-21T22:52:49.766243+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:48.759135+0000","last_change":"2024-02-21T22:52:48.759135+0000","last_active":"2024-02-21T22:52:48.759135+0000","last_peered":"2024-02-21T22:52:48.759135+0000","last_clean":"2024-02-21T22:52:48.759135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:48.759135+0000","last_undegraded":"2024-02-21T22:52:48.759135+0000","last_fullsized":"2024-02-21T22:52:48.759135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:49.766243+0000","last_change":"2024-02-21T22:52:49.766243+0000","last_active":"2024-02-21T22:52:49.766243+0000","last_peered":"2024-02-21T22:52:49.766243+0000","last_clean":"2024-02-21T22:52:49.766243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:49.766243+0000","last_undegraded":"2024-02-21T22:52:49.766243+0000","last_fullsized":"2024-02-21T22:52:49.766243+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:48.759135+0000","last_change":"2024-02-21T22:52:48.759135+0000","last_active":"2024-02-21T22:52:48.759135+0000","last_peered":"2024-02-21T22:52:48.759135+0000","last_clean":"2024-02-21T22:52:48.759135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:48.759135+0000","last_undegraded":"2024-02-21T22:52:48.759135+0000","last_fullsized":"2024-02-21T22:52:48.759135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:49.766243+0000","last_change":"2024-02-21T22:52:49.766243+0000","last_active":"2024-02-21T22:52:49.766243+0000","last_peered":"2024-02-21T22:52:49.766243+0000","last_clean":"2024-02-21T22:52:49.766243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:49.766243+0000","last_undegraded":"2024-02-21T22:52:49.766243+0000","last_fullsized":"2024-02-21T22:52:49.766243+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:48.759135+0000","last_change":"2024-02-21T22:52:48.759135+0000","last_active":"2024-02-21T22:52:48.759135+0000","last_peered":"2024-02-21T22:52:48.759135+0000","last_clean":"2024-02-21T22:52:48.759135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:48.759135+0000","last_undegraded":"2024-02-21T22:52:48.759135+0000","last_fullsized":"2024-02-21T22:52:48.759135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:49.766243+0000","last_change":"2024-02-21T22:52:49.766243+0000","last_active":"2024-02-21T22:52:49.766243+0000","last_peered":"2024-02-21T22:52:49.766243+0000","last_clean":"2024-02-21T22:52:49.766243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:49.766243+0000","last_undegraded":"2024-02-21T22:52:49.766243+0000","last_fullsized":"2024-02-21T22:52:49.766243+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:48.759135+0000","last_change":"2024-02-21T22:52:48.759135+0000","last_active":"2024-02-21T22:52:48.759135+0000","last_peered":"2024-02-21T22:52:48.759135+0000","last_clean":"2024-02-21T22:52:48.759135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:48.759135+0000","last_undegraded":"2024-02-21T22:52:48.759135+0000","last_fullsized":"2024-02-21T22:52:48.759135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:49.766243+0000","last_change":"2024-02-21T22:52:49.766243+0000","last_active":"2024-02-21T22:52:49.766243+0000","last_peered":"2024-02-21T22:52:49.766243+0000","last_clean":"2024-02-21T22:52:49.766243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:49.766243+0000","last_undegraded":"2024-02-21T22:52:49.766243+0000","last_fullsized":"2024-02-21T22:52:49.766243+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:48.759135+0000","last_change":"2024-02-21T22:52:48.759135+0000","last_active":"2024-02-21T22:52:48.759135+0000","last_peered":"2024-02-21T22:52:48.759135+0000","last_clean":"2024-02-21T22:52:48.759135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:48.759135+0000","last_undegraded":"2024-02-21T22:52:48.759135+0000","last_fullsized":"2024-02-21T22:52:48.759135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:49.766243+0000","last_change":"2024-02-21T22:52:49.766243+0000","last_active":"2024-02-21T22:52:49.766243+0000","last_peered":"2024-02-21T22:52:49.766243+0000","last_clean":"2024-02-21T22:52:49.766243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:49.766243+0000","last_undegraded":"2024-02-21T22:52:49.766243+0000","last_fullsized":"2024-02-21T22:52:49.766243+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:48.759135+0000","last_change":"2024-02-21T22:52:48.759135+0000","last_active":"2024-02-21T22:52:48.759135+0000","last_peered":"2024-02-21T22:52:48.759135+0000","last_clean":"2024-02-21T22:52:48.759135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:48.759135+0000","last_undegraded":"2024-02-21T22:52:48.759135+0000","last_fullsized":"2024-02-21T22:52:48.759135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:49.766243+0000","last_change":"2024-02-21T22:52:49.766243+0000","last_active":"2024-02-21T22:52:49.766243+0000","last_peered":"2024-02-21T22:52:49.766243+0000","last_clean":"2024-02-21T22:52:49.766243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:49.766243+0000","last_undegraded":"2024-02-21T22:52:49.766243+0000","last_fullsized":"2024-02-21T22:52:49.766243+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:48.759135+0000","last_change":"2024-02-21T22:52:48.759135+0000","last_active":"2024-02-21T22:52:48.759135+0000","last_peered":"2024-02-21T22:52:48.759135+0000","last_clean":"2024-02-21T22:52:48.759135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:48.759135+0000","last_undegraded":"2024-02-21T22:52:48.759135+0000","last_fullsized":"2024-02-21T22:52:48.759135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:49.766243+0000","last_change":"2024-02-21T22:52:49.766243+0000","last_active":"2024-02-21T22:52:49.766243+0000","last_peered":"2024-02-21T22:52:49.766243+0000","last_clean":"2024-02-21T22:52:49.766243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:49.766243+0000","last_undegraded":"2024-02-21T22:52:49.766243+0000","last_fullsized":"2024-02-21T22:52:49.766243+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:48.759135+0000","last_change":"2024-02-21T22:52:48.759135+0000","last_active":"2024-02-21T22:52:48.759135+0000","last_peered":"2024-02-21T22:52:48.759135+0000","last_clean":"2024-02-21T22:52:48.759135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:48.759135+0000","last_undegraded":"2024-02-21T22:52:48.759135+0000","last_fullsized":"2024-02-21T22:52:48.759135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:49.766243+0000","last_change":"2024-02-21T22:52:49.766243+0000","last_active":"2024-02-21T22:52:49.766243+0000","last_peered":"2024-02-21T22:52:49.766243+0000","last_clean":"2024-02-21T22:52:49.766243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:49.766243+0000","last_undegraded":"2024-02-21T22:52:49.766243+0000","last_fullsized":"2024-02-21T22:52:49.766243+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:48.759135+0000","last_change":"2024-02-21T22:52:48.759135+0000","last_active":"2024-02-21T22:52:48.759135+0000","last_peered":"2024-02-21T22:52:48.759135+0000","last_clean":"2024-02-21T22:52:48.759135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:48.759135+0000","last_undegraded":"2024-02-21T22:52:48.759135+0000","last_fullsized":"2024-02-21T22:52:48.759135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:49.766243+0000","last_change":"2024-02-21T22:52:49.766243+0000","last_active":"2024-02-21T22:52:49.766243+0000","last_peered":"2024-02-21T22:52:49.766243+0000","last_clean":"2024-02-21T22:52:49.766243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:49.766243+0000","last_undegraded":"2024-02-21T22:52:49.766243+0000","last_fullsized":"2024-02-21T22:52:49.766243+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:49.766243+0000","last_change":"2024-02-21T22:52:49.766243+0000","last_active":"2024-02-21T22:52:49.766243+0000","last_peered":"2024-02-21T22:52:49.766243+0000","last_clean":"2024-02-21T22:52:49.766243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:49.766243+0000","last_undegraded":"2024-02-21T22:52:49.766243+0000","last_fullsized":"2024-02-21T22:52:49.766243+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:48.759135+0000","last_change":"2024-02-21T22:52:48.759135+0000","last_active":"2024-02-21T22:52:48.759135+0000","last_peered":"2024-02-21T22:52:48.759135+0000","last_clean":"2024-02-21T22:52:48.759135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:48.759135+0000","last_undegraded":"2024-02-21T22:52:48.759135+0000","last_fullsized":"2024-02-21T22:52:48.759135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:49.766243+0000","last_change":"2024-02-21T22:52:49.766243+0000","last_active":"2024-02-21T22:52:49.766243+0000","last_peered":"2024-02-21T22:52:49.766243+0000","last_clean":"2024-02-21T22:52:49.766243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:49.766243+0000","last_undegraded":"2024-02-21T22:52:49.766243+0000","last_fullsized":"2024-02-21T22:52:49.766243+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:48.759135+0000","last_change":"2024-02-21T22:52:48.759135+0000","last_active":"2024-02-21T22:52:48.759135+0000","last_peered":"2024-02-21T22:52:48.759135+0000","last_clean":"2024-02-21T22:52:48.759135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:48.759135+0000","last_undegraded":"2024-02-21T22:52:48.759135+0000","last_fullsized":"2024-02-21T22:52:48.759135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:49.766243+0000","last_change":"2024-02-21T22:52:49.766243+0000","last_active":"2024-02-21T22:52:49.766243+0000","last_peered":"2024-02-21T22:52:49.766243+0000","last_clean":"2024-02-21T22:52:49.766243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:49.766243+0000","last_undegraded":"2024-02-21T22:52:49.766243+0000","last_fullsized":"2024-02-21T22:52:49.766243+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:48.759135+0000","last_change":"2024-02-21T22:52:48.759135+0000","last_active":"2024-02-21T22:52:48.759135+0000","last_peered":"2024-02-21T22:52:48.759135+0000","last_clean":"2024-02-21T22:52:48.759135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:48.759135+0000","last_undegraded":"2024-02-21T22:52:48.759135+0000","last_fullsized":"2024-02-21T22:52:48.759135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:49.766243+0000","last_change":"2024-02-21T22:52:49.766243+0000","last_active":"2024-02-21T22:52:49.766243+0000","last_peered":"2024-02-21T22:52:49.766243+0000","last_clean":"2024-02-21T22:52:49.766243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:49.766243+0000","last_undegraded":"2024-02-21T22:52:49.766243+0000","last_fullsized":"2024-02-21T22:52:49.766243+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-21T22:52:48.759135+0000","last_change":"2024-02-21T22:52:48.759135+0000","last_active":"2024-02-21T22:52:48.759135+0000","last_peered":"2024-02-21T22:52:48.759135+0000","last_clean":"2024-02-21T22:52:48.759135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-21T22:52:48.759135+0000","last_undegraded":"2024-02-21T22:52:48.759135+0000","last_fullsized":"2024-02-21T22:52:48.759135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28316,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343524,"statfs":{"total":96636764160,"available":96607768576,"internally_reserved":0,"allocated":749568,"data_stored":636135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27172,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344668,"statfs":{"total":96636764160,"available":96608940032,"internally_reserved":0,"allocated":155648,"data_stored":45767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27172,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344668,"statfs":{"total":96636764160,"available":96608940032,"internally_reserved":0,"allocated":155648,"data_stored":45767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27172,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344668,"statfs":{"total":96636764160,"available":96608940032,"internally_reserved":0,"allocated":155648,"data_stored":45767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27172,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344668,"statfs":{"total":96636764160,"available":96608940032,"internally_reserved":0,"allocated":155648,"data_stored":45767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27172,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344668,"statfs":{"total":96636764160,"available":96608940032,"internally_reserved":0,"allocated":155648,"data_stored":45767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27172,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344668,"statfs":{"total":96636764160,"available":96608940032,"internally_reserved":0,"allocated":155648,"data_stored":45767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28316,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343524,"statfs":{"total":96636764160,"available":96607768576,"internally_reserved":0,"allocated":749568,"data_stored":636135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-21T22:52:54.081 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-21T22:52:54.218 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.227+0000 7f18e135e640 1 Processor -- start 2024-02-21T22:52:54.218 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.227+0000 7f18e135e640 1 -- start start 2024-02-21T22:52:54.220 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.228+0000 7f18e135e640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f18dc0d0510 0x7f18dc0d08f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:54.220 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.228+0000 7f18e135e640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f18dc0d1c30 0x7f18dc0d2430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:54.220 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.228+0000 7f18e135e640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18dc0cfa50 con 0x7f18dc0ce8c0 2024-02-21T22:52:54.220 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.228+0000 7f18e135e640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18dc0d1450 con 0x7f18dc0d0510 2024-02-21T22:52:54.220 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.228+0000 7f18e135e640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18dc0d0e30 con 0x7f18dc0d1c30 2024-02-21T22:52:54.220 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.228+0000 7f18daffd640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f18dc0d0510 0x7f18dc0d08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:54.220 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.228+0000 7f18db7fe640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f18dc0ce8c0 0x7f18dc0ced10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:56880/0 (socket says 172.21.15.116:56880) 2024-02-21T22:52:54.220 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.228+0000 7f18db7fe640 1 -- 172.21.15.116:0/3190435211 learned_addr learned my addr 172.21.15.116:0/3190435211 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-02-21T22:52:54.220 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.228+0000 7f18da7fc640 1 --2- 172.21.15.116:0/3190435211 >> v2:172.21.15.142:3300/0 conn(0x7f18dc0d1c30 0x7f18dc0d2430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:54.220 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.228+0000 7f18daffd640 1 -- 172.21.15.116:0/3190435211 >> v2:172.21.15.142:3300/0 conn(0x7f18dc0d1c30 msgr2=0x7f18dc0d2430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:52:54.220 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.228+0000 7f18daffd640 1 --2- 172.21.15.116:0/3190435211 >> v2:172.21.15.142:3300/0 conn(0x7f18dc0d1c30 0x7f18dc0d2430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:54.220 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.228+0000 7f18daffd640 1 -- 172.21.15.116:0/3190435211 >> v1:172.21.15.116:6789/0 conn(0x7f18dc0ce8c0 legacy=0x7f18dc0ced10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:54.220 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.228+0000 7f18daffd640 1 -- 172.21.15.116:0/3190435211 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18dc0cfcc0 con 0x7f18dc0d0510 2024-02-21T22:52:54.221 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.228+0000 7f18da7fc640 1 --2- 172.21.15.116:0/3190435211 >> v2:172.21.15.142:3300/0 conn(0x7f18dc0d1c30 0x7f18dc0d2430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T22:52:54.221 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.229+0000 7f18daffd640 1 --2- 172.21.15.116:0/3190435211 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f18dc0d0510 0x7f18dc0d08f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f18dc0d15d0 tx=0x7f18cc02be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72ec264a8fdcef29 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:52:54.221 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.229+0000 7f18d9ffb640 1 -- 172.21.15.116:0/3190435211 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18cc039070 con 0x7f18dc0d0510 2024-02-21T22:52:54.221 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.229+0000 7f18d9ffb640 1 -- 172.21.15.116:0/3190435211 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18cc02cbd0 con 0x7f18dc0d0510 2024-02-21T22:52:54.221 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.229+0000 7f18d9ffb640 1 -- 172.21.15.116:0/3190435211 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18cc034440 con 0x7f18dc0d0510 2024-02-21T22:52:54.224 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.230+0000 7f18e135e640 1 -- 172.21.15.116:0/3190435211 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f18dc0d0510 msgr2=0x7f18dc0d08f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:54.224 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.230+0000 7f18e135e640 1 --2- 172.21.15.116:0/3190435211 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f18dc0d0510 0x7f18dc0d08f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f18dc0d15d0 tx=0x7f18cc02be20 comp rx=0 tx=0).stop 2024-02-21T22:52:54.224 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.230+0000 7f18e135e640 1 -- 172.21.15.116:0/3190435211 shutdown_connections 2024-02-21T22:52:54.224 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.230+0000 7f18e135e640 1 --2- 172.21.15.116:0/3190435211 >> v2:172.21.15.142:3300/0 conn(0x7f18dc0d1c30 0x7f18dc0d2430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:54.224 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.230+0000 7f18e135e640 1 --2- 172.21.15.116:0/3190435211 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f18dc0d0510 0x7f18dc0d08f0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:54.224 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.230+0000 7f18e135e640 1 -- 172.21.15.116:0/3190435211 >> 172.21.15.116:0/3190435211 conn(0x7f18dc0d3e50 msgr2=0x7f18dc0d4260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:52:54.224 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.230+0000 7f18e135e640 1 -- 172.21.15.116:0/3190435211 shutdown_connections 2024-02-21T22:52:54.224 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.230+0000 7f18e135e640 1 -- 172.21.15.116:0/3190435211 wait complete. 2024-02-21T22:52:54.224 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.231+0000 7f18e135e640 1 Processor -- start 2024-02-21T22:52:54.224 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.231+0000 7f18e135e640 1 -- start start 2024-02-21T22:52:54.224 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.232+0000 7f18e135e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f18dc0ce8c0 0x7f18dc155720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:54.225 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.232+0000 7f18e135e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f18dc0d0510 0x7f18dc0c99d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:54.225 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.232+0000 7f18e135e640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f18dc0d1c30 0x7f18dc15c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:54.225 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.232+0000 7f18e135e640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18dc15e640 con 0x7f18dc0d1c30 2024-02-21T22:52:54.225 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.232+0000 7f18e135e640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18dc0d10e0 con 0x7f18dc0d0510 2024-02-21T22:52:54.225 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.232+0000 7f18e135e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18dc0d2970 con 0x7f18dc0ce8c0 2024-02-21T22:52:54.225 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.232+0000 7f18db7fe640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f18dc0d1c30 0x7f18dc15c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:54.225 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.232+0000 7f18db7fe640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f18dc0d1c30 0x7f18dc15c4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:51042/0 (socket says 172.21.15.116:51042) 2024-02-21T22:52:54.225 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.232+0000 7f18db7fe640 1 -- 172.21.15.116:0/2659390658 learned_addr learned my addr 172.21.15.116:0/2659390658 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:52:54.225 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.232+0000 7f18da7fc640 1 --2- 172.21.15.116:0/2659390658 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f18dc0d0510 0x7f18dc0c99d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:54.225 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.232+0000 7f18daffd640 1 --2- 172.21.15.116:0/2659390658 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f18dc0ce8c0 0x7f18dc155720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:54.225 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.232+0000 7f18db7fe640 1 -- 172.21.15.116:0/2659390658 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f18dc0ce8c0 msgr2=0x7f18dc155720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:54.225 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.232+0000 7f18db7fe640 1 --2- 172.21.15.116:0/2659390658 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f18dc0ce8c0 0x7f18dc155720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:54.225 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.232+0000 7f18db7fe640 1 -- 172.21.15.116:0/2659390658 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f18dc0d0510 msgr2=0x7f18dc0c99d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:54.225 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.232+0000 7f18db7fe640 1 --2- 172.21.15.116:0/2659390658 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f18dc0d0510 0x7f18dc0c99d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:54.225 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.232+0000 7f18db7fe640 1 -- 172.21.15.116:0/2659390658 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18dc158020 con 0x7f18dc0d1c30 2024-02-21T22:52:54.225 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.232+0000 7f18db7fe640 1 --2- 172.21.15.116:0/2659390658 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f18dc0d1c30 0x7f18dc15c4c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f18d400c3a0 tx=0x7f18d400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:52:54.226 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.232+0000 7f18c37fe640 1 -- 172.21.15.116:0/2659390658 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18d4017070 con 0x7f18dc0d1c30 2024-02-21T22:52:54.226 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.232+0000 7f18c37fe640 1 -- 172.21.15.116:0/2659390658 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18d4005ce0 con 0x7f18dc0d1c30 2024-02-21T22:52:54.226 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.232+0000 7f18e135e640 1 -- 172.21.15.116:0/2659390658 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18dc158300 con 0x7f18dc0d1c30 2024-02-21T22:52:54.226 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.232+0000 7f18c37fe640 1 -- 172.21.15.116:0/2659390658 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18d40072d0 con 0x7f18dc0d1c30 2024-02-21T22:52:54.226 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.232+0000 7f18e135e640 1 -- 172.21.15.116:0/2659390658 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18dc1588c0 con 0x7f18dc0d1c30 2024-02-21T22:52:54.226 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.233+0000 7f18e135e640 1 -- 172.21.15.116:0/2659390658 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18dc0752f0 con 0x7f18dc0d1c30 2024-02-21T22:52:54.227 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.234+0000 7f18c37fe640 1 -- 172.21.15.116:0/2659390658 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f18d401a070 con 0x7f18dc0d1c30 2024-02-21T22:52:54.227 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.234+0000 7f18c37fe640 1 --2- 172.21.15.116:0/2659390658 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f18c806b4d0 0x7f18c806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:54.227 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.234+0000 7f18c37fe640 1 -- 172.21.15.116:0/2659390658 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f18d4089410 con 0x7f18dc0d1c30 2024-02-21T22:52:54.227 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.234+0000 7f18daffd640 1 --2- 172.21.15.116:0/2659390658 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f18c806b4d0 0x7f18c806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:54.227 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.235+0000 7f18daffd640 1 --2- 172.21.15.116:0/2659390658 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f18c806b4d0 0x7f18c806d990 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f18cc036000 tx=0x7f18cc030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:52:54.229 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.238+0000 7f18c37fe640 1 -- 172.21.15.116:0/2659390658 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f18d4057c40 con 0x7f18dc0d1c30 2024-02-21T22:52:54.397 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.406+0000 7f18e135e640 1 -- 172.21.15.116:0/2659390658 --> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f18dc0d2210 con 0x7f18c806b4d0 2024-02-21T22:52:54.404 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.414+0000 7f18c37fe640 1 -- 172.21.15.116:0/2659390658 <== mgr.4103 v2:172.21.15.142:6832/1381484782 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251946 (secure 0 0 0) 0x7f18dc0d2210 con 0x7f18c806b4d0 2024-02-21T22:52:54.407 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-02-21T22:52:54.408 INFO:teuthology.orchestra.run.smithi116.stderr:dumped all 2024-02-21T22:52:54.409 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.416+0000 7f18e135e640 1 -- 172.21.15.116:0/2659390658 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f18c806b4d0 msgr2=0x7f18c806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:54.410 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.416+0000 7f18e135e640 1 --2- 172.21.15.116:0/2659390658 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f18c806b4d0 0x7f18c806d990 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f18cc036000 tx=0x7f18cc030000 comp rx=0 tx=0).stop 2024-02-21T22:52:54.410 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.416+0000 7f18e135e640 1 -- 172.21.15.116:0/2659390658 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f18dc0d1c30 msgr2=0x7f18dc15c4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:54.410 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.416+0000 7f18e135e640 1 --2- 172.21.15.116:0/2659390658 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f18dc0d1c30 0x7f18dc15c4c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f18d400c3a0 tx=0x7f18d400c860 comp rx=0 tx=0).stop 2024-02-21T22:52:54.410 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.416+0000 7f18e135e640 1 -- 172.21.15.116:0/2659390658 shutdown_connections 2024-02-21T22:52:54.410 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.416+0000 7f18e135e640 1 --2- 172.21.15.116:0/2659390658 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f18dc0d1c30 0x7f18dc15c4c0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:54.410 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.416+0000 7f18e135e640 1 --2- 172.21.15.116:0/2659390658 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f18dc0d0510 0x7f18dc0c99d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:54.410 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.416+0000 7f18e135e640 1 --2- 172.21.15.116:0/2659390658 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f18c806b4d0 0x7f18c806d990 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:54.410 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.416+0000 7f18e135e640 1 --2- 172.21.15.116:0/2659390658 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f18dc0ce8c0 0x7f18dc155720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:54.410 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.416+0000 7f18e135e640 1 -- 172.21.15.116:0/2659390658 >> 172.21.15.116:0/2659390658 conn(0x7f18dc0d3e50 msgr2=0x7f18dc0cb760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:52:54.410 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.416+0000 7f18e135e640 1 -- 172.21.15.116:0/2659390658 shutdown_connections 2024-02-21T22:52:54.410 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.417+0000 7f18e135e640 1 -- 172.21.15.116:0/2659390658 wait complete. 2024-02-21T22:52:54.418 INFO:teuthology.orchestra.run.smithi116.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-02-21T22:52:54.288256+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":125,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219016,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755704,"statfs":{"total":773094113280,"available":772869840896,"internally_reserved":0,"allocated":2891776,"data_stored":1753028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.521499"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234219+0000","last_change":"2024-02-21T22:52:50.804119+0000","last_active":"2024-02-21T22:52:52.234219+0000","last_peered":"2024-02-21T22:52:52.234219+0000","last_clean":"2024-02-21T22:52:52.234219+0000","last_became_active":"2024-02-21T22:52:50.801464+0000","last_became_peered":"2024-02-21T22:52:50.801464+0000","last_unstale":"2024-02-21T22:52:52.234219+0000","last_undegraded":"2024-02-21T22:52:52.234219+0000","last_fullsized":"2024-02-21T22:52:52.234219+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:06:29.082788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:51.792663+0000","last_change":"2024-02-21T22:52:50.787683+0000","last_active":"2024-02-21T22:52:51.792663+0000","last_peered":"2024-02-21T22:52:51.792663+0000","last_clean":"2024-02-21T22:52:51.792663+0000","last_became_active":"2024-02-21T22:52:50.787384+0000","last_became_peered":"2024-02-21T22:52:50.787384+0000","last_unstale":"2024-02-21T22:52:51.792663+0000","last_undegraded":"2024-02-21T22:52:51.792663+0000","last_fullsized":"2024-02-21T22:52:51.792663+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:10:56.108581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.233732+0000","last_change":"2024-02-21T22:52:50.786452+0000","last_active":"2024-02-21T22:52:52.233732+0000","last_peered":"2024-02-21T22:52:52.233732+0000","last_clean":"2024-02-21T22:52:52.233732+0000","last_became_active":"2024-02-21T22:52:50.786191+0000","last_became_peered":"2024-02-21T22:52:50.786191+0000","last_unstale":"2024-02-21T22:52:52.233732+0000","last_undegraded":"2024-02-21T22:52:52.233732+0000","last_fullsized":"2024-02-21T22:52:52.233732+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:43:33.767331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.233922+0000","last_change":"2024-02-21T22:52:50.805367+0000","last_active":"2024-02-21T22:52:52.233922+0000","last_peered":"2024-02-21T22:52:52.233922+0000","last_clean":"2024-02-21T22:52:52.233922+0000","last_became_active":"2024-02-21T22:52:50.805067+0000","last_became_peered":"2024-02-21T22:52:50.805067+0000","last_unstale":"2024-02-21T22:52:52.233922+0000","last_undegraded":"2024-02-21T22:52:52.233922+0000","last_fullsized":"2024-02-21T22:52:52.233922+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T02:49:51.875007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234052+0000","last_change":"2024-02-21T22:52:50.793726+0000","last_active":"2024-02-21T22:52:52.234052+0000","last_peered":"2024-02-21T22:52:52.234052+0000","last_clean":"2024-02-21T22:52:52.234052+0000","last_became_active":"2024-02-21T22:52:50.793461+0000","last_became_peered":"2024-02-21T22:52:50.793461+0000","last_unstale":"2024-02-21T22:52:52.234052+0000","last_undegraded":"2024-02-21T22:52:52.234052+0000","last_fullsized":"2024-02-21T22:52:52.234052+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:25:14.399237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.233784+0000","last_change":"2024-02-21T22:52:50.797872+0000","last_active":"2024-02-21T22:52:52.233784+0000","last_peered":"2024-02-21T22:52:52.233784+0000","last_clean":"2024-02-21T22:52:52.233784+0000","last_became_active":"2024-02-21T22:52:50.797547+0000","last_became_peered":"2024-02-21T22:52:50.797547+0000","last_unstale":"2024-02-21T22:52:52.233784+0000","last_undegraded":"2024-02-21T22:52:52.233784+0000","last_fullsized":"2024-02-21T22:52:52.233784+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:38:41.981414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.233678+0000","last_change":"2024-02-21T22:52:50.792977+0000","last_active":"2024-02-21T22:52:52.233678+0000","last_peered":"2024-02-21T22:52:52.233678+0000","last_clean":"2024-02-21T22:52:52.233678+0000","last_became_active":"2024-02-21T22:52:50.792731+0000","last_became_peered":"2024-02-21T22:52:50.792731+0000","last_unstale":"2024-02-21T22:52:52.233678+0000","last_undegraded":"2024-02-21T22:52:52.233678+0000","last_fullsized":"2024-02-21T22:52:52.233678+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T02:49:51.875007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.233592+0000","last_change":"2024-02-21T22:52:50.800588+0000","last_active":"2024-02-21T22:52:52.233592+0000","last_peered":"2024-02-21T22:52:52.233592+0000","last_clean":"2024-02-21T22:52:52.233592+0000","last_became_active":"2024-02-21T22:52:50.800266+0000","last_became_peered":"2024-02-21T22:52:50.800266+0000","last_unstale":"2024-02-21T22:52:52.233592+0000","last_undegraded":"2024-02-21T22:52:52.233592+0000","last_fullsized":"2024-02-21T22:52:52.233592+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:49:26.881791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234360+0000","last_change":"2024-02-21T22:52:50.802133+0000","last_active":"2024-02-21T22:52:52.234360+0000","last_peered":"2024-02-21T22:52:52.234360+0000","last_clean":"2024-02-21T22:52:52.234360+0000","last_became_active":"2024-02-21T22:52:50.801109+0000","last_became_peered":"2024-02-21T22:52:50.801109+0000","last_unstale":"2024-02-21T22:52:52.234360+0000","last_undegraded":"2024-02-21T22:52:52.234360+0000","last_fullsized":"2024-02-21T22:52:52.234360+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:32:36.066162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:51.795991+0000","last_change":"2024-02-21T22:52:50.799972+0000","last_active":"2024-02-21T22:52:51.795991+0000","last_peered":"2024-02-21T22:52:51.795991+0000","last_clean":"2024-02-21T22:52:51.795991+0000","last_became_active":"2024-02-21T22:52:50.799713+0000","last_became_peered":"2024-02-21T22:52:50.799713+0000","last_unstale":"2024-02-21T22:52:51.795991+0000","last_undegraded":"2024-02-21T22:52:51.795991+0000","last_fullsized":"2024-02-21T22:52:51.795991+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:10:56.108581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:51.794860+0000","last_change":"2024-02-21T22:52:50.800180+0000","last_active":"2024-02-21T22:52:51.794860+0000","last_peered":"2024-02-21T22:52:51.794860+0000","last_clean":"2024-02-21T22:52:51.794860+0000","last_became_active":"2024-02-21T22:52:50.799506+0000","last_became_peered":"2024-02-21T22:52:50.799506+0000","last_unstale":"2024-02-21T22:52:51.794860+0000","last_undegraded":"2024-02-21T22:52:51.794860+0000","last_fullsized":"2024-02-21T22:52:51.794860+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:49:26.881791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:51.795709+0000","last_change":"2024-02-21T22:52:50.785668+0000","last_active":"2024-02-21T22:52:51.795709+0000","last_peered":"2024-02-21T22:52:51.795709+0000","last_clean":"2024-02-21T22:52:51.795709+0000","last_became_active":"2024-02-21T22:52:50.785381+0000","last_became_peered":"2024-02-21T22:52:50.785381+0000","last_unstale":"2024-02-21T22:52:51.795709+0000","last_undegraded":"2024-02-21T22:52:51.795709+0000","last_fullsized":"2024-02-21T22:52:51.795709+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:29:58.630598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234333+0000","last_change":"2024-02-21T22:52:50.789689+0000","last_active":"2024-02-21T22:52:52.234333+0000","last_peered":"2024-02-21T22:52:52.234333+0000","last_clean":"2024-02-21T22:52:52.234333+0000","last_became_active":"2024-02-21T22:52:50.789124+0000","last_became_peered":"2024-02-21T22:52:50.789124+0000","last_unstale":"2024-02-21T22:52:52.234333+0000","last_undegraded":"2024-02-21T22:52:52.234333+0000","last_fullsized":"2024-02-21T22:52:52.234333+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:10:56.108581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.233802+0000","last_change":"2024-02-21T22:52:50.787622+0000","last_active":"2024-02-21T22:52:52.233802+0000","last_peered":"2024-02-21T22:52:52.233802+0000","last_clean":"2024-02-21T22:52:52.233802+0000","last_became_active":"2024-02-21T22:52:50.787315+0000","last_became_peered":"2024-02-21T22:52:50.787315+0000","last_unstale":"2024-02-21T22:52:52.233802+0000","last_undegraded":"2024-02-21T22:52:52.233802+0000","last_fullsized":"2024-02-21T22:52:52.233802+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:07:39.283417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:51.792349+0000","last_change":"2024-02-21T22:52:50.785274+0000","last_active":"2024-02-21T22:52:51.792349+0000","last_peered":"2024-02-21T22:52:51.792349+0000","last_clean":"2024-02-21T22:52:51.792349+0000","last_became_active":"2024-02-21T22:52:50.784970+0000","last_became_peered":"2024-02-21T22:52:50.784970+0000","last_unstale":"2024-02-21T22:52:51.792349+0000","last_undegraded":"2024-02-21T22:52:51.792349+0000","last_fullsized":"2024-02-21T22:52:51.792349+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:17:34.365402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234235+0000","last_change":"2024-02-21T22:52:50.797804+0000","last_active":"2024-02-21T22:52:52.234235+0000","last_peered":"2024-02-21T22:52:52.234235+0000","last_clean":"2024-02-21T22:52:52.234235+0000","last_became_active":"2024-02-21T22:52:50.797414+0000","last_became_peered":"2024-02-21T22:52:50.797414+0000","last_unstale":"2024-02-21T22:52:52.234235+0000","last_undegraded":"2024-02-21T22:52:52.234235+0000","last_fullsized":"2024-02-21T22:52:52.234235+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:10:56.108581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234715+0000","last_change":"2024-02-21T22:52:50.808468+0000","last_active":"2024-02-21T22:52:52.234715+0000","last_peered":"2024-02-21T22:52:52.234715+0000","last_clean":"2024-02-21T22:52:52.234715+0000","last_became_active":"2024-02-21T22:52:50.808183+0000","last_became_peered":"2024-02-21T22:52:50.808183+0000","last_unstale":"2024-02-21T22:52:52.234715+0000","last_undegraded":"2024-02-21T22:52:52.234715+0000","last_fullsized":"2024-02-21T22:52:52.234715+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:22:02.404664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.233676+0000","last_change":"2024-02-21T22:52:50.789333+0000","last_active":"2024-02-21T22:52:52.233676+0000","last_peered":"2024-02-21T22:52:52.233676+0000","last_clean":"2024-02-21T22:52:52.233676+0000","last_became_active":"2024-02-21T22:52:50.789054+0000","last_became_peered":"2024-02-21T22:52:50.789054+0000","last_unstale":"2024-02-21T22:52:52.233676+0000","last_undegraded":"2024-02-21T22:52:52.233676+0000","last_fullsized":"2024-02-21T22:52:52.233676+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:31:51.565091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234606+0000","last_change":"2024-02-21T22:52:50.796065+0000","last_active":"2024-02-21T22:52:52.234606+0000","last_peered":"2024-02-21T22:52:52.234606+0000","last_clean":"2024-02-21T22:52:52.234606+0000","last_became_active":"2024-02-21T22:52:50.794895+0000","last_became_peered":"2024-02-21T22:52:50.794895+0000","last_unstale":"2024-02-21T22:52:52.234606+0000","last_undegraded":"2024-02-21T22:52:52.234606+0000","last_fullsized":"2024-02-21T22:52:52.234606+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:03:04.692215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:51.794890+0000","last_change":"2024-02-21T22:52:50.795221+0000","last_active":"2024-02-21T22:52:51.794890+0000","last_peered":"2024-02-21T22:52:51.794890+0000","last_clean":"2024-02-21T22:52:51.794890+0000","last_became_active":"2024-02-21T22:52:50.794693+0000","last_became_peered":"2024-02-21T22:52:50.794693+0000","last_unstale":"2024-02-21T22:52:51.794890+0000","last_undegraded":"2024-02-21T22:52:51.794890+0000","last_fullsized":"2024-02-21T22:52:51.794890+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T10:36:17.566817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234167+0000","last_change":"2024-02-21T22:52:50.793867+0000","last_active":"2024-02-21T22:52:52.234167+0000","last_peered":"2024-02-21T22:52:52.234167+0000","last_clean":"2024-02-21T22:52:52.234167+0000","last_became_active":"2024-02-21T22:52:50.793645+0000","last_became_peered":"2024-02-21T22:52:50.793645+0000","last_unstale":"2024-02-21T22:52:52.234167+0000","last_undegraded":"2024-02-21T22:52:52.234167+0000","last_fullsized":"2024-02-21T22:52:52.234167+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:25:58.111654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.233930+0000","last_change":"2024-02-21T22:52:50.807989+0000","last_active":"2024-02-21T22:52:52.233930+0000","last_peered":"2024-02-21T22:52:52.233930+0000","last_clean":"2024-02-21T22:52:52.233930+0000","last_became_active":"2024-02-21T22:52:50.807712+0000","last_became_peered":"2024-02-21T22:52:50.807712+0000","last_unstale":"2024-02-21T22:52:52.233930+0000","last_undegraded":"2024-02-21T22:52:52.233930+0000","last_fullsized":"2024-02-21T22:52:52.233930+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:36:16.855646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234410+0000","last_change":"2024-02-21T22:52:50.800936+0000","last_active":"2024-02-21T22:52:52.234410+0000","last_peered":"2024-02-21T22:52:52.234410+0000","last_clean":"2024-02-21T22:52:52.234410+0000","last_became_active":"2024-02-21T22:52:50.800431+0000","last_became_peered":"2024-02-21T22:52:50.800431+0000","last_unstale":"2024-02-21T22:52:52.234410+0000","last_undegraded":"2024-02-21T22:52:52.234410+0000","last_fullsized":"2024-02-21T22:52:52.234410+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:38:41.981414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234377+0000","last_change":"2024-02-21T22:52:50.805357+0000","last_active":"2024-02-21T22:52:52.234377+0000","last_peered":"2024-02-21T22:52:52.234377+0000","last_clean":"2024-02-21T22:52:52.234377+0000","last_became_active":"2024-02-21T22:52:50.805060+0000","last_became_peered":"2024-02-21T22:52:50.805060+0000","last_unstale":"2024-02-21T22:52:52.234377+0000","last_undegraded":"2024-02-21T22:52:52.234377+0000","last_fullsized":"2024-02-21T22:52:52.234377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:51:16.039745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234522+0000","last_change":"2024-02-21T22:52:50.797979+0000","last_active":"2024-02-21T22:52:52.234522+0000","last_peered":"2024-02-21T22:52:52.234522+0000","last_clean":"2024-02-21T22:52:52.234522+0000","last_became_active":"2024-02-21T22:52:50.797343+0000","last_became_peered":"2024-02-21T22:52:50.797343+0000","last_unstale":"2024-02-21T22:52:52.234522+0000","last_undegraded":"2024-02-21T22:52:52.234522+0000","last_fullsized":"2024-02-21T22:52:52.234522+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:25:14.399237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:51.795952+0000","last_change":"2024-02-21T22:52:50.797991+0000","last_active":"2024-02-21T22:52:51.795952+0000","last_peered":"2024-02-21T22:52:51.795952+0000","last_clean":"2024-02-21T22:52:51.795952+0000","last_became_active":"2024-02-21T22:52:50.797667+0000","last_became_peered":"2024-02-21T22:52:50.797667+0000","last_unstale":"2024-02-21T22:52:51.795952+0000","last_undegraded":"2024-02-21T22:52:51.795952+0000","last_fullsized":"2024-02-21T22:52:51.795952+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:33:40.513967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:51.792515+0000","last_change":"2024-02-21T22:52:50.788943+0000","last_active":"2024-02-21T22:52:51.792515+0000","last_peered":"2024-02-21T22:52:51.792515+0000","last_clean":"2024-02-21T22:52:51.792515+0000","last_became_active":"2024-02-21T22:52:50.788672+0000","last_became_peered":"2024-02-21T22:52:50.788672+0000","last_unstale":"2024-02-21T22:52:51.792515+0000","last_undegraded":"2024-02-21T22:52:51.792515+0000","last_fullsized":"2024-02-21T22:52:51.792515+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:25:58.111654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234510+0000","last_change":"2024-02-21T22:52:50.797663+0000","last_active":"2024-02-21T22:52:52.234510+0000","last_peered":"2024-02-21T22:52:52.234510+0000","last_clean":"2024-02-21T22:52:52.234510+0000","last_became_active":"2024-02-21T22:52:50.797359+0000","last_became_peered":"2024-02-21T22:52:50.797359+0000","last_unstale":"2024-02-21T22:52:52.234510+0000","last_undegraded":"2024-02-21T22:52:52.234510+0000","last_fullsized":"2024-02-21T22:52:52.234510+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:36:16.855646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234239+0000","last_change":"2024-02-21T22:52:50.788672+0000","last_active":"2024-02-21T22:52:52.234239+0000","last_peered":"2024-02-21T22:52:52.234239+0000","last_clean":"2024-02-21T22:52:52.234239+0000","last_became_active":"2024-02-21T22:52:50.788413+0000","last_became_peered":"2024-02-21T22:52:50.788413+0000","last_unstale":"2024-02-21T22:52:52.234239+0000","last_undegraded":"2024-02-21T22:52:52.234239+0000","last_fullsized":"2024-02-21T22:52:52.234239+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:33:40.513967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234286+0000","last_change":"2024-02-21T22:52:50.808763+0000","last_active":"2024-02-21T22:52:52.234286+0000","last_peered":"2024-02-21T22:52:52.234286+0000","last_clean":"2024-02-21T22:52:52.234286+0000","last_became_active":"2024-02-21T22:52:50.805917+0000","last_became_peered":"2024-02-21T22:52:50.805917+0000","last_unstale":"2024-02-21T22:52:52.234286+0000","last_undegraded":"2024-02-21T22:52:52.234286+0000","last_fullsized":"2024-02-21T22:52:52.234286+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:39:55.210527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.233575+0000","last_change":"2024-02-21T22:52:50.799649+0000","last_active":"2024-02-21T22:52:52.233575+0000","last_peered":"2024-02-21T22:52:52.233575+0000","last_clean":"2024-02-21T22:52:52.233575+0000","last_became_active":"2024-02-21T22:52:50.799372+0000","last_became_peered":"2024-02-21T22:52:50.799372+0000","last_unstale":"2024-02-21T22:52:52.233575+0000","last_undegraded":"2024-02-21T22:52:52.233575+0000","last_fullsized":"2024-02-21T22:52:52.233575+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:20:01.491741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:51.795278+0000","last_change":"2024-02-21T22:52:50.789389+0000","last_active":"2024-02-21T22:52:51.795278+0000","last_peered":"2024-02-21T22:52:51.795278+0000","last_clean":"2024-02-21T22:52:51.795278+0000","last_became_active":"2024-02-21T22:52:50.789121+0000","last_became_peered":"2024-02-21T22:52:50.789121+0000","last_unstale":"2024-02-21T22:52:51.795278+0000","last_undegraded":"2024-02-21T22:52:51.795278+0000","last_fullsized":"2024-02-21T22:52:51.795278+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:58:42.676518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:51.794985+0000","last_change":"2024-02-21T22:52:50.792014+0000","last_active":"2024-02-21T22:52:51.794985+0000","last_peered":"2024-02-21T22:52:51.794985+0000","last_clean":"2024-02-21T22:52:51.794985+0000","last_became_active":"2024-02-21T22:52:50.790916+0000","last_became_peered":"2024-02-21T22:52:50.790916+0000","last_unstale":"2024-02-21T22:52:51.794985+0000","last_undegraded":"2024-02-21T22:52:51.794985+0000","last_fullsized":"2024-02-21T22:52:51.794985+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:04:04.768586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234516+0000","last_change":"2024-02-21T22:52:49.786296+0000","last_active":"2024-02-21T22:52:52.234516+0000","last_peered":"2024-02-21T22:52:52.234516+0000","last_clean":"2024-02-21T22:52:52.234516+0000","last_became_active":"2024-02-21T22:52:49.785971+0000","last_became_peered":"2024-02-21T22:52:49.785971+0000","last_unstale":"2024-02-21T22:52:52.234516+0000","last_undegraded":"2024-02-21T22:52:52.234516+0000","last_fullsized":"2024-02-21T22:52:52.234516+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:23:17.385208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234297+0000","last_change":"2024-02-21T22:52:50.802188+0000","last_active":"2024-02-21T22:52:52.234297+0000","last_peered":"2024-02-21T22:52:52.234297+0000","last_clean":"2024-02-21T22:52:52.234297+0000","last_became_active":"2024-02-21T22:52:50.801916+0000","last_became_peered":"2024-02-21T22:52:50.801916+0000","last_unstale":"2024-02-21T22:52:52.234297+0000","last_undegraded":"2024-02-21T22:52:52.234297+0000","last_fullsized":"2024-02-21T22:52:52.234297+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:10:56.108581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:51.795043+0000","last_change":"2024-02-21T22:52:49.789667+0000","last_active":"2024-02-21T22:52:51.795043+0000","last_peered":"2024-02-21T22:52:51.795043+0000","last_clean":"2024-02-21T22:52:51.795043+0000","last_became_active":"2024-02-21T22:52:49.789375+0000","last_became_peered":"2024-02-21T22:52:49.789375+0000","last_unstale":"2024-02-21T22:52:51.795043+0000","last_undegraded":"2024-02-21T22:52:51.795043+0000","last_fullsized":"2024-02-21T22:52:51.795043+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:04:03.761477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234559+0000","last_change":"2024-02-21T22:52:49.785301+0000","last_active":"2024-02-21T22:52:52.234559+0000","last_peered":"2024-02-21T22:52:52.234559+0000","last_clean":"2024-02-21T22:52:52.234559+0000","last_became_active":"2024-02-21T22:52:49.784975+0000","last_became_peered":"2024-02-21T22:52:49.784975+0000","last_unstale":"2024-02-21T22:52:52.234559+0000","last_undegraded":"2024-02-21T22:52:52.234559+0000","last_fullsized":"2024-02-21T22:52:52.234559+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:57:47.487172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.233732+0000","last_change":"2024-02-21T22:52:50.792749+0000","last_active":"2024-02-21T22:52:52.233732+0000","last_peered":"2024-02-21T22:52:52.233732+0000","last_clean":"2024-02-21T22:52:52.233732+0000","last_became_active":"2024-02-21T22:52:50.792219+0000","last_became_peered":"2024-02-21T22:52:50.792219+0000","last_unstale":"2024-02-21T22:52:52.233732+0000","last_undegraded":"2024-02-21T22:52:52.233732+0000","last_fullsized":"2024-02-21T22:52:52.233732+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T10:36:17.566817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234473+0000","last_change":"2024-02-21T22:52:49.789709+0000","last_active":"2024-02-21T22:52:52.234473+0000","last_peered":"2024-02-21T22:52:52.234473+0000","last_clean":"2024-02-21T22:52:52.234473+0000","last_became_active":"2024-02-21T22:52:49.789393+0000","last_became_peered":"2024-02-21T22:52:49.789393+0000","last_unstale":"2024-02-21T22:52:52.234473+0000","last_undegraded":"2024-02-21T22:52:52.234473+0000","last_fullsized":"2024-02-21T22:52:52.234473+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:04:03.761477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:51.792319+0000","last_change":"2024-02-21T22:52:50.789201+0000","last_active":"2024-02-21T22:52:51.792319+0000","last_peered":"2024-02-21T22:52:51.792319+0000","last_clean":"2024-02-21T22:52:51.792319+0000","last_became_active":"2024-02-21T22:52:50.787792+0000","last_became_peered":"2024-02-21T22:52:50.787792+0000","last_unstale":"2024-02-21T22:52:51.792319+0000","last_undegraded":"2024-02-21T22:52:51.792319+0000","last_fullsized":"2024-02-21T22:52:51.792319+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:49:26.881791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:51.795081+0000","last_change":"2024-02-21T22:52:49.791132+0000","last_active":"2024-02-21T22:52:51.795081+0000","last_peered":"2024-02-21T22:52:51.795081+0000","last_clean":"2024-02-21T22:52:51.795081+0000","last_became_active":"2024-02-21T22:52:49.790747+0000","last_became_peered":"2024-02-21T22:52:49.790747+0000","last_unstale":"2024-02-21T22:52:51.795081+0000","last_undegraded":"2024-02-21T22:52:51.795081+0000","last_fullsized":"2024-02-21T22:52:51.795081+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:57:47.487172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234358+0000","last_change":"2024-02-21T22:52:50.808244+0000","last_active":"2024-02-21T22:52:52.234358+0000","last_peered":"2024-02-21T22:52:52.234358+0000","last_clean":"2024-02-21T22:52:52.234358+0000","last_became_active":"2024-02-21T22:52:50.807811+0000","last_became_peered":"2024-02-21T22:52:50.807811+0000","last_unstale":"2024-02-21T22:52:52.234358+0000","last_undegraded":"2024-02-21T22:52:52.234358+0000","last_fullsized":"2024-02-21T22:52:52.234358+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:32:36.066162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234444+0000","last_change":"2024-02-21T22:52:49.792899+0000","last_active":"2024-02-21T22:52:52.234444+0000","last_peered":"2024-02-21T22:52:52.234444+0000","last_clean":"2024-02-21T22:52:52.234444+0000","last_became_active":"2024-02-21T22:52:49.792617+0000","last_became_peered":"2024-02-21T22:52:49.792617+0000","last_unstale":"2024-02-21T22:52:52.234444+0000","last_undegraded":"2024-02-21T22:52:52.234444+0000","last_fullsized":"2024-02-21T22:52:52.234444+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:06:28.817953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234067+0000","last_change":"2024-02-21T22:52:50.803201+0000","last_active":"2024-02-21T22:52:52.234067+0000","last_peered":"2024-02-21T22:52:52.234067+0000","last_clean":"2024-02-21T22:52:52.234067+0000","last_became_active":"2024-02-21T22:52:50.801870+0000","last_became_peered":"2024-02-21T22:52:50.801870+0000","last_unstale":"2024-02-21T22:52:52.234067+0000","last_undegraded":"2024-02-21T22:52:52.234067+0000","last_fullsized":"2024-02-21T22:52:52.234067+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:17:34.365402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:51.792522+0000","last_change":"2024-02-21T22:52:49.793191+0000","last_active":"2024-02-21T22:52:51.792522+0000","last_peered":"2024-02-21T22:52:51.792522+0000","last_clean":"2024-02-21T22:52:51.792522+0000","last_became_active":"2024-02-21T22:52:49.791992+0000","last_became_peered":"2024-02-21T22:52:49.791992+0000","last_unstale":"2024-02-21T22:52:51.792522+0000","last_undegraded":"2024-02-21T22:52:51.792522+0000","last_fullsized":"2024-02-21T22:52:51.792522+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:04:03.761477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:51.795759+0000","last_change":"2024-02-21T22:52:50.796850+0000","last_active":"2024-02-21T22:52:51.795759+0000","last_peered":"2024-02-21T22:52:51.795759+0000","last_clean":"2024-02-21T22:52:51.795759+0000","last_became_active":"2024-02-21T22:52:50.796589+0000","last_became_peered":"2024-02-21T22:52:50.796589+0000","last_unstale":"2024-02-21T22:52:51.795759+0000","last_undegraded":"2024-02-21T22:52:51.795759+0000","last_fullsized":"2024-02-21T22:52:51.795759+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:06:29.825061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:51.795352+0000","last_change":"2024-02-21T22:52:49.785392+0000","last_active":"2024-02-21T22:52:51.795352+0000","last_peered":"2024-02-21T22:52:51.795352+0000","last_clean":"2024-02-21T22:52:51.795352+0000","last_became_active":"2024-02-21T22:52:49.784936+0000","last_became_peered":"2024-02-21T22:52:49.784936+0000","last_unstale":"2024-02-21T22:52:51.795352+0000","last_undegraded":"2024-02-21T22:52:51.795352+0000","last_fullsized":"2024-02-21T22:52:51.795352+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:01:23.165721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234195+0000","last_change":"2024-02-21T22:52:50.793898+0000","last_active":"2024-02-21T22:52:52.234195+0000","last_peered":"2024-02-21T22:52:52.234195+0000","last_clean":"2024-02-21T22:52:52.234195+0000","last_became_active":"2024-02-21T22:52:50.793620+0000","last_became_peered":"2024-02-21T22:52:50.793620+0000","last_unstale":"2024-02-21T22:52:52.234195+0000","last_undegraded":"2024-02-21T22:52:52.234195+0000","last_fullsized":"2024-02-21T22:52:52.234195+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:13:03.777546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234350+0000","last_change":"2024-02-21T22:52:49.794586+0000","last_active":"2024-02-21T22:52:52.234350+0000","last_peered":"2024-02-21T22:52:52.234350+0000","last_clean":"2024-02-21T22:52:52.234350+0000","last_became_active":"2024-02-21T22:52:49.794288+0000","last_became_peered":"2024-02-21T22:52:49.794288+0000","last_unstale":"2024-02-21T22:52:52.234350+0000","last_undegraded":"2024-02-21T22:52:52.234350+0000","last_fullsized":"2024-02-21T22:52:52.234350+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:37:35.716112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.233964+0000","last_change":"2024-02-21T22:52:50.793467+0000","last_active":"2024-02-21T22:52:52.233964+0000","last_peered":"2024-02-21T22:52:52.233964+0000","last_clean":"2024-02-21T22:52:52.233964+0000","last_became_active":"2024-02-21T22:52:50.793160+0000","last_became_peered":"2024-02-21T22:52:50.793160+0000","last_unstale":"2024-02-21T22:52:52.233964+0000","last_undegraded":"2024-02-21T22:52:52.233964+0000","last_fullsized":"2024-02-21T22:52:52.233964+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T10:36:17.566817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234478+0000","last_change":"2024-02-21T22:52:49.793628+0000","last_active":"2024-02-21T22:52:52.234478+0000","last_peered":"2024-02-21T22:52:52.234478+0000","last_clean":"2024-02-21T22:52:52.234478+0000","last_became_active":"2024-02-21T22:52:49.793291+0000","last_became_peered":"2024-02-21T22:52:49.793291+0000","last_unstale":"2024-02-21T22:52:52.234478+0000","last_undegraded":"2024-02-21T22:52:52.234478+0000","last_fullsized":"2024-02-21T22:52:52.234478+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:29:57.623490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234378+0000","last_change":"2024-02-21T22:52:50.809208+0000","last_active":"2024-02-21T22:52:52.234378+0000","last_peered":"2024-02-21T22:52:52.234378+0000","last_clean":"2024-02-21T22:52:52.234378+0000","last_became_active":"2024-02-21T22:52:50.808950+0000","last_became_peered":"2024-02-21T22:52:50.808950+0000","last_unstale":"2024-02-21T22:52:52.234378+0000","last_undegraded":"2024-02-21T22:52:52.234378+0000","last_fullsized":"2024-02-21T22:52:52.234378+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:51:16.039745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:51.794655+0000","last_change":"2024-02-21T22:52:49.788987+0000","last_active":"2024-02-21T22:52:51.794655+0000","last_peered":"2024-02-21T22:52:51.794655+0000","last_clean":"2024-02-21T22:52:51.794655+0000","last_became_active":"2024-02-21T22:52:49.788704+0000","last_became_peered":"2024-02-21T22:52:49.788704+0000","last_unstale":"2024-02-21T22:52:51.794655+0000","last_undegraded":"2024-02-21T22:52:51.794655+0000","last_fullsized":"2024-02-21T22:52:51.794655+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T10:42:14.273761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:51.795107+0000","last_change":"2024-02-21T22:52:50.789680+0000","last_active":"2024-02-21T22:52:51.795107+0000","last_peered":"2024-02-21T22:52:51.795107+0000","last_clean":"2024-02-21T22:52:51.795107+0000","last_became_active":"2024-02-21T22:52:50.788648+0000","last_became_peered":"2024-02-21T22:52:50.788648+0000","last_unstale":"2024-02-21T22:52:51.795107+0000","last_undegraded":"2024-02-21T22:52:51.795107+0000","last_fullsized":"2024-02-21T22:52:51.795107+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:25:58.111654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.233423+0000","last_change":"2024-02-21T22:52:49.783735+0000","last_active":"2024-02-21T22:52:52.233423+0000","last_peered":"2024-02-21T22:52:52.233423+0000","last_clean":"2024-02-21T22:52:52.233423+0000","last_became_active":"2024-02-21T22:52:49.783350+0000","last_became_peered":"2024-02-21T22:52:49.783350+0000","last_unstale":"2024-02-21T22:52:52.233423+0000","last_undegraded":"2024-02-21T22:52:52.233423+0000","last_fullsized":"2024-02-21T22:52:52.233423+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:57:47.487172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.233816+0000","last_change":"2024-02-21T22:52:50.808882+0000","last_active":"2024-02-21T22:52:52.233816+0000","last_peered":"2024-02-21T22:52:52.233816+0000","last_clean":"2024-02-21T22:52:52.233816+0000","last_became_active":"2024-02-21T22:52:50.808584+0000","last_became_peered":"2024-02-21T22:52:50.808584+0000","last_unstale":"2024-02-21T22:52:52.233816+0000","last_undegraded":"2024-02-21T22:52:52.233816+0000","last_fullsized":"2024-02-21T22:52:52.233816+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:36:16.855646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:51.795199+0000","last_change":"2024-02-21T22:52:49.792856+0000","last_active":"2024-02-21T22:52:51.795199+0000","last_peered":"2024-02-21T22:52:51.795199+0000","last_clean":"2024-02-21T22:52:51.795199+0000","last_became_active":"2024-02-21T22:52:49.792509+0000","last_became_peered":"2024-02-21T22:52:49.792509+0000","last_unstale":"2024-02-21T22:52:51.795199+0000","last_undegraded":"2024-02-21T22:52:51.795199+0000","last_fullsized":"2024-02-21T22:52:51.795199+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:12:21.047751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234103+0000","last_change":"2024-02-21T22:52:50.808696+0000","last_active":"2024-02-21T22:52:52.234103+0000","last_peered":"2024-02-21T22:52:52.234103+0000","last_clean":"2024-02-21T22:52:52.234103+0000","last_became_active":"2024-02-21T22:52:50.808416+0000","last_became_peered":"2024-02-21T22:52:50.808416+0000","last_unstale":"2024-02-21T22:52:52.234103+0000","last_undegraded":"2024-02-21T22:52:52.234103+0000","last_fullsized":"2024-02-21T22:52:52.234103+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:02:22.212238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.233760+0000","last_change":"2024-02-21T22:52:49.789756+0000","last_active":"2024-02-21T22:52:52.233760+0000","last_peered":"2024-02-21T22:52:52.233760+0000","last_clean":"2024-02-21T22:52:52.233760+0000","last_became_active":"2024-02-21T22:52:49.789447+0000","last_became_peered":"2024-02-21T22:52:49.789447+0000","last_unstale":"2024-02-21T22:52:52.233760+0000","last_undegraded":"2024-02-21T22:52:52.233760+0000","last_fullsized":"2024-02-21T22:52:52.233760+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:01:23.165721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234491+0000","last_change":"2024-02-21T22:52:50.809468+0000","last_active":"2024-02-21T22:52:52.234491+0000","last_peered":"2024-02-21T22:52:52.234491+0000","last_clean":"2024-02-21T22:52:52.234491+0000","last_became_active":"2024-02-21T22:52:50.809053+0000","last_became_peered":"2024-02-21T22:52:50.809053+0000","last_unstale":"2024-02-21T22:52:52.234491+0000","last_undegraded":"2024-02-21T22:52:52.234491+0000","last_fullsized":"2024-02-21T22:52:52.234491+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:22:02.404664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:51.792607+0000","last_change":"2024-02-21T22:52:49.791174+0000","last_active":"2024-02-21T22:52:51.792607+0000","last_peered":"2024-02-21T22:52:51.792607+0000","last_clean":"2024-02-21T22:52:51.792607+0000","last_became_active":"2024-02-21T22:52:49.790885+0000","last_became_peered":"2024-02-21T22:52:49.790885+0000","last_unstale":"2024-02-21T22:52:51.792607+0000","last_undegraded":"2024-02-21T22:52:51.792607+0000","last_fullsized":"2024-02-21T22:52:51.792607+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:06:28.817953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234062+0000","last_change":"2024-02-21T22:52:50.802420+0000","last_active":"2024-02-21T22:52:52.234062+0000","last_peered":"2024-02-21T22:52:52.234062+0000","last_clean":"2024-02-21T22:52:52.234062+0000","last_became_active":"2024-02-21T22:52:50.801980+0000","last_became_peered":"2024-02-21T22:52:50.801980+0000","last_unstale":"2024-02-21T22:52:52.234062+0000","last_undegraded":"2024-02-21T22:52:52.234062+0000","last_fullsized":"2024-02-21T22:52:52.234062+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:02:22.212238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.233717+0000","last_change":"2024-02-21T22:52:49.787772+0000","last_active":"2024-02-21T22:52:52.233717+0000","last_peered":"2024-02-21T22:52:52.233717+0000","last_clean":"2024-02-21T22:52:52.233717+0000","last_became_active":"2024-02-21T22:52:49.787483+0000","last_became_peered":"2024-02-21T22:52:49.787483+0000","last_unstale":"2024-02-21T22:52:52.233717+0000","last_undegraded":"2024-02-21T22:52:52.233717+0000","last_fullsized":"2024-02-21T22:52:52.233717+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:04:03.761477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234346+0000","last_change":"2024-02-21T22:52:50.801710+0000","last_active":"2024-02-21T22:52:52.234346+0000","last_peered":"2024-02-21T22:52:52.234346+0000","last_clean":"2024-02-21T22:52:52.234346+0000","last_became_active":"2024-02-21T22:52:50.801446+0000","last_became_peered":"2024-02-21T22:52:50.801446+0000","last_unstale":"2024-02-21T22:52:52.234346+0000","last_undegraded":"2024-02-21T22:52:52.234346+0000","last_fullsized":"2024-02-21T22:52:52.234346+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:39:55.210527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":170,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.233578+0000","last_change":"2024-02-21T22:52:40.336187+0000","last_active":"2024-02-21T22:52:52.233578+0000","last_peered":"2024-02-21T22:52:52.233578+0000","last_clean":"2024-02-21T22:52:52.233578+0000","last_became_active":"2024-02-21T22:52:40.335061+0000","last_became_peered":"2024-02-21T22:52:40.335061+0000","last_unstale":"2024-02-21T22:52:52.233578+0000","last_undegraded":"2024-02-21T22:52:52.233578+0000","last_fullsized":"2024-02-21T22:52:52.233578+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:38.328863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:38.328863+0000","last_clean_scrub_stamp":"2024-02-21T22:52:38.328863+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:33:53.012414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.233685+0000","last_change":"2024-02-21T22:52:49.787124+0000","last_active":"2024-02-21T22:52:52.233685+0000","last_peered":"2024-02-21T22:52:52.233685+0000","last_clean":"2024-02-21T22:52:52.233685+0000","last_became_active":"2024-02-21T22:52:49.786800+0000","last_became_peered":"2024-02-21T22:52:49.786800+0000","last_unstale":"2024-02-21T22:52:52.233685+0000","last_undegraded":"2024-02-21T22:52:52.233685+0000","last_fullsized":"2024-02-21T22:52:52.233685+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:01:23.165721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.233943+0000","last_change":"2024-02-21T22:52:50.800508+0000","last_active":"2024-02-21T22:52:52.233943+0000","last_peered":"2024-02-21T22:52:52.233943+0000","last_clean":"2024-02-21T22:52:52.233943+0000","last_became_active":"2024-02-21T22:52:50.800215+0000","last_became_peered":"2024-02-21T22:52:50.800215+0000","last_unstale":"2024-02-21T22:52:52.233943+0000","last_undegraded":"2024-02-21T22:52:52.233943+0000","last_fullsized":"2024-02-21T22:52:52.233943+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:25:58.111654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.233509+0000","last_change":"2024-02-21T22:52:49.788881+0000","last_active":"2024-02-21T22:52:52.233509+0000","last_peered":"2024-02-21T22:52:52.233509+0000","last_clean":"2024-02-21T22:52:52.233509+0000","last_became_active":"2024-02-21T22:52:49.788611+0000","last_became_peered":"2024-02-21T22:52:49.788611+0000","last_unstale":"2024-02-21T22:52:52.233509+0000","last_undegraded":"2024-02-21T22:52:52.233509+0000","last_fullsized":"2024-02-21T22:52:52.233509+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T10:42:14.273761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.233594+0000","last_change":"2024-02-21T22:52:50.801343+0000","last_active":"2024-02-21T22:52:52.233594+0000","last_peered":"2024-02-21T22:52:52.233594+0000","last_clean":"2024-02-21T22:52:52.233594+0000","last_became_active":"2024-02-21T22:52:50.801029+0000","last_became_peered":"2024-02-21T22:52:50.801029+0000","last_unstale":"2024-02-21T22:52:52.233594+0000","last_undegraded":"2024-02-21T22:52:52.233594+0000","last_fullsized":"2024-02-21T22:52:52.233594+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:00:31.831396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.233662+0000","last_change":"2024-02-21T22:52:49.790068+0000","last_active":"2024-02-21T22:52:52.233662+0000","last_peered":"2024-02-21T22:52:52.233662+0000","last_clean":"2024-02-21T22:52:52.233662+0000","last_became_active":"2024-02-21T22:52:49.789766+0000","last_became_peered":"2024-02-21T22:52:49.789766+0000","last_unstale":"2024-02-21T22:52:52.233662+0000","last_undegraded":"2024-02-21T22:52:52.233662+0000","last_fullsized":"2024-02-21T22:52:52.233662+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T10:42:14.273761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:51.792345+0000","last_change":"2024-02-21T22:52:50.787018+0000","last_active":"2024-02-21T22:52:51.792345+0000","last_peered":"2024-02-21T22:52:51.792345+0000","last_clean":"2024-02-21T22:52:51.792345+0000","last_became_active":"2024-02-21T22:52:50.786695+0000","last_became_peered":"2024-02-21T22:52:50.786695+0000","last_unstale":"2024-02-21T22:52:51.792345+0000","last_undegraded":"2024-02-21T22:52:51.792345+0000","last_fullsized":"2024-02-21T22:52:51.792345+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T10:36:17.566817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234569+0000","last_change":"2024-02-21T22:52:49.789752+0000","last_active":"2024-02-21T22:52:52.234569+0000","last_peered":"2024-02-21T22:52:52.234569+0000","last_clean":"2024-02-21T22:52:52.234569+0000","last_became_active":"2024-02-21T22:52:49.789375+0000","last_became_peered":"2024-02-21T22:52:49.789375+0000","last_unstale":"2024-02-21T22:52:52.234569+0000","last_undegraded":"2024-02-21T22:52:52.234569+0000","last_fullsized":"2024-02-21T22:52:52.234569+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T10:42:14.273761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:51.795446+0000","last_change":"2024-02-21T22:52:50.791657+0000","last_active":"2024-02-21T22:52:51.795446+0000","last_peered":"2024-02-21T22:52:51.795446+0000","last_clean":"2024-02-21T22:52:51.795446+0000","last_became_active":"2024-02-21T22:52:50.791419+0000","last_became_peered":"2024-02-21T22:52:50.791419+0000","last_unstale":"2024-02-21T22:52:51.795446+0000","last_undegraded":"2024-02-21T22:52:51.795446+0000","last_fullsized":"2024-02-21T22:52:51.795446+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T10:42:15.280869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:51.792606+0000","last_change":"2024-02-21T22:52:49.793130+0000","last_active":"2024-02-21T22:52:51.792606+0000","last_peered":"2024-02-21T22:52:51.792606+0000","last_clean":"2024-02-21T22:52:51.792606+0000","last_became_active":"2024-02-21T22:52:49.792824+0000","last_became_peered":"2024-02-21T22:52:49.792824+0000","last_unstale":"2024-02-21T22:52:51.792606+0000","last_undegraded":"2024-02-21T22:52:51.792606+0000","last_fullsized":"2024-02-21T22:52:51.792606+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:01:23.165721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234113+0000","last_change":"2024-02-21T22:52:50.806582+0000","last_active":"2024-02-21T22:52:52.234113+0000","last_peered":"2024-02-21T22:52:52.234113+0000","last_clean":"2024-02-21T22:52:52.234113+0000","last_became_active":"2024-02-21T22:52:50.806257+0000","last_became_peered":"2024-02-21T22:52:50.806257+0000","last_unstale":"2024-02-21T22:52:52.234113+0000","last_undegraded":"2024-02-21T22:52:52.234113+0000","last_fullsized":"2024-02-21T22:52:52.234113+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:13:03.777546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234594+0000","last_change":"2024-02-21T22:52:49.793178+0000","last_active":"2024-02-21T22:52:52.234594+0000","last_peered":"2024-02-21T22:52:52.234594+0000","last_clean":"2024-02-21T22:52:52.234594+0000","last_became_active":"2024-02-21T22:52:49.792301+0000","last_became_peered":"2024-02-21T22:52:49.792301+0000","last_unstale":"2024-02-21T22:52:52.234594+0000","last_undegraded":"2024-02-21T22:52:52.234594+0000","last_fullsized":"2024-02-21T22:52:52.234594+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:53:50.332475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:51.792632+0000","last_change":"2024-02-21T22:52:50.785491+0000","last_active":"2024-02-21T22:52:51.792632+0000","last_peered":"2024-02-21T22:52:51.792632+0000","last_clean":"2024-02-21T22:52:51.792632+0000","last_became_active":"2024-02-21T22:52:50.785220+0000","last_became_peered":"2024-02-21T22:52:50.785220+0000","last_unstale":"2024-02-21T22:52:51.792632+0000","last_undegraded":"2024-02-21T22:52:51.792632+0000","last_fullsized":"2024-02-21T22:52:51.792632+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:33:40.513967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:51.796299+0000","last_change":"2024-02-21T22:52:49.787159+0000","last_active":"2024-02-21T22:52:51.796299+0000","last_peered":"2024-02-21T22:52:51.796299+0000","last_clean":"2024-02-21T22:52:51.796299+0000","last_became_active":"2024-02-21T22:52:49.786876+0000","last_became_peered":"2024-02-21T22:52:49.786876+0000","last_unstale":"2024-02-21T22:52:51.796299+0000","last_undegraded":"2024-02-21T22:52:51.796299+0000","last_fullsized":"2024-02-21T22:52:51.796299+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:20:00.484633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234594+0000","last_change":"2024-02-21T22:52:50.794174+0000","last_active":"2024-02-21T22:52:52.234594+0000","last_peered":"2024-02-21T22:52:52.234594+0000","last_clean":"2024-02-21T22:52:52.234594+0000","last_became_active":"2024-02-21T22:52:50.793881+0000","last_became_peered":"2024-02-21T22:52:50.793881+0000","last_unstale":"2024-02-21T22:52:52.234594+0000","last_undegraded":"2024-02-21T22:52:52.234594+0000","last_fullsized":"2024-02-21T22:52:52.234594+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:02:22.212238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:51.795185+0000","last_change":"2024-02-21T22:52:49.790424+0000","last_active":"2024-02-21T22:52:51.795185+0000","last_peered":"2024-02-21T22:52:51.795185+0000","last_clean":"2024-02-21T22:52:51.795185+0000","last_became_active":"2024-02-21T22:52:49.790147+0000","last_became_peered":"2024-02-21T22:52:49.790147+0000","last_unstale":"2024-02-21T22:52:51.795185+0000","last_undegraded":"2024-02-21T22:52:51.795185+0000","last_fullsized":"2024-02-21T22:52:51.795185+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:23:17.385208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.233852+0000","last_change":"2024-02-21T22:52:50.790678+0000","last_active":"2024-02-21T22:52:52.233852+0000","last_peered":"2024-02-21T22:52:52.233852+0000","last_clean":"2024-02-21T22:52:52.233852+0000","last_became_active":"2024-02-21T22:52:50.790415+0000","last_became_peered":"2024-02-21T22:52:50.790415+0000","last_unstale":"2024-02-21T22:52:52.233852+0000","last_undegraded":"2024-02-21T22:52:52.233852+0000","last_fullsized":"2024-02-21T22:52:52.233852+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:58:42.676518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.233605+0000","last_change":"2024-02-21T22:52:49.794656+0000","last_active":"2024-02-21T22:52:52.233605+0000","last_peered":"2024-02-21T22:52:52.233605+0000","last_clean":"2024-02-21T22:52:52.233605+0000","last_became_active":"2024-02-21T22:52:49.794394+0000","last_became_peered":"2024-02-21T22:52:49.794394+0000","last_unstale":"2024-02-21T22:52:52.233605+0000","last_undegraded":"2024-02-21T22:52:52.233605+0000","last_fullsized":"2024-02-21T22:52:52.233605+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:29:57.623490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:51.795821+0000","last_change":"2024-02-21T22:52:50.792184+0000","last_active":"2024-02-21T22:52:51.795821+0000","last_peered":"2024-02-21T22:52:51.795821+0000","last_clean":"2024-02-21T22:52:51.795821+0000","last_became_active":"2024-02-21T22:52:50.791180+0000","last_became_peered":"2024-02-21T22:52:50.791180+0000","last_unstale":"2024-02-21T22:52:51.795821+0000","last_undegraded":"2024-02-21T22:52:51.795821+0000","last_fullsized":"2024-02-21T22:52:51.795821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:20:01.491741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:51.792408+0000","last_change":"2024-02-21T22:52:49.791409+0000","last_active":"2024-02-21T22:52:51.792408+0000","last_peered":"2024-02-21T22:52:51.792408+0000","last_clean":"2024-02-21T22:52:51.792408+0000","last_became_active":"2024-02-21T22:52:49.791124+0000","last_became_peered":"2024-02-21T22:52:49.791124+0000","last_unstale":"2024-02-21T22:52:51.792408+0000","last_undegraded":"2024-02-21T22:52:51.792408+0000","last_fullsized":"2024-02-21T22:52:51.792408+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T10:42:14.273761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.233884+0000","last_change":"2024-02-21T22:52:50.790359+0000","last_active":"2024-02-21T22:52:52.233884+0000","last_peered":"2024-02-21T22:52:52.233884+0000","last_clean":"2024-02-21T22:52:52.233884+0000","last_became_active":"2024-02-21T22:52:50.790083+0000","last_became_peered":"2024-02-21T22:52:50.790083+0000","last_unstale":"2024-02-21T22:52:52.233884+0000","last_undegraded":"2024-02-21T22:52:52.233884+0000","last_fullsized":"2024-02-21T22:52:52.233884+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:17:34.365402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:51.792512+0000","last_change":"2024-02-21T22:52:49.786337+0000","last_active":"2024-02-21T22:52:51.792512+0000","last_peered":"2024-02-21T22:52:51.792512+0000","last_clean":"2024-02-21T22:52:51.792512+0000","last_became_active":"2024-02-21T22:52:49.786058+0000","last_became_peered":"2024-02-21T22:52:49.786058+0000","last_unstale":"2024-02-21T22:52:51.792512+0000","last_undegraded":"2024-02-21T22:52:51.792512+0000","last_fullsized":"2024-02-21T22:52:51.792512+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:29:57.623490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234482+0000","last_change":"2024-02-21T22:52:50.792676+0000","last_active":"2024-02-21T22:52:52.234482+0000","last_peered":"2024-02-21T22:52:52.234482+0000","last_clean":"2024-02-21T22:52:52.234482+0000","last_became_active":"2024-02-21T22:52:50.792330+0000","last_became_peered":"2024-02-21T22:52:50.792330+0000","last_unstale":"2024-02-21T22:52:52.234482+0000","last_undegraded":"2024-02-21T22:52:52.234482+0000","last_fullsized":"2024-02-21T22:52:52.234482+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T02:49:51.875007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234484+0000","last_change":"2024-02-21T22:52:49.791921+0000","last_active":"2024-02-21T22:52:52.234484+0000","last_peered":"2024-02-21T22:52:52.234484+0000","last_clean":"2024-02-21T22:52:52.234484+0000","last_became_active":"2024-02-21T22:52:49.791614+0000","last_became_peered":"2024-02-21T22:52:49.791614+0000","last_unstale":"2024-02-21T22:52:52.234484+0000","last_undegraded":"2024-02-21T22:52:52.234484+0000","last_fullsized":"2024-02-21T22:52:52.234484+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:06:28.817953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:51.794942+0000","last_change":"2024-02-21T22:52:50.794820+0000","last_active":"2024-02-21T22:52:51.794942+0000","last_peered":"2024-02-21T22:52:51.794942+0000","last_clean":"2024-02-21T22:52:51.794942+0000","last_became_active":"2024-02-21T22:52:50.794504+0000","last_became_peered":"2024-02-21T22:52:50.794504+0000","last_unstale":"2024-02-21T22:52:51.794942+0000","last_undegraded":"2024-02-21T22:52:51.794942+0000","last_fullsized":"2024-02-21T22:52:51.794942+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:17:34.365402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.233975+0000","last_change":"2024-02-21T22:52:50.806225+0000","last_active":"2024-02-21T22:52:52.233975+0000","last_peered":"2024-02-21T22:52:52.233975+0000","last_clean":"2024-02-21T22:52:52.233975+0000","last_became_active":"2024-02-21T22:52:50.805867+0000","last_became_peered":"2024-02-21T22:52:50.805867+0000","last_unstale":"2024-02-21T22:52:52.233975+0000","last_undegraded":"2024-02-21T22:52:52.233975+0000","last_fullsized":"2024-02-21T22:52:52.233975+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:25:14.399237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234362+0000","last_change":"2024-02-21T22:52:49.791427+0000","last_active":"2024-02-21T22:52:52.234362+0000","last_peered":"2024-02-21T22:52:52.234362+0000","last_clean":"2024-02-21T22:52:52.234362+0000","last_became_active":"2024-02-21T22:52:49.790879+0000","last_became_peered":"2024-02-21T22:52:49.790879+0000","last_unstale":"2024-02-21T22:52:52.234362+0000","last_undegraded":"2024-02-21T22:52:52.234362+0000","last_fullsized":"2024-02-21T22:52:52.234362+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:20:00.484633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234211+0000","last_change":"2024-02-21T22:52:50.804074+0000","last_active":"2024-02-21T22:52:52.234211+0000","last_peered":"2024-02-21T22:52:52.234211+0000","last_clean":"2024-02-21T22:52:52.234211+0000","last_became_active":"2024-02-21T22:52:50.803759+0000","last_became_peered":"2024-02-21T22:52:50.803759+0000","last_unstale":"2024-02-21T22:52:52.234211+0000","last_undegraded":"2024-02-21T22:52:52.234211+0000","last_fullsized":"2024-02-21T22:52:52.234211+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:06:29.082788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234445+0000","last_change":"2024-02-21T22:52:49.790281+0000","last_active":"2024-02-21T22:52:52.234445+0000","last_peered":"2024-02-21T22:52:52.234445+0000","last_clean":"2024-02-21T22:52:52.234445+0000","last_became_active":"2024-02-21T22:52:49.790023+0000","last_became_peered":"2024-02-21T22:52:49.790023+0000","last_unstale":"2024-02-21T22:52:52.234445+0000","last_undegraded":"2024-02-21T22:52:52.234445+0000","last_fullsized":"2024-02-21T22:52:52.234445+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:31:50.557983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.233936+0000","last_change":"2024-02-21T22:52:50.801839+0000","last_active":"2024-02-21T22:52:52.233936+0000","last_peered":"2024-02-21T22:52:52.233936+0000","last_clean":"2024-02-21T22:52:52.233936+0000","last_became_active":"2024-02-21T22:52:50.801499+0000","last_became_peered":"2024-02-21T22:52:50.801499+0000","last_unstale":"2024-02-21T22:52:52.233936+0000","last_undegraded":"2024-02-21T22:52:52.233936+0000","last_fullsized":"2024-02-21T22:52:52.233936+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:49:26.881791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234190+0000","last_change":"2024-02-21T22:52:49.792448+0000","last_active":"2024-02-21T22:52:52.234190+0000","last_peered":"2024-02-21T22:52:52.234190+0000","last_clean":"2024-02-21T22:52:52.234190+0000","last_became_active":"2024-02-21T22:52:49.792116+0000","last_became_peered":"2024-02-21T22:52:49.792116+0000","last_unstale":"2024-02-21T22:52:52.234190+0000","last_undegraded":"2024-02-21T22:52:52.234190+0000","last_fullsized":"2024-02-21T22:52:52.234190+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:34:55.953292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234013+0000","last_change":"2024-02-21T22:52:50.791072+0000","last_active":"2024-02-21T22:52:52.234013+0000","last_peered":"2024-02-21T22:52:52.234013+0000","last_clean":"2024-02-21T22:52:52.234013+0000","last_became_active":"2024-02-21T22:52:50.790784+0000","last_became_peered":"2024-02-21T22:52:50.790784+0000","last_unstale":"2024-02-21T22:52:52.234013+0000","last_undegraded":"2024-02-21T22:52:52.234013+0000","last_fullsized":"2024-02-21T22:52:52.234013+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:33:40.513967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234149+0000","last_change":"2024-02-21T22:52:49.792852+0000","last_active":"2024-02-21T22:52:52.234149+0000","last_peered":"2024-02-21T22:52:52.234149+0000","last_clean":"2024-02-21T22:52:52.234149+0000","last_became_active":"2024-02-21T22:52:49.792580+0000","last_became_peered":"2024-02-21T22:52:49.792580+0000","last_unstale":"2024-02-21T22:52:52.234149+0000","last_undegraded":"2024-02-21T22:52:52.234149+0000","last_fullsized":"2024-02-21T22:52:52.234149+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:34:55.953292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":802816,"data_stored":661884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":208896,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":71060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":70934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":212992,"data_stored":71094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":811008,"data_stored":661940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-21T22:52:54.423 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-02-21T22:52:54.558 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.567+0000 7f01aa088640 1 Processor -- start 2024-02-21T22:52:54.558 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.567+0000 7f01aa088640 1 -- start start 2024-02-21T22:52:54.559 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.568+0000 7f01aa088640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f01a406c1d0 0x7f01a406c960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:54.560 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.568+0000 7f01aa088640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f01a406cea0 0x7f01a415d840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:54.560 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.568+0000 7f01aa088640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01a40709a0 con 0x7f01a40705c0 2024-02-21T22:52:54.560 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.568+0000 7f01aa088640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01a40d0c50 con 0x7f01a406c1d0 2024-02-21T22:52:54.560 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.568+0000 7f01aa088640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01a406fbb0 con 0x7f01a406cea0 2024-02-21T22:52:54.560 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.568+0000 7f01a37fe640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f01a40705c0 0x7f01a40cefa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.116:49282/0 (socket says 172.21.15.116:49282) 2024-02-21T22:52:54.560 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.568+0000 7f01a2ffd640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f01a406c1d0 0x7f01a406c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:54.560 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.568+0000 7f01a37fe640 1 -- 172.21.15.116:0/1422810494 learned_addr learned my addr 172.21.15.116:0/1422810494 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-02-21T22:52:54.560 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.568+0000 7f01a3fff640 1 --2- 172.21.15.116:0/1422810494 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f01a406cea0 0x7f01a415d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:54.560 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.568+0000 7f01a3fff640 1 -- 172.21.15.116:0/1422810494 >> v2:172.21.15.142:3300/0 conn(0x7f01a406c1d0 msgr2=0x7f01a406c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:52:54.560 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.568+0000 7f01a3fff640 1 --2- 172.21.15.116:0/1422810494 >> v2:172.21.15.142:3300/0 conn(0x7f01a406c1d0 0x7f01a406c960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:54.560 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.568+0000 7f01a3fff640 1 -- 172.21.15.116:0/1422810494 >> v1:172.21.15.142:6789/0 conn(0x7f01a40705c0 legacy=0x7f01a40cefa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:54.560 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.568+0000 7f01a3fff640 1 -- 172.21.15.116:0/1422810494 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01a40d0040 con 0x7f01a406cea0 2024-02-21T22:52:54.560 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.568+0000 7f01a2ffd640 1 --2- 172.21.15.116:0/1422810494 >> v2:172.21.15.142:3300/0 conn(0x7f01a406c1d0 0x7f01a406c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T22:52:54.560 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.569+0000 7f01a3fff640 1 --2- 172.21.15.116:0/1422810494 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f01a406cea0 0x7f01a415d840 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f019c009d90 tx=0x7f019c02bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ec119782bda15781 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:52:54.561 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.569+0000 7f01a27fc640 1 -- 172.21.15.116:0/1422810494 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f019c039070 con 0x7f01a406cea0 2024-02-21T22:52:54.561 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.569+0000 7f01a27fc640 1 -- 172.21.15.116:0/1422810494 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f019c02cc50 con 0x7f01a406cea0 2024-02-21T22:52:54.561 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.569+0000 7f01a27fc640 1 -- 172.21.15.116:0/1422810494 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f019c034440 con 0x7f01a406cea0 2024-02-21T22:52:54.563 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.570+0000 7f01aa088640 1 -- 172.21.15.116:0/1422810494 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f01a406cea0 msgr2=0x7f01a415d840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:54.563 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.570+0000 7f01aa088640 1 --2- 172.21.15.116:0/1422810494 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f01a406cea0 0x7f01a415d840 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f019c009d90 tx=0x7f019c02bea0 comp rx=0 tx=0).stop 2024-02-21T22:52:54.564 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.570+0000 7f01aa088640 1 -- 172.21.15.116:0/1422810494 shutdown_connections 2024-02-21T22:52:54.564 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.570+0000 7f01aa088640 1 --2- 172.21.15.116:0/1422810494 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f01a406cea0 0x7f01a415d840 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:54.564 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.570+0000 7f01aa088640 1 --2- 172.21.15.116:0/1422810494 >> v2:172.21.15.142:3300/0 conn(0x7f01a406c1d0 0x7f01a406c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:54.564 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.570+0000 7f01aa088640 1 -- 172.21.15.116:0/1422810494 >> 172.21.15.116:0/1422810494 conn(0x7f01a40d1bd0 msgr2=0x7f01a40d1fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:52:54.564 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.570+0000 7f01aa088640 1 -- 172.21.15.116:0/1422810494 shutdown_connections 2024-02-21T22:52:54.564 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.570+0000 7f01aa088640 1 -- 172.21.15.116:0/1422810494 wait complete. 2024-02-21T22:52:54.564 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.571+0000 7f01aa088640 1 Processor -- start 2024-02-21T22:52:54.564 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.571+0000 7f01aa088640 1 -- start start 2024-02-21T22:52:54.564 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.572+0000 7f01aa088640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f01a406c1d0 0x7f01a40c95c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:54.564 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.572+0000 7f01aa088640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f01a406cea0 0x7f01a40b3c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:54.564 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.572+0000 7f01aa088640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f01a40705c0 0x7f01a40b4140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:54.564 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.572+0000 7f01aa088640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01a40d08e0 con 0x7f01a406cea0 2024-02-21T22:52:54.564 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.572+0000 7f01aa088640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01a40d0600 con 0x7f01a40705c0 2024-02-21T22:52:54.564 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.572+0000 7f01aa088640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01a40d10e0 con 0x7f01a406c1d0 2024-02-21T22:52:54.565 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.572+0000 7f01a2ffd640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f01a406cea0 0x7f01a40b3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:54.565 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.572+0000 7f01a2ffd640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f01a406cea0 0x7f01a40b3c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:51050/0 (socket says 172.21.15.116:51050) 2024-02-21T22:52:54.565 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.572+0000 7f01a2ffd640 1 -- 172.21.15.116:0/2497244060 learned_addr learned my addr 172.21.15.116:0/2497244060 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:52:54.565 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.572+0000 7f01a37fe640 1 --2- 172.21.15.116:0/2497244060 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f01a406c1d0 0x7f01a40c95c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:54.565 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.572+0000 7f01a3fff640 1 --2- 172.21.15.116:0/2497244060 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f01a40705c0 0x7f01a40b4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:54.565 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.572+0000 7f01a2ffd640 1 -- 172.21.15.116:0/2497244060 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f01a406c1d0 msgr2=0x7f01a40c95c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:54.565 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.572+0000 7f01a2ffd640 1 --2- 172.21.15.116:0/2497244060 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f01a406c1d0 0x7f01a40c95c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:54.565 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.572+0000 7f01a2ffd640 1 -- 172.21.15.116:0/2497244060 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f01a40705c0 msgr2=0x7f01a40b4140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:54.565 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.572+0000 7f01a2ffd640 1 --2- 172.21.15.116:0/2497244060 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f01a40705c0 0x7f01a40b4140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:54.565 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.572+0000 7f01a2ffd640 1 -- 172.21.15.116:0/2497244060 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01a40b4aa0 con 0x7f01a406cea0 2024-02-21T22:52:54.565 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.572+0000 7f01a2ffd640 1 --2- 172.21.15.116:0/2497244060 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f01a406cea0 0x7f01a40b3c00 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f019800ebe0 tx=0x7f019800c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:52:54.565 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.572+0000 7f018bfff640 1 -- 172.21.15.116:0/2497244060 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0198017070 con 0x7f01a406cea0 2024-02-21T22:52:54.565 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.572+0000 7f018bfff640 1 -- 172.21.15.116:0/2497244060 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f019800cc30 con 0x7f01a406cea0 2024-02-21T22:52:54.565 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.572+0000 7f018bfff640 1 -- 172.21.15.116:0/2497244060 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0198013470 con 0x7f01a406cea0 2024-02-21T22:52:54.565 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.572+0000 7f01aa088640 1 -- 172.21.15.116:0/2497244060 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01a40b4d80 con 0x7f01a406cea0 2024-02-21T22:52:54.566 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.572+0000 7f01aa088640 1 -- 172.21.15.116:0/2497244060 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01a40c9ba0 con 0x7f01a406cea0 2024-02-21T22:52:54.566 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.573+0000 7f01aa088640 1 -- 172.21.15.116:0/2497244060 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01a40752f0 con 0x7f01a406cea0 2024-02-21T22:52:54.566 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.574+0000 7f018bfff640 1 -- 172.21.15.116:0/2497244060 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f019801a070 con 0x7f01a406cea0 2024-02-21T22:52:54.567 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.574+0000 7f018bfff640 1 --2- 172.21.15.116:0/2497244060 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f019006b500 0x7f019006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:54.567 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.574+0000 7f018bfff640 1 -- 172.21.15.116:0/2497244060 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f019808a0f0 con 0x7f01a406cea0 2024-02-21T22:52:54.567 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.574+0000 7f01a37fe640 1 --2- 172.21.15.116:0/2497244060 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f019006b500 0x7f019006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:54.567 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.575+0000 7f01a37fe640 1 --2- 172.21.15.116:0/2497244060 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f019006b500 0x7f019006d9c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f0194007fd0 tx=0x7f0194007e80 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:52:54.569 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.578+0000 7f018bfff640 1 -- 172.21.15.116:0/2497244060 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f0198058920 con 0x7f01a406cea0 2024-02-21T22:52:54.808 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.817+0000 7f01aa088640 1 -- 172.21.15.116:0/2497244060 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f01a40b7790 con 0x7f01a406cea0 2024-02-21T22:52:54.808 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.817+0000 7f018bfff640 1 -- 172.21.15.116:0/2497244060 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1011 (secure 0 0 0) 0x7f019805c9c0 con 0x7f01a406cea0 2024-02-21T22:52:54.808 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-02-21T22:52:54.808 INFO:teuthology.orchestra.run.smithi116.stdout:{"fsid":"7c298660-5f63-4b5c-a800-58c5be9a8445","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":28,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":20,"num_osds":8,"num_up_osds":8,"osd_up_since":1708555957,"num_in_osds":8,"osd_in_since":1708555948,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":24,"data_bytes":592778,"bytes_used":224272384,"bytes_avail":772869840896,"bytes_total":773094113280,"write_bytes_sec":2596,"read_op_per_sec":0,"write_op_per_sec":8},"fsmap":{"epoch":6,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"d","status":"up:active","gid":4290}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2024-02-21T22:52:25.996269+0000","services":{}},"progress_events":{}} 2024-02-21T22:52:54.810 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.819+0000 7f01aa088640 1 -- 172.21.15.116:0/2497244060 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f019006b500 msgr2=0x7f019006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:54.810 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.819+0000 7f01aa088640 1 --2- 172.21.15.116:0/2497244060 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f019006b500 0x7f019006d9c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f0194007fd0 tx=0x7f0194007e80 comp rx=0 tx=0).stop 2024-02-21T22:52:54.810 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.819+0000 7f01aa088640 1 -- 172.21.15.116:0/2497244060 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f01a406cea0 msgr2=0x7f01a40b3c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:54.810 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.819+0000 7f01aa088640 1 --2- 172.21.15.116:0/2497244060 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f01a406cea0 0x7f01a40b3c00 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f019800ebe0 tx=0x7f019800c520 comp rx=0 tx=0).stop 2024-02-21T22:52:54.810 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.819+0000 7f01aa088640 1 -- 172.21.15.116:0/2497244060 shutdown_connections 2024-02-21T22:52:54.810 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.819+0000 7f01aa088640 1 --2- 172.21.15.116:0/2497244060 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f01a40705c0 0x7f01a40b4140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:54.810 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.819+0000 7f01aa088640 1 --2- 172.21.15.116:0/2497244060 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f01a406cea0 0x7f01a40b3c00 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:54.810 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.819+0000 7f01aa088640 1 --2- 172.21.15.116:0/2497244060 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f019006b500 0x7f019006d9c0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:54.811 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.819+0000 7f01aa088640 1 --2- 172.21.15.116:0/2497244060 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f01a406c1d0 0x7f01a40c95c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:54.811 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.819+0000 7f01aa088640 1 -- 172.21.15.116:0/2497244060 >> 172.21.15.116:0/2497244060 conn(0x7f01a40d1bd0 msgr2=0x7f01a40cbee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:52:54.811 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.819+0000 7f01aa088640 1 -- 172.21.15.116:0/2497244060 shutdown_connections 2024-02-21T22:52:54.811 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.819+0000 7f01aa088640 1 -- 172.21.15.116:0/2497244060 wait complete. 2024-02-21T22:52:54.820 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-02-21T22:52:54.821 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-21T22:52:54.921 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.930+0000 7f9066768640 1 Processor -- start 2024-02-21T22:52:54.921 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.930+0000 7f9066768640 1 -- start start 2024-02-21T22:52:54.923 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.931+0000 7f9066768640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f906006d1c0 0x7f906015df60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:54.923 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.931+0000 7f9066768640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f90601626a0 0x7f906015e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:54.923 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.931+0000 7f9066768640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f906006df90 con 0x7f90601622c0 2024-02-21T22:52:54.923 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.931+0000 7f9066768640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f906006d6f0 con 0x7f906006d1c0 2024-02-21T22:52:54.923 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.931+0000 7f9066768640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f906006d9d0 con 0x7f90601626a0 2024-02-21T22:52:54.923 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.931+0000 7f905f7fe640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f906006d1c0 0x7f906015df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:54.923 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.931+0000 7f905ffff640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f90601622c0 0x7f90600b2f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:56882/0 (socket says 172.21.15.116:56882) 2024-02-21T22:52:54.923 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.931+0000 7f905ffff640 1 -- 172.21.15.116:0/1468645292 learned_addr learned my addr 172.21.15.116:0/1468645292 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-02-21T22:52:54.923 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.931+0000 7f9064d05640 1 --2- 172.21.15.116:0/1468645292 >> v2:172.21.15.142:3300/0 conn(0x7f90601626a0 0x7f906015e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:54.923 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.931+0000 7f905f7fe640 1 -- 172.21.15.116:0/1468645292 >> v2:172.21.15.142:3300/0 conn(0x7f90601626a0 msgr2=0x7f906015e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:52:54.923 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.931+0000 7f905f7fe640 1 --2- 172.21.15.116:0/1468645292 >> v2:172.21.15.142:3300/0 conn(0x7f90601626a0 0x7f906015e4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:54.923 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.931+0000 7f905f7fe640 1 -- 172.21.15.116:0/1468645292 >> v1:172.21.15.116:6789/0 conn(0x7f90601622c0 legacy=0x7f90600b2f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:54.924 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.931+0000 7f905f7fe640 1 -- 172.21.15.116:0/1468645292 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f906006dcb0 con 0x7f906006d1c0 2024-02-21T22:52:54.924 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.931+0000 7f905effd640 1 -- 172.21.15.116:0/1468645292 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3131048272 0 0) 0x7f906006df90 con 0x7f90601622c0 2024-02-21T22:52:54.924 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.932+0000 7f905f7fe640 1 --2- 172.21.15.116:0/1468645292 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f906006d1c0 0x7f906015df60 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f9060162b30 tx=0x7f905402b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7df59bcf17bc01ee server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:52:54.924 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.932+0000 7f905effd640 1 -- 172.21.15.116:0/1468645292 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9054034070 con 0x7f906006d1c0 2024-02-21T22:52:54.924 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.932+0000 7f905effd640 1 -- 172.21.15.116:0/1468645292 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9054030610 con 0x7f906006d1c0 2024-02-21T22:52:54.924 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.932+0000 7f905effd640 1 -- 172.21.15.116:0/1468645292 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90540309e0 con 0x7f906006d1c0 2024-02-21T22:52:54.927 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.933+0000 7f9066768640 1 -- 172.21.15.116:0/1468645292 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f906006d1c0 msgr2=0x7f906015df60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:54.927 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.933+0000 7f9066768640 1 --2- 172.21.15.116:0/1468645292 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f906006d1c0 0x7f906015df60 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f9060162b30 tx=0x7f905402b960 comp rx=0 tx=0).stop 2024-02-21T22:52:54.927 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.933+0000 7f9066768640 1 -- 172.21.15.116:0/1468645292 shutdown_connections 2024-02-21T22:52:54.927 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.933+0000 7f9066768640 1 --2- 172.21.15.116:0/1468645292 >> v2:172.21.15.142:3300/0 conn(0x7f90601626a0 0x7f906015e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:54.927 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.933+0000 7f9066768640 1 --2- 172.21.15.116:0/1468645292 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f906006d1c0 0x7f906015df60 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:54.927 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.933+0000 7f9066768640 1 -- 172.21.15.116:0/1468645292 >> 172.21.15.116:0/1468645292 conn(0x7f90600d1be0 msgr2=0x7f90600d1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:52:54.927 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.933+0000 7f9066768640 1 -- 172.21.15.116:0/1468645292 shutdown_connections 2024-02-21T22:52:54.927 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.933+0000 7f9066768640 1 -- 172.21.15.116:0/1468645292 wait complete. 2024-02-21T22:52:54.928 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.934+0000 7f9066768640 1 Processor -- start 2024-02-21T22:52:54.928 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.934+0000 7f9066768640 1 -- start start 2024-02-21T22:52:54.928 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.935+0000 7f9066768640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f906006d1c0 0x7f90601f3d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:54.928 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.935+0000 7f9066768640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f90601622c0 0x7f90600c69e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:54.928 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.935+0000 7f9066768640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f90601626a0 0x7f90600c6f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:54.928 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.935+0000 7f9066768640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90600b51e0 con 0x7f90601622c0 2024-02-21T22:52:54.928 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.935+0000 7f9066768640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90600b5060 con 0x7f90601626a0 2024-02-21T22:52:54.928 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.935+0000 7f9066768640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90600b5360 con 0x7f906006d1c0 2024-02-21T22:52:54.928 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.935+0000 7f905f7fe640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f90601622c0 0x7f90600c69e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:54.928 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.935+0000 7f905f7fe640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f90601622c0 0x7f90600c69e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:51064/0 (socket says 172.21.15.116:51064) 2024-02-21T22:52:54.928 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.935+0000 7f905f7fe640 1 -- 172.21.15.116:0/2735576449 learned_addr learned my addr 172.21.15.116:0/2735576449 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:52:54.928 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.935+0000 7f9064d05640 1 --2- 172.21.15.116:0/2735576449 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f90601626a0 0x7f90600c6f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:54.928 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.935+0000 7f905ffff640 1 --2- 172.21.15.116:0/2735576449 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f906006d1c0 0x7f90601f3d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:54.928 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.935+0000 7f905f7fe640 1 -- 172.21.15.116:0/2735576449 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f906006d1c0 msgr2=0x7f90601f3d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:54.929 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.935+0000 7f905f7fe640 1 --2- 172.21.15.116:0/2735576449 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f906006d1c0 0x7f90601f3d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:54.929 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.935+0000 7f905f7fe640 1 -- 172.21.15.116:0/2735576449 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f90601626a0 msgr2=0x7f90600c6f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:54.929 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.935+0000 7f905f7fe640 1 --2- 172.21.15.116:0/2735576449 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f90601626a0 0x7f90600c6f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:54.929 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.935+0000 7f905f7fe640 1 -- 172.21.15.116:0/2735576449 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90600c7550 con 0x7f90601622c0 2024-02-21T22:52:54.929 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.935+0000 7f905f7fe640 1 --2- 172.21.15.116:0/2735576449 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f90601622c0 0x7f90600c69e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f9054000c00 tx=0x7f90540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:52:54.929 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.935+0000 7f905cff9640 1 -- 172.21.15.116:0/2735576449 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9054034040 con 0x7f90601622c0 2024-02-21T22:52:54.929 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.935+0000 7f905cff9640 1 -- 172.21.15.116:0/2735576449 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9054030410 con 0x7f90601622c0 2024-02-21T22:52:54.929 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.935+0000 7f9066768640 1 -- 172.21.15.116:0/2735576449 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90600c7830 con 0x7f90601622c0 2024-02-21T22:52:54.929 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.935+0000 7f905cff9640 1 -- 172.21.15.116:0/2735576449 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9054039c50 con 0x7f90601622c0 2024-02-21T22:52:54.929 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.936+0000 7f9066768640 1 -- 172.21.15.116:0/2735576449 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90600c7df0 con 0x7f90601622c0 2024-02-21T22:52:54.929 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.936+0000 7f9066768640 1 -- 172.21.15.116:0/2735576449 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90600752f0 con 0x7f90601622c0 2024-02-21T22:52:54.929 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.937+0000 7f905cff9640 1 -- 172.21.15.116:0/2735576449 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f9054037070 con 0x7f90601622c0 2024-02-21T22:52:54.930 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.937+0000 7f905cff9640 1 --2- 172.21.15.116:0/2735576449 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f904c06b4d0 0x7f904c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:54.930 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.937+0000 7f905cff9640 1 -- 172.21.15.116:0/2735576449 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f90540ac0c0 con 0x7f90601622c0 2024-02-21T22:52:54.931 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.937+0000 7f905ffff640 1 --2- 172.21.15.116:0/2735576449 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f904c06b4d0 0x7f904c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:54.931 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.938+0000 7f905ffff640 1 --2- 172.21.15.116:0/2735576449 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f904c06b4d0 0x7f904c06d990 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9050000f60 tx=0x7f9050007d50 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:52:54.932 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:54.942+0000 7f905cff9640 1 -- 172.21.15.116:0/2735576449 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f905407a8f0 con 0x7f90601622c0 2024-02-21T22:52:55.100 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:55.110+0000 7f9066768640 1 -- 172.21.15.116:0/2735576449 --> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f90600d0ee0 con 0x7f904c06b4d0 2024-02-21T22:52:55.108 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:55.116+0000 7f905cff9640 1 -- 172.21.15.116:0/2735576449 <== mgr.4103 v2:172.21.15.142:6832/1381484782 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251946 (secure 0 0 0) 0x7f90600d0ee0 con 0x7f904c06b4d0 2024-02-21T22:52:55.111 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-02-21T22:52:55.112 INFO:teuthology.orchestra.run.smithi116.stderr:dumped all 2024-02-21T22:52:55.114 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:55.119+0000 7f9066768640 1 -- 172.21.15.116:0/2735576449 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f904c06b4d0 msgr2=0x7f904c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:55.114 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:55.119+0000 7f9066768640 1 --2- 172.21.15.116:0/2735576449 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f904c06b4d0 0x7f904c06d990 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9050000f60 tx=0x7f9050007d50 comp rx=0 tx=0).stop 2024-02-21T22:52:55.114 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:55.119+0000 7f9066768640 1 -- 172.21.15.116:0/2735576449 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f90601622c0 msgr2=0x7f90600c69e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:55.114 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:55.119+0000 7f9066768640 1 --2- 172.21.15.116:0/2735576449 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f90601622c0 0x7f90600c69e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f9054000c00 tx=0x7f90540046c0 comp rx=0 tx=0).stop 2024-02-21T22:52:55.114 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:55.119+0000 7f9066768640 1 -- 172.21.15.116:0/2735576449 shutdown_connections 2024-02-21T22:52:55.114 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:55.119+0000 7f9066768640 1 --2- 172.21.15.116:0/2735576449 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f90601626a0 0x7f90600c6f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:55.114 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:55.119+0000 7f9066768640 1 --2- 172.21.15.116:0/2735576449 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f90601622c0 0x7f90600c69e0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:55.114 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:55.119+0000 7f9066768640 1 --2- 172.21.15.116:0/2735576449 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f904c06b4d0 0x7f904c06d990 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:55.114 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:55.119+0000 7f9066768640 1 --2- 172.21.15.116:0/2735576449 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f906006d1c0 0x7f90601f3d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:55.114 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:55.119+0000 7f9066768640 1 -- 172.21.15.116:0/2735576449 >> 172.21.15.116:0/2735576449 conn(0x7f90600d1be0 msgr2=0x7f906015bef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:52:55.114 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:55.119+0000 7f9066768640 1 -- 172.21.15.116:0/2735576449 shutdown_connections 2024-02-21T22:52:55.114 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:55.119+0000 7f9066768640 1 -- 172.21.15.116:0/2735576449 wait complete. 2024-02-21T22:52:55.120 INFO:teuthology.orchestra.run.smithi116.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-02-21T22:52:54.288256+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":125,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219016,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755704,"statfs":{"total":773094113280,"available":772869840896,"internally_reserved":0,"allocated":2891776,"data_stored":1753028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.521499"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234219+0000","last_change":"2024-02-21T22:52:50.804119+0000","last_active":"2024-02-21T22:52:52.234219+0000","last_peered":"2024-02-21T22:52:52.234219+0000","last_clean":"2024-02-21T22:52:52.234219+0000","last_became_active":"2024-02-21T22:52:50.801464+0000","last_became_peered":"2024-02-21T22:52:50.801464+0000","last_unstale":"2024-02-21T22:52:52.234219+0000","last_undegraded":"2024-02-21T22:52:52.234219+0000","last_fullsized":"2024-02-21T22:52:52.234219+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:06:29.082788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:51.792663+0000","last_change":"2024-02-21T22:52:50.787683+0000","last_active":"2024-02-21T22:52:51.792663+0000","last_peered":"2024-02-21T22:52:51.792663+0000","last_clean":"2024-02-21T22:52:51.792663+0000","last_became_active":"2024-02-21T22:52:50.787384+0000","last_became_peered":"2024-02-21T22:52:50.787384+0000","last_unstale":"2024-02-21T22:52:51.792663+0000","last_undegraded":"2024-02-21T22:52:51.792663+0000","last_fullsized":"2024-02-21T22:52:51.792663+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:10:56.108581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.233732+0000","last_change":"2024-02-21T22:52:50.786452+0000","last_active":"2024-02-21T22:52:52.233732+0000","last_peered":"2024-02-21T22:52:52.233732+0000","last_clean":"2024-02-21T22:52:52.233732+0000","last_became_active":"2024-02-21T22:52:50.786191+0000","last_became_peered":"2024-02-21T22:52:50.786191+0000","last_unstale":"2024-02-21T22:52:52.233732+0000","last_undegraded":"2024-02-21T22:52:52.233732+0000","last_fullsized":"2024-02-21T22:52:52.233732+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:43:33.767331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.233922+0000","last_change":"2024-02-21T22:52:50.805367+0000","last_active":"2024-02-21T22:52:52.233922+0000","last_peered":"2024-02-21T22:52:52.233922+0000","last_clean":"2024-02-21T22:52:52.233922+0000","last_became_active":"2024-02-21T22:52:50.805067+0000","last_became_peered":"2024-02-21T22:52:50.805067+0000","last_unstale":"2024-02-21T22:52:52.233922+0000","last_undegraded":"2024-02-21T22:52:52.233922+0000","last_fullsized":"2024-02-21T22:52:52.233922+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T02:49:51.875007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234052+0000","last_change":"2024-02-21T22:52:50.793726+0000","last_active":"2024-02-21T22:52:52.234052+0000","last_peered":"2024-02-21T22:52:52.234052+0000","last_clean":"2024-02-21T22:52:52.234052+0000","last_became_active":"2024-02-21T22:52:50.793461+0000","last_became_peered":"2024-02-21T22:52:50.793461+0000","last_unstale":"2024-02-21T22:52:52.234052+0000","last_undegraded":"2024-02-21T22:52:52.234052+0000","last_fullsized":"2024-02-21T22:52:52.234052+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:25:14.399237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.233784+0000","last_change":"2024-02-21T22:52:50.797872+0000","last_active":"2024-02-21T22:52:52.233784+0000","last_peered":"2024-02-21T22:52:52.233784+0000","last_clean":"2024-02-21T22:52:52.233784+0000","last_became_active":"2024-02-21T22:52:50.797547+0000","last_became_peered":"2024-02-21T22:52:50.797547+0000","last_unstale":"2024-02-21T22:52:52.233784+0000","last_undegraded":"2024-02-21T22:52:52.233784+0000","last_fullsized":"2024-02-21T22:52:52.233784+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:38:41.981414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.233678+0000","last_change":"2024-02-21T22:52:50.792977+0000","last_active":"2024-02-21T22:52:52.233678+0000","last_peered":"2024-02-21T22:52:52.233678+0000","last_clean":"2024-02-21T22:52:52.233678+0000","last_became_active":"2024-02-21T22:52:50.792731+0000","last_became_peered":"2024-02-21T22:52:50.792731+0000","last_unstale":"2024-02-21T22:52:52.233678+0000","last_undegraded":"2024-02-21T22:52:52.233678+0000","last_fullsized":"2024-02-21T22:52:52.233678+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T02:49:51.875007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.233592+0000","last_change":"2024-02-21T22:52:50.800588+0000","last_active":"2024-02-21T22:52:52.233592+0000","last_peered":"2024-02-21T22:52:52.233592+0000","last_clean":"2024-02-21T22:52:52.233592+0000","last_became_active":"2024-02-21T22:52:50.800266+0000","last_became_peered":"2024-02-21T22:52:50.800266+0000","last_unstale":"2024-02-21T22:52:52.233592+0000","last_undegraded":"2024-02-21T22:52:52.233592+0000","last_fullsized":"2024-02-21T22:52:52.233592+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:49:26.881791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234360+0000","last_change":"2024-02-21T22:52:50.802133+0000","last_active":"2024-02-21T22:52:52.234360+0000","last_peered":"2024-02-21T22:52:52.234360+0000","last_clean":"2024-02-21T22:52:52.234360+0000","last_became_active":"2024-02-21T22:52:50.801109+0000","last_became_peered":"2024-02-21T22:52:50.801109+0000","last_unstale":"2024-02-21T22:52:52.234360+0000","last_undegraded":"2024-02-21T22:52:52.234360+0000","last_fullsized":"2024-02-21T22:52:52.234360+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:32:36.066162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:51.795991+0000","last_change":"2024-02-21T22:52:50.799972+0000","last_active":"2024-02-21T22:52:51.795991+0000","last_peered":"2024-02-21T22:52:51.795991+0000","last_clean":"2024-02-21T22:52:51.795991+0000","last_became_active":"2024-02-21T22:52:50.799713+0000","last_became_peered":"2024-02-21T22:52:50.799713+0000","last_unstale":"2024-02-21T22:52:51.795991+0000","last_undegraded":"2024-02-21T22:52:51.795991+0000","last_fullsized":"2024-02-21T22:52:51.795991+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:10:56.108581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:51.794860+0000","last_change":"2024-02-21T22:52:50.800180+0000","last_active":"2024-02-21T22:52:51.794860+0000","last_peered":"2024-02-21T22:52:51.794860+0000","last_clean":"2024-02-21T22:52:51.794860+0000","last_became_active":"2024-02-21T22:52:50.799506+0000","last_became_peered":"2024-02-21T22:52:50.799506+0000","last_unstale":"2024-02-21T22:52:51.794860+0000","last_undegraded":"2024-02-21T22:52:51.794860+0000","last_fullsized":"2024-02-21T22:52:51.794860+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:49:26.881791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:51.795709+0000","last_change":"2024-02-21T22:52:50.785668+0000","last_active":"2024-02-21T22:52:51.795709+0000","last_peered":"2024-02-21T22:52:51.795709+0000","last_clean":"2024-02-21T22:52:51.795709+0000","last_became_active":"2024-02-21T22:52:50.785381+0000","last_became_peered":"2024-02-21T22:52:50.785381+0000","last_unstale":"2024-02-21T22:52:51.795709+0000","last_undegraded":"2024-02-21T22:52:51.795709+0000","last_fullsized":"2024-02-21T22:52:51.795709+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:29:58.630598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234333+0000","last_change":"2024-02-21T22:52:50.789689+0000","last_active":"2024-02-21T22:52:52.234333+0000","last_peered":"2024-02-21T22:52:52.234333+0000","last_clean":"2024-02-21T22:52:52.234333+0000","last_became_active":"2024-02-21T22:52:50.789124+0000","last_became_peered":"2024-02-21T22:52:50.789124+0000","last_unstale":"2024-02-21T22:52:52.234333+0000","last_undegraded":"2024-02-21T22:52:52.234333+0000","last_fullsized":"2024-02-21T22:52:52.234333+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:10:56.108581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.233802+0000","last_change":"2024-02-21T22:52:50.787622+0000","last_active":"2024-02-21T22:52:52.233802+0000","last_peered":"2024-02-21T22:52:52.233802+0000","last_clean":"2024-02-21T22:52:52.233802+0000","last_became_active":"2024-02-21T22:52:50.787315+0000","last_became_peered":"2024-02-21T22:52:50.787315+0000","last_unstale":"2024-02-21T22:52:52.233802+0000","last_undegraded":"2024-02-21T22:52:52.233802+0000","last_fullsized":"2024-02-21T22:52:52.233802+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:07:39.283417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:51.792349+0000","last_change":"2024-02-21T22:52:50.785274+0000","last_active":"2024-02-21T22:52:51.792349+0000","last_peered":"2024-02-21T22:52:51.792349+0000","last_clean":"2024-02-21T22:52:51.792349+0000","last_became_active":"2024-02-21T22:52:50.784970+0000","last_became_peered":"2024-02-21T22:52:50.784970+0000","last_unstale":"2024-02-21T22:52:51.792349+0000","last_undegraded":"2024-02-21T22:52:51.792349+0000","last_fullsized":"2024-02-21T22:52:51.792349+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:17:34.365402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234235+0000","last_change":"2024-02-21T22:52:50.797804+0000","last_active":"2024-02-21T22:52:52.234235+0000","last_peered":"2024-02-21T22:52:52.234235+0000","last_clean":"2024-02-21T22:52:52.234235+0000","last_became_active":"2024-02-21T22:52:50.797414+0000","last_became_peered":"2024-02-21T22:52:50.797414+0000","last_unstale":"2024-02-21T22:52:52.234235+0000","last_undegraded":"2024-02-21T22:52:52.234235+0000","last_fullsized":"2024-02-21T22:52:52.234235+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:10:56.108581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234715+0000","last_change":"2024-02-21T22:52:50.808468+0000","last_active":"2024-02-21T22:52:52.234715+0000","last_peered":"2024-02-21T22:52:52.234715+0000","last_clean":"2024-02-21T22:52:52.234715+0000","last_became_active":"2024-02-21T22:52:50.808183+0000","last_became_peered":"2024-02-21T22:52:50.808183+0000","last_unstale":"2024-02-21T22:52:52.234715+0000","last_undegraded":"2024-02-21T22:52:52.234715+0000","last_fullsized":"2024-02-21T22:52:52.234715+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:22:02.404664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.233676+0000","last_change":"2024-02-21T22:52:50.789333+0000","last_active":"2024-02-21T22:52:52.233676+0000","last_peered":"2024-02-21T22:52:52.233676+0000","last_clean":"2024-02-21T22:52:52.233676+0000","last_became_active":"2024-02-21T22:52:50.789054+0000","last_became_peered":"2024-02-21T22:52:50.789054+0000","last_unstale":"2024-02-21T22:52:52.233676+0000","last_undegraded":"2024-02-21T22:52:52.233676+0000","last_fullsized":"2024-02-21T22:52:52.233676+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:31:51.565091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234606+0000","last_change":"2024-02-21T22:52:50.796065+0000","last_active":"2024-02-21T22:52:52.234606+0000","last_peered":"2024-02-21T22:52:52.234606+0000","last_clean":"2024-02-21T22:52:52.234606+0000","last_became_active":"2024-02-21T22:52:50.794895+0000","last_became_peered":"2024-02-21T22:52:50.794895+0000","last_unstale":"2024-02-21T22:52:52.234606+0000","last_undegraded":"2024-02-21T22:52:52.234606+0000","last_fullsized":"2024-02-21T22:52:52.234606+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:03:04.692215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:51.794890+0000","last_change":"2024-02-21T22:52:50.795221+0000","last_active":"2024-02-21T22:52:51.794890+0000","last_peered":"2024-02-21T22:52:51.794890+0000","last_clean":"2024-02-21T22:52:51.794890+0000","last_became_active":"2024-02-21T22:52:50.794693+0000","last_became_peered":"2024-02-21T22:52:50.794693+0000","last_unstale":"2024-02-21T22:52:51.794890+0000","last_undegraded":"2024-02-21T22:52:51.794890+0000","last_fullsized":"2024-02-21T22:52:51.794890+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T10:36:17.566817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234167+0000","last_change":"2024-02-21T22:52:50.793867+0000","last_active":"2024-02-21T22:52:52.234167+0000","last_peered":"2024-02-21T22:52:52.234167+0000","last_clean":"2024-02-21T22:52:52.234167+0000","last_became_active":"2024-02-21T22:52:50.793645+0000","last_became_peered":"2024-02-21T22:52:50.793645+0000","last_unstale":"2024-02-21T22:52:52.234167+0000","last_undegraded":"2024-02-21T22:52:52.234167+0000","last_fullsized":"2024-02-21T22:52:52.234167+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:25:58.111654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.233930+0000","last_change":"2024-02-21T22:52:50.807989+0000","last_active":"2024-02-21T22:52:52.233930+0000","last_peered":"2024-02-21T22:52:52.233930+0000","last_clean":"2024-02-21T22:52:52.233930+0000","last_became_active":"2024-02-21T22:52:50.807712+0000","last_became_peered":"2024-02-21T22:52:50.807712+0000","last_unstale":"2024-02-21T22:52:52.233930+0000","last_undegraded":"2024-02-21T22:52:52.233930+0000","last_fullsized":"2024-02-21T22:52:52.233930+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:36:16.855646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234410+0000","last_change":"2024-02-21T22:52:50.800936+0000","last_active":"2024-02-21T22:52:52.234410+0000","last_peered":"2024-02-21T22:52:52.234410+0000","last_clean":"2024-02-21T22:52:52.234410+0000","last_became_active":"2024-02-21T22:52:50.800431+0000","last_became_peered":"2024-02-21T22:52:50.800431+0000","last_unstale":"2024-02-21T22:52:52.234410+0000","last_undegraded":"2024-02-21T22:52:52.234410+0000","last_fullsized":"2024-02-21T22:52:52.234410+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:38:41.981414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234377+0000","last_change":"2024-02-21T22:52:50.805357+0000","last_active":"2024-02-21T22:52:52.234377+0000","last_peered":"2024-02-21T22:52:52.234377+0000","last_clean":"2024-02-21T22:52:52.234377+0000","last_became_active":"2024-02-21T22:52:50.805060+0000","last_became_peered":"2024-02-21T22:52:50.805060+0000","last_unstale":"2024-02-21T22:52:52.234377+0000","last_undegraded":"2024-02-21T22:52:52.234377+0000","last_fullsized":"2024-02-21T22:52:52.234377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:51:16.039745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234522+0000","last_change":"2024-02-21T22:52:50.797979+0000","last_active":"2024-02-21T22:52:52.234522+0000","last_peered":"2024-02-21T22:52:52.234522+0000","last_clean":"2024-02-21T22:52:52.234522+0000","last_became_active":"2024-02-21T22:52:50.797343+0000","last_became_peered":"2024-02-21T22:52:50.797343+0000","last_unstale":"2024-02-21T22:52:52.234522+0000","last_undegraded":"2024-02-21T22:52:52.234522+0000","last_fullsized":"2024-02-21T22:52:52.234522+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:25:14.399237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:51.795952+0000","last_change":"2024-02-21T22:52:50.797991+0000","last_active":"2024-02-21T22:52:51.795952+0000","last_peered":"2024-02-21T22:52:51.795952+0000","last_clean":"2024-02-21T22:52:51.795952+0000","last_became_active":"2024-02-21T22:52:50.797667+0000","last_became_peered":"2024-02-21T22:52:50.797667+0000","last_unstale":"2024-02-21T22:52:51.795952+0000","last_undegraded":"2024-02-21T22:52:51.795952+0000","last_fullsized":"2024-02-21T22:52:51.795952+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:33:40.513967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:51.792515+0000","last_change":"2024-02-21T22:52:50.788943+0000","last_active":"2024-02-21T22:52:51.792515+0000","last_peered":"2024-02-21T22:52:51.792515+0000","last_clean":"2024-02-21T22:52:51.792515+0000","last_became_active":"2024-02-21T22:52:50.788672+0000","last_became_peered":"2024-02-21T22:52:50.788672+0000","last_unstale":"2024-02-21T22:52:51.792515+0000","last_undegraded":"2024-02-21T22:52:51.792515+0000","last_fullsized":"2024-02-21T22:52:51.792515+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:25:58.111654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234510+0000","last_change":"2024-02-21T22:52:50.797663+0000","last_active":"2024-02-21T22:52:52.234510+0000","last_peered":"2024-02-21T22:52:52.234510+0000","last_clean":"2024-02-21T22:52:52.234510+0000","last_became_active":"2024-02-21T22:52:50.797359+0000","last_became_peered":"2024-02-21T22:52:50.797359+0000","last_unstale":"2024-02-21T22:52:52.234510+0000","last_undegraded":"2024-02-21T22:52:52.234510+0000","last_fullsized":"2024-02-21T22:52:52.234510+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:36:16.855646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234239+0000","last_change":"2024-02-21T22:52:50.788672+0000","last_active":"2024-02-21T22:52:52.234239+0000","last_peered":"2024-02-21T22:52:52.234239+0000","last_clean":"2024-02-21T22:52:52.234239+0000","last_became_active":"2024-02-21T22:52:50.788413+0000","last_became_peered":"2024-02-21T22:52:50.788413+0000","last_unstale":"2024-02-21T22:52:52.234239+0000","last_undegraded":"2024-02-21T22:52:52.234239+0000","last_fullsized":"2024-02-21T22:52:52.234239+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:33:40.513967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234286+0000","last_change":"2024-02-21T22:52:50.808763+0000","last_active":"2024-02-21T22:52:52.234286+0000","last_peered":"2024-02-21T22:52:52.234286+0000","last_clean":"2024-02-21T22:52:52.234286+0000","last_became_active":"2024-02-21T22:52:50.805917+0000","last_became_peered":"2024-02-21T22:52:50.805917+0000","last_unstale":"2024-02-21T22:52:52.234286+0000","last_undegraded":"2024-02-21T22:52:52.234286+0000","last_fullsized":"2024-02-21T22:52:52.234286+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:39:55.210527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.233575+0000","last_change":"2024-02-21T22:52:50.799649+0000","last_active":"2024-02-21T22:52:52.233575+0000","last_peered":"2024-02-21T22:52:52.233575+0000","last_clean":"2024-02-21T22:52:52.233575+0000","last_became_active":"2024-02-21T22:52:50.799372+0000","last_became_peered":"2024-02-21T22:52:50.799372+0000","last_unstale":"2024-02-21T22:52:52.233575+0000","last_undegraded":"2024-02-21T22:52:52.233575+0000","last_fullsized":"2024-02-21T22:52:52.233575+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:20:01.491741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:51.795278+0000","last_change":"2024-02-21T22:52:50.789389+0000","last_active":"2024-02-21T22:52:51.795278+0000","last_peered":"2024-02-21T22:52:51.795278+0000","last_clean":"2024-02-21T22:52:51.795278+0000","last_became_active":"2024-02-21T22:52:50.789121+0000","last_became_peered":"2024-02-21T22:52:50.789121+0000","last_unstale":"2024-02-21T22:52:51.795278+0000","last_undegraded":"2024-02-21T22:52:51.795278+0000","last_fullsized":"2024-02-21T22:52:51.795278+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:58:42.676518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:51.794985+0000","last_change":"2024-02-21T22:52:50.792014+0000","last_active":"2024-02-21T22:52:51.794985+0000","last_peered":"2024-02-21T22:52:51.794985+0000","last_clean":"2024-02-21T22:52:51.794985+0000","last_became_active":"2024-02-21T22:52:50.790916+0000","last_became_peered":"2024-02-21T22:52:50.790916+0000","last_unstale":"2024-02-21T22:52:51.794985+0000","last_undegraded":"2024-02-21T22:52:51.794985+0000","last_fullsized":"2024-02-21T22:52:51.794985+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:04:04.768586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234516+0000","last_change":"2024-02-21T22:52:49.786296+0000","last_active":"2024-02-21T22:52:52.234516+0000","last_peered":"2024-02-21T22:52:52.234516+0000","last_clean":"2024-02-21T22:52:52.234516+0000","last_became_active":"2024-02-21T22:52:49.785971+0000","last_became_peered":"2024-02-21T22:52:49.785971+0000","last_unstale":"2024-02-21T22:52:52.234516+0000","last_undegraded":"2024-02-21T22:52:52.234516+0000","last_fullsized":"2024-02-21T22:52:52.234516+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:23:17.385208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234297+0000","last_change":"2024-02-21T22:52:50.802188+0000","last_active":"2024-02-21T22:52:52.234297+0000","last_peered":"2024-02-21T22:52:52.234297+0000","last_clean":"2024-02-21T22:52:52.234297+0000","last_became_active":"2024-02-21T22:52:50.801916+0000","last_became_peered":"2024-02-21T22:52:50.801916+0000","last_unstale":"2024-02-21T22:52:52.234297+0000","last_undegraded":"2024-02-21T22:52:52.234297+0000","last_fullsized":"2024-02-21T22:52:52.234297+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:10:56.108581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:51.795043+0000","last_change":"2024-02-21T22:52:49.789667+0000","last_active":"2024-02-21T22:52:51.795043+0000","last_peered":"2024-02-21T22:52:51.795043+0000","last_clean":"2024-02-21T22:52:51.795043+0000","last_became_active":"2024-02-21T22:52:49.789375+0000","last_became_peered":"2024-02-21T22:52:49.789375+0000","last_unstale":"2024-02-21T22:52:51.795043+0000","last_undegraded":"2024-02-21T22:52:51.795043+0000","last_fullsized":"2024-02-21T22:52:51.795043+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:04:03.761477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234559+0000","last_change":"2024-02-21T22:52:49.785301+0000","last_active":"2024-02-21T22:52:52.234559+0000","last_peered":"2024-02-21T22:52:52.234559+0000","last_clean":"2024-02-21T22:52:52.234559+0000","last_became_active":"2024-02-21T22:52:49.784975+0000","last_became_peered":"2024-02-21T22:52:49.784975+0000","last_unstale":"2024-02-21T22:52:52.234559+0000","last_undegraded":"2024-02-21T22:52:52.234559+0000","last_fullsized":"2024-02-21T22:52:52.234559+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:57:47.487172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.233732+0000","last_change":"2024-02-21T22:52:50.792749+0000","last_active":"2024-02-21T22:52:52.233732+0000","last_peered":"2024-02-21T22:52:52.233732+0000","last_clean":"2024-02-21T22:52:52.233732+0000","last_became_active":"2024-02-21T22:52:50.792219+0000","last_became_peered":"2024-02-21T22:52:50.792219+0000","last_unstale":"2024-02-21T22:52:52.233732+0000","last_undegraded":"2024-02-21T22:52:52.233732+0000","last_fullsized":"2024-02-21T22:52:52.233732+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T10:36:17.566817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234473+0000","last_change":"2024-02-21T22:52:49.789709+0000","last_active":"2024-02-21T22:52:52.234473+0000","last_peered":"2024-02-21T22:52:52.234473+0000","last_clean":"2024-02-21T22:52:52.234473+0000","last_became_active":"2024-02-21T22:52:49.789393+0000","last_became_peered":"2024-02-21T22:52:49.789393+0000","last_unstale":"2024-02-21T22:52:52.234473+0000","last_undegraded":"2024-02-21T22:52:52.234473+0000","last_fullsized":"2024-02-21T22:52:52.234473+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:04:03.761477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:51.792319+0000","last_change":"2024-02-21T22:52:50.789201+0000","last_active":"2024-02-21T22:52:51.792319+0000","last_peered":"2024-02-21T22:52:51.792319+0000","last_clean":"2024-02-21T22:52:51.792319+0000","last_became_active":"2024-02-21T22:52:50.787792+0000","last_became_peered":"2024-02-21T22:52:50.787792+0000","last_unstale":"2024-02-21T22:52:51.792319+0000","last_undegraded":"2024-02-21T22:52:51.792319+0000","last_fullsized":"2024-02-21T22:52:51.792319+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:49:26.881791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:51.795081+0000","last_change":"2024-02-21T22:52:49.791132+0000","last_active":"2024-02-21T22:52:51.795081+0000","last_peered":"2024-02-21T22:52:51.795081+0000","last_clean":"2024-02-21T22:52:51.795081+0000","last_became_active":"2024-02-21T22:52:49.790747+0000","last_became_peered":"2024-02-21T22:52:49.790747+0000","last_unstale":"2024-02-21T22:52:51.795081+0000","last_undegraded":"2024-02-21T22:52:51.795081+0000","last_fullsized":"2024-02-21T22:52:51.795081+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:57:47.487172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234358+0000","last_change":"2024-02-21T22:52:50.808244+0000","last_active":"2024-02-21T22:52:52.234358+0000","last_peered":"2024-02-21T22:52:52.234358+0000","last_clean":"2024-02-21T22:52:52.234358+0000","last_became_active":"2024-02-21T22:52:50.807811+0000","last_became_peered":"2024-02-21T22:52:50.807811+0000","last_unstale":"2024-02-21T22:52:52.234358+0000","last_undegraded":"2024-02-21T22:52:52.234358+0000","last_fullsized":"2024-02-21T22:52:52.234358+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:32:36.066162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234444+0000","last_change":"2024-02-21T22:52:49.792899+0000","last_active":"2024-02-21T22:52:52.234444+0000","last_peered":"2024-02-21T22:52:52.234444+0000","last_clean":"2024-02-21T22:52:52.234444+0000","last_became_active":"2024-02-21T22:52:49.792617+0000","last_became_peered":"2024-02-21T22:52:49.792617+0000","last_unstale":"2024-02-21T22:52:52.234444+0000","last_undegraded":"2024-02-21T22:52:52.234444+0000","last_fullsized":"2024-02-21T22:52:52.234444+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:06:28.817953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234067+0000","last_change":"2024-02-21T22:52:50.803201+0000","last_active":"2024-02-21T22:52:52.234067+0000","last_peered":"2024-02-21T22:52:52.234067+0000","last_clean":"2024-02-21T22:52:52.234067+0000","last_became_active":"2024-02-21T22:52:50.801870+0000","last_became_peered":"2024-02-21T22:52:50.801870+0000","last_unstale":"2024-02-21T22:52:52.234067+0000","last_undegraded":"2024-02-21T22:52:52.234067+0000","last_fullsized":"2024-02-21T22:52:52.234067+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:17:34.365402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:51.792522+0000","last_change":"2024-02-21T22:52:49.793191+0000","last_active":"2024-02-21T22:52:51.792522+0000","last_peered":"2024-02-21T22:52:51.792522+0000","last_clean":"2024-02-21T22:52:51.792522+0000","last_became_active":"2024-02-21T22:52:49.791992+0000","last_became_peered":"2024-02-21T22:52:49.791992+0000","last_unstale":"2024-02-21T22:52:51.792522+0000","last_undegraded":"2024-02-21T22:52:51.792522+0000","last_fullsized":"2024-02-21T22:52:51.792522+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:04:03.761477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:51.795759+0000","last_change":"2024-02-21T22:52:50.796850+0000","last_active":"2024-02-21T22:52:51.795759+0000","last_peered":"2024-02-21T22:52:51.795759+0000","last_clean":"2024-02-21T22:52:51.795759+0000","last_became_active":"2024-02-21T22:52:50.796589+0000","last_became_peered":"2024-02-21T22:52:50.796589+0000","last_unstale":"2024-02-21T22:52:51.795759+0000","last_undegraded":"2024-02-21T22:52:51.795759+0000","last_fullsized":"2024-02-21T22:52:51.795759+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:06:29.825061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:51.795352+0000","last_change":"2024-02-21T22:52:49.785392+0000","last_active":"2024-02-21T22:52:51.795352+0000","last_peered":"2024-02-21T22:52:51.795352+0000","last_clean":"2024-02-21T22:52:51.795352+0000","last_became_active":"2024-02-21T22:52:49.784936+0000","last_became_peered":"2024-02-21T22:52:49.784936+0000","last_unstale":"2024-02-21T22:52:51.795352+0000","last_undegraded":"2024-02-21T22:52:51.795352+0000","last_fullsized":"2024-02-21T22:52:51.795352+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:01:23.165721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234195+0000","last_change":"2024-02-21T22:52:50.793898+0000","last_active":"2024-02-21T22:52:52.234195+0000","last_peered":"2024-02-21T22:52:52.234195+0000","last_clean":"2024-02-21T22:52:52.234195+0000","last_became_active":"2024-02-21T22:52:50.793620+0000","last_became_peered":"2024-02-21T22:52:50.793620+0000","last_unstale":"2024-02-21T22:52:52.234195+0000","last_undegraded":"2024-02-21T22:52:52.234195+0000","last_fullsized":"2024-02-21T22:52:52.234195+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:13:03.777546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234350+0000","last_change":"2024-02-21T22:52:49.794586+0000","last_active":"2024-02-21T22:52:52.234350+0000","last_peered":"2024-02-21T22:52:52.234350+0000","last_clean":"2024-02-21T22:52:52.234350+0000","last_became_active":"2024-02-21T22:52:49.794288+0000","last_became_peered":"2024-02-21T22:52:49.794288+0000","last_unstale":"2024-02-21T22:52:52.234350+0000","last_undegraded":"2024-02-21T22:52:52.234350+0000","last_fullsized":"2024-02-21T22:52:52.234350+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:37:35.716112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.233964+0000","last_change":"2024-02-21T22:52:50.793467+0000","last_active":"2024-02-21T22:52:52.233964+0000","last_peered":"2024-02-21T22:52:52.233964+0000","last_clean":"2024-02-21T22:52:52.233964+0000","last_became_active":"2024-02-21T22:52:50.793160+0000","last_became_peered":"2024-02-21T22:52:50.793160+0000","last_unstale":"2024-02-21T22:52:52.233964+0000","last_undegraded":"2024-02-21T22:52:52.233964+0000","last_fullsized":"2024-02-21T22:52:52.233964+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T10:36:17.566817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234478+0000","last_change":"2024-02-21T22:52:49.793628+0000","last_active":"2024-02-21T22:52:52.234478+0000","last_peered":"2024-02-21T22:52:52.234478+0000","last_clean":"2024-02-21T22:52:52.234478+0000","last_became_active":"2024-02-21T22:52:49.793291+0000","last_became_peered":"2024-02-21T22:52:49.793291+0000","last_unstale":"2024-02-21T22:52:52.234478+0000","last_undegraded":"2024-02-21T22:52:52.234478+0000","last_fullsized":"2024-02-21T22:52:52.234478+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:29:57.623490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234378+0000","last_change":"2024-02-21T22:52:50.809208+0000","last_active":"2024-02-21T22:52:52.234378+0000","last_peered":"2024-02-21T22:52:52.234378+0000","last_clean":"2024-02-21T22:52:52.234378+0000","last_became_active":"2024-02-21T22:52:50.808950+0000","last_became_peered":"2024-02-21T22:52:50.808950+0000","last_unstale":"2024-02-21T22:52:52.234378+0000","last_undegraded":"2024-02-21T22:52:52.234378+0000","last_fullsized":"2024-02-21T22:52:52.234378+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:51:16.039745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:51.794655+0000","last_change":"2024-02-21T22:52:49.788987+0000","last_active":"2024-02-21T22:52:51.794655+0000","last_peered":"2024-02-21T22:52:51.794655+0000","last_clean":"2024-02-21T22:52:51.794655+0000","last_became_active":"2024-02-21T22:52:49.788704+0000","last_became_peered":"2024-02-21T22:52:49.788704+0000","last_unstale":"2024-02-21T22:52:51.794655+0000","last_undegraded":"2024-02-21T22:52:51.794655+0000","last_fullsized":"2024-02-21T22:52:51.794655+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T10:42:14.273761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:51.795107+0000","last_change":"2024-02-21T22:52:50.789680+0000","last_active":"2024-02-21T22:52:51.795107+0000","last_peered":"2024-02-21T22:52:51.795107+0000","last_clean":"2024-02-21T22:52:51.795107+0000","last_became_active":"2024-02-21T22:52:50.788648+0000","last_became_peered":"2024-02-21T22:52:50.788648+0000","last_unstale":"2024-02-21T22:52:51.795107+0000","last_undegraded":"2024-02-21T22:52:51.795107+0000","last_fullsized":"2024-02-21T22:52:51.795107+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:25:58.111654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.233423+0000","last_change":"2024-02-21T22:52:49.783735+0000","last_active":"2024-02-21T22:52:52.233423+0000","last_peered":"2024-02-21T22:52:52.233423+0000","last_clean":"2024-02-21T22:52:52.233423+0000","last_became_active":"2024-02-21T22:52:49.783350+0000","last_became_peered":"2024-02-21T22:52:49.783350+0000","last_unstale":"2024-02-21T22:52:52.233423+0000","last_undegraded":"2024-02-21T22:52:52.233423+0000","last_fullsized":"2024-02-21T22:52:52.233423+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:57:47.487172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.233816+0000","last_change":"2024-02-21T22:52:50.808882+0000","last_active":"2024-02-21T22:52:52.233816+0000","last_peered":"2024-02-21T22:52:52.233816+0000","last_clean":"2024-02-21T22:52:52.233816+0000","last_became_active":"2024-02-21T22:52:50.808584+0000","last_became_peered":"2024-02-21T22:52:50.808584+0000","last_unstale":"2024-02-21T22:52:52.233816+0000","last_undegraded":"2024-02-21T22:52:52.233816+0000","last_fullsized":"2024-02-21T22:52:52.233816+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:36:16.855646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:51.795199+0000","last_change":"2024-02-21T22:52:49.792856+0000","last_active":"2024-02-21T22:52:51.795199+0000","last_peered":"2024-02-21T22:52:51.795199+0000","last_clean":"2024-02-21T22:52:51.795199+0000","last_became_active":"2024-02-21T22:52:49.792509+0000","last_became_peered":"2024-02-21T22:52:49.792509+0000","last_unstale":"2024-02-21T22:52:51.795199+0000","last_undegraded":"2024-02-21T22:52:51.795199+0000","last_fullsized":"2024-02-21T22:52:51.795199+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:12:21.047751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234103+0000","last_change":"2024-02-21T22:52:50.808696+0000","last_active":"2024-02-21T22:52:52.234103+0000","last_peered":"2024-02-21T22:52:52.234103+0000","last_clean":"2024-02-21T22:52:52.234103+0000","last_became_active":"2024-02-21T22:52:50.808416+0000","last_became_peered":"2024-02-21T22:52:50.808416+0000","last_unstale":"2024-02-21T22:52:52.234103+0000","last_undegraded":"2024-02-21T22:52:52.234103+0000","last_fullsized":"2024-02-21T22:52:52.234103+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:02:22.212238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.233760+0000","last_change":"2024-02-21T22:52:49.789756+0000","last_active":"2024-02-21T22:52:52.233760+0000","last_peered":"2024-02-21T22:52:52.233760+0000","last_clean":"2024-02-21T22:52:52.233760+0000","last_became_active":"2024-02-21T22:52:49.789447+0000","last_became_peered":"2024-02-21T22:52:49.789447+0000","last_unstale":"2024-02-21T22:52:52.233760+0000","last_undegraded":"2024-02-21T22:52:52.233760+0000","last_fullsized":"2024-02-21T22:52:52.233760+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:01:23.165721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234491+0000","last_change":"2024-02-21T22:52:50.809468+0000","last_active":"2024-02-21T22:52:52.234491+0000","last_peered":"2024-02-21T22:52:52.234491+0000","last_clean":"2024-02-21T22:52:52.234491+0000","last_became_active":"2024-02-21T22:52:50.809053+0000","last_became_peered":"2024-02-21T22:52:50.809053+0000","last_unstale":"2024-02-21T22:52:52.234491+0000","last_undegraded":"2024-02-21T22:52:52.234491+0000","last_fullsized":"2024-02-21T22:52:52.234491+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:22:02.404664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:51.792607+0000","last_change":"2024-02-21T22:52:49.791174+0000","last_active":"2024-02-21T22:52:51.792607+0000","last_peered":"2024-02-21T22:52:51.792607+0000","last_clean":"2024-02-21T22:52:51.792607+0000","last_became_active":"2024-02-21T22:52:49.790885+0000","last_became_peered":"2024-02-21T22:52:49.790885+0000","last_unstale":"2024-02-21T22:52:51.792607+0000","last_undegraded":"2024-02-21T22:52:51.792607+0000","last_fullsized":"2024-02-21T22:52:51.792607+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:06:28.817953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234062+0000","last_change":"2024-02-21T22:52:50.802420+0000","last_active":"2024-02-21T22:52:52.234062+0000","last_peered":"2024-02-21T22:52:52.234062+0000","last_clean":"2024-02-21T22:52:52.234062+0000","last_became_active":"2024-02-21T22:52:50.801980+0000","last_became_peered":"2024-02-21T22:52:50.801980+0000","last_unstale":"2024-02-21T22:52:52.234062+0000","last_undegraded":"2024-02-21T22:52:52.234062+0000","last_fullsized":"2024-02-21T22:52:52.234062+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:02:22.212238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.233717+0000","last_change":"2024-02-21T22:52:49.787772+0000","last_active":"2024-02-21T22:52:52.233717+0000","last_peered":"2024-02-21T22:52:52.233717+0000","last_clean":"2024-02-21T22:52:52.233717+0000","last_became_active":"2024-02-21T22:52:49.787483+0000","last_became_peered":"2024-02-21T22:52:49.787483+0000","last_unstale":"2024-02-21T22:52:52.233717+0000","last_undegraded":"2024-02-21T22:52:52.233717+0000","last_fullsized":"2024-02-21T22:52:52.233717+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:04:03.761477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234346+0000","last_change":"2024-02-21T22:52:50.801710+0000","last_active":"2024-02-21T22:52:52.234346+0000","last_peered":"2024-02-21T22:52:52.234346+0000","last_clean":"2024-02-21T22:52:52.234346+0000","last_became_active":"2024-02-21T22:52:50.801446+0000","last_became_peered":"2024-02-21T22:52:50.801446+0000","last_unstale":"2024-02-21T22:52:52.234346+0000","last_undegraded":"2024-02-21T22:52:52.234346+0000","last_fullsized":"2024-02-21T22:52:52.234346+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:39:55.210527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":170,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.233578+0000","last_change":"2024-02-21T22:52:40.336187+0000","last_active":"2024-02-21T22:52:52.233578+0000","last_peered":"2024-02-21T22:52:52.233578+0000","last_clean":"2024-02-21T22:52:52.233578+0000","last_became_active":"2024-02-21T22:52:40.335061+0000","last_became_peered":"2024-02-21T22:52:40.335061+0000","last_unstale":"2024-02-21T22:52:52.233578+0000","last_undegraded":"2024-02-21T22:52:52.233578+0000","last_fullsized":"2024-02-21T22:52:52.233578+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:38.328863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:38.328863+0000","last_clean_scrub_stamp":"2024-02-21T22:52:38.328863+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:33:53.012414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.233685+0000","last_change":"2024-02-21T22:52:49.787124+0000","last_active":"2024-02-21T22:52:52.233685+0000","last_peered":"2024-02-21T22:52:52.233685+0000","last_clean":"2024-02-21T22:52:52.233685+0000","last_became_active":"2024-02-21T22:52:49.786800+0000","last_became_peered":"2024-02-21T22:52:49.786800+0000","last_unstale":"2024-02-21T22:52:52.233685+0000","last_undegraded":"2024-02-21T22:52:52.233685+0000","last_fullsized":"2024-02-21T22:52:52.233685+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:01:23.165721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.233943+0000","last_change":"2024-02-21T22:52:50.800508+0000","last_active":"2024-02-21T22:52:52.233943+0000","last_peered":"2024-02-21T22:52:52.233943+0000","last_clean":"2024-02-21T22:52:52.233943+0000","last_became_active":"2024-02-21T22:52:50.800215+0000","last_became_peered":"2024-02-21T22:52:50.800215+0000","last_unstale":"2024-02-21T22:52:52.233943+0000","last_undegraded":"2024-02-21T22:52:52.233943+0000","last_fullsized":"2024-02-21T22:52:52.233943+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:25:58.111654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.233509+0000","last_change":"2024-02-21T22:52:49.788881+0000","last_active":"2024-02-21T22:52:52.233509+0000","last_peered":"2024-02-21T22:52:52.233509+0000","last_clean":"2024-02-21T22:52:52.233509+0000","last_became_active":"2024-02-21T22:52:49.788611+0000","last_became_peered":"2024-02-21T22:52:49.788611+0000","last_unstale":"2024-02-21T22:52:52.233509+0000","last_undegraded":"2024-02-21T22:52:52.233509+0000","last_fullsized":"2024-02-21T22:52:52.233509+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T10:42:14.273761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.233594+0000","last_change":"2024-02-21T22:52:50.801343+0000","last_active":"2024-02-21T22:52:52.233594+0000","last_peered":"2024-02-21T22:52:52.233594+0000","last_clean":"2024-02-21T22:52:52.233594+0000","last_became_active":"2024-02-21T22:52:50.801029+0000","last_became_peered":"2024-02-21T22:52:50.801029+0000","last_unstale":"2024-02-21T22:52:52.233594+0000","last_undegraded":"2024-02-21T22:52:52.233594+0000","last_fullsized":"2024-02-21T22:52:52.233594+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:00:31.831396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.233662+0000","last_change":"2024-02-21T22:52:49.790068+0000","last_active":"2024-02-21T22:52:52.233662+0000","last_peered":"2024-02-21T22:52:52.233662+0000","last_clean":"2024-02-21T22:52:52.233662+0000","last_became_active":"2024-02-21T22:52:49.789766+0000","last_became_peered":"2024-02-21T22:52:49.789766+0000","last_unstale":"2024-02-21T22:52:52.233662+0000","last_undegraded":"2024-02-21T22:52:52.233662+0000","last_fullsized":"2024-02-21T22:52:52.233662+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T10:42:14.273761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:51.792345+0000","last_change":"2024-02-21T22:52:50.787018+0000","last_active":"2024-02-21T22:52:51.792345+0000","last_peered":"2024-02-21T22:52:51.792345+0000","last_clean":"2024-02-21T22:52:51.792345+0000","last_became_active":"2024-02-21T22:52:50.786695+0000","last_became_peered":"2024-02-21T22:52:50.786695+0000","last_unstale":"2024-02-21T22:52:51.792345+0000","last_undegraded":"2024-02-21T22:52:51.792345+0000","last_fullsized":"2024-02-21T22:52:51.792345+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T10:36:17.566817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234569+0000","last_change":"2024-02-21T22:52:49.789752+0000","last_active":"2024-02-21T22:52:52.234569+0000","last_peered":"2024-02-21T22:52:52.234569+0000","last_clean":"2024-02-21T22:52:52.234569+0000","last_became_active":"2024-02-21T22:52:49.789375+0000","last_became_peered":"2024-02-21T22:52:49.789375+0000","last_unstale":"2024-02-21T22:52:52.234569+0000","last_undegraded":"2024-02-21T22:52:52.234569+0000","last_fullsized":"2024-02-21T22:52:52.234569+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T10:42:14.273761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:51.795446+0000","last_change":"2024-02-21T22:52:50.791657+0000","last_active":"2024-02-21T22:52:51.795446+0000","last_peered":"2024-02-21T22:52:51.795446+0000","last_clean":"2024-02-21T22:52:51.795446+0000","last_became_active":"2024-02-21T22:52:50.791419+0000","last_became_peered":"2024-02-21T22:52:50.791419+0000","last_unstale":"2024-02-21T22:52:51.795446+0000","last_undegraded":"2024-02-21T22:52:51.795446+0000","last_fullsized":"2024-02-21T22:52:51.795446+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T10:42:15.280869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:51.792606+0000","last_change":"2024-02-21T22:52:49.793130+0000","last_active":"2024-02-21T22:52:51.792606+0000","last_peered":"2024-02-21T22:52:51.792606+0000","last_clean":"2024-02-21T22:52:51.792606+0000","last_became_active":"2024-02-21T22:52:49.792824+0000","last_became_peered":"2024-02-21T22:52:49.792824+0000","last_unstale":"2024-02-21T22:52:51.792606+0000","last_undegraded":"2024-02-21T22:52:51.792606+0000","last_fullsized":"2024-02-21T22:52:51.792606+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:01:23.165721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234113+0000","last_change":"2024-02-21T22:52:50.806582+0000","last_active":"2024-02-21T22:52:52.234113+0000","last_peered":"2024-02-21T22:52:52.234113+0000","last_clean":"2024-02-21T22:52:52.234113+0000","last_became_active":"2024-02-21T22:52:50.806257+0000","last_became_peered":"2024-02-21T22:52:50.806257+0000","last_unstale":"2024-02-21T22:52:52.234113+0000","last_undegraded":"2024-02-21T22:52:52.234113+0000","last_fullsized":"2024-02-21T22:52:52.234113+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:13:03.777546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234594+0000","last_change":"2024-02-21T22:52:49.793178+0000","last_active":"2024-02-21T22:52:52.234594+0000","last_peered":"2024-02-21T22:52:52.234594+0000","last_clean":"2024-02-21T22:52:52.234594+0000","last_became_active":"2024-02-21T22:52:49.792301+0000","last_became_peered":"2024-02-21T22:52:49.792301+0000","last_unstale":"2024-02-21T22:52:52.234594+0000","last_undegraded":"2024-02-21T22:52:52.234594+0000","last_fullsized":"2024-02-21T22:52:52.234594+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:53:50.332475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:51.792632+0000","last_change":"2024-02-21T22:52:50.785491+0000","last_active":"2024-02-21T22:52:51.792632+0000","last_peered":"2024-02-21T22:52:51.792632+0000","last_clean":"2024-02-21T22:52:51.792632+0000","last_became_active":"2024-02-21T22:52:50.785220+0000","last_became_peered":"2024-02-21T22:52:50.785220+0000","last_unstale":"2024-02-21T22:52:51.792632+0000","last_undegraded":"2024-02-21T22:52:51.792632+0000","last_fullsized":"2024-02-21T22:52:51.792632+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:33:40.513967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:51.796299+0000","last_change":"2024-02-21T22:52:49.787159+0000","last_active":"2024-02-21T22:52:51.796299+0000","last_peered":"2024-02-21T22:52:51.796299+0000","last_clean":"2024-02-21T22:52:51.796299+0000","last_became_active":"2024-02-21T22:52:49.786876+0000","last_became_peered":"2024-02-21T22:52:49.786876+0000","last_unstale":"2024-02-21T22:52:51.796299+0000","last_undegraded":"2024-02-21T22:52:51.796299+0000","last_fullsized":"2024-02-21T22:52:51.796299+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:20:00.484633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234594+0000","last_change":"2024-02-21T22:52:50.794174+0000","last_active":"2024-02-21T22:52:52.234594+0000","last_peered":"2024-02-21T22:52:52.234594+0000","last_clean":"2024-02-21T22:52:52.234594+0000","last_became_active":"2024-02-21T22:52:50.793881+0000","last_became_peered":"2024-02-21T22:52:50.793881+0000","last_unstale":"2024-02-21T22:52:52.234594+0000","last_undegraded":"2024-02-21T22:52:52.234594+0000","last_fullsized":"2024-02-21T22:52:52.234594+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:02:22.212238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:51.795185+0000","last_change":"2024-02-21T22:52:49.790424+0000","last_active":"2024-02-21T22:52:51.795185+0000","last_peered":"2024-02-21T22:52:51.795185+0000","last_clean":"2024-02-21T22:52:51.795185+0000","last_became_active":"2024-02-21T22:52:49.790147+0000","last_became_peered":"2024-02-21T22:52:49.790147+0000","last_unstale":"2024-02-21T22:52:51.795185+0000","last_undegraded":"2024-02-21T22:52:51.795185+0000","last_fullsized":"2024-02-21T22:52:51.795185+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:23:17.385208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.233852+0000","last_change":"2024-02-21T22:52:50.790678+0000","last_active":"2024-02-21T22:52:52.233852+0000","last_peered":"2024-02-21T22:52:52.233852+0000","last_clean":"2024-02-21T22:52:52.233852+0000","last_became_active":"2024-02-21T22:52:50.790415+0000","last_became_peered":"2024-02-21T22:52:50.790415+0000","last_unstale":"2024-02-21T22:52:52.233852+0000","last_undegraded":"2024-02-21T22:52:52.233852+0000","last_fullsized":"2024-02-21T22:52:52.233852+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:58:42.676518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.233605+0000","last_change":"2024-02-21T22:52:49.794656+0000","last_active":"2024-02-21T22:52:52.233605+0000","last_peered":"2024-02-21T22:52:52.233605+0000","last_clean":"2024-02-21T22:52:52.233605+0000","last_became_active":"2024-02-21T22:52:49.794394+0000","last_became_peered":"2024-02-21T22:52:49.794394+0000","last_unstale":"2024-02-21T22:52:52.233605+0000","last_undegraded":"2024-02-21T22:52:52.233605+0000","last_fullsized":"2024-02-21T22:52:52.233605+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:29:57.623490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:51.795821+0000","last_change":"2024-02-21T22:52:50.792184+0000","last_active":"2024-02-21T22:52:51.795821+0000","last_peered":"2024-02-21T22:52:51.795821+0000","last_clean":"2024-02-21T22:52:51.795821+0000","last_became_active":"2024-02-21T22:52:50.791180+0000","last_became_peered":"2024-02-21T22:52:50.791180+0000","last_unstale":"2024-02-21T22:52:51.795821+0000","last_undegraded":"2024-02-21T22:52:51.795821+0000","last_fullsized":"2024-02-21T22:52:51.795821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:20:01.491741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:51.792408+0000","last_change":"2024-02-21T22:52:49.791409+0000","last_active":"2024-02-21T22:52:51.792408+0000","last_peered":"2024-02-21T22:52:51.792408+0000","last_clean":"2024-02-21T22:52:51.792408+0000","last_became_active":"2024-02-21T22:52:49.791124+0000","last_became_peered":"2024-02-21T22:52:49.791124+0000","last_unstale":"2024-02-21T22:52:51.792408+0000","last_undegraded":"2024-02-21T22:52:51.792408+0000","last_fullsized":"2024-02-21T22:52:51.792408+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T10:42:14.273761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.233884+0000","last_change":"2024-02-21T22:52:50.790359+0000","last_active":"2024-02-21T22:52:52.233884+0000","last_peered":"2024-02-21T22:52:52.233884+0000","last_clean":"2024-02-21T22:52:52.233884+0000","last_became_active":"2024-02-21T22:52:50.790083+0000","last_became_peered":"2024-02-21T22:52:50.790083+0000","last_unstale":"2024-02-21T22:52:52.233884+0000","last_undegraded":"2024-02-21T22:52:52.233884+0000","last_fullsized":"2024-02-21T22:52:52.233884+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:17:34.365402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:51.792512+0000","last_change":"2024-02-21T22:52:49.786337+0000","last_active":"2024-02-21T22:52:51.792512+0000","last_peered":"2024-02-21T22:52:51.792512+0000","last_clean":"2024-02-21T22:52:51.792512+0000","last_became_active":"2024-02-21T22:52:49.786058+0000","last_became_peered":"2024-02-21T22:52:49.786058+0000","last_unstale":"2024-02-21T22:52:51.792512+0000","last_undegraded":"2024-02-21T22:52:51.792512+0000","last_fullsized":"2024-02-21T22:52:51.792512+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:29:57.623490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234482+0000","last_change":"2024-02-21T22:52:50.792676+0000","last_active":"2024-02-21T22:52:52.234482+0000","last_peered":"2024-02-21T22:52:52.234482+0000","last_clean":"2024-02-21T22:52:52.234482+0000","last_became_active":"2024-02-21T22:52:50.792330+0000","last_became_peered":"2024-02-21T22:52:50.792330+0000","last_unstale":"2024-02-21T22:52:52.234482+0000","last_undegraded":"2024-02-21T22:52:52.234482+0000","last_fullsized":"2024-02-21T22:52:52.234482+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T02:49:51.875007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234484+0000","last_change":"2024-02-21T22:52:49.791921+0000","last_active":"2024-02-21T22:52:52.234484+0000","last_peered":"2024-02-21T22:52:52.234484+0000","last_clean":"2024-02-21T22:52:52.234484+0000","last_became_active":"2024-02-21T22:52:49.791614+0000","last_became_peered":"2024-02-21T22:52:49.791614+0000","last_unstale":"2024-02-21T22:52:52.234484+0000","last_undegraded":"2024-02-21T22:52:52.234484+0000","last_fullsized":"2024-02-21T22:52:52.234484+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:06:28.817953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:51.794942+0000","last_change":"2024-02-21T22:52:50.794820+0000","last_active":"2024-02-21T22:52:51.794942+0000","last_peered":"2024-02-21T22:52:51.794942+0000","last_clean":"2024-02-21T22:52:51.794942+0000","last_became_active":"2024-02-21T22:52:50.794504+0000","last_became_peered":"2024-02-21T22:52:50.794504+0000","last_unstale":"2024-02-21T22:52:51.794942+0000","last_undegraded":"2024-02-21T22:52:51.794942+0000","last_fullsized":"2024-02-21T22:52:51.794942+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:17:34.365402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.233975+0000","last_change":"2024-02-21T22:52:50.806225+0000","last_active":"2024-02-21T22:52:52.233975+0000","last_peered":"2024-02-21T22:52:52.233975+0000","last_clean":"2024-02-21T22:52:52.233975+0000","last_became_active":"2024-02-21T22:52:50.805867+0000","last_became_peered":"2024-02-21T22:52:50.805867+0000","last_unstale":"2024-02-21T22:52:52.233975+0000","last_undegraded":"2024-02-21T22:52:52.233975+0000","last_fullsized":"2024-02-21T22:52:52.233975+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:25:14.399237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234362+0000","last_change":"2024-02-21T22:52:49.791427+0000","last_active":"2024-02-21T22:52:52.234362+0000","last_peered":"2024-02-21T22:52:52.234362+0000","last_clean":"2024-02-21T22:52:52.234362+0000","last_became_active":"2024-02-21T22:52:49.790879+0000","last_became_peered":"2024-02-21T22:52:49.790879+0000","last_unstale":"2024-02-21T22:52:52.234362+0000","last_undegraded":"2024-02-21T22:52:52.234362+0000","last_fullsized":"2024-02-21T22:52:52.234362+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:20:00.484633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234211+0000","last_change":"2024-02-21T22:52:50.804074+0000","last_active":"2024-02-21T22:52:52.234211+0000","last_peered":"2024-02-21T22:52:52.234211+0000","last_clean":"2024-02-21T22:52:52.234211+0000","last_became_active":"2024-02-21T22:52:50.803759+0000","last_became_peered":"2024-02-21T22:52:50.803759+0000","last_unstale":"2024-02-21T22:52:52.234211+0000","last_undegraded":"2024-02-21T22:52:52.234211+0000","last_fullsized":"2024-02-21T22:52:52.234211+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:06:29.082788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234445+0000","last_change":"2024-02-21T22:52:49.790281+0000","last_active":"2024-02-21T22:52:52.234445+0000","last_peered":"2024-02-21T22:52:52.234445+0000","last_clean":"2024-02-21T22:52:52.234445+0000","last_became_active":"2024-02-21T22:52:49.790023+0000","last_became_peered":"2024-02-21T22:52:49.790023+0000","last_unstale":"2024-02-21T22:52:52.234445+0000","last_undegraded":"2024-02-21T22:52:52.234445+0000","last_fullsized":"2024-02-21T22:52:52.234445+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:31:50.557983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.233936+0000","last_change":"2024-02-21T22:52:50.801839+0000","last_active":"2024-02-21T22:52:52.233936+0000","last_peered":"2024-02-21T22:52:52.233936+0000","last_clean":"2024-02-21T22:52:52.233936+0000","last_became_active":"2024-02-21T22:52:50.801499+0000","last_became_peered":"2024-02-21T22:52:50.801499+0000","last_unstale":"2024-02-21T22:52:52.233936+0000","last_undegraded":"2024-02-21T22:52:52.233936+0000","last_fullsized":"2024-02-21T22:52:52.233936+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:49:26.881791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234190+0000","last_change":"2024-02-21T22:52:49.792448+0000","last_active":"2024-02-21T22:52:52.234190+0000","last_peered":"2024-02-21T22:52:52.234190+0000","last_clean":"2024-02-21T22:52:52.234190+0000","last_became_active":"2024-02-21T22:52:49.792116+0000","last_became_peered":"2024-02-21T22:52:49.792116+0000","last_unstale":"2024-02-21T22:52:52.234190+0000","last_undegraded":"2024-02-21T22:52:52.234190+0000","last_fullsized":"2024-02-21T22:52:52.234190+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:34:55.953292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234013+0000","last_change":"2024-02-21T22:52:50.791072+0000","last_active":"2024-02-21T22:52:52.234013+0000","last_peered":"2024-02-21T22:52:52.234013+0000","last_clean":"2024-02-21T22:52:52.234013+0000","last_became_active":"2024-02-21T22:52:50.790784+0000","last_became_peered":"2024-02-21T22:52:50.790784+0000","last_unstale":"2024-02-21T22:52:52.234013+0000","last_undegraded":"2024-02-21T22:52:52.234013+0000","last_fullsized":"2024-02-21T22:52:52.234013+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:33:40.513967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234149+0000","last_change":"2024-02-21T22:52:49.792852+0000","last_active":"2024-02-21T22:52:52.234149+0000","last_peered":"2024-02-21T22:52:52.234149+0000","last_clean":"2024-02-21T22:52:52.234149+0000","last_became_active":"2024-02-21T22:52:49.792580+0000","last_became_peered":"2024-02-21T22:52:49.792580+0000","last_unstale":"2024-02-21T22:52:52.234149+0000","last_undegraded":"2024-02-21T22:52:52.234149+0000","last_fullsized":"2024-02-21T22:52:52.234149+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:34:55.953292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":802816,"data_stored":661884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":208896,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":71060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":70934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":212992,"data_stored":71094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":811008,"data_stored":661940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-21T22:52:55.749 INFO:tasks.ceph.mds.d.smithi142.stderr:2024-02-21T22:52:55.760+0000 7fc89a7f1640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-02-21T22:52:58.125 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-21T22:52:58.237 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.246+0000 7fb887368640 1 Processor -- start 2024-02-21T22:52:58.237 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.247+0000 7fb887368640 1 -- start start 2024-02-21T22:52:58.239 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.247+0000 7fb887368640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb8801622c0 0x7fb8800b2f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:58.239 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.247+0000 7fb887368640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fb88006d1c0 0x7fb88015df60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:58.239 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.247+0000 7fb887368640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb88006df90 con 0x7fb8801626a0 2024-02-21T22:52:58.239 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.248+0000 7fb887368640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8800b34c0 con 0x7fb88006d1c0 2024-02-21T22:52:58.239 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.248+0000 7fb887368640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb88006d6f0 con 0x7fb8801622c0 2024-02-21T22:52:58.239 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.248+0000 7fb884903640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fb88006d1c0 0x7fb88015df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:58.239 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.248+0000 7fb884903640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fb88006d1c0 0x7fb88015df60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:34054/0 (socket says 172.21.15.116:34054) 2024-02-21T22:52:58.239 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.248+0000 7fb885104640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb8801622c0 0x7fb8800b2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:58.239 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.248+0000 7fb884903640 1 -- 172.21.15.116:0/3603309873 learned_addr learned my addr 172.21.15.116:0/3603309873 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:52:58.239 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.248+0000 7fb87ffff640 1 -- 172.21.15.116:0/3603309873 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 482649208 0 0) 0x7fb88006df90 con 0x7fb8801626a0 2024-02-21T22:52:58.239 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.248+0000 7fb884903640 1 -- 172.21.15.116:0/3603309873 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb8801622c0 msgr2=0x7fb8800b2f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:52:58.239 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.248+0000 7fb884903640 1 --2- 172.21.15.116:0/3603309873 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb8801622c0 0x7fb8800b2f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:58.239 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.248+0000 7fb884903640 1 -- 172.21.15.116:0/3603309873 >> v1:172.21.15.142:6789/0 conn(0x7fb8801626a0 legacy=0x7fb8800cfd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:58.240 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.248+0000 7fb884903640 1 -- 172.21.15.116:0/3603309873 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb88006d9d0 con 0x7fb88006d1c0 2024-02-21T22:52:58.241 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.249+0000 7fb884903640 1 --2- 172.21.15.116:0/3603309873 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb88006d1c0 0x7fb88015df60 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fb874009870 tx=0x7fb87402ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec63c18fe0e6683d server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:52:58.241 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.249+0000 7fb87ffff640 1 -- 172.21.15.116:0/3603309873 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb87402f840 con 0x7fb88006d1c0 2024-02-21T22:52:58.241 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.249+0000 7fb87ffff640 1 -- 172.21.15.116:0/3603309873 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb87402f9e0 con 0x7fb88006d1c0 2024-02-21T22:52:58.241 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.249+0000 7fb87ffff640 1 -- 172.21.15.116:0/3603309873 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb87402fdb0 con 0x7fb88006d1c0 2024-02-21T22:52:58.241 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.249+0000 7fb887368640 1 -- 172.21.15.116:0/3603309873 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb88006d1c0 msgr2=0x7fb88015df60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:58.241 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.249+0000 7fb887368640 1 --2- 172.21.15.116:0/3603309873 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb88006d1c0 0x7fb88015df60 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fb874009870 tx=0x7fb87402ba20 comp rx=0 tx=0).stop 2024-02-21T22:52:58.241 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.249+0000 7fb887368640 1 -- 172.21.15.116:0/3603309873 shutdown_connections 2024-02-21T22:52:58.242 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.249+0000 7fb887368640 1 --2- 172.21.15.116:0/3603309873 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb88006d1c0 0x7fb88015df60 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:58.242 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.249+0000 7fb887368640 1 --2- 172.21.15.116:0/3603309873 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb8801622c0 0x7fb8800b2f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:58.242 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.250+0000 7fb887368640 1 -- 172.21.15.116:0/3603309873 >> 172.21.15.116:0/3603309873 conn(0x7fb8800d1be0 msgr2=0x7fb8800d1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:52:58.242 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.250+0000 7fb887368640 1 -- 172.21.15.116:0/3603309873 shutdown_connections 2024-02-21T22:52:58.242 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.250+0000 7fb887368640 1 -- 172.21.15.116:0/3603309873 wait complete. 2024-02-21T22:52:58.242 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.251+0000 7fb887368640 1 Processor -- start 2024-02-21T22:52:58.242 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.251+0000 7fb887368640 1 -- start start 2024-02-21T22:52:58.244 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.251+0000 7fb887368640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb88006d1c0 0x7fb880158a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:58.244 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.251+0000 7fb887368640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb8801622c0 0x7fb8800ca390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:58.244 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.252+0000 7fb887368640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb8801626a0 0x7fb8800ca8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:58.244 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.252+0000 7fb887368640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8800b6070 con 0x7fb8801622c0 2024-02-21T22:52:58.244 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.252+0000 7fb887368640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8800b4b40 con 0x7fb88006d1c0 2024-02-21T22:52:58.244 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.252+0000 7fb887368640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8800b61f0 con 0x7fb8801626a0 2024-02-21T22:52:58.244 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.252+0000 7fb884903640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb8801622c0 0x7fb8800ca390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:58.244 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.252+0000 7fb884903640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb8801622c0 0x7fb8800ca390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:34062/0 (socket says 172.21.15.116:34062) 2024-02-21T22:52:58.244 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.252+0000 7fb884903640 1 -- 172.21.15.116:0/574391767 learned_addr learned my addr 172.21.15.116:0/574391767 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:52:58.245 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.252+0000 7fb885104640 1 --2- 172.21.15.116:0/574391767 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb88006d1c0 0x7fb880158a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:58.245 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.252+0000 7fb885905640 1 --2- 172.21.15.116:0/574391767 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb8801626a0 0x7fb8800ca8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:58.245 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.252+0000 7fb884903640 1 -- 172.21.15.116:0/574391767 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb8801626a0 msgr2=0x7fb8800ca8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:58.245 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.252+0000 7fb884903640 1 --2- 172.21.15.116:0/574391767 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb8801626a0 0x7fb8800ca8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:58.245 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.252+0000 7fb884903640 1 -- 172.21.15.116:0/574391767 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb88006d1c0 msgr2=0x7fb880158a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:58.245 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.252+0000 7fb884903640 1 --2- 172.21.15.116:0/574391767 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb88006d1c0 0x7fb880158a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:58.245 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.252+0000 7fb884903640 1 -- 172.21.15.116:0/574391767 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8800c7130 con 0x7fb8801622c0 2024-02-21T22:52:58.245 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.252+0000 7fb884903640 1 --2- 172.21.15.116:0/574391767 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb8801622c0 0x7fb8800ca390 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fb874000c00 tx=0x7fb874004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:52:58.245 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.252+0000 7fb87dffb640 1 -- 172.21.15.116:0/574391767 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb874037bc0 con 0x7fb8801622c0 2024-02-21T22:52:58.245 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.252+0000 7fb87dffb640 1 -- 172.21.15.116:0/574391767 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb874046070 con 0x7fb8801622c0 2024-02-21T22:52:58.245 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.252+0000 7fb887368640 1 -- 172.21.15.116:0/574391767 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8800c7410 con 0x7fb8801622c0 2024-02-21T22:52:58.245 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.252+0000 7fb87dffb640 1 -- 172.21.15.116:0/574391767 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb874041400 con 0x7fb8801622c0 2024-02-21T22:52:58.245 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.252+0000 7fb887368640 1 -- 172.21.15.116:0/574391767 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb880158fb0 con 0x7fb8801622c0 2024-02-21T22:52:58.245 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.254+0000 7fb887368640 1 -- 172.21.15.116:0/574391767 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8800b5e60 con 0x7fb8801622c0 2024-02-21T22:52:58.246 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.254+0000 7fb87dffb640 1 -- 172.21.15.116:0/574391767 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fb874040070 con 0x7fb8801622c0 2024-02-21T22:52:58.246 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.254+0000 7fb87dffb640 1 --2- 172.21.15.116:0/574391767 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fb86c06b4d0 0x7fb86c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:58.246 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.254+0000 7fb87dffb640 1 -- 172.21.15.116:0/574391767 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb8740ac630 con 0x7fb8801622c0 2024-02-21T22:52:58.246 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.255+0000 7fb885104640 1 --2- 172.21.15.116:0/574391767 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fb86c06b4d0 0x7fb86c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:58.247 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.255+0000 7fb885104640 1 --2- 172.21.15.116:0/574391767 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fb86c06b4d0 0x7fb86c06d990 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb8800cb1b0 tx=0x7fb87800b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:52:58.249 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.259+0000 7fb87dffb640 1 -- 172.21.15.116:0/574391767 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7fb8800b5e60 con 0x7fb8801622c0 2024-02-21T22:52:58.420 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.429+0000 7fb887368640 1 -- 172.21.15.116:0/574391767 --> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb8800b42f0 con 0x7fb86c06b4d0 2024-02-21T22:52:58.426 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.435+0000 7fb87dffb640 1 -- 172.21.15.116:0/574391767 <== mgr.4103 v2:172.21.15.142:6832/1381484782 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251946 (secure 0 0 0) 0x7fb8800b42f0 con 0x7fb86c06b4d0 2024-02-21T22:52:58.428 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-02-21T22:52:58.429 INFO:teuthology.orchestra.run.smithi116.stderr:dumped all 2024-02-21T22:52:58.431 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.438+0000 7fb887368640 1 -- 172.21.15.116:0/574391767 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fb86c06b4d0 msgr2=0x7fb86c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:58.431 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.438+0000 7fb887368640 1 --2- 172.21.15.116:0/574391767 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fb86c06b4d0 0x7fb86c06d990 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb8800cb1b0 tx=0x7fb87800b040 comp rx=0 tx=0).stop 2024-02-21T22:52:58.431 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.438+0000 7fb887368640 1 -- 172.21.15.116:0/574391767 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb8801622c0 msgr2=0x7fb8800ca390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:58.431 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.438+0000 7fb887368640 1 --2- 172.21.15.116:0/574391767 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb8801622c0 0x7fb8800ca390 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fb874000c00 tx=0x7fb874004730 comp rx=0 tx=0).stop 2024-02-21T22:52:58.431 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.438+0000 7fb887368640 1 -- 172.21.15.116:0/574391767 shutdown_connections 2024-02-21T22:52:58.431 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.438+0000 7fb887368640 1 --2- 172.21.15.116:0/574391767 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fb86c06b4d0 0x7fb86c06d990 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:58.431 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.438+0000 7fb887368640 1 --2- 172.21.15.116:0/574391767 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb8801626a0 0x7fb8800ca8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:58.431 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.438+0000 7fb887368640 1 --2- 172.21.15.116:0/574391767 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb8801622c0 0x7fb8800ca390 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:58.432 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.438+0000 7fb887368640 1 --2- 172.21.15.116:0/574391767 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb88006d1c0 0x7fb880158a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:58.432 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.438+0000 7fb887368640 1 -- 172.21.15.116:0/574391767 >> 172.21.15.116:0/574391767 conn(0x7fb8800d1be0 msgr2=0x7fb8800b36d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:52:58.432 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.438+0000 7fb887368640 1 -- 172.21.15.116:0/574391767 shutdown_connections 2024-02-21T22:52:58.432 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.438+0000 7fb887368640 1 -- 172.21.15.116:0/574391767 wait complete. 2024-02-21T22:52:58.439 INFO:teuthology.orchestra.run.smithi116.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-02-21T22:52:58.288906+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":125,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219016,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755704,"statfs":{"total":773094113280,"available":772869840896,"internally_reserved":0,"allocated":2891776,"data_stored":1753028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001352"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234219+0000","last_change":"2024-02-21T22:52:50.804119+0000","last_active":"2024-02-21T22:52:52.234219+0000","last_peered":"2024-02-21T22:52:52.234219+0000","last_clean":"2024-02-21T22:52:52.234219+0000","last_became_active":"2024-02-21T22:52:50.801464+0000","last_became_peered":"2024-02-21T22:52:50.801464+0000","last_unstale":"2024-02-21T22:52:52.234219+0000","last_undegraded":"2024-02-21T22:52:52.234219+0000","last_fullsized":"2024-02-21T22:52:52.234219+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:06:29.082788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:51.792663+0000","last_change":"2024-02-21T22:52:50.787683+0000","last_active":"2024-02-21T22:52:51.792663+0000","last_peered":"2024-02-21T22:52:51.792663+0000","last_clean":"2024-02-21T22:52:51.792663+0000","last_became_active":"2024-02-21T22:52:50.787384+0000","last_became_peered":"2024-02-21T22:52:50.787384+0000","last_unstale":"2024-02-21T22:52:51.792663+0000","last_undegraded":"2024-02-21T22:52:51.792663+0000","last_fullsized":"2024-02-21T22:52:51.792663+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:10:56.108581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.233732+0000","last_change":"2024-02-21T22:52:50.786452+0000","last_active":"2024-02-21T22:52:52.233732+0000","last_peered":"2024-02-21T22:52:52.233732+0000","last_clean":"2024-02-21T22:52:52.233732+0000","last_became_active":"2024-02-21T22:52:50.786191+0000","last_became_peered":"2024-02-21T22:52:50.786191+0000","last_unstale":"2024-02-21T22:52:52.233732+0000","last_undegraded":"2024-02-21T22:52:52.233732+0000","last_fullsized":"2024-02-21T22:52:52.233732+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:43:33.767331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.233922+0000","last_change":"2024-02-21T22:52:50.805367+0000","last_active":"2024-02-21T22:52:52.233922+0000","last_peered":"2024-02-21T22:52:52.233922+0000","last_clean":"2024-02-21T22:52:52.233922+0000","last_became_active":"2024-02-21T22:52:50.805067+0000","last_became_peered":"2024-02-21T22:52:50.805067+0000","last_unstale":"2024-02-21T22:52:52.233922+0000","last_undegraded":"2024-02-21T22:52:52.233922+0000","last_fullsized":"2024-02-21T22:52:52.233922+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T02:49:51.875007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234052+0000","last_change":"2024-02-21T22:52:50.793726+0000","last_active":"2024-02-21T22:52:52.234052+0000","last_peered":"2024-02-21T22:52:52.234052+0000","last_clean":"2024-02-21T22:52:52.234052+0000","last_became_active":"2024-02-21T22:52:50.793461+0000","last_became_peered":"2024-02-21T22:52:50.793461+0000","last_unstale":"2024-02-21T22:52:52.234052+0000","last_undegraded":"2024-02-21T22:52:52.234052+0000","last_fullsized":"2024-02-21T22:52:52.234052+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:25:14.399237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.233784+0000","last_change":"2024-02-21T22:52:50.797872+0000","last_active":"2024-02-21T22:52:52.233784+0000","last_peered":"2024-02-21T22:52:52.233784+0000","last_clean":"2024-02-21T22:52:52.233784+0000","last_became_active":"2024-02-21T22:52:50.797547+0000","last_became_peered":"2024-02-21T22:52:50.797547+0000","last_unstale":"2024-02-21T22:52:52.233784+0000","last_undegraded":"2024-02-21T22:52:52.233784+0000","last_fullsized":"2024-02-21T22:52:52.233784+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:38:41.981414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.233678+0000","last_change":"2024-02-21T22:52:50.792977+0000","last_active":"2024-02-21T22:52:52.233678+0000","last_peered":"2024-02-21T22:52:52.233678+0000","last_clean":"2024-02-21T22:52:52.233678+0000","last_became_active":"2024-02-21T22:52:50.792731+0000","last_became_peered":"2024-02-21T22:52:50.792731+0000","last_unstale":"2024-02-21T22:52:52.233678+0000","last_undegraded":"2024-02-21T22:52:52.233678+0000","last_fullsized":"2024-02-21T22:52:52.233678+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T02:49:51.875007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.233592+0000","last_change":"2024-02-21T22:52:50.800588+0000","last_active":"2024-02-21T22:52:52.233592+0000","last_peered":"2024-02-21T22:52:52.233592+0000","last_clean":"2024-02-21T22:52:52.233592+0000","last_became_active":"2024-02-21T22:52:50.800266+0000","last_became_peered":"2024-02-21T22:52:50.800266+0000","last_unstale":"2024-02-21T22:52:52.233592+0000","last_undegraded":"2024-02-21T22:52:52.233592+0000","last_fullsized":"2024-02-21T22:52:52.233592+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:49:26.881791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234360+0000","last_change":"2024-02-21T22:52:50.802133+0000","last_active":"2024-02-21T22:52:52.234360+0000","last_peered":"2024-02-21T22:52:52.234360+0000","last_clean":"2024-02-21T22:52:52.234360+0000","last_became_active":"2024-02-21T22:52:50.801109+0000","last_became_peered":"2024-02-21T22:52:50.801109+0000","last_unstale":"2024-02-21T22:52:52.234360+0000","last_undegraded":"2024-02-21T22:52:52.234360+0000","last_fullsized":"2024-02-21T22:52:52.234360+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:32:36.066162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:51.795991+0000","last_change":"2024-02-21T22:52:50.799972+0000","last_active":"2024-02-21T22:52:51.795991+0000","last_peered":"2024-02-21T22:52:51.795991+0000","last_clean":"2024-02-21T22:52:51.795991+0000","last_became_active":"2024-02-21T22:52:50.799713+0000","last_became_peered":"2024-02-21T22:52:50.799713+0000","last_unstale":"2024-02-21T22:52:51.795991+0000","last_undegraded":"2024-02-21T22:52:51.795991+0000","last_fullsized":"2024-02-21T22:52:51.795991+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:10:56.108581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:51.794860+0000","last_change":"2024-02-21T22:52:50.800180+0000","last_active":"2024-02-21T22:52:51.794860+0000","last_peered":"2024-02-21T22:52:51.794860+0000","last_clean":"2024-02-21T22:52:51.794860+0000","last_became_active":"2024-02-21T22:52:50.799506+0000","last_became_peered":"2024-02-21T22:52:50.799506+0000","last_unstale":"2024-02-21T22:52:51.794860+0000","last_undegraded":"2024-02-21T22:52:51.794860+0000","last_fullsized":"2024-02-21T22:52:51.794860+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:49:26.881791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:51.795709+0000","last_change":"2024-02-21T22:52:50.785668+0000","last_active":"2024-02-21T22:52:51.795709+0000","last_peered":"2024-02-21T22:52:51.795709+0000","last_clean":"2024-02-21T22:52:51.795709+0000","last_became_active":"2024-02-21T22:52:50.785381+0000","last_became_peered":"2024-02-21T22:52:50.785381+0000","last_unstale":"2024-02-21T22:52:51.795709+0000","last_undegraded":"2024-02-21T22:52:51.795709+0000","last_fullsized":"2024-02-21T22:52:51.795709+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:29:58.630598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234333+0000","last_change":"2024-02-21T22:52:50.789689+0000","last_active":"2024-02-21T22:52:52.234333+0000","last_peered":"2024-02-21T22:52:52.234333+0000","last_clean":"2024-02-21T22:52:52.234333+0000","last_became_active":"2024-02-21T22:52:50.789124+0000","last_became_peered":"2024-02-21T22:52:50.789124+0000","last_unstale":"2024-02-21T22:52:52.234333+0000","last_undegraded":"2024-02-21T22:52:52.234333+0000","last_fullsized":"2024-02-21T22:52:52.234333+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:10:56.108581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.233802+0000","last_change":"2024-02-21T22:52:50.787622+0000","last_active":"2024-02-21T22:52:52.233802+0000","last_peered":"2024-02-21T22:52:52.233802+0000","last_clean":"2024-02-21T22:52:52.233802+0000","last_became_active":"2024-02-21T22:52:50.787315+0000","last_became_peered":"2024-02-21T22:52:50.787315+0000","last_unstale":"2024-02-21T22:52:52.233802+0000","last_undegraded":"2024-02-21T22:52:52.233802+0000","last_fullsized":"2024-02-21T22:52:52.233802+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:07:39.283417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:51.792349+0000","last_change":"2024-02-21T22:52:50.785274+0000","last_active":"2024-02-21T22:52:51.792349+0000","last_peered":"2024-02-21T22:52:51.792349+0000","last_clean":"2024-02-21T22:52:51.792349+0000","last_became_active":"2024-02-21T22:52:50.784970+0000","last_became_peered":"2024-02-21T22:52:50.784970+0000","last_unstale":"2024-02-21T22:52:51.792349+0000","last_undegraded":"2024-02-21T22:52:51.792349+0000","last_fullsized":"2024-02-21T22:52:51.792349+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:17:34.365402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234235+0000","last_change":"2024-02-21T22:52:50.797804+0000","last_active":"2024-02-21T22:52:52.234235+0000","last_peered":"2024-02-21T22:52:52.234235+0000","last_clean":"2024-02-21T22:52:52.234235+0000","last_became_active":"2024-02-21T22:52:50.797414+0000","last_became_peered":"2024-02-21T22:52:50.797414+0000","last_unstale":"2024-02-21T22:52:52.234235+0000","last_undegraded":"2024-02-21T22:52:52.234235+0000","last_fullsized":"2024-02-21T22:52:52.234235+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:10:56.108581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234715+0000","last_change":"2024-02-21T22:52:50.808468+0000","last_active":"2024-02-21T22:52:52.234715+0000","last_peered":"2024-02-21T22:52:52.234715+0000","last_clean":"2024-02-21T22:52:52.234715+0000","last_became_active":"2024-02-21T22:52:50.808183+0000","last_became_peered":"2024-02-21T22:52:50.808183+0000","last_unstale":"2024-02-21T22:52:52.234715+0000","last_undegraded":"2024-02-21T22:52:52.234715+0000","last_fullsized":"2024-02-21T22:52:52.234715+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:22:02.404664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.233676+0000","last_change":"2024-02-21T22:52:50.789333+0000","last_active":"2024-02-21T22:52:52.233676+0000","last_peered":"2024-02-21T22:52:52.233676+0000","last_clean":"2024-02-21T22:52:52.233676+0000","last_became_active":"2024-02-21T22:52:50.789054+0000","last_became_peered":"2024-02-21T22:52:50.789054+0000","last_unstale":"2024-02-21T22:52:52.233676+0000","last_undegraded":"2024-02-21T22:52:52.233676+0000","last_fullsized":"2024-02-21T22:52:52.233676+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:31:51.565091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234606+0000","last_change":"2024-02-21T22:52:50.796065+0000","last_active":"2024-02-21T22:52:52.234606+0000","last_peered":"2024-02-21T22:52:52.234606+0000","last_clean":"2024-02-21T22:52:52.234606+0000","last_became_active":"2024-02-21T22:52:50.794895+0000","last_became_peered":"2024-02-21T22:52:50.794895+0000","last_unstale":"2024-02-21T22:52:52.234606+0000","last_undegraded":"2024-02-21T22:52:52.234606+0000","last_fullsized":"2024-02-21T22:52:52.234606+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:03:04.692215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:51.794890+0000","last_change":"2024-02-21T22:52:50.795221+0000","last_active":"2024-02-21T22:52:51.794890+0000","last_peered":"2024-02-21T22:52:51.794890+0000","last_clean":"2024-02-21T22:52:51.794890+0000","last_became_active":"2024-02-21T22:52:50.794693+0000","last_became_peered":"2024-02-21T22:52:50.794693+0000","last_unstale":"2024-02-21T22:52:51.794890+0000","last_undegraded":"2024-02-21T22:52:51.794890+0000","last_fullsized":"2024-02-21T22:52:51.794890+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T10:36:17.566817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234167+0000","last_change":"2024-02-21T22:52:50.793867+0000","last_active":"2024-02-21T22:52:52.234167+0000","last_peered":"2024-02-21T22:52:52.234167+0000","last_clean":"2024-02-21T22:52:52.234167+0000","last_became_active":"2024-02-21T22:52:50.793645+0000","last_became_peered":"2024-02-21T22:52:50.793645+0000","last_unstale":"2024-02-21T22:52:52.234167+0000","last_undegraded":"2024-02-21T22:52:52.234167+0000","last_fullsized":"2024-02-21T22:52:52.234167+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:25:58.111654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.233930+0000","last_change":"2024-02-21T22:52:50.807989+0000","last_active":"2024-02-21T22:52:52.233930+0000","last_peered":"2024-02-21T22:52:52.233930+0000","last_clean":"2024-02-21T22:52:52.233930+0000","last_became_active":"2024-02-21T22:52:50.807712+0000","last_became_peered":"2024-02-21T22:52:50.807712+0000","last_unstale":"2024-02-21T22:52:52.233930+0000","last_undegraded":"2024-02-21T22:52:52.233930+0000","last_fullsized":"2024-02-21T22:52:52.233930+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:36:16.855646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234410+0000","last_change":"2024-02-21T22:52:50.800936+0000","last_active":"2024-02-21T22:52:52.234410+0000","last_peered":"2024-02-21T22:52:52.234410+0000","last_clean":"2024-02-21T22:52:52.234410+0000","last_became_active":"2024-02-21T22:52:50.800431+0000","last_became_peered":"2024-02-21T22:52:50.800431+0000","last_unstale":"2024-02-21T22:52:52.234410+0000","last_undegraded":"2024-02-21T22:52:52.234410+0000","last_fullsized":"2024-02-21T22:52:52.234410+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:38:41.981414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234377+0000","last_change":"2024-02-21T22:52:50.805357+0000","last_active":"2024-02-21T22:52:52.234377+0000","last_peered":"2024-02-21T22:52:52.234377+0000","last_clean":"2024-02-21T22:52:52.234377+0000","last_became_active":"2024-02-21T22:52:50.805060+0000","last_became_peered":"2024-02-21T22:52:50.805060+0000","last_unstale":"2024-02-21T22:52:52.234377+0000","last_undegraded":"2024-02-21T22:52:52.234377+0000","last_fullsized":"2024-02-21T22:52:52.234377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:51:16.039745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234522+0000","last_change":"2024-02-21T22:52:50.797979+0000","last_active":"2024-02-21T22:52:52.234522+0000","last_peered":"2024-02-21T22:52:52.234522+0000","last_clean":"2024-02-21T22:52:52.234522+0000","last_became_active":"2024-02-21T22:52:50.797343+0000","last_became_peered":"2024-02-21T22:52:50.797343+0000","last_unstale":"2024-02-21T22:52:52.234522+0000","last_undegraded":"2024-02-21T22:52:52.234522+0000","last_fullsized":"2024-02-21T22:52:52.234522+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:25:14.399237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:51.795952+0000","last_change":"2024-02-21T22:52:50.797991+0000","last_active":"2024-02-21T22:52:51.795952+0000","last_peered":"2024-02-21T22:52:51.795952+0000","last_clean":"2024-02-21T22:52:51.795952+0000","last_became_active":"2024-02-21T22:52:50.797667+0000","last_became_peered":"2024-02-21T22:52:50.797667+0000","last_unstale":"2024-02-21T22:52:51.795952+0000","last_undegraded":"2024-02-21T22:52:51.795952+0000","last_fullsized":"2024-02-21T22:52:51.795952+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:33:40.513967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:51.792515+0000","last_change":"2024-02-21T22:52:50.788943+0000","last_active":"2024-02-21T22:52:51.792515+0000","last_peered":"2024-02-21T22:52:51.792515+0000","last_clean":"2024-02-21T22:52:51.792515+0000","last_became_active":"2024-02-21T22:52:50.788672+0000","last_became_peered":"2024-02-21T22:52:50.788672+0000","last_unstale":"2024-02-21T22:52:51.792515+0000","last_undegraded":"2024-02-21T22:52:51.792515+0000","last_fullsized":"2024-02-21T22:52:51.792515+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:25:58.111654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234510+0000","last_change":"2024-02-21T22:52:50.797663+0000","last_active":"2024-02-21T22:52:52.234510+0000","last_peered":"2024-02-21T22:52:52.234510+0000","last_clean":"2024-02-21T22:52:52.234510+0000","last_became_active":"2024-02-21T22:52:50.797359+0000","last_became_peered":"2024-02-21T22:52:50.797359+0000","last_unstale":"2024-02-21T22:52:52.234510+0000","last_undegraded":"2024-02-21T22:52:52.234510+0000","last_fullsized":"2024-02-21T22:52:52.234510+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:36:16.855646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234239+0000","last_change":"2024-02-21T22:52:50.788672+0000","last_active":"2024-02-21T22:52:52.234239+0000","last_peered":"2024-02-21T22:52:52.234239+0000","last_clean":"2024-02-21T22:52:52.234239+0000","last_became_active":"2024-02-21T22:52:50.788413+0000","last_became_peered":"2024-02-21T22:52:50.788413+0000","last_unstale":"2024-02-21T22:52:52.234239+0000","last_undegraded":"2024-02-21T22:52:52.234239+0000","last_fullsized":"2024-02-21T22:52:52.234239+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:33:40.513967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234286+0000","last_change":"2024-02-21T22:52:50.808763+0000","last_active":"2024-02-21T22:52:52.234286+0000","last_peered":"2024-02-21T22:52:52.234286+0000","last_clean":"2024-02-21T22:52:52.234286+0000","last_became_active":"2024-02-21T22:52:50.805917+0000","last_became_peered":"2024-02-21T22:52:50.805917+0000","last_unstale":"2024-02-21T22:52:52.234286+0000","last_undegraded":"2024-02-21T22:52:52.234286+0000","last_fullsized":"2024-02-21T22:52:52.234286+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:39:55.210527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.233575+0000","last_change":"2024-02-21T22:52:50.799649+0000","last_active":"2024-02-21T22:52:52.233575+0000","last_peered":"2024-02-21T22:52:52.233575+0000","last_clean":"2024-02-21T22:52:52.233575+0000","last_became_active":"2024-02-21T22:52:50.799372+0000","last_became_peered":"2024-02-21T22:52:50.799372+0000","last_unstale":"2024-02-21T22:52:52.233575+0000","last_undegraded":"2024-02-21T22:52:52.233575+0000","last_fullsized":"2024-02-21T22:52:52.233575+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:20:01.491741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:51.795278+0000","last_change":"2024-02-21T22:52:50.789389+0000","last_active":"2024-02-21T22:52:51.795278+0000","last_peered":"2024-02-21T22:52:51.795278+0000","last_clean":"2024-02-21T22:52:51.795278+0000","last_became_active":"2024-02-21T22:52:50.789121+0000","last_became_peered":"2024-02-21T22:52:50.789121+0000","last_unstale":"2024-02-21T22:52:51.795278+0000","last_undegraded":"2024-02-21T22:52:51.795278+0000","last_fullsized":"2024-02-21T22:52:51.795278+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:58:42.676518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:51.794985+0000","last_change":"2024-02-21T22:52:50.792014+0000","last_active":"2024-02-21T22:52:51.794985+0000","last_peered":"2024-02-21T22:52:51.794985+0000","last_clean":"2024-02-21T22:52:51.794985+0000","last_became_active":"2024-02-21T22:52:50.790916+0000","last_became_peered":"2024-02-21T22:52:50.790916+0000","last_unstale":"2024-02-21T22:52:51.794985+0000","last_undegraded":"2024-02-21T22:52:51.794985+0000","last_fullsized":"2024-02-21T22:52:51.794985+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:04:04.768586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234516+0000","last_change":"2024-02-21T22:52:49.786296+0000","last_active":"2024-02-21T22:52:52.234516+0000","last_peered":"2024-02-21T22:52:52.234516+0000","last_clean":"2024-02-21T22:52:52.234516+0000","last_became_active":"2024-02-21T22:52:49.785971+0000","last_became_peered":"2024-02-21T22:52:49.785971+0000","last_unstale":"2024-02-21T22:52:52.234516+0000","last_undegraded":"2024-02-21T22:52:52.234516+0000","last_fullsized":"2024-02-21T22:52:52.234516+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:23:17.385208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234297+0000","last_change":"2024-02-21T22:52:50.802188+0000","last_active":"2024-02-21T22:52:52.234297+0000","last_peered":"2024-02-21T22:52:52.234297+0000","last_clean":"2024-02-21T22:52:52.234297+0000","last_became_active":"2024-02-21T22:52:50.801916+0000","last_became_peered":"2024-02-21T22:52:50.801916+0000","last_unstale":"2024-02-21T22:52:52.234297+0000","last_undegraded":"2024-02-21T22:52:52.234297+0000","last_fullsized":"2024-02-21T22:52:52.234297+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:10:56.108581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:51.795043+0000","last_change":"2024-02-21T22:52:49.789667+0000","last_active":"2024-02-21T22:52:51.795043+0000","last_peered":"2024-02-21T22:52:51.795043+0000","last_clean":"2024-02-21T22:52:51.795043+0000","last_became_active":"2024-02-21T22:52:49.789375+0000","last_became_peered":"2024-02-21T22:52:49.789375+0000","last_unstale":"2024-02-21T22:52:51.795043+0000","last_undegraded":"2024-02-21T22:52:51.795043+0000","last_fullsized":"2024-02-21T22:52:51.795043+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:04:03.761477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234559+0000","last_change":"2024-02-21T22:52:49.785301+0000","last_active":"2024-02-21T22:52:52.234559+0000","last_peered":"2024-02-21T22:52:52.234559+0000","last_clean":"2024-02-21T22:52:52.234559+0000","last_became_active":"2024-02-21T22:52:49.784975+0000","last_became_peered":"2024-02-21T22:52:49.784975+0000","last_unstale":"2024-02-21T22:52:52.234559+0000","last_undegraded":"2024-02-21T22:52:52.234559+0000","last_fullsized":"2024-02-21T22:52:52.234559+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:57:47.487172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.233732+0000","last_change":"2024-02-21T22:52:50.792749+0000","last_active":"2024-02-21T22:52:52.233732+0000","last_peered":"2024-02-21T22:52:52.233732+0000","last_clean":"2024-02-21T22:52:52.233732+0000","last_became_active":"2024-02-21T22:52:50.792219+0000","last_became_peered":"2024-02-21T22:52:50.792219+0000","last_unstale":"2024-02-21T22:52:52.233732+0000","last_undegraded":"2024-02-21T22:52:52.233732+0000","last_fullsized":"2024-02-21T22:52:52.233732+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T10:36:17.566817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234473+0000","last_change":"2024-02-21T22:52:49.789709+0000","last_active":"2024-02-21T22:52:52.234473+0000","last_peered":"2024-02-21T22:52:52.234473+0000","last_clean":"2024-02-21T22:52:52.234473+0000","last_became_active":"2024-02-21T22:52:49.789393+0000","last_became_peered":"2024-02-21T22:52:49.789393+0000","last_unstale":"2024-02-21T22:52:52.234473+0000","last_undegraded":"2024-02-21T22:52:52.234473+0000","last_fullsized":"2024-02-21T22:52:52.234473+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:04:03.761477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:51.792319+0000","last_change":"2024-02-21T22:52:50.789201+0000","last_active":"2024-02-21T22:52:51.792319+0000","last_peered":"2024-02-21T22:52:51.792319+0000","last_clean":"2024-02-21T22:52:51.792319+0000","last_became_active":"2024-02-21T22:52:50.787792+0000","last_became_peered":"2024-02-21T22:52:50.787792+0000","last_unstale":"2024-02-21T22:52:51.792319+0000","last_undegraded":"2024-02-21T22:52:51.792319+0000","last_fullsized":"2024-02-21T22:52:51.792319+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:49:26.881791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:51.795081+0000","last_change":"2024-02-21T22:52:49.791132+0000","last_active":"2024-02-21T22:52:51.795081+0000","last_peered":"2024-02-21T22:52:51.795081+0000","last_clean":"2024-02-21T22:52:51.795081+0000","last_became_active":"2024-02-21T22:52:49.790747+0000","last_became_peered":"2024-02-21T22:52:49.790747+0000","last_unstale":"2024-02-21T22:52:51.795081+0000","last_undegraded":"2024-02-21T22:52:51.795081+0000","last_fullsized":"2024-02-21T22:52:51.795081+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:57:47.487172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234358+0000","last_change":"2024-02-21T22:52:50.808244+0000","last_active":"2024-02-21T22:52:52.234358+0000","last_peered":"2024-02-21T22:52:52.234358+0000","last_clean":"2024-02-21T22:52:52.234358+0000","last_became_active":"2024-02-21T22:52:50.807811+0000","last_became_peered":"2024-02-21T22:52:50.807811+0000","last_unstale":"2024-02-21T22:52:52.234358+0000","last_undegraded":"2024-02-21T22:52:52.234358+0000","last_fullsized":"2024-02-21T22:52:52.234358+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:32:36.066162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234444+0000","last_change":"2024-02-21T22:52:49.792899+0000","last_active":"2024-02-21T22:52:52.234444+0000","last_peered":"2024-02-21T22:52:52.234444+0000","last_clean":"2024-02-21T22:52:52.234444+0000","last_became_active":"2024-02-21T22:52:49.792617+0000","last_became_peered":"2024-02-21T22:52:49.792617+0000","last_unstale":"2024-02-21T22:52:52.234444+0000","last_undegraded":"2024-02-21T22:52:52.234444+0000","last_fullsized":"2024-02-21T22:52:52.234444+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:06:28.817953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234067+0000","last_change":"2024-02-21T22:52:50.803201+0000","last_active":"2024-02-21T22:52:52.234067+0000","last_peered":"2024-02-21T22:52:52.234067+0000","last_clean":"2024-02-21T22:52:52.234067+0000","last_became_active":"2024-02-21T22:52:50.801870+0000","last_became_peered":"2024-02-21T22:52:50.801870+0000","last_unstale":"2024-02-21T22:52:52.234067+0000","last_undegraded":"2024-02-21T22:52:52.234067+0000","last_fullsized":"2024-02-21T22:52:52.234067+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:17:34.365402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:51.792522+0000","last_change":"2024-02-21T22:52:49.793191+0000","last_active":"2024-02-21T22:52:51.792522+0000","last_peered":"2024-02-21T22:52:51.792522+0000","last_clean":"2024-02-21T22:52:51.792522+0000","last_became_active":"2024-02-21T22:52:49.791992+0000","last_became_peered":"2024-02-21T22:52:49.791992+0000","last_unstale":"2024-02-21T22:52:51.792522+0000","last_undegraded":"2024-02-21T22:52:51.792522+0000","last_fullsized":"2024-02-21T22:52:51.792522+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:04:03.761477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:51.795759+0000","last_change":"2024-02-21T22:52:50.796850+0000","last_active":"2024-02-21T22:52:51.795759+0000","last_peered":"2024-02-21T22:52:51.795759+0000","last_clean":"2024-02-21T22:52:51.795759+0000","last_became_active":"2024-02-21T22:52:50.796589+0000","last_became_peered":"2024-02-21T22:52:50.796589+0000","last_unstale":"2024-02-21T22:52:51.795759+0000","last_undegraded":"2024-02-21T22:52:51.795759+0000","last_fullsized":"2024-02-21T22:52:51.795759+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:06:29.825061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:51.795352+0000","last_change":"2024-02-21T22:52:49.785392+0000","last_active":"2024-02-21T22:52:51.795352+0000","last_peered":"2024-02-21T22:52:51.795352+0000","last_clean":"2024-02-21T22:52:51.795352+0000","last_became_active":"2024-02-21T22:52:49.784936+0000","last_became_peered":"2024-02-21T22:52:49.784936+0000","last_unstale":"2024-02-21T22:52:51.795352+0000","last_undegraded":"2024-02-21T22:52:51.795352+0000","last_fullsized":"2024-02-21T22:52:51.795352+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:01:23.165721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234195+0000","last_change":"2024-02-21T22:52:50.793898+0000","last_active":"2024-02-21T22:52:52.234195+0000","last_peered":"2024-02-21T22:52:52.234195+0000","last_clean":"2024-02-21T22:52:52.234195+0000","last_became_active":"2024-02-21T22:52:50.793620+0000","last_became_peered":"2024-02-21T22:52:50.793620+0000","last_unstale":"2024-02-21T22:52:52.234195+0000","last_undegraded":"2024-02-21T22:52:52.234195+0000","last_fullsized":"2024-02-21T22:52:52.234195+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:13:03.777546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234350+0000","last_change":"2024-02-21T22:52:49.794586+0000","last_active":"2024-02-21T22:52:52.234350+0000","last_peered":"2024-02-21T22:52:52.234350+0000","last_clean":"2024-02-21T22:52:52.234350+0000","last_became_active":"2024-02-21T22:52:49.794288+0000","last_became_peered":"2024-02-21T22:52:49.794288+0000","last_unstale":"2024-02-21T22:52:52.234350+0000","last_undegraded":"2024-02-21T22:52:52.234350+0000","last_fullsized":"2024-02-21T22:52:52.234350+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:37:35.716112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.233964+0000","last_change":"2024-02-21T22:52:50.793467+0000","last_active":"2024-02-21T22:52:52.233964+0000","last_peered":"2024-02-21T22:52:52.233964+0000","last_clean":"2024-02-21T22:52:52.233964+0000","last_became_active":"2024-02-21T22:52:50.793160+0000","last_became_peered":"2024-02-21T22:52:50.793160+0000","last_unstale":"2024-02-21T22:52:52.233964+0000","last_undegraded":"2024-02-21T22:52:52.233964+0000","last_fullsized":"2024-02-21T22:52:52.233964+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T10:36:17.566817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234478+0000","last_change":"2024-02-21T22:52:49.793628+0000","last_active":"2024-02-21T22:52:52.234478+0000","last_peered":"2024-02-21T22:52:52.234478+0000","last_clean":"2024-02-21T22:52:52.234478+0000","last_became_active":"2024-02-21T22:52:49.793291+0000","last_became_peered":"2024-02-21T22:52:49.793291+0000","last_unstale":"2024-02-21T22:52:52.234478+0000","last_undegraded":"2024-02-21T22:52:52.234478+0000","last_fullsized":"2024-02-21T22:52:52.234478+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:29:57.623490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234378+0000","last_change":"2024-02-21T22:52:50.809208+0000","last_active":"2024-02-21T22:52:52.234378+0000","last_peered":"2024-02-21T22:52:52.234378+0000","last_clean":"2024-02-21T22:52:52.234378+0000","last_became_active":"2024-02-21T22:52:50.808950+0000","last_became_peered":"2024-02-21T22:52:50.808950+0000","last_unstale":"2024-02-21T22:52:52.234378+0000","last_undegraded":"2024-02-21T22:52:52.234378+0000","last_fullsized":"2024-02-21T22:52:52.234378+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:51:16.039745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:51.794655+0000","last_change":"2024-02-21T22:52:49.788987+0000","last_active":"2024-02-21T22:52:51.794655+0000","last_peered":"2024-02-21T22:52:51.794655+0000","last_clean":"2024-02-21T22:52:51.794655+0000","last_became_active":"2024-02-21T22:52:49.788704+0000","last_became_peered":"2024-02-21T22:52:49.788704+0000","last_unstale":"2024-02-21T22:52:51.794655+0000","last_undegraded":"2024-02-21T22:52:51.794655+0000","last_fullsized":"2024-02-21T22:52:51.794655+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T10:42:14.273761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:51.795107+0000","last_change":"2024-02-21T22:52:50.789680+0000","last_active":"2024-02-21T22:52:51.795107+0000","last_peered":"2024-02-21T22:52:51.795107+0000","last_clean":"2024-02-21T22:52:51.795107+0000","last_became_active":"2024-02-21T22:52:50.788648+0000","last_became_peered":"2024-02-21T22:52:50.788648+0000","last_unstale":"2024-02-21T22:52:51.795107+0000","last_undegraded":"2024-02-21T22:52:51.795107+0000","last_fullsized":"2024-02-21T22:52:51.795107+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:25:58.111654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.233423+0000","last_change":"2024-02-21T22:52:49.783735+0000","last_active":"2024-02-21T22:52:52.233423+0000","last_peered":"2024-02-21T22:52:52.233423+0000","last_clean":"2024-02-21T22:52:52.233423+0000","last_became_active":"2024-02-21T22:52:49.783350+0000","last_became_peered":"2024-02-21T22:52:49.783350+0000","last_unstale":"2024-02-21T22:52:52.233423+0000","last_undegraded":"2024-02-21T22:52:52.233423+0000","last_fullsized":"2024-02-21T22:52:52.233423+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:57:47.487172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.233816+0000","last_change":"2024-02-21T22:52:50.808882+0000","last_active":"2024-02-21T22:52:52.233816+0000","last_peered":"2024-02-21T22:52:52.233816+0000","last_clean":"2024-02-21T22:52:52.233816+0000","last_became_active":"2024-02-21T22:52:50.808584+0000","last_became_peered":"2024-02-21T22:52:50.808584+0000","last_unstale":"2024-02-21T22:52:52.233816+0000","last_undegraded":"2024-02-21T22:52:52.233816+0000","last_fullsized":"2024-02-21T22:52:52.233816+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:36:16.855646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:51.795199+0000","last_change":"2024-02-21T22:52:49.792856+0000","last_active":"2024-02-21T22:52:51.795199+0000","last_peered":"2024-02-21T22:52:51.795199+0000","last_clean":"2024-02-21T22:52:51.795199+0000","last_became_active":"2024-02-21T22:52:49.792509+0000","last_became_peered":"2024-02-21T22:52:49.792509+0000","last_unstale":"2024-02-21T22:52:51.795199+0000","last_undegraded":"2024-02-21T22:52:51.795199+0000","last_fullsized":"2024-02-21T22:52:51.795199+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:12:21.047751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234103+0000","last_change":"2024-02-21T22:52:50.808696+0000","last_active":"2024-02-21T22:52:52.234103+0000","last_peered":"2024-02-21T22:52:52.234103+0000","last_clean":"2024-02-21T22:52:52.234103+0000","last_became_active":"2024-02-21T22:52:50.808416+0000","last_became_peered":"2024-02-21T22:52:50.808416+0000","last_unstale":"2024-02-21T22:52:52.234103+0000","last_undegraded":"2024-02-21T22:52:52.234103+0000","last_fullsized":"2024-02-21T22:52:52.234103+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:02:22.212238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.233760+0000","last_change":"2024-02-21T22:52:49.789756+0000","last_active":"2024-02-21T22:52:52.233760+0000","last_peered":"2024-02-21T22:52:52.233760+0000","last_clean":"2024-02-21T22:52:52.233760+0000","last_became_active":"2024-02-21T22:52:49.789447+0000","last_became_peered":"2024-02-21T22:52:49.789447+0000","last_unstale":"2024-02-21T22:52:52.233760+0000","last_undegraded":"2024-02-21T22:52:52.233760+0000","last_fullsized":"2024-02-21T22:52:52.233760+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:01:23.165721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234491+0000","last_change":"2024-02-21T22:52:50.809468+0000","last_active":"2024-02-21T22:52:52.234491+0000","last_peered":"2024-02-21T22:52:52.234491+0000","last_clean":"2024-02-21T22:52:52.234491+0000","last_became_active":"2024-02-21T22:52:50.809053+0000","last_became_peered":"2024-02-21T22:52:50.809053+0000","last_unstale":"2024-02-21T22:52:52.234491+0000","last_undegraded":"2024-02-21T22:52:52.234491+0000","last_fullsized":"2024-02-21T22:52:52.234491+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:22:02.404664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:51.792607+0000","last_change":"2024-02-21T22:52:49.791174+0000","last_active":"2024-02-21T22:52:51.792607+0000","last_peered":"2024-02-21T22:52:51.792607+0000","last_clean":"2024-02-21T22:52:51.792607+0000","last_became_active":"2024-02-21T22:52:49.790885+0000","last_became_peered":"2024-02-21T22:52:49.790885+0000","last_unstale":"2024-02-21T22:52:51.792607+0000","last_undegraded":"2024-02-21T22:52:51.792607+0000","last_fullsized":"2024-02-21T22:52:51.792607+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:06:28.817953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234062+0000","last_change":"2024-02-21T22:52:50.802420+0000","last_active":"2024-02-21T22:52:52.234062+0000","last_peered":"2024-02-21T22:52:52.234062+0000","last_clean":"2024-02-21T22:52:52.234062+0000","last_became_active":"2024-02-21T22:52:50.801980+0000","last_became_peered":"2024-02-21T22:52:50.801980+0000","last_unstale":"2024-02-21T22:52:52.234062+0000","last_undegraded":"2024-02-21T22:52:52.234062+0000","last_fullsized":"2024-02-21T22:52:52.234062+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:02:22.212238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.233717+0000","last_change":"2024-02-21T22:52:49.787772+0000","last_active":"2024-02-21T22:52:52.233717+0000","last_peered":"2024-02-21T22:52:52.233717+0000","last_clean":"2024-02-21T22:52:52.233717+0000","last_became_active":"2024-02-21T22:52:49.787483+0000","last_became_peered":"2024-02-21T22:52:49.787483+0000","last_unstale":"2024-02-21T22:52:52.233717+0000","last_undegraded":"2024-02-21T22:52:52.233717+0000","last_fullsized":"2024-02-21T22:52:52.233717+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:04:03.761477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234346+0000","last_change":"2024-02-21T22:52:50.801710+0000","last_active":"2024-02-21T22:52:52.234346+0000","last_peered":"2024-02-21T22:52:52.234346+0000","last_clean":"2024-02-21T22:52:52.234346+0000","last_became_active":"2024-02-21T22:52:50.801446+0000","last_became_peered":"2024-02-21T22:52:50.801446+0000","last_unstale":"2024-02-21T22:52:52.234346+0000","last_undegraded":"2024-02-21T22:52:52.234346+0000","last_fullsized":"2024-02-21T22:52:52.234346+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:39:55.210527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":170,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.233578+0000","last_change":"2024-02-21T22:52:40.336187+0000","last_active":"2024-02-21T22:52:52.233578+0000","last_peered":"2024-02-21T22:52:52.233578+0000","last_clean":"2024-02-21T22:52:52.233578+0000","last_became_active":"2024-02-21T22:52:40.335061+0000","last_became_peered":"2024-02-21T22:52:40.335061+0000","last_unstale":"2024-02-21T22:52:52.233578+0000","last_undegraded":"2024-02-21T22:52:52.233578+0000","last_fullsized":"2024-02-21T22:52:52.233578+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:38.328863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:38.328863+0000","last_clean_scrub_stamp":"2024-02-21T22:52:38.328863+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:33:53.012414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.233685+0000","last_change":"2024-02-21T22:52:49.787124+0000","last_active":"2024-02-21T22:52:52.233685+0000","last_peered":"2024-02-21T22:52:52.233685+0000","last_clean":"2024-02-21T22:52:52.233685+0000","last_became_active":"2024-02-21T22:52:49.786800+0000","last_became_peered":"2024-02-21T22:52:49.786800+0000","last_unstale":"2024-02-21T22:52:52.233685+0000","last_undegraded":"2024-02-21T22:52:52.233685+0000","last_fullsized":"2024-02-21T22:52:52.233685+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:01:23.165721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.233943+0000","last_change":"2024-02-21T22:52:50.800508+0000","last_active":"2024-02-21T22:52:52.233943+0000","last_peered":"2024-02-21T22:52:52.233943+0000","last_clean":"2024-02-21T22:52:52.233943+0000","last_became_active":"2024-02-21T22:52:50.800215+0000","last_became_peered":"2024-02-21T22:52:50.800215+0000","last_unstale":"2024-02-21T22:52:52.233943+0000","last_undegraded":"2024-02-21T22:52:52.233943+0000","last_fullsized":"2024-02-21T22:52:52.233943+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:25:58.111654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.233509+0000","last_change":"2024-02-21T22:52:49.788881+0000","last_active":"2024-02-21T22:52:52.233509+0000","last_peered":"2024-02-21T22:52:52.233509+0000","last_clean":"2024-02-21T22:52:52.233509+0000","last_became_active":"2024-02-21T22:52:49.788611+0000","last_became_peered":"2024-02-21T22:52:49.788611+0000","last_unstale":"2024-02-21T22:52:52.233509+0000","last_undegraded":"2024-02-21T22:52:52.233509+0000","last_fullsized":"2024-02-21T22:52:52.233509+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T10:42:14.273761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.233594+0000","last_change":"2024-02-21T22:52:50.801343+0000","last_active":"2024-02-21T22:52:52.233594+0000","last_peered":"2024-02-21T22:52:52.233594+0000","last_clean":"2024-02-21T22:52:52.233594+0000","last_became_active":"2024-02-21T22:52:50.801029+0000","last_became_peered":"2024-02-21T22:52:50.801029+0000","last_unstale":"2024-02-21T22:52:52.233594+0000","last_undegraded":"2024-02-21T22:52:52.233594+0000","last_fullsized":"2024-02-21T22:52:52.233594+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:00:31.831396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.233662+0000","last_change":"2024-02-21T22:52:49.790068+0000","last_active":"2024-02-21T22:52:52.233662+0000","last_peered":"2024-02-21T22:52:52.233662+0000","last_clean":"2024-02-21T22:52:52.233662+0000","last_became_active":"2024-02-21T22:52:49.789766+0000","last_became_peered":"2024-02-21T22:52:49.789766+0000","last_unstale":"2024-02-21T22:52:52.233662+0000","last_undegraded":"2024-02-21T22:52:52.233662+0000","last_fullsized":"2024-02-21T22:52:52.233662+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T10:42:14.273761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:51.792345+0000","last_change":"2024-02-21T22:52:50.787018+0000","last_active":"2024-02-21T22:52:51.792345+0000","last_peered":"2024-02-21T22:52:51.792345+0000","last_clean":"2024-02-21T22:52:51.792345+0000","last_became_active":"2024-02-21T22:52:50.786695+0000","last_became_peered":"2024-02-21T22:52:50.786695+0000","last_unstale":"2024-02-21T22:52:51.792345+0000","last_undegraded":"2024-02-21T22:52:51.792345+0000","last_fullsized":"2024-02-21T22:52:51.792345+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T10:36:17.566817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234569+0000","last_change":"2024-02-21T22:52:49.789752+0000","last_active":"2024-02-21T22:52:52.234569+0000","last_peered":"2024-02-21T22:52:52.234569+0000","last_clean":"2024-02-21T22:52:52.234569+0000","last_became_active":"2024-02-21T22:52:49.789375+0000","last_became_peered":"2024-02-21T22:52:49.789375+0000","last_unstale":"2024-02-21T22:52:52.234569+0000","last_undegraded":"2024-02-21T22:52:52.234569+0000","last_fullsized":"2024-02-21T22:52:52.234569+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T10:42:14.273761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:51.795446+0000","last_change":"2024-02-21T22:52:50.791657+0000","last_active":"2024-02-21T22:52:51.795446+0000","last_peered":"2024-02-21T22:52:51.795446+0000","last_clean":"2024-02-21T22:52:51.795446+0000","last_became_active":"2024-02-21T22:52:50.791419+0000","last_became_peered":"2024-02-21T22:52:50.791419+0000","last_unstale":"2024-02-21T22:52:51.795446+0000","last_undegraded":"2024-02-21T22:52:51.795446+0000","last_fullsized":"2024-02-21T22:52:51.795446+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T10:42:15.280869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:51.792606+0000","last_change":"2024-02-21T22:52:49.793130+0000","last_active":"2024-02-21T22:52:51.792606+0000","last_peered":"2024-02-21T22:52:51.792606+0000","last_clean":"2024-02-21T22:52:51.792606+0000","last_became_active":"2024-02-21T22:52:49.792824+0000","last_became_peered":"2024-02-21T22:52:49.792824+0000","last_unstale":"2024-02-21T22:52:51.792606+0000","last_undegraded":"2024-02-21T22:52:51.792606+0000","last_fullsized":"2024-02-21T22:52:51.792606+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:01:23.165721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234113+0000","last_change":"2024-02-21T22:52:50.806582+0000","last_active":"2024-02-21T22:52:52.234113+0000","last_peered":"2024-02-21T22:52:52.234113+0000","last_clean":"2024-02-21T22:52:52.234113+0000","last_became_active":"2024-02-21T22:52:50.806257+0000","last_became_peered":"2024-02-21T22:52:50.806257+0000","last_unstale":"2024-02-21T22:52:52.234113+0000","last_undegraded":"2024-02-21T22:52:52.234113+0000","last_fullsized":"2024-02-21T22:52:52.234113+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:13:03.777546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234594+0000","last_change":"2024-02-21T22:52:49.793178+0000","last_active":"2024-02-21T22:52:52.234594+0000","last_peered":"2024-02-21T22:52:52.234594+0000","last_clean":"2024-02-21T22:52:52.234594+0000","last_became_active":"2024-02-21T22:52:49.792301+0000","last_became_peered":"2024-02-21T22:52:49.792301+0000","last_unstale":"2024-02-21T22:52:52.234594+0000","last_undegraded":"2024-02-21T22:52:52.234594+0000","last_fullsized":"2024-02-21T22:52:52.234594+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:53:50.332475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:51.792632+0000","last_change":"2024-02-21T22:52:50.785491+0000","last_active":"2024-02-21T22:52:51.792632+0000","last_peered":"2024-02-21T22:52:51.792632+0000","last_clean":"2024-02-21T22:52:51.792632+0000","last_became_active":"2024-02-21T22:52:50.785220+0000","last_became_peered":"2024-02-21T22:52:50.785220+0000","last_unstale":"2024-02-21T22:52:51.792632+0000","last_undegraded":"2024-02-21T22:52:51.792632+0000","last_fullsized":"2024-02-21T22:52:51.792632+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:33:40.513967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:51.796299+0000","last_change":"2024-02-21T22:52:49.787159+0000","last_active":"2024-02-21T22:52:51.796299+0000","last_peered":"2024-02-21T22:52:51.796299+0000","last_clean":"2024-02-21T22:52:51.796299+0000","last_became_active":"2024-02-21T22:52:49.786876+0000","last_became_peered":"2024-02-21T22:52:49.786876+0000","last_unstale":"2024-02-21T22:52:51.796299+0000","last_undegraded":"2024-02-21T22:52:51.796299+0000","last_fullsized":"2024-02-21T22:52:51.796299+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:20:00.484633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234594+0000","last_change":"2024-02-21T22:52:50.794174+0000","last_active":"2024-02-21T22:52:52.234594+0000","last_peered":"2024-02-21T22:52:52.234594+0000","last_clean":"2024-02-21T22:52:52.234594+0000","last_became_active":"2024-02-21T22:52:50.793881+0000","last_became_peered":"2024-02-21T22:52:50.793881+0000","last_unstale":"2024-02-21T22:52:52.234594+0000","last_undegraded":"2024-02-21T22:52:52.234594+0000","last_fullsized":"2024-02-21T22:52:52.234594+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:02:22.212238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:51.795185+0000","last_change":"2024-02-21T22:52:49.790424+0000","last_active":"2024-02-21T22:52:51.795185+0000","last_peered":"2024-02-21T22:52:51.795185+0000","last_clean":"2024-02-21T22:52:51.795185+0000","last_became_active":"2024-02-21T22:52:49.790147+0000","last_became_peered":"2024-02-21T22:52:49.790147+0000","last_unstale":"2024-02-21T22:52:51.795185+0000","last_undegraded":"2024-02-21T22:52:51.795185+0000","last_fullsized":"2024-02-21T22:52:51.795185+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:23:17.385208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.233852+0000","last_change":"2024-02-21T22:52:50.790678+0000","last_active":"2024-02-21T22:52:52.233852+0000","last_peered":"2024-02-21T22:52:52.233852+0000","last_clean":"2024-02-21T22:52:52.233852+0000","last_became_active":"2024-02-21T22:52:50.790415+0000","last_became_peered":"2024-02-21T22:52:50.790415+0000","last_unstale":"2024-02-21T22:52:52.233852+0000","last_undegraded":"2024-02-21T22:52:52.233852+0000","last_fullsized":"2024-02-21T22:52:52.233852+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:58:42.676518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.233605+0000","last_change":"2024-02-21T22:52:49.794656+0000","last_active":"2024-02-21T22:52:52.233605+0000","last_peered":"2024-02-21T22:52:52.233605+0000","last_clean":"2024-02-21T22:52:52.233605+0000","last_became_active":"2024-02-21T22:52:49.794394+0000","last_became_peered":"2024-02-21T22:52:49.794394+0000","last_unstale":"2024-02-21T22:52:52.233605+0000","last_undegraded":"2024-02-21T22:52:52.233605+0000","last_fullsized":"2024-02-21T22:52:52.233605+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:29:57.623490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:51.795821+0000","last_change":"2024-02-21T22:52:50.792184+0000","last_active":"2024-02-21T22:52:51.795821+0000","last_peered":"2024-02-21T22:52:51.795821+0000","last_clean":"2024-02-21T22:52:51.795821+0000","last_became_active":"2024-02-21T22:52:50.791180+0000","last_became_peered":"2024-02-21T22:52:50.791180+0000","last_unstale":"2024-02-21T22:52:51.795821+0000","last_undegraded":"2024-02-21T22:52:51.795821+0000","last_fullsized":"2024-02-21T22:52:51.795821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:20:01.491741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:51.792408+0000","last_change":"2024-02-21T22:52:49.791409+0000","last_active":"2024-02-21T22:52:51.792408+0000","last_peered":"2024-02-21T22:52:51.792408+0000","last_clean":"2024-02-21T22:52:51.792408+0000","last_became_active":"2024-02-21T22:52:49.791124+0000","last_became_peered":"2024-02-21T22:52:49.791124+0000","last_unstale":"2024-02-21T22:52:51.792408+0000","last_undegraded":"2024-02-21T22:52:51.792408+0000","last_fullsized":"2024-02-21T22:52:51.792408+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T10:42:14.273761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.233884+0000","last_change":"2024-02-21T22:52:50.790359+0000","last_active":"2024-02-21T22:52:52.233884+0000","last_peered":"2024-02-21T22:52:52.233884+0000","last_clean":"2024-02-21T22:52:52.233884+0000","last_became_active":"2024-02-21T22:52:50.790083+0000","last_became_peered":"2024-02-21T22:52:50.790083+0000","last_unstale":"2024-02-21T22:52:52.233884+0000","last_undegraded":"2024-02-21T22:52:52.233884+0000","last_fullsized":"2024-02-21T22:52:52.233884+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:17:34.365402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:51.792512+0000","last_change":"2024-02-21T22:52:49.786337+0000","last_active":"2024-02-21T22:52:51.792512+0000","last_peered":"2024-02-21T22:52:51.792512+0000","last_clean":"2024-02-21T22:52:51.792512+0000","last_became_active":"2024-02-21T22:52:49.786058+0000","last_became_peered":"2024-02-21T22:52:49.786058+0000","last_unstale":"2024-02-21T22:52:51.792512+0000","last_undegraded":"2024-02-21T22:52:51.792512+0000","last_fullsized":"2024-02-21T22:52:51.792512+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:29:57.623490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234482+0000","last_change":"2024-02-21T22:52:50.792676+0000","last_active":"2024-02-21T22:52:52.234482+0000","last_peered":"2024-02-21T22:52:52.234482+0000","last_clean":"2024-02-21T22:52:52.234482+0000","last_became_active":"2024-02-21T22:52:50.792330+0000","last_became_peered":"2024-02-21T22:52:50.792330+0000","last_unstale":"2024-02-21T22:52:52.234482+0000","last_undegraded":"2024-02-21T22:52:52.234482+0000","last_fullsized":"2024-02-21T22:52:52.234482+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T02:49:51.875007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234484+0000","last_change":"2024-02-21T22:52:49.791921+0000","last_active":"2024-02-21T22:52:52.234484+0000","last_peered":"2024-02-21T22:52:52.234484+0000","last_clean":"2024-02-21T22:52:52.234484+0000","last_became_active":"2024-02-21T22:52:49.791614+0000","last_became_peered":"2024-02-21T22:52:49.791614+0000","last_unstale":"2024-02-21T22:52:52.234484+0000","last_undegraded":"2024-02-21T22:52:52.234484+0000","last_fullsized":"2024-02-21T22:52:52.234484+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:06:28.817953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:51.794942+0000","last_change":"2024-02-21T22:52:50.794820+0000","last_active":"2024-02-21T22:52:51.794942+0000","last_peered":"2024-02-21T22:52:51.794942+0000","last_clean":"2024-02-21T22:52:51.794942+0000","last_became_active":"2024-02-21T22:52:50.794504+0000","last_became_peered":"2024-02-21T22:52:50.794504+0000","last_unstale":"2024-02-21T22:52:51.794942+0000","last_undegraded":"2024-02-21T22:52:51.794942+0000","last_fullsized":"2024-02-21T22:52:51.794942+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:17:34.365402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.233975+0000","last_change":"2024-02-21T22:52:50.806225+0000","last_active":"2024-02-21T22:52:52.233975+0000","last_peered":"2024-02-21T22:52:52.233975+0000","last_clean":"2024-02-21T22:52:52.233975+0000","last_became_active":"2024-02-21T22:52:50.805867+0000","last_became_peered":"2024-02-21T22:52:50.805867+0000","last_unstale":"2024-02-21T22:52:52.233975+0000","last_undegraded":"2024-02-21T22:52:52.233975+0000","last_fullsized":"2024-02-21T22:52:52.233975+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:25:14.399237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234362+0000","last_change":"2024-02-21T22:52:49.791427+0000","last_active":"2024-02-21T22:52:52.234362+0000","last_peered":"2024-02-21T22:52:52.234362+0000","last_clean":"2024-02-21T22:52:52.234362+0000","last_became_active":"2024-02-21T22:52:49.790879+0000","last_became_peered":"2024-02-21T22:52:49.790879+0000","last_unstale":"2024-02-21T22:52:52.234362+0000","last_undegraded":"2024-02-21T22:52:52.234362+0000","last_fullsized":"2024-02-21T22:52:52.234362+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:20:00.484633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234211+0000","last_change":"2024-02-21T22:52:50.804074+0000","last_active":"2024-02-21T22:52:52.234211+0000","last_peered":"2024-02-21T22:52:52.234211+0000","last_clean":"2024-02-21T22:52:52.234211+0000","last_became_active":"2024-02-21T22:52:50.803759+0000","last_became_peered":"2024-02-21T22:52:50.803759+0000","last_unstale":"2024-02-21T22:52:52.234211+0000","last_undegraded":"2024-02-21T22:52:52.234211+0000","last_fullsized":"2024-02-21T22:52:52.234211+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:06:29.082788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234445+0000","last_change":"2024-02-21T22:52:49.790281+0000","last_active":"2024-02-21T22:52:52.234445+0000","last_peered":"2024-02-21T22:52:52.234445+0000","last_clean":"2024-02-21T22:52:52.234445+0000","last_became_active":"2024-02-21T22:52:49.790023+0000","last_became_peered":"2024-02-21T22:52:49.790023+0000","last_unstale":"2024-02-21T22:52:52.234445+0000","last_undegraded":"2024-02-21T22:52:52.234445+0000","last_fullsized":"2024-02-21T22:52:52.234445+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:31:50.557983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.233936+0000","last_change":"2024-02-21T22:52:50.801839+0000","last_active":"2024-02-21T22:52:52.233936+0000","last_peered":"2024-02-21T22:52:52.233936+0000","last_clean":"2024-02-21T22:52:52.233936+0000","last_became_active":"2024-02-21T22:52:50.801499+0000","last_became_peered":"2024-02-21T22:52:50.801499+0000","last_unstale":"2024-02-21T22:52:52.233936+0000","last_undegraded":"2024-02-21T22:52:52.233936+0000","last_fullsized":"2024-02-21T22:52:52.233936+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:49:26.881791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234190+0000","last_change":"2024-02-21T22:52:49.792448+0000","last_active":"2024-02-21T22:52:52.234190+0000","last_peered":"2024-02-21T22:52:52.234190+0000","last_clean":"2024-02-21T22:52:52.234190+0000","last_became_active":"2024-02-21T22:52:49.792116+0000","last_became_peered":"2024-02-21T22:52:49.792116+0000","last_unstale":"2024-02-21T22:52:52.234190+0000","last_undegraded":"2024-02-21T22:52:52.234190+0000","last_fullsized":"2024-02-21T22:52:52.234190+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:34:55.953292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234013+0000","last_change":"2024-02-21T22:52:50.791072+0000","last_active":"2024-02-21T22:52:52.234013+0000","last_peered":"2024-02-21T22:52:52.234013+0000","last_clean":"2024-02-21T22:52:52.234013+0000","last_became_active":"2024-02-21T22:52:50.790784+0000","last_became_peered":"2024-02-21T22:52:50.790784+0000","last_unstale":"2024-02-21T22:52:52.234013+0000","last_undegraded":"2024-02-21T22:52:52.234013+0000","last_fullsized":"2024-02-21T22:52:52.234013+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:33:40.513967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234149+0000","last_change":"2024-02-21T22:52:49.792852+0000","last_active":"2024-02-21T22:52:52.234149+0000","last_peered":"2024-02-21T22:52:52.234149+0000","last_clean":"2024-02-21T22:52:52.234149+0000","last_became_active":"2024-02-21T22:52:49.792580+0000","last_became_peered":"2024-02-21T22:52:49.792580+0000","last_unstale":"2024-02-21T22:52:52.234149+0000","last_undegraded":"2024-02-21T22:52:52.234149+0000","last_fullsized":"2024-02-21T22:52:52.234149+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:34:55.953292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":802816,"data_stored":661884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":208896,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":71060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":70934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":212992,"data_stored":71094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":811008,"data_stored":661940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-21T22:52:58.443 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-02-21T22:52:58.443 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-02-21T22:52:58.444 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-02-21T22:52:58.444 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-02-21T22:52:58.444 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-02-21T22:52:58.580 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.590+0000 7ff970aa2640 1 Processor -- start 2024-02-21T22:52:58.580 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.590+0000 7ff970aa2640 1 -- start start 2024-02-21T22:52:58.582 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.590+0000 7ff970aa2640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff96c15c190 0x7ff96c0cfcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:58.582 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.590+0000 7ff970aa2640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7ff96c0cc990 0x7ff96c15fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:58.582 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.590+0000 7ff970aa2640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff96c0cf530 con 0x7ff96c0d28d0 2024-02-21T22:52:58.582 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.590+0000 7ff970aa2640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff96c0b2d50 con 0x7ff96c0cc990 2024-02-21T22:52:58.582 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.590+0000 7ff970aa2640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff96c0b3310 con 0x7ff96c15c190 2024-02-21T22:52:58.582 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.590+0000 7ff963fff640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7ff96c0cc990 0x7ff96c15fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:58.582 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.590+0000 7ff96ad9d640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7ff96c0d28d0 0x7ff96c0b1540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:50870/0 (socket says 172.21.15.116:50870) 2024-02-21T22:52:58.582 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.591+0000 7ff96ad9d640 1 -- 172.21.15.116:0/2325252902 learned_addr learned my addr 172.21.15.116:0/2325252902 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-02-21T22:52:58.582 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.591+0000 7ff96a59c640 1 --2- 172.21.15.116:0/2325252902 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff96c15c190 0x7ff96c0cfcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:58.583 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.591+0000 7ff963fff640 1 -- 172.21.15.116:0/2325252902 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff96c15c190 msgr2=0x7ff96c0cfcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:52:58.583 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.591+0000 7ff963fff640 1 --2- 172.21.15.116:0/2325252902 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff96c15c190 0x7ff96c0cfcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:58.583 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.591+0000 7ff963fff640 1 -- 172.21.15.116:0/2325252902 >> v1:172.21.15.116:6789/0 conn(0x7ff96c0d28d0 legacy=0x7ff96c0b1540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:58.583 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.591+0000 7ff963fff640 1 -- 172.21.15.116:0/2325252902 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff96c0b26d0 con 0x7ff96c0cc990 2024-02-21T22:52:58.583 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.591+0000 7ff969d9b640 1 -- 172.21.15.116:0/2325252902 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1506018084 0 0) 0x7ff964001490 con 0x7ff96c0d28d0 2024-02-21T22:52:58.583 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.591+0000 7ff963fff640 1 --2- 172.21.15.116:0/2325252902 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff96c0cc990 0x7ff96c15fe20 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ff9540097a0 tx=0x7ff95402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76ea3f74be30f90b server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:52:58.583 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.592+0000 7ff969d9b640 1 -- 172.21.15.116:0/2325252902 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff954035020 con 0x7ff96c0cc990 2024-02-21T22:52:58.583 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.592+0000 7ff969d9b640 1 -- 172.21.15.116:0/2325252902 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff954031830 con 0x7ff96c0cc990 2024-02-21T22:52:58.583 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.592+0000 7ff969d9b640 1 -- 172.21.15.116:0/2325252902 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff954031c00 con 0x7ff96c0cc990 2024-02-21T22:52:58.586 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.592+0000 7ff970aa2640 1 -- 172.21.15.116:0/2325252902 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff96c0cc990 msgr2=0x7ff96c15fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:58.586 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.592+0000 7ff970aa2640 1 --2- 172.21.15.116:0/2325252902 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff96c0cc990 0x7ff96c15fe20 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ff9540097a0 tx=0x7ff95402b8d0 comp rx=0 tx=0).stop 2024-02-21T22:52:58.586 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.592+0000 7ff970aa2640 1 -- 172.21.15.116:0/2325252902 shutdown_connections 2024-02-21T22:52:58.586 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.592+0000 7ff970aa2640 1 --2- 172.21.15.116:0/2325252902 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff96c0cc990 0x7ff96c15fe20 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:58.586 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.592+0000 7ff970aa2640 1 --2- 172.21.15.116:0/2325252902 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff96c15c190 0x7ff96c0cfcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:58.586 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.592+0000 7ff970aa2640 1 -- 172.21.15.116:0/2325252902 >> 172.21.15.116:0/2325252902 conn(0x7ff96c0d1be0 msgr2=0x7ff96c0d1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:52:58.587 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.592+0000 7ff970aa2640 1 -- 172.21.15.116:0/2325252902 shutdown_connections 2024-02-21T22:52:58.587 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.592+0000 7ff970aa2640 1 -- 172.21.15.116:0/2325252902 wait complete. 2024-02-21T22:52:58.587 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.593+0000 7ff970aa2640 1 Processor -- start 2024-02-21T22:52:58.587 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.594+0000 7ff970aa2640 1 -- start start 2024-02-21T22:52:58.587 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.594+0000 7ff970aa2640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff96c0cc990 0x7ff96c1f5b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:58.587 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.594+0000 7ff970aa2640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff96c0d28d0 0x7ff96c151290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:58.587 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.594+0000 7ff970aa2640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff96c15c190 0x7ff96c1f1c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:58.587 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.594+0000 7ff970aa2640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff96c0b2fa0 con 0x7ff96c0d28d0 2024-02-21T22:52:58.587 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.594+0000 7ff970aa2640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff96c0d0230 con 0x7ff96c0cc990 2024-02-21T22:52:58.587 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.594+0000 7ff970aa2640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff96c15c570 con 0x7ff96c15c190 2024-02-21T22:52:58.587 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.594+0000 7ff963fff640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff96c0d28d0 0x7ff96c151290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:58.587 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.594+0000 7ff963fff640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff96c0d28d0 0x7ff96c151290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:34074/0 (socket says 172.21.15.116:34074) 2024-02-21T22:52:58.587 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.594+0000 7ff963fff640 1 -- 172.21.15.116:0/4008420373 learned_addr learned my addr 172.21.15.116:0/4008420373 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:52:58.587 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.594+0000 7ff96a59c640 1 --2- 172.21.15.116:0/4008420373 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff96c0cc990 0x7ff96c1f5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:58.587 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.594+0000 7ff96ad9d640 1 --2- 172.21.15.116:0/4008420373 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff96c15c190 0x7ff96c1f1c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:58.588 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.595+0000 7ff963fff640 1 -- 172.21.15.116:0/4008420373 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff96c15c190 msgr2=0x7ff96c1f1c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:58.588 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.595+0000 7ff963fff640 1 --2- 172.21.15.116:0/4008420373 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff96c15c190 0x7ff96c1f1c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:58.588 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.595+0000 7ff963fff640 1 -- 172.21.15.116:0/4008420373 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff96c0cc990 msgr2=0x7ff96c1f5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:58.588 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.595+0000 7ff963fff640 1 --2- 172.21.15.116:0/4008420373 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff96c0cc990 0x7ff96c1f5b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:58.588 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.595+0000 7ff963fff640 1 -- 172.21.15.116:0/4008420373 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff96c1f60c0 con 0x7ff96c0d28d0 2024-02-21T22:52:58.588 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.595+0000 7ff963fff640 1 --2- 172.21.15.116:0/4008420373 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff96c0d28d0 0x7ff96c151290 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ff9540098c0 tx=0x7ff9540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:52:58.588 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.595+0000 7ff962ffd640 1 -- 172.21.15.116:0/4008420373 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff954041070 con 0x7ff96c0d28d0 2024-02-21T22:52:58.588 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.595+0000 7ff962ffd640 1 -- 172.21.15.116:0/4008420373 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff95403b920 con 0x7ff96c0d28d0 2024-02-21T22:52:58.588 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.595+0000 7ff962ffd640 1 -- 172.21.15.116:0/4008420373 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff954035040 con 0x7ff96c0d28d0 2024-02-21T22:52:58.588 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.595+0000 7ff970aa2640 1 -- 172.21.15.116:0/4008420373 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff96c1f25d0 con 0x7ff96c0d28d0 2024-02-21T22:52:58.588 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.595+0000 7ff970aa2640 1 -- 172.21.15.116:0/4008420373 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff96c1f5380 con 0x7ff96c0d28d0 2024-02-21T22:52:58.589 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.596+0000 7ff970aa2640 1 -- 172.21.15.116:0/4008420373 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff96c0752f0 con 0x7ff96c0d28d0 2024-02-21T22:52:58.589 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.596+0000 7ff962ffd640 1 -- 172.21.15.116:0/4008420373 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ff95404c060 con 0x7ff96c0d28d0 2024-02-21T22:52:58.589 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.597+0000 7ff962ffd640 1 --2- 172.21.15.116:0/4008420373 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7ff94c06b4d0 0x7ff94c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:58.589 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.597+0000 7ff962ffd640 1 -- 172.21.15.116:0/4008420373 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff9540ab960 con 0x7ff96c0d28d0 2024-02-21T22:52:58.589 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.597+0000 7ff96a59c640 1 --2- 172.21.15.116:0/4008420373 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7ff94c06b4d0 0x7ff94c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:58.590 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.597+0000 7ff96a59c640 1 --2- 172.21.15.116:0/4008420373 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7ff94c06b4d0 0x7ff94c06d990 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ff95c009aa0 tx=0x7ff95c009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:52:58.591 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.601+0000 7ff962ffd640 1 -- 172.21.15.116:0/4008420373 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7ff954031800 con 0x7ff96c0d28d0 2024-02-21T22:52:58.810 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.819+0000 7ff970aa2640 1 -- 172.21.15.116:0/4008420373 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7ff96c0b7b60 con 0x7ff96c0d28d0 2024-02-21T22:52:58.812 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.822+0000 7ff962ffd640 1 -- 172.21.15.116:0/4008420373 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+171792 (secure 0 0 0) 0x7ff95407a220 con 0x7ff96c0d28d0 2024-02-21T22:52:58.815 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-02-21T22:52:58.817 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.824+0000 7ff970aa2640 1 -- 172.21.15.116:0/4008420373 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7ff94c06b4d0 msgr2=0x7ff94c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:58.817 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.824+0000 7ff970aa2640 1 --2- 172.21.15.116:0/4008420373 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7ff94c06b4d0 0x7ff94c06d990 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ff95c009aa0 tx=0x7ff95c009190 comp rx=0 tx=0).stop 2024-02-21T22:52:58.817 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.824+0000 7ff970aa2640 1 -- 172.21.15.116:0/4008420373 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff96c0d28d0 msgr2=0x7ff96c151290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:58.817 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.824+0000 7ff970aa2640 1 --2- 172.21.15.116:0/4008420373 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff96c0d28d0 0x7ff96c151290 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ff9540098c0 tx=0x7ff9540046c0 comp rx=0 tx=0).stop 2024-02-21T22:52:58.817 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.824+0000 7ff970aa2640 1 -- 172.21.15.116:0/4008420373 shutdown_connections 2024-02-21T22:52:58.818 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.824+0000 7ff970aa2640 1 --2- 172.21.15.116:0/4008420373 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7ff94c06b4d0 0x7ff94c06d990 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:58.818 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.824+0000 7ff970aa2640 1 --2- 172.21.15.116:0/4008420373 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff96c15c190 0x7ff96c1f1c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:58.818 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.824+0000 7ff970aa2640 1 --2- 172.21.15.116:0/4008420373 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff96c0d28d0 0x7ff96c151290 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:58.818 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.824+0000 7ff970aa2640 1 --2- 172.21.15.116:0/4008420373 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff96c0cc990 0x7ff96c1f5b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:58.818 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.824+0000 7ff970aa2640 1 -- 172.21.15.116:0/4008420373 >> 172.21.15.116:0/4008420373 conn(0x7ff96c0d1be0 msgr2=0x7ff96c06eb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:52:58.818 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.824+0000 7ff970aa2640 1 -- 172.21.15.116:0/4008420373 shutdown_connections 2024-02-21T22:52:58.818 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.824+0000 7ff970aa2640 1 -- 172.21.15.116:0/4008420373 wait complete. 2024-02-21T22:52:58.825 INFO:teuthology.orchestra.run.smithi116.stdout:{"epoch":5,"flags":0,"active_gid":4103,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":1381484782},{"type":"v1","addr":"172.21.15.142:6833","nonce":1381484782}]},"active_addr":"172.21.15.142:6833/1381484782","active_change":"2024-02-21T22:52:30.277014+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4110,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.142:0","nonce":2363620440}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.142:0","nonce":4241881468}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.142:0","nonce":3706975556}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.142:0","nonce":3977934474}]}]} 2024-02-21T22:52:58.829 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-02-21T22:52:58.829 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-02-21T22:52:58.829 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-21T22:52:58.929 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.939+0000 7f4193181640 1 Processor -- start 2024-02-21T22:52:58.929 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.939+0000 7f4193181640 1 -- start start 2024-02-21T22:52:58.930 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.939+0000 7f4193181640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f418c15c190 0x7f418c0cfcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:58.931 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.939+0000 7f4193181640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f418c0b26d0 con 0x7f418c160530 2024-02-21T22:52:58.931 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.939+0000 7f4193181640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f418c0b29b0 con 0x7f418c0cc990 2024-02-21T22:52:58.931 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.939+0000 7f4193181640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f418c0b2d50 con 0x7f418c15c190 2024-02-21T22:52:58.931 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.940+0000 7f4190f1d640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f418c15c190 0x7f418c0cfcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:58.931 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.940+0000 7f419171e640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f418c160530 0x7f418c0ce520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:50880/0 (socket says 172.21.15.116:50880) 2024-02-21T22:52:58.931 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.940+0000 7f419171e640 1 -- 172.21.15.116:0/4228555152 learned_addr learned my addr 172.21.15.116:0/4228555152 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-02-21T22:52:58.931 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.940+0000 7f4190f1d640 1 -- 172.21.15.116:0/4228555152 >> v1:172.21.15.142:6789/0 conn(0x7f418c0cc990 legacy=0x7f418c15fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:58.931 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.940+0000 7f4190f1d640 1 -- 172.21.15.116:0/4228555152 >> v1:172.21.15.116:6789/0 conn(0x7f418c160530 legacy=0x7f418c0ce520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:58.931 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.940+0000 7f41837fe640 1 -- 172.21.15.116:0/4228555152 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2122429234 0 0) 0x7f418c0b29b0 con 0x7f418c0cc990 2024-02-21T22:52:58.931 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.940+0000 7f4190f1d640 1 -- 172.21.15.116:0/4228555152 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f418c0b2fa0 con 0x7f418c15c190 2024-02-21T22:52:58.933 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.941+0000 7f4190f1d640 1 --2- 172.21.15.116:0/4228555152 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f418c15c190 0x7f418c0cfcf0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f41880097a0 tx=0x7f418802b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4489bca5cb5a853d server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:52:58.933 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.941+0000 7f41837fe640 1 -- 172.21.15.116:0/4228555152 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4188037070 con 0x7f418c15c190 2024-02-21T22:52:58.933 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.941+0000 7f41837fe640 1 -- 172.21.15.116:0/4228555152 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4188030710 con 0x7f418c15c190 2024-02-21T22:52:58.933 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.941+0000 7f41837fe640 1 -- 172.21.15.116:0/4228555152 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4188030ae0 con 0x7f418c15c190 2024-02-21T22:52:58.933 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.941+0000 7f4193181640 1 -- 172.21.15.116:0/4228555152 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f418c15c190 msgr2=0x7f418c0cfcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:58.933 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.941+0000 7f4193181640 1 --2- 172.21.15.116:0/4228555152 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f418c15c190 0x7f418c0cfcf0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f41880097a0 tx=0x7f418802b790 comp rx=0 tx=0).stop 2024-02-21T22:52:58.933 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.941+0000 7f4193181640 1 -- 172.21.15.116:0/4228555152 shutdown_connections 2024-02-21T22:52:58.933 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.941+0000 7f4193181640 1 --2- 172.21.15.116:0/4228555152 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f418c15c190 0x7f418c0cfcf0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:58.933 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.941+0000 7f4193181640 1 -- 172.21.15.116:0/4228555152 >> 172.21.15.116:0/4228555152 conn(0x7f418c0d1be0 msgr2=0x7f418c0d1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:52:58.933 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.941+0000 7f4193181640 1 -- 172.21.15.116:0/4228555152 shutdown_connections 2024-02-21T22:52:58.933 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.941+0000 7f4193181640 1 -- 172.21.15.116:0/4228555152 wait complete. 2024-02-21T22:52:58.934 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.942+0000 7f4193181640 1 Processor -- start 2024-02-21T22:52:58.934 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.942+0000 7f4193181640 1 -- start start 2024-02-21T22:52:58.936 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.943+0000 7f4193181640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f418c0cc990 0x7f418c15dca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:58.937 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.943+0000 7f4193181640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f418c15c190 0x7f418c15c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:58.937 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.943+0000 7f4193181640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f418c160530 0x7f418c0afdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:58.937 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.943+0000 7f4193181640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f418c0d0230 con 0x7f418c160530 2024-02-21T22:52:58.937 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.943+0000 7f4193181640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f418c0b3310 con 0x7f418c15c190 2024-02-21T22:52:58.937 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.943+0000 7f4193181640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f418c0d28d0 con 0x7f418c0cc990 2024-02-21T22:52:58.937 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.943+0000 7f419171e640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f418c160530 0x7f418c0afdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:58.937 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.943+0000 7f419171e640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f418c160530 0x7f418c0afdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:34094/0 (socket says 172.21.15.116:34094) 2024-02-21T22:52:58.937 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.943+0000 7f419171e640 1 -- 172.21.15.116:0/3773537760 learned_addr learned my addr 172.21.15.116:0/3773537760 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:52:58.937 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.943+0000 7f4190f1d640 1 --2- 172.21.15.116:0/3773537760 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f418c0cc990 0x7f418c15dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:58.937 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.943+0000 7f4183fff640 1 --2- 172.21.15.116:0/3773537760 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f418c15c190 0x7f418c15c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:58.937 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.944+0000 7f419171e640 1 -- 172.21.15.116:0/3773537760 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f418c0cc990 msgr2=0x7f418c15dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:58.937 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.944+0000 7f419171e640 1 --2- 172.21.15.116:0/3773537760 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f418c0cc990 0x7f418c15dca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:58.937 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.944+0000 7f419171e640 1 -- 172.21.15.116:0/3773537760 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f418c15c190 msgr2=0x7f418c15c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:58.937 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.944+0000 7f419171e640 1 --2- 172.21.15.116:0/3773537760 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f418c15c190 0x7f418c15c780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:58.938 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.944+0000 7f419171e640 1 -- 172.21.15.116:0/3773537760 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f418c15ccc0 con 0x7f418c160530 2024-02-21T22:52:58.938 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.944+0000 7f419171e640 1 --2- 172.21.15.116:0/3773537760 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f418c160530 0x7f418c0afdd0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f418400c8f0 tx=0x7f418400cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:52:58.938 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.944+0000 7f41817fa640 1 -- 172.21.15.116:0/3773537760 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4184018070 con 0x7f418c160530 2024-02-21T22:52:58.938 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.944+0000 7f41817fa640 1 -- 172.21.15.116:0/3773537760 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f418400a640 con 0x7f418c160530 2024-02-21T22:52:58.938 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.944+0000 7f4193181640 1 -- 172.21.15.116:0/3773537760 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f418c0c91b0 con 0x7f418c160530 2024-02-21T22:52:58.938 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.944+0000 7f41817fa640 1 -- 172.21.15.116:0/3773537760 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f418400aa30 con 0x7f418c160530 2024-02-21T22:52:58.938 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.944+0000 7f4193181640 1 -- 172.21.15.116:0/3773537760 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f418c0c9770 con 0x7f418c160530 2024-02-21T22:52:58.938 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.945+0000 7f4193181640 1 -- 172.21.15.116:0/3773537760 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f418c0752f0 con 0x7f418c160530 2024-02-21T22:52:58.938 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.945+0000 7f41817fa640 1 -- 172.21.15.116:0/3773537760 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f418401b070 con 0x7f418c160530 2024-02-21T22:52:58.938 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.946+0000 7f41817fa640 1 --2- 172.21.15.116:0/3773537760 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f417806b500 0x7f417806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:58.938 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.946+0000 7f41817fa640 1 -- 172.21.15.116:0/3773537760 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f41840897c0 con 0x7f418c160530 2024-02-21T22:52:58.938 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.946+0000 7f4190f1d640 1 --2- 172.21.15.116:0/3773537760 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f417806b500 0x7f417806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:58.938 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.946+0000 7f4190f1d640 1 --2- 172.21.15.116:0/3773537760 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f417806b500 0x7f417806d9c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f4188034000 tx=0x7f418802f000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:52:58.940 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:58.950+0000 7f41817fa640 1 -- 172.21.15.116:0/3773537760 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f4184057ff0 con 0x7f418c160530 2024-02-21T22:52:59.112 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.122+0000 7f4193181640 1 -- 172.21.15.116:0/3773537760 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f418c0b7b60 con 0x7f418c160530 2024-02-21T22:52:59.113 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.123+0000 7f41817fa640 1 -- 172.21.15.116:0/3773537760 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16653 (secure 0 0 0) 0x7f418405c090 con 0x7f418c160530 2024-02-21T22:52:59.113 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-02-21T22:52:59.114 INFO:teuthology.orchestra.run.smithi116.stdout:{"epoch":20,"fsid":"7c298660-5f63-4b5c-a800-58c5be9a8445","created":"2024-02-21T22:52:25.994613+0000","modified":"2024-02-21T22:52:51.786454+0000","last_up_change":"2024-02-21T22:52:37.313595+0000","last_in_change":"2024-02-21T22:52:28.176031+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-21T22:52:38.328796+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-21T22:52:48.145152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-21T22:52:49.096955+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4f09126b-b5e4-4876-8b08-f5cbb967388a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":1613202231},{"type":"v1","addr":"172.21.15.116:6809","nonce":1613202231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":1613202231},{"type":"v1","addr":"172.21.15.116:6811","nonce":1613202231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":1613202231},{"type":"v1","addr":"172.21.15.116:6815","nonce":1613202231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":1613202231},{"type":"v1","addr":"172.21.15.116:6813","nonce":1613202231}]},"public_addr":"172.21.15.116:6809/1613202231","cluster_addr":"172.21.15.116:6811/1613202231","heartbeat_back_addr":"172.21.15.116:6815/1613202231","heartbeat_front_addr":"172.21.15.116:6813/1613202231","state":["exists","up"]},{"osd":1,"uuid":"7272c51d-51f9-4536-931d-33ad7a4b377e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6816","nonce":172614746},{"type":"v1","addr":"172.21.15.116:6817","nonce":172614746}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":172614746},{"type":"v1","addr":"172.21.15.116:6819","nonce":172614746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":172614746},{"type":"v1","addr":"172.21.15.116:6823","nonce":172614746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":172614746},{"type":"v1","addr":"172.21.15.116:6821","nonce":172614746}]},"public_addr":"172.21.15.116:6817/172614746","cluster_addr":"172.21.15.116:6819/172614746","heartbeat_back_addr":"172.21.15.116:6823/172614746","heartbeat_front_addr":"172.21.15.116:6821/172614746","state":["exists","up"]},{"osd":2,"uuid":"2589616c-adf1-4187-aac3-735256cf624b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":1029280577},{"type":"v1","addr":"172.21.15.116:6825","nonce":1029280577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":1029280577},{"type":"v1","addr":"172.21.15.116:6827","nonce":1029280577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":1029280577},{"type":"v1","addr":"172.21.15.116:6831","nonce":1029280577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":1029280577},{"type":"v1","addr":"172.21.15.116:6829","nonce":1029280577}]},"public_addr":"172.21.15.116:6825/1029280577","cluster_addr":"172.21.15.116:6827/1029280577","heartbeat_back_addr":"172.21.15.116:6831/1029280577","heartbeat_front_addr":"172.21.15.116:6829/1029280577","state":["exists","up"]},{"osd":3,"uuid":"0fd2e563-7c5b-46f6-82c2-b60c86072c93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":3106627557},{"type":"v1","addr":"172.21.15.116:6801","nonce":3106627557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":3106627557},{"type":"v1","addr":"172.21.15.116:6803","nonce":3106627557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":3106627557},{"type":"v1","addr":"172.21.15.116:6807","nonce":3106627557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":3106627557},{"type":"v1","addr":"172.21.15.116:6805","nonce":3106627557}]},"public_addr":"172.21.15.116:6801/3106627557","cluster_addr":"172.21.15.116:6803/3106627557","heartbeat_back_addr":"172.21.15.116:6807/3106627557","heartbeat_front_addr":"172.21.15.116:6805/3106627557","state":["exists","up"]},{"osd":4,"uuid":"79ae35b7-dda8-4ab8-96ce-47515afde082","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":3231407772},{"type":"v1","addr":"172.21.15.142:6825","nonce":3231407772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":3231407772},{"type":"v1","addr":"172.21.15.142:6827","nonce":3231407772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":3231407772},{"type":"v1","addr":"172.21.15.142:6831","nonce":3231407772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":3231407772},{"type":"v1","addr":"172.21.15.142:6829","nonce":3231407772}]},"public_addr":"172.21.15.142:6825/3231407772","cluster_addr":"172.21.15.142:6827/3231407772","heartbeat_back_addr":"172.21.15.142:6831/3231407772","heartbeat_front_addr":"172.21.15.142:6829/3231407772","state":["exists","up"]},{"osd":5,"uuid":"3166eb2c-3fcf-41c8-9362-45bafaabaa39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":1184158716},{"type":"v1","addr":"172.21.15.142:6817","nonce":1184158716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":1184158716},{"type":"v1","addr":"172.21.15.142:6819","nonce":1184158716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":1184158716},{"type":"v1","addr":"172.21.15.142:6823","nonce":1184158716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":1184158716},{"type":"v1","addr":"172.21.15.142:6821","nonce":1184158716}]},"public_addr":"172.21.15.142:6817/1184158716","cluster_addr":"172.21.15.142:6819/1184158716","heartbeat_back_addr":"172.21.15.142:6823/1184158716","heartbeat_front_addr":"172.21.15.142:6821/1184158716","state":["exists","up"]},{"osd":6,"uuid":"f9aa9672-7527-43e2-963e-b61868e5e63f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":1987868911},{"type":"v1","addr":"172.21.15.142:6801","nonce":1987868911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":1987868911},{"type":"v1","addr":"172.21.15.142:6803","nonce":1987868911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":1987868911},{"type":"v1","addr":"172.21.15.142:6807","nonce":1987868911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":1987868911},{"type":"v1","addr":"172.21.15.142:6805","nonce":1987868911}]},"public_addr":"172.21.15.142:6801/1987868911","cluster_addr":"172.21.15.142:6803/1987868911","heartbeat_back_addr":"172.21.15.142:6807/1987868911","heartbeat_front_addr":"172.21.15.142:6805/1987868911","state":["exists","up"]},{"osd":7,"uuid":"7ed29226-fc42-4382-a91a-fa50f7ec5426","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":1272081937},{"type":"v1","addr":"172.21.15.142:6809","nonce":1272081937}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":1272081937},{"type":"v1","addr":"172.21.15.142:6811","nonce":1272081937}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":1272081937},{"type":"v1","addr":"172.21.15.142:6815","nonce":1272081937}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":1272081937},{"type":"v1","addr":"172.21.15.142:6813","nonce":1272081937}]},"public_addr":"172.21.15.142:6809/1272081937","cluster_addr":"172.21.15.142:6811/1272081937","heartbeat_back_addr":"172.21.15.142:6815/1272081937","heartbeat_front_addr":"172.21.15.142:6813/1272081937","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.350998+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.307201+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.289112+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.243888+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.312091+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.370472+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.275659+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.289297+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-21T22:52:59.116 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.125+0000 7f4193181640 1 -- 172.21.15.116:0/3773537760 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f417806b500 msgr2=0x7f417806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:59.116 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.125+0000 7f4193181640 1 --2- 172.21.15.116:0/3773537760 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f417806b500 0x7f417806d9c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f4188034000 tx=0x7f418802f000 comp rx=0 tx=0).stop 2024-02-21T22:52:59.116 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.125+0000 7f4193181640 1 -- 172.21.15.116:0/3773537760 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f418c160530 msgr2=0x7f418c0afdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:59.116 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.125+0000 7f4193181640 1 --2- 172.21.15.116:0/3773537760 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f418c160530 0x7f418c0afdd0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f418400c8f0 tx=0x7f418400cdb0 comp rx=0 tx=0).stop 2024-02-21T22:52:59.116 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.125+0000 7f4193181640 1 -- 172.21.15.116:0/3773537760 shutdown_connections 2024-02-21T22:52:59.116 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.125+0000 7f4193181640 1 --2- 172.21.15.116:0/3773537760 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f418c160530 0x7f418c0afdd0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:59.116 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.125+0000 7f4193181640 1 --2- 172.21.15.116:0/3773537760 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f418c15c190 0x7f418c15c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:59.116 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.125+0000 7f4193181640 1 --2- 172.21.15.116:0/3773537760 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f417806b500 0x7f417806d9c0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:59.116 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.125+0000 7f4193181640 1 --2- 172.21.15.116:0/3773537760 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f418c0cc990 0x7f418c15dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:59.116 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.125+0000 7f4193181640 1 -- 172.21.15.116:0/3773537760 >> 172.21.15.116:0/3773537760 conn(0x7f418c0d1be0 msgr2=0x7f418c0d1fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:52:59.116 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.125+0000 7f4193181640 1 -- 172.21.15.116:0/3773537760 shutdown_connections 2024-02-21T22:52:59.117 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.125+0000 7f4193181640 1 -- 172.21.15.116:0/3773537760 wait complete. 2024-02-21T22:52:59.126 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-02-21T22:52:59.126 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-21T22:52:59.226 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.235+0000 7efe45605640 1 Processor -- start 2024-02-21T22:52:59.226 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.235+0000 7efe45605640 1 -- start start 2024-02-21T22:52:59.228 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.236+0000 7efe45605640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7efe4015e560 0x7efe400d1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:59.228 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.236+0000 7efe45605640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efe400d0fc0 0x7efe400b0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:59.228 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.236+0000 7efe45605640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe400ce8f0 con 0x7efe4015e180 2024-02-21T22:52:59.228 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.236+0000 7efe45605640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe400b31b0 con 0x7efe4015e560 2024-02-21T22:52:59.228 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.236+0000 7efe45605640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe400d2100 con 0x7efe400d0fc0 2024-02-21T22:52:59.228 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.236+0000 7efe3e7fc640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7efe4015e560 0x7efe400d1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:59.228 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.236+0000 7efe3e7fc640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7efe4015e560 0x7efe400d1bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:34110/0 (socket says 172.21.15.116:34110) 2024-02-21T22:52:59.228 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.236+0000 7efe3e7fc640 1 -- 172.21.15.116:0/632730498 learned_addr learned my addr 172.21.15.116:0/632730498 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:52:59.228 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.236+0000 7efe3f7fe640 1 --2- 172.21.15.116:0/632730498 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efe400d0fc0 0x7efe400b0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:59.229 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.237+0000 7efe3e7fc640 1 -- 172.21.15.116:0/632730498 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efe400d0fc0 msgr2=0x7efe400b0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:52:59.229 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.237+0000 7efe3e7fc640 1 --2- 172.21.15.116:0/632730498 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efe400d0fc0 0x7efe400b0a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:59.229 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.237+0000 7efe3e7fc640 1 -- 172.21.15.116:0/632730498 >> v1:172.21.15.142:6789/0 conn(0x7efe4015e180 legacy=0x7efe400cf650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:59.229 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.237+0000 7efe3e7fc640 1 -- 172.21.15.116:0/632730498 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe400d1530 con 0x7efe4015e560 2024-02-21T22:52:59.229 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.237+0000 7efe3e7fc640 1 --2- 172.21.15.116:0/632730498 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efe4015e560 0x7efe400d1bc0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7efe34009870 tx=0x7efe3402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c689b76fdcc9d41 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:52:59.229 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.237+0000 7efe3dffb640 1 -- 172.21.15.116:0/632730498 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe34034070 con 0x7efe4015e560 2024-02-21T22:52:59.229 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.238+0000 7efe3dffb640 1 -- 172.21.15.116:0/632730498 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe34030840 con 0x7efe4015e560 2024-02-21T22:52:59.229 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.238+0000 7efe3dffb640 1 -- 172.21.15.116:0/632730498 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe34030c10 con 0x7efe4015e560 2024-02-21T22:52:59.230 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.238+0000 7efe45605640 1 -- 172.21.15.116:0/632730498 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efe4015e560 msgr2=0x7efe400d1bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:59.230 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.238+0000 7efe45605640 1 --2- 172.21.15.116:0/632730498 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efe4015e560 0x7efe400d1bc0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7efe34009870 tx=0x7efe3402b980 comp rx=0 tx=0).stop 2024-02-21T22:52:59.230 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.238+0000 7efe45605640 1 -- 172.21.15.116:0/632730498 shutdown_connections 2024-02-21T22:52:59.230 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.238+0000 7efe45605640 1 --2- 172.21.15.116:0/632730498 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efe400d0fc0 0x7efe400b0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:59.230 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.238+0000 7efe45605640 1 --2- 172.21.15.116:0/632730498 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efe4015e560 0x7efe400d1bc0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:59.230 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.238+0000 7efe45605640 1 -- 172.21.15.116:0/632730498 >> 172.21.15.116:0/632730498 conn(0x7efe400d3de0 msgr2=0x7efe400d41f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:52:59.230 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.238+0000 7efe45605640 1 -- 172.21.15.116:0/632730498 shutdown_connections 2024-02-21T22:52:59.231 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.238+0000 7efe45605640 1 -- 172.21.15.116:0/632730498 wait complete. 2024-02-21T22:52:59.231 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.239+0000 7efe45605640 1 Processor -- start 2024-02-21T22:52:59.231 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.239+0000 7efe45605640 1 -- start start 2024-02-21T22:52:59.233 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.240+0000 7efe45605640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efe400d0fc0 0x7efe4015a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:59.233 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.240+0000 7efe45605640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efe4015e180 0x7efe40151250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:59.233 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.240+0000 7efe45605640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efe4015e560 0x7efe400b9190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:59.233 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.240+0000 7efe45605640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe400cee50 con 0x7efe400d0fc0 2024-02-21T22:52:59.233 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.240+0000 7efe45605640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe400cf1c0 con 0x7efe4015e560 2024-02-21T22:52:59.233 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.240+0000 7efe45605640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe400cfd60 con 0x7efe4015e180 2024-02-21T22:52:59.233 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.240+0000 7efe3effd640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efe400d0fc0 0x7efe4015a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:59.233 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.240+0000 7efe3effd640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efe400d0fc0 0x7efe4015a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:34112/0 (socket says 172.21.15.116:34112) 2024-02-21T22:52:59.233 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.240+0000 7efe3effd640 1 -- 172.21.15.116:0/3156444473 learned_addr learned my addr 172.21.15.116:0/3156444473 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:52:59.233 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.240+0000 7efe3f7fe640 1 --2- 172.21.15.116:0/3156444473 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efe4015e560 0x7efe400b9190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:59.234 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.240+0000 7efe3e7fc640 1 --2- 172.21.15.116:0/3156444473 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efe4015e180 0x7efe40151250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:59.234 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.240+0000 7efe3effd640 1 -- 172.21.15.116:0/3156444473 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efe4015e180 msgr2=0x7efe40151250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:59.234 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.240+0000 7efe3effd640 1 --2- 172.21.15.116:0/3156444473 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efe4015e180 0x7efe40151250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:59.234 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.240+0000 7efe3effd640 1 -- 172.21.15.116:0/3156444473 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efe4015e560 msgr2=0x7efe400b9190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:59.234 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.240+0000 7efe3effd640 1 --2- 172.21.15.116:0/3156444473 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efe4015e560 0x7efe400b9190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:59.234 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.240+0000 7efe3effd640 1 -- 172.21.15.116:0/3156444473 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe400cb1e0 con 0x7efe400d0fc0 2024-02-21T22:52:59.234 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.241+0000 7efe3effd640 1 --2- 172.21.15.116:0/3156444473 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efe400d0fc0 0x7efe4015a5a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7efe3000c790 tx=0x7efe3000cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:52:59.234 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.241+0000 7efe277fe640 1 -- 172.21.15.116:0/3156444473 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe30016020 con 0x7efe400d0fc0 2024-02-21T22:52:59.234 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.241+0000 7efe277fe640 1 -- 172.21.15.116:0/3156444473 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe30006d50 con 0x7efe400d0fc0 2024-02-21T22:52:59.234 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.241+0000 7efe45605640 1 -- 172.21.15.116:0/3156444473 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe400b9820 con 0x7efe400d0fc0 2024-02-21T22:52:59.234 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.241+0000 7efe277fe640 1 -- 172.21.15.116:0/3156444473 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe30003bb0 con 0x7efe400d0fc0 2024-02-21T22:52:59.234 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.241+0000 7efe45605640 1 -- 172.21.15.116:0/3156444473 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe400cd8f0 con 0x7efe400d0fc0 2024-02-21T22:52:59.234 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.242+0000 7efe45605640 1 -- 172.21.15.116:0/3156444473 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe400752f0 con 0x7efe400d0fc0 2024-02-21T22:52:59.234 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.242+0000 7efe277fe640 1 -- 172.21.15.116:0/3156444473 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7efe3000a850 con 0x7efe400d0fc0 2024-02-21T22:52:59.234 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.242+0000 7efe277fe640 1 --2- 172.21.15.116:0/3156444473 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7efe2c06b500 0x7efe2c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:59.235 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.243+0000 7efe277fe640 1 -- 172.21.15.116:0/3156444473 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efe30089d10 con 0x7efe400d0fc0 2024-02-21T22:52:59.235 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.243+0000 7efe3e7fc640 1 --2- 172.21.15.116:0/3156444473 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7efe2c06b500 0x7efe2c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:59.235 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.243+0000 7efe3e7fc640 1 --2- 172.21.15.116:0/3156444473 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7efe2c06b500 0x7efe2c06d9c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7efe34036000 tx=0x7efe3403b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:52:59.237 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.247+0000 7efe277fe640 1 -- 172.21.15.116:0/3156444473 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7efe30020020 con 0x7efe400d0fc0 2024-02-21T22:52:59.410 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.419+0000 7efe45605640 1 -- 172.21.15.116:0/3156444473 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efe4015d780 con 0x7efe400d0fc0 2024-02-21T22:52:59.411 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.420+0000 7efe277fe640 1 -- 172.21.15.116:0/3156444473 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16653 (secure 0 0 0) 0x7efe400cb1e0 con 0x7efe400d0fc0 2024-02-21T22:52:59.411 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-02-21T22:52:59.411 INFO:teuthology.orchestra.run.smithi116.stdout:{"epoch":20,"fsid":"7c298660-5f63-4b5c-a800-58c5be9a8445","created":"2024-02-21T22:52:25.994613+0000","modified":"2024-02-21T22:52:51.786454+0000","last_up_change":"2024-02-21T22:52:37.313595+0000","last_in_change":"2024-02-21T22:52:28.176031+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-21T22:52:38.328796+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-21T22:52:48.145152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-21T22:52:49.096955+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4f09126b-b5e4-4876-8b08-f5cbb967388a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":1613202231},{"type":"v1","addr":"172.21.15.116:6809","nonce":1613202231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":1613202231},{"type":"v1","addr":"172.21.15.116:6811","nonce":1613202231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":1613202231},{"type":"v1","addr":"172.21.15.116:6815","nonce":1613202231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":1613202231},{"type":"v1","addr":"172.21.15.116:6813","nonce":1613202231}]},"public_addr":"172.21.15.116:6809/1613202231","cluster_addr":"172.21.15.116:6811/1613202231","heartbeat_back_addr":"172.21.15.116:6815/1613202231","heartbeat_front_addr":"172.21.15.116:6813/1613202231","state":["exists","up"]},{"osd":1,"uuid":"7272c51d-51f9-4536-931d-33ad7a4b377e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6816","nonce":172614746},{"type":"v1","addr":"172.21.15.116:6817","nonce":172614746}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":172614746},{"type":"v1","addr":"172.21.15.116:6819","nonce":172614746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":172614746},{"type":"v1","addr":"172.21.15.116:6823","nonce":172614746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":172614746},{"type":"v1","addr":"172.21.15.116:6821","nonce":172614746}]},"public_addr":"172.21.15.116:6817/172614746","cluster_addr":"172.21.15.116:6819/172614746","heartbeat_back_addr":"172.21.15.116:6823/172614746","heartbeat_front_addr":"172.21.15.116:6821/172614746","state":["exists","up"]},{"osd":2,"uuid":"2589616c-adf1-4187-aac3-735256cf624b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":1029280577},{"type":"v1","addr":"172.21.15.116:6825","nonce":1029280577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":1029280577},{"type":"v1","addr":"172.21.15.116:6827","nonce":1029280577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":1029280577},{"type":"v1","addr":"172.21.15.116:6831","nonce":1029280577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":1029280577},{"type":"v1","addr":"172.21.15.116:6829","nonce":1029280577}]},"public_addr":"172.21.15.116:6825/1029280577","cluster_addr":"172.21.15.116:6827/1029280577","heartbeat_back_addr":"172.21.15.116:6831/1029280577","heartbeat_front_addr":"172.21.15.116:6829/1029280577","state":["exists","up"]},{"osd":3,"uuid":"0fd2e563-7c5b-46f6-82c2-b60c86072c93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":3106627557},{"type":"v1","addr":"172.21.15.116:6801","nonce":3106627557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":3106627557},{"type":"v1","addr":"172.21.15.116:6803","nonce":3106627557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":3106627557},{"type":"v1","addr":"172.21.15.116:6807","nonce":3106627557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":3106627557},{"type":"v1","addr":"172.21.15.116:6805","nonce":3106627557}]},"public_addr":"172.21.15.116:6801/3106627557","cluster_addr":"172.21.15.116:6803/3106627557","heartbeat_back_addr":"172.21.15.116:6807/3106627557","heartbeat_front_addr":"172.21.15.116:6805/3106627557","state":["exists","up"]},{"osd":4,"uuid":"79ae35b7-dda8-4ab8-96ce-47515afde082","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":3231407772},{"type":"v1","addr":"172.21.15.142:6825","nonce":3231407772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":3231407772},{"type":"v1","addr":"172.21.15.142:6827","nonce":3231407772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":3231407772},{"type":"v1","addr":"172.21.15.142:6831","nonce":3231407772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":3231407772},{"type":"v1","addr":"172.21.15.142:6829","nonce":3231407772}]},"public_addr":"172.21.15.142:6825/3231407772","cluster_addr":"172.21.15.142:6827/3231407772","heartbeat_back_addr":"172.21.15.142:6831/3231407772","heartbeat_front_addr":"172.21.15.142:6829/3231407772","state":["exists","up"]},{"osd":5,"uuid":"3166eb2c-3fcf-41c8-9362-45bafaabaa39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":1184158716},{"type":"v1","addr":"172.21.15.142:6817","nonce":1184158716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":1184158716},{"type":"v1","addr":"172.21.15.142:6819","nonce":1184158716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":1184158716},{"type":"v1","addr":"172.21.15.142:6823","nonce":1184158716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":1184158716},{"type":"v1","addr":"172.21.15.142:6821","nonce":1184158716}]},"public_addr":"172.21.15.142:6817/1184158716","cluster_addr":"172.21.15.142:6819/1184158716","heartbeat_back_addr":"172.21.15.142:6823/1184158716","heartbeat_front_addr":"172.21.15.142:6821/1184158716","state":["exists","up"]},{"osd":6,"uuid":"f9aa9672-7527-43e2-963e-b61868e5e63f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":1987868911},{"type":"v1","addr":"172.21.15.142:6801","nonce":1987868911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":1987868911},{"type":"v1","addr":"172.21.15.142:6803","nonce":1987868911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":1987868911},{"type":"v1","addr":"172.21.15.142:6807","nonce":1987868911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":1987868911},{"type":"v1","addr":"172.21.15.142:6805","nonce":1987868911}]},"public_addr":"172.21.15.142:6801/1987868911","cluster_addr":"172.21.15.142:6803/1987868911","heartbeat_back_addr":"172.21.15.142:6807/1987868911","heartbeat_front_addr":"172.21.15.142:6805/1987868911","state":["exists","up"]},{"osd":7,"uuid":"7ed29226-fc42-4382-a91a-fa50f7ec5426","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":1272081937},{"type":"v1","addr":"172.21.15.142:6809","nonce":1272081937}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":1272081937},{"type":"v1","addr":"172.21.15.142:6811","nonce":1272081937}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":1272081937},{"type":"v1","addr":"172.21.15.142:6815","nonce":1272081937}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":1272081937},{"type":"v1","addr":"172.21.15.142:6813","nonce":1272081937}]},"public_addr":"172.21.15.142:6809/1272081937","cluster_addr":"172.21.15.142:6811/1272081937","heartbeat_back_addr":"172.21.15.142:6815/1272081937","heartbeat_front_addr":"172.21.15.142:6813/1272081937","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.350998+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.307201+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.289112+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.243888+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.312091+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.370472+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.275659+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.289297+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-21T22:52:59.413 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.422+0000 7efe45605640 1 -- 172.21.15.116:0/3156444473 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7efe2c06b500 msgr2=0x7efe2c06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:59.413 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.422+0000 7efe45605640 1 --2- 172.21.15.116:0/3156444473 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7efe2c06b500 0x7efe2c06d9c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7efe34036000 tx=0x7efe3403b040 comp rx=0 tx=0).stop 2024-02-21T22:52:59.413 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.422+0000 7efe45605640 1 -- 172.21.15.116:0/3156444473 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efe400d0fc0 msgr2=0x7efe4015a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:59.413 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.422+0000 7efe45605640 1 --2- 172.21.15.116:0/3156444473 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efe400d0fc0 0x7efe4015a5a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7efe3000c790 tx=0x7efe3000cc50 comp rx=0 tx=0).stop 2024-02-21T22:52:59.413 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.422+0000 7efe45605640 1 -- 172.21.15.116:0/3156444473 shutdown_connections 2024-02-21T22:52:59.413 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.422+0000 7efe45605640 1 --2- 172.21.15.116:0/3156444473 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efe4015e560 0x7efe400b9190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:59.413 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.422+0000 7efe45605640 1 --2- 172.21.15.116:0/3156444473 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7efe2c06b500 0x7efe2c06d9c0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:59.413 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.422+0000 7efe45605640 1 --2- 172.21.15.116:0/3156444473 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efe4015e180 0x7efe40151250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:59.414 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.422+0000 7efe45605640 1 --2- 172.21.15.116:0/3156444473 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efe400d0fc0 0x7efe4015a5a0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:59.414 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.422+0000 7efe45605640 1 -- 172.21.15.116:0/3156444473 >> 172.21.15.116:0/3156444473 conn(0x7efe400d3de0 msgr2=0x7efe4006cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:52:59.414 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.422+0000 7efe45605640 1 -- 172.21.15.116:0/3156444473 shutdown_connections 2024-02-21T22:52:59.414 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.422+0000 7efe45605640 1 -- 172.21.15.116:0/3156444473 wait complete. 2024-02-21T22:52:59.425 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-02-21T22:52:59.425 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-02-21T22:52:59.425 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-02-21T22:52:59.426 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-02-21T22:52:59.426 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-02-21T22:52:59.426 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-02-21T22:52:59.427 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-02-21T22:52:59.427 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-02-21T22:52:59.597 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.606+0000 7f2e316de640 1 Processor -- start 2024-02-21T22:52:59.597 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.606+0000 7f2e316de640 1 -- start start 2024-02-21T22:52:59.598 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.606+0000 7f845991e640 1 Processor -- start 2024-02-21T22:52:59.598 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.606+0000 7f845991e640 1 -- start start 2024-02-21T22:52:59.598 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.607+0000 7f22db59e640 1 Processor -- start 2024-02-21T22:52:59.598 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.607+0000 7f22db59e640 1 -- start start 2024-02-21T22:52:59.599 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.607+0000 7f3252a1c640 1 Processor -- start 2024-02-21T22:52:59.599 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.607+0000 7fc697fff640 1 Processor -- start 2024-02-21T22:52:59.599 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.607+0000 7fc697fff640 1 -- start start 2024-02-21T22:52:59.600 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.607+0000 7f2e316de640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f2e2c15fe10 0x7f2e2c071c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:59.600 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.607+0000 7f2e316de640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f2e2c072150 0x7f2e2c0cfcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:59.600 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.607+0000 7f3252a1c640 1 -- start start 2024-02-21T22:52:59.601 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.607+0000 7f2e316de640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e2c072660 con 0x7f2e2c0d0230 2024-02-21T22:52:59.601 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.607+0000 7f2e316de640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e2c0d0680 con 0x7f2e2c15fe10 2024-02-21T22:52:59.602 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.607+0000 7f2e316de640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e2c0cc2b0 con 0x7f2e2c072150 2024-02-21T22:52:59.602 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.608+0000 7f845991e640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f845415dfb0 0x7f845406ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:59.603 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.608+0000 7f845991e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f845406f1a0 0x7f845406b380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:59.603 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.608+0000 7f845991e640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84540b5830 con 0x7f84541628a0 2024-02-21T22:52:59.603 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.608+0000 7f845991e640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8454161b70 con 0x7f845415dfb0 2024-02-21T22:52:59.603 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.608+0000 7f845991e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8454162410 con 0x7f845406f1a0 2024-02-21T22:52:59.603 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.608+0000 7f776ffff640 1 Processor -- start 2024-02-21T22:52:59.603 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.608+0000 7f2e2a7fc640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f2e2c072150 0x7f2e2c0cfcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:59.604 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.608+0000 7f8452ffd640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f845415dfb0 0x7f845406ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:59.604 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.608+0000 7f22db59e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f22dc0b1430 0x7f22dc0b1870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:59.604 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.608+0000 7f22db59e640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f22dc0cd4a0 0x7f22dc0cd8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:59.604 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.608+0000 7f8452ffd640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f845415dfb0 0x7f845406ae40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.116:40890/0 (socket says 172.21.15.116:40890) 2024-02-21T22:52:59.605 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.608+0000 7f8452ffd640 1 -- 172.21.15.116:0/4039054746 learned_addr learned my addr 172.21.15.116:0/4039054746 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:52:59.605 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.608+0000 7f3252a1c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f324c0b44a0 0x7f324c15ae90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:59.605 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.608+0000 7f3252a1c640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f324c0b48d0 0x7f324c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:59.605 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.608+0000 7f324bfff640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f324c070b70 0x7f324c070f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.116:59086/0 (socket says 172.21.15.116:59086) 2024-02-21T22:52:59.606 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.608+0000 7f2e2b7fe640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f2e2c0d0230 0x7f2e2c0707a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.116:59078/0 (socket says 172.21.15.116:59078) 2024-02-21T22:52:59.606 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.608+0000 7f2e2b7fe640 1 -- 172.21.15.116:0/3985872110 learned_addr learned my addr 172.21.15.116:0/3985872110 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-02-21T22:52:59.606 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.608+0000 7f2e29ffb640 1 -- 172.21.15.116:0/3985872110 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1083208389 0 0) 0x7f2e2c072660 con 0x7f2e2c0d0230 2024-02-21T22:52:59.606 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.608+0000 7f2e29ffb640 1 -- 172.21.15.116:0/3985872110 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e14003520 con 0x7f2e2c0d0230 2024-02-21T22:52:59.606 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.609+0000 7f2e2affd640 1 --2- 172.21.15.116:0/3985872110 >> v2:172.21.15.116:3300/0 conn(0x7f2e2c15fe10 0x7f2e2c071c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:59.606 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.608+0000 7fc697fff640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc6980cef50 0x7fc698070640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:59.606 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.608+0000 7fc697fff640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fc69806e830 0x7fc69815e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:59.606 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.608+0000 7fc697fff640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc69815e820 con 0x7fc698159ad0 2024-02-21T22:52:59.606 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.608+0000 7fc697fff640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6980cf3e0 con 0x7fc69806e830 2024-02-21T22:52:59.607 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.608+0000 7fc697fff640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6980c9f50 con 0x7fc6980cef50 2024-02-21T22:52:59.607 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.608+0000 7fc696ffd640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc6980cef50 0x7fc698070640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:59.607 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.609+0000 7fc696ffd640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc6980cef50 0x7fc698070640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.116:40910/0 (socket says 172.21.15.116:40910) 2024-02-21T22:52:59.607 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.609+0000 7fc696ffd640 1 -- 172.21.15.116:0/2370880753 learned_addr learned my addr 172.21.15.116:0/2370880753 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:52:59.607 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.609+0000 7f324b7fe640 1 --2- 172.21.15.116:0/2926586971 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f324c0b44a0 0x7f324c15ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:59.607 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.609+0000 7f324bfff640 1 -- 172.21.15.116:0/2926586971 learned_addr learned my addr 172.21.15.116:0/2926586971 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-02-21T22:52:59.607 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.609+0000 7f3250fb9640 1 --2- 172.21.15.116:0/2926586971 >> v2:172.21.15.142:3300/0 conn(0x7f324c0b48d0 0x7f324c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:59.608 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.609+0000 7f84537fe640 1 --2- 172.21.15.116:0/4039054746 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f845406f1a0 0x7f845406b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:59.608 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.609+0000 7f3252a1c640 1 -- 172.21.15.116:0/2926586971 --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f324c15b480 con 0x7f324c070b70 2024-02-21T22:52:59.608 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.609+0000 7f8452ffd640 1 -- 172.21.15.116:0/4039054746 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f845406f1a0 msgr2=0x7f845406b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:52:59.609 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.609+0000 7f3252a1c640 1 -- 172.21.15.116:0/2926586971 --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f324c15e9c0 con 0x7f324c0b48d0 2024-02-21T22:52:59.609 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.609+0000 7f3252a1c640 1 -- 172.21.15.116:0/2926586971 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f324c15dc00 con 0x7f324c0b44a0 2024-02-21T22:52:59.609 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.609+0000 7f8452ffd640 1 --2- 172.21.15.116:0/4039054746 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f845406f1a0 0x7f845406b380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:59.609 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.609+0000 7f2e2a7fc640 1 -- 172.21.15.116:0/3985872110 >> v2:172.21.15.116:3300/0 conn(0x7f2e2c15fe10 msgr2=0x7f2e2c071c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:52:59.609 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.609+0000 7f2e2a7fc640 1 --2- 172.21.15.116:0/3985872110 >> v2:172.21.15.116:3300/0 conn(0x7f2e2c15fe10 0x7f2e2c071c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:59.609 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.609+0000 7f2e2a7fc640 1 -- 172.21.15.116:0/3985872110 >> v1:172.21.15.142:6789/0 conn(0x7f2e2c0d0230 legacy=0x7f2e2c0707a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:59.610 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.609+0000 7f2e2a7fc640 1 -- 172.21.15.116:0/3985872110 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e2c0cc500 con 0x7f2e2c072150 2024-02-21T22:52:59.610 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.609+0000 7f8452ffd640 1 -- 172.21.15.116:0/4039054746 >> v1:172.21.15.116:6789/0 conn(0x7f84541628a0 legacy=0x7f8454071990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:52:59.610 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.609+0000 7f8452ffd640 1 -- 172.21.15.116:0/4039054746 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84540b5ad0 con 0x7f845415dfb0 2024-02-21T22:52:59.610 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.609+0000 7f324affd640 1 -- 172.21.15.116:0/2926586971 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 205370203 0 0) 0x7f324c15b480 con 0x7f324c070b70 2024-02-21T22:52:59.611 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.609+0000 7fca5e895640 1 Processor -- start 2024-02-21T22:52:59.611 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.608+0000 7f776ffff640 1 -- start start 2024-02-21T22:52:59.611 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.609+0000 7f776ffff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f77680ead00 0x7f776804fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:59.611 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.609+0000 7f776ffff640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f776804ffd0 0x7f7768037bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:59.611 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.609+0000 7f22dad9d640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f22dc0cd4a0 0x7f22dc0cd8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:59.611 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.609+0000 7f22dad9d640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f22dc0cd4a0 0x7f22dc0cd8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:34118/0 (socket says 172.21.15.116:34118) 2024-02-21T22:52:59.611 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.609+0000 7f22dad9d640 1 -- 172.21.15.116:0/3015115674 learned_addr learned my addr 172.21.15.116:0/3015115674 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:52:59.612 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.609+0000 7fca5e895640 1 -- start start 2024-02-21T22:52:59.612 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.609+0000 7f776ffff640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f7768038110 0x7f77680385a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:59.612 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.609+0000 7f776ffff640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7768054330 con 0x7f776804ffd0 2024-02-21T22:52:59.612 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.609+0000 7f776ffff640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7768053720 con 0x7f7768038110 2024-02-21T22:52:59.612 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.609+0000 7f776ffff640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7768053a00 con 0x7f77680ead00 2024-02-21T22:52:59.612 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.609+0000 7f22db59e640 1 -- 172.21.15.116:0/3015115674 --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22dc0caa30 con 0x7f22dc15dc60 2024-02-21T22:52:59.612 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.609+0000 7f22db59e640 1 -- 172.21.15.116:0/3015115674 --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22dc0cb640 con 0x7f22dc0cd4a0 2024-02-21T22:52:59.613 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.609+0000 7f22db59e640 1 -- 172.21.15.116:0/3015115674 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22dc0b1db0 con 0x7f22dc0b1430 2024-02-21T22:52:59.613 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.610+0000 7f776f7fe640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f7768038110 0x7f77680385a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:59.613 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.610+0000 7f776f7fe640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f7768038110 0x7f77680385a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.116:40926/0 (socket says 172.21.15.116:40926) 2024-02-21T22:52:59.613 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.610+0000 7f776f7fe640 1 -- 172.21.15.116:0/2219229699 learned_addr learned my addr 172.21.15.116:0/2219229699 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:52:59.613 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.610+0000 7f776e7fc640 1 --2- 172.21.15.116:0/2219229699 >> v2:172.21.15.116:3300/0 conn(0x7f776804ffd0 0x7f7768037bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:59.613 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.610+0000 7f22dad9d640 1 -- 172.21.15.116:0/3015115674 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f22dc0b1430 msgr2=0x7f22dc0b1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:52:59.613 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.610+0000 7f22d9d9b640 1 --2- 172.21.15.116:0/3015115674 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f22dc0b1430 0x7f22dc0b1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:59.614 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.609+0000 7fc696ffd640 1 -- 172.21.15.116:0/2370880753 >> v2:172.21.15.116:3300/0 conn(0x7fc69806e830 msgr2=0x7fc69815e2e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T22:52:59.614 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.609+0000 7fc696ffd640 1 --2- 172.21.15.116:0/2370880753 >> v2:172.21.15.116:3300/0 conn(0x7fc69806e830 0x7fc69815e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:59.614 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.609+0000 7fc696ffd640 1 -- 172.21.15.116:0/2370880753 >> v1:172.21.15.142:6789/0 conn(0x7fc698159ad0 legacy=0x7fc6980b1430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:59.614 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.609+0000 7fc696ffd640 1 -- 172.21.15.116:0/2370880753 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6980ca230 con 0x7fc6980cef50 2024-02-21T22:52:59.614 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.610+0000 7f22dad9d640 1 --2- 172.21.15.116:0/3015115674 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f22dc0b1430 0x7f22dc0b1870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:59.614 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.610+0000 7f22dad9d640 1 -- 172.21.15.116:0/3015115674 >> v1:172.21.15.142:6789/0 conn(0x7f22dc15dc60 legacy=0x7f22dc162240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:52:59.615 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.610+0000 7fc696ffd640 1 --2- 172.21.15.116:0/2370880753 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc6980cef50 0x7fc698070640 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc69815e9f0 tx=0x7fc68802b7d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=55b761fe9e28ed96 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:52:59.615 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.610+0000 7fc695ffb640 1 -- 172.21.15.116:0/2370880753 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc688037070 con 0x7fc6980cef50 2024-02-21T22:52:59.615 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.610+0000 7fc695ffb640 1 -- 172.21.15.116:0/2370880753 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc688030710 con 0x7fc6980cef50 2024-02-21T22:52:59.615 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.610+0000 7fc695ffb640 1 -- 172.21.15.116:0/2370880753 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc688030ae0 con 0x7fc6980cef50 2024-02-21T22:52:59.615 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.610+0000 7f776f7fe640 1 -- 172.21.15.116:0/2219229699 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f77680ead00 msgr2=0x7f776804fa90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T22:52:59.615 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.610+0000 7f776f7fe640 1 --2- 172.21.15.116:0/2219229699 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f77680ead00 0x7f776804fa90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:59.615 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.610+0000 7f776f7fe640 1 -- 172.21.15.116:0/2219229699 >> v2:172.21.15.116:3300/0 conn(0x7f776804ffd0 msgr2=0x7f7768037bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:52:59.615 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.610+0000 7f776f7fe640 1 --2- 172.21.15.116:0/2219229699 >> v2:172.21.15.116:3300/0 conn(0x7f776804ffd0 0x7f7768037bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:59.615 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.610+0000 7f776f7fe640 1 -- 172.21.15.116:0/2219229699 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7768053ce0 con 0x7f7768038110 2024-02-21T22:52:59.616 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.610+0000 7f22dad9d640 1 -- 172.21.15.116:0/3015115674 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22dc0cad10 con 0x7f22dc0cd4a0 2024-02-21T22:52:59.616 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.609+0000 7f324b7fe640 1 -- 172.21.15.116:0/2926586971 >> v2:172.21.15.142:3300/0 conn(0x7f324c0b48d0 msgr2=0x7f324c06c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:52:59.616 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.609+0000 7f324b7fe640 1 --2- 172.21.15.116:0/2926586971 >> v2:172.21.15.142:3300/0 conn(0x7f324c0b48d0 0x7f324c06c8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:59.616 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.609+0000 7f324b7fe640 1 -- 172.21.15.116:0/2926586971 >> v1:172.21.15.142:6789/0 conn(0x7f324c070b70 legacy=0x7f324c070f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:59.616 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.609+0000 7f324b7fe640 1 -- 172.21.15.116:0/2926586971 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f324c15dee0 con 0x7f324c0b44a0 2024-02-21T22:52:59.616 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.611+0000 7f324b7fe640 1 --2- 172.21.15.116:0/2926586971 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f324c0b44a0 0x7f324c15ae90 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f3240009fb0 tx=0x7f324002dbe0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=defbf08260e9c270 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:52:59.616 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.610+0000 7f2e2a7fc640 1 --2- 172.21.15.116:0/3985872110 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2e2c072150 0x7f2e2c0cfcf0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f2e2c071ac0 tx=0x7f2e2002b630 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b9de388af12e4506 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:52:59.617 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.610+0000 7f2e29ffb640 1 -- 172.21.15.116:0/3985872110 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e20037070 con 0x7f2e2c072150 2024-02-21T22:52:59.617 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.610+0000 7f2e29ffb640 1 -- 172.21.15.116:0/3985872110 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e20030510 con 0x7f2e2c072150 2024-02-21T22:52:59.617 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.610+0000 7f2e29ffb640 1 -- 172.21.15.116:0/3985872110 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e1c001670 con 0x7f2e2c072150 2024-02-21T22:52:59.617 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.610+0000 7f9eca3c8640 1 Processor -- start 2024-02-21T22:52:59.617 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.610+0000 7f8452ffd640 1 --2- 172.21.15.116:0/4039054746 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f845415dfb0 0x7f845406ae40 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f8454072dd0 tx=0x7f844402b7c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c9aee4464b612d99 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:52:59.617 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.611+0000 7f8451ffb640 1 -- 172.21.15.116:0/4039054746 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8444038070 con 0x7f845415dfb0 2024-02-21T22:52:59.618 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.611+0000 7f8451ffb640 1 -- 172.21.15.116:0/4039054746 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8444031520 con 0x7f845415dfb0 2024-02-21T22:52:59.618 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.611+0000 7f8451ffb640 1 -- 172.21.15.116:0/4039054746 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8444031930 con 0x7f845415dfb0 2024-02-21T22:52:59.618 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.611+0000 7f324affd640 1 -- 172.21.15.116:0/2926586971 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f324003b070 con 0x7f324c0b44a0 2024-02-21T22:52:59.618 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.611+0000 7fca5e895640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fca580b2880 0x7fca580cfcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:59.618 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.611+0000 7fca5e895640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca5806d1c0 con 0x7fca58156330 2024-02-21T22:52:59.618 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.611+0000 7fca5e895640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca5815cc50 con 0x7fca580d0230 2024-02-21T22:52:59.619 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.611+0000 7fca5e895640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca5815cf30 con 0x7fca580b2880 2024-02-21T22:52:59.619 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.611+0000 7fca57fff640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7fca58156330 0x7fca5815c130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:50892/0 (socket says 172.21.15.116:50892) 2024-02-21T22:52:59.619 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.611+0000 7fca57fff640 1 -- 172.21.15.116:0/1370586682 learned_addr learned my addr 172.21.15.116:0/1370586682 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-02-21T22:52:59.619 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.611+0000 7f324affd640 1 -- 172.21.15.116:0/2926586971 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f324002e990 con 0x7f324c0b44a0 2024-02-21T22:52:59.619 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.611+0000 7f2e316de640 1 -- 172.21.15.116:0/3985872110 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2e2c072150 msgr2=0x7f2e2c0cfcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:59.619 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.611+0000 7f2e316de640 1 --2- 172.21.15.116:0/3985872110 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2e2c072150 0x7f2e2c0cfcf0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f2e2c071ac0 tx=0x7f2e2002b630 comp rx=0 tx=0).stop 2024-02-21T22:52:59.620 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.611+0000 7f22dad9d640 1 --2- 172.21.15.116:0/3015115674 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f22dc0cd4a0 0x7f22dc0cd8f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f22d0009ad0 tx=0x7f22d002bb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b8b8c47ff2014c7 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:52:59.620 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.611+0000 7fc697fff640 1 -- 172.21.15.116:0/2370880753 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc6980cef50 msgr2=0x7fc698070640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:59.620 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.611+0000 7fca56ffd640 1 -- 172.21.15.116:0/1370586682 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1919487432 0 0) 0x7fca5806d1c0 con 0x7fca58156330 2024-02-21T22:52:59.620 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.611+0000 7fca56ffd640 1 -- 172.21.15.116:0/1370586682 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca40003520 con 0x7fca58156330 2024-02-21T22:52:59.621 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.611+0000 7f776e7fc640 1 --2- 172.21.15.116:0/2219229699 >> v2:172.21.15.116:3300/0 conn(0x7f776804ffd0 0x7f7768037bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T22:52:59.621 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.610+0000 7f9eca3c8640 1 -- start start 2024-02-21T22:52:59.621 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.611+0000 7f9eca3c8640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f9ec406ec00 0x7f9ec40b4540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:59.621 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.611+0000 7f9eca3c8640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f9ec40cd7d0 0x7f9ec415aab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:59.621 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.611+0000 7f9eca3c8640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ec415a5d0 con 0x7f9ec40cdc60 2024-02-21T22:52:59.621 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.611+0000 7f9eca3c8640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ec4157f50 con 0x7f9ec40cd7d0 2024-02-21T22:52:59.621 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.611+0000 7f9eca3c8640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ec40b2a00 con 0x7f9ec406ec00 2024-02-21T22:52:59.622 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.611+0000 7fc697fff640 1 --2- 172.21.15.116:0/2370880753 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc6980cef50 0x7fc698070640 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc69815e9f0 tx=0x7fc68802b7d0 comp rx=0 tx=0).stop 2024-02-21T22:52:59.622 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.611+0000 7fc697fff640 1 -- 172.21.15.116:0/2370880753 shutdown_connections 2024-02-21T22:52:59.622 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.611+0000 7fc697fff640 1 --2- 172.21.15.116:0/2370880753 >> v2:172.21.15.116:3300/0 conn(0x7fc69806e830 0x7fc69815e2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:59.622 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.611+0000 7fc697fff640 1 --2- 172.21.15.116:0/2370880753 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc6980cef50 0x7fc698070640 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:59.622 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.611+0000 7fc697fff640 1 -- 172.21.15.116:0/2370880753 >> 172.21.15.116:0/2370880753 conn(0x7fc6980cf7f0 msgr2=0x7fc6980cfc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:52:59.622 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.612+0000 7fc697fff640 1 -- 172.21.15.116:0/2370880753 shutdown_connections 2024-02-21T22:52:59.622 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.611+0000 7f22d959a640 1 -- 172.21.15.116:0/3015115674 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22d002d700 con 0x7f22dc0cd4a0 2024-02-21T22:52:59.622 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.612+0000 7f22d959a640 1 -- 172.21.15.116:0/3015115674 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22d002d8a0 con 0x7f22dc0cd4a0 2024-02-21T22:52:59.623 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.612+0000 7f22d959a640 1 -- 172.21.15.116:0/3015115674 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22d002dc70 con 0x7f22dc0cd4a0 2024-02-21T22:52:59.623 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.612+0000 7f9ec3fff640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f9ec406ec00 0x7f9ec40b4540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:59.623 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.612+0000 7f9ec3fff640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f9ec406ec00 0x7f9ec40b4540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.116:40928/0 (socket says 172.21.15.116:40928) 2024-02-21T22:52:59.623 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.612+0000 7f9ec3fff640 1 -- 172.21.15.116:0/3839971820 learned_addr learned my addr 172.21.15.116:0/3839971820 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:52:59.623 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.612+0000 7fc697fff640 1 -- 172.21.15.116:0/2370880753 wait complete. 2024-02-21T22:52:59.623 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.612+0000 7f2e316de640 1 -- 172.21.15.116:0/3985872110 shutdown_connections 2024-02-21T22:52:59.624 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.612+0000 7f2e316de640 1 --2- 172.21.15.116:0/3985872110 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2e2c072150 0x7f2e2c0cfcf0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:59.624 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.612+0000 7f2e316de640 1 --2- 172.21.15.116:0/3985872110 >> v2:172.21.15.116:3300/0 conn(0x7f2e2c15fe10 0x7f2e2c071c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:59.624 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.612+0000 7f2e316de640 1 -- 172.21.15.116:0/3985872110 >> 172.21.15.116:0/3985872110 conn(0x7f2e2c0b19a0 msgr2=0x7f2e2c0b1db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:52:59.624 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.612+0000 7fca56ffd640 1 -- 172.21.15.116:0/1370586682 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2102475209 0 0) 0x7fca5815cc50 con 0x7fca580d0230 2024-02-21T22:52:59.624 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.612+0000 7fca56ffd640 1 -- 172.21.15.116:0/1370586682 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca5806d1c0 con 0x7fca580d0230 2024-02-21T22:52:59.624 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.612+0000 7fca577fe640 1 --2- 172.21.15.116:0/1370586682 >> v2:172.21.15.116:3300/0 conn(0x7fca580b2880 0x7fca580cfcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:59.624 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.612+0000 7fca56ffd640 1 -- 172.21.15.116:0/1370586682 <== mon.0 v1:172.21.15.116:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4251682175 0 0) 0x7fca40003520 con 0x7fca58156330 2024-02-21T22:52:59.624 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.612+0000 7fca56ffd640 1 -- 172.21.15.116:0/1370586682 >> v2:172.21.15.116:3300/0 conn(0x7fca580b2880 msgr2=0x7fca580cfcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:52:59.625 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.612+0000 7fca56ffd640 1 --2- 172.21.15.116:0/1370586682 >> v2:172.21.15.116:3300/0 conn(0x7fca580b2880 0x7fca580cfcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:59.625 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.612+0000 7fca56ffd640 1 -- 172.21.15.116:0/1370586682 >> v1:172.21.15.142:6789/0 conn(0x7fca580d0230 legacy=0x7fca581657b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:59.625 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.612+0000 7f2e316de640 1 -- 172.21.15.116:0/3985872110 shutdown_connections 2024-02-21T22:52:59.625 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.612+0000 7fca56ffd640 1 -- 172.21.15.116:0/1370586682 --> v1:172.21.15.116:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca5806d480 con 0x7fca58156330 2024-02-21T22:52:59.625 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.612+0000 7f3252a1c640 1 -- 172.21.15.116:0/2926586971 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f324c0b44a0 msgr2=0x7f324c15ae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:59.626 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.612+0000 7f3252a1c640 1 --2- 172.21.15.116:0/2926586971 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f324c0b44a0 0x7f324c15ae90 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f3240009fb0 tx=0x7f324002dbe0 comp rx=0 tx=0).stop 2024-02-21T22:52:59.626 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.612+0000 7f845991e640 1 -- 172.21.15.116:0/4039054746 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f845415dfb0 msgr2=0x7f845406ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:59.626 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.612+0000 7f845991e640 1 --2- 172.21.15.116:0/4039054746 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f845415dfb0 0x7f845406ae40 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f8454072dd0 tx=0x7f844402b7c0 comp rx=0 tx=0).stop 2024-02-21T22:52:59.626 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.612+0000 7f845991e640 1 -- 172.21.15.116:0/4039054746 shutdown_connections 2024-02-21T22:52:59.626 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.612+0000 7f845991e640 1 --2- 172.21.15.116:0/4039054746 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f845406f1a0 0x7f845406b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:59.626 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.612+0000 7f845991e640 1 --2- 172.21.15.116:0/4039054746 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f845415dfb0 0x7f845406ae40 secure :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f8454072dd0 tx=0x7f844402b7c0 comp rx=0 tx=0).stop 2024-02-21T22:52:59.626 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.612+0000 7f845991e640 1 -- 172.21.15.116:0/4039054746 >> 172.21.15.116:0/4039054746 conn(0x7f84540b2750 msgr2=0x7f84540b2b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:52:59.626 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.612+0000 7f2e316de640 1 -- 172.21.15.116:0/3985872110 wait complete. 2024-02-21T22:52:59.627 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.612+0000 7fca56ffd640 1 -- 172.21.15.116:0/1370586682 <== mon.0 v1:172.21.15.116:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1101981580 0 0) 0x7fca50001970 con 0x7fca58156330 2024-02-21T22:52:59.627 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.612+0000 7fca56ffd640 1 -- 172.21.15.116:0/1370586682 >> v1:172.21.15.116:6789/0 conn(0x7fca58156330 legacy=0x7fca5815c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:59.627 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.612+0000 7fca56ffd640 1 --2- 172.21.15.116:0/1370586682 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fca40003b90 0x7fca40003f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:59.627 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.612+0000 7fca56ffd640 1 --2- 172.21.15.116:0/1370586682 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fca40004800 0x7fca40004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:59.627 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.612+0000 7f9ec37fe640 1 --2- 172.21.15.116:0/3839971820 >> v2:172.21.15.116:3300/0 conn(0x7f9ec40cd7d0 0x7f9ec415aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:59.627 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.612+0000 7f9ec3fff640 1 -- 172.21.15.116:0/3839971820 >> v2:172.21.15.116:3300/0 conn(0x7f9ec40cd7d0 msgr2=0x7f9ec415aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:52:59.627 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.612+0000 7f9ec3fff640 1 --2- 172.21.15.116:0/3839971820 >> v2:172.21.15.116:3300/0 conn(0x7f9ec40cd7d0 0x7f9ec415aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:59.628 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.612+0000 7fca56ffd640 1 --2- 172.21.15.116:0/1370586682 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fca40005210 0x7fca4000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:59.628 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.612+0000 7f22db59e640 1 -- 172.21.15.116:0/3015115674 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f22dc0cd4a0 msgr2=0x7f22dc0cd8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:59.628 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.612+0000 7f22db59e640 1 --2- 172.21.15.116:0/3015115674 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f22dc0cd4a0 0x7f22dc0cd8f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f22d0009ad0 tx=0x7f22d002bb50 comp rx=0 tx=0).stop 2024-02-21T22:52:59.628 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.612+0000 7f9ec3fff640 1 -- 172.21.15.116:0/3839971820 >> v1:172.21.15.142:6789/0 conn(0x7f9ec40cdc60 legacy=0x7f9ec40707a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:59.628 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.612+0000 7f9ec3fff640 1 -- 172.21.15.116:0/3839971820 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ec40b2ce0 con 0x7f9ec406ec00 2024-02-21T22:52:59.629 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.613+0000 7f845991e640 1 -- 172.21.15.116:0/4039054746 shutdown_connections 2024-02-21T22:52:59.629 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.613+0000 7f845991e640 1 -- 172.21.15.116:0/4039054746 wait complete. 2024-02-21T22:52:59.629 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.613+0000 7fca56ffd640 1 -- 172.21.15.116:0/1370586682 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca5815cf30 con 0x7fca40003b90 2024-02-21T22:52:59.629 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.613+0000 7fca56ffd640 1 -- 172.21.15.116:0/1370586682 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca4000c140 con 0x7fca40004800 2024-02-21T22:52:59.629 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.613+0000 7fca5ce32640 1 --2- 172.21.15.116:0/1370586682 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fca40005210 0x7fca4000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:59.629 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.613+0000 7fca56ffd640 1 -- 172.21.15.116:0/1370586682 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca4000c340 con 0x7fca40005210 2024-02-21T22:52:59.630 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.613+0000 7f22db59e640 1 -- 172.21.15.116:0/3015115674 shutdown_connections 2024-02-21T22:52:59.630 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.613+0000 7f22db59e640 1 --2- 172.21.15.116:0/3015115674 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f22dc0cd4a0 0x7f22dc0cd8f0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:59.630 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.613+0000 7f22db59e640 1 --2- 172.21.15.116:0/3015115674 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f22dc0b1430 0x7f22dc0b1870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:59.630 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.613+0000 7f22db59e640 1 -- 172.21.15.116:0/3015115674 >> 172.21.15.116:0/3015115674 conn(0x7f22dc0cf7f0 msgr2=0x7f22dc0cfc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:52:59.630 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.613+0000 7fca57fff640 1 --2- 172.21.15.116:0/1370586682 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fca40003b90 0x7fca40003f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:59.630 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.613+0000 7fca577fe640 1 --2- 172.21.15.116:0/1370586682 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fca40004800 0x7fca40004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:59.630 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.612+0000 7f3252a1c640 1 -- 172.21.15.116:0/2926586971 shutdown_connections 2024-02-21T22:52:59.631 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.612+0000 7f3252a1c640 1 --2- 172.21.15.116:0/2926586971 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f324c0b44a0 0x7f324c15ae90 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:59.631 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.612+0000 7f3252a1c640 1 --2- 172.21.15.116:0/2926586971 >> v2:172.21.15.142:3300/0 conn(0x7f324c0b48d0 0x7f324c06c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:59.631 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.613+0000 7f3252a1c640 1 -- 172.21.15.116:0/2926586971 >> 172.21.15.116:0/2926586971 conn(0x7f324c0b18e0 msgr2=0x7f324c0b1cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:52:59.631 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.613+0000 7f776f7fe640 1 --2- 172.21.15.116:0/2219229699 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7768038110 0x7f77680385a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f776800bd00 tx=0x7f776402b940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7724e9bf544a5250 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:52:59.631 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.613+0000 7f776dffb640 1 -- 172.21.15.116:0/2219229699 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7764034070 con 0x7f7768038110 2024-02-21T22:52:59.631 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.613+0000 7f22db59e640 1 -- 172.21.15.116:0/3015115674 shutdown_connections 2024-02-21T22:52:59.632 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.613+0000 7f776dffb640 1 -- 172.21.15.116:0/2219229699 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7764030800 con 0x7f7768038110 2024-02-21T22:52:59.632 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.613+0000 7f776dffb640 1 -- 172.21.15.116:0/2219229699 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7764030bd0 con 0x7f7768038110 2024-02-21T22:52:59.632 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.613+0000 7f22db59e640 1 -- 172.21.15.116:0/3015115674 wait complete. 2024-02-21T22:52:59.633 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.613+0000 7fca577fe640 1 -- 172.21.15.116:0/1370586682 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fca40005210 msgr2=0x7fca4000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:52:59.633 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.613+0000 7fca577fe640 1 --2- 172.21.15.116:0/1370586682 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fca40005210 0x7fca4000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:59.633 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.613+0000 7fca577fe640 1 -- 172.21.15.116:0/1370586682 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fca40003b90 msgr2=0x7fca40003f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:52:59.633 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.613+0000 7fca577fe640 1 --2- 172.21.15.116:0/1370586682 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fca40003b90 0x7fca40003f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:59.633 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.613+0000 7fca577fe640 1 -- 172.21.15.116:0/1370586682 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca40003520 con 0x7fca40004800 2024-02-21T22:52:59.633 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.614+0000 7fca5ce32640 1 -- 172.21.15.116:0/1370586682 reap_dead start 2024-02-21T22:52:59.633 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.614+0000 7fc697fff640 1 Processor -- start 2024-02-21T22:52:59.633 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.614+0000 7fc697fff640 1 -- start start 2024-02-21T22:52:59.634 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.614+0000 7f3252a1c640 1 -- 172.21.15.116:0/2926586971 shutdown_connections 2024-02-21T22:52:59.634 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.614+0000 7f2e316de640 1 Processor -- start 2024-02-21T22:52:59.634 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.614+0000 7f9ec3fff640 1 --2- 172.21.15.116:0/3839971820 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9ec406ec00 0x7f9ec40b4540 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f9ec406bed0 tx=0x7f9ebc02e330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dfcbe7350844ac04 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:52:59.635 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.614+0000 7f3252a1c640 1 -- 172.21.15.116:0/2926586971 wait complete. 2024-02-21T22:52:59.635 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.614+0000 7f845991e640 1 Processor -- start 2024-02-21T22:52:59.635 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.614+0000 7f9ec2ffd640 1 -- 172.21.15.116:0/3839971820 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ebc034070 con 0x7f9ec406ec00 2024-02-21T22:52:59.635 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.614+0000 7f9ec2ffd640 1 -- 172.21.15.116:0/3839971820 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ebc038600 con 0x7f9ec406ec00 2024-02-21T22:52:59.635 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.614+0000 7f9ec2ffd640 1 -- 172.21.15.116:0/3839971820 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ebc00be60 con 0x7f9ec406ec00 2024-02-21T22:52:59.636 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.614+0000 7f2e316de640 1 -- start start 2024-02-21T22:52:59.636 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.614+0000 7f776ffff640 1 -- 172.21.15.116:0/2219229699 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7768038110 msgr2=0x7f77680385a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:59.636 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.615+0000 7f776ffff640 1 --2- 172.21.15.116:0/2219229699 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7768038110 0x7f77680385a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f776800bd00 tx=0x7f776402b940 comp rx=0 tx=0).stop 2024-02-21T22:52:59.636 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.615+0000 7f776ffff640 1 -- 172.21.15.116:0/2219229699 shutdown_connections 2024-02-21T22:52:59.636 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.615+0000 7f776ffff640 1 --2- 172.21.15.116:0/2219229699 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7768038110 0x7f77680385a0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:59.637 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.615+0000 7f776ffff640 1 --2- 172.21.15.116:0/2219229699 >> v2:172.21.15.116:3300/0 conn(0x7f776804ffd0 0x7f7768037bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:59.637 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.615+0000 7f776ffff640 1 --2- 172.21.15.116:0/2219229699 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f77680ead00 0x7f776804fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:59.637 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.615+0000 7f845991e640 1 -- start start 2024-02-21T22:52:59.637 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.615+0000 7f776ffff640 1 -- 172.21.15.116:0/2219229699 >> 172.21.15.116:0/2219229699 conn(0x7f7768009fb0 msgr2=0x7f776800a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:52:59.637 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.615+0000 7fc697fff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc69806e830 0x7fc6980c4980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:59.638 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.615+0000 7f776ffff640 1 -- 172.21.15.116:0/2219229699 shutdown_connections 2024-02-21T22:52:59.638 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.615+0000 7fca577fe640 1 --2- 172.21.15.116:0/1370586682 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fca40004800 0x7fca40004c80 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fca4c00ba00 tx=0x7fca40005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1ec2b7738829c4bd server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:52:59.638 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.615+0000 7f776ffff640 1 -- 172.21.15.116:0/2219229699 wait complete. 2024-02-21T22:52:59.639 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.615+0000 7fc697fff640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc698159ad0 0x7fc6980c8dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:59.639 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.615+0000 7f2e316de640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2e2c072150 0x7f2e2c15baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:59.639 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.615+0000 7f2e316de640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2e2c0d0230 0x7f2e2c0ad290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:59.639 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.615+0000 7f2e316de640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2e2c15fe10 0x7f2e2c0adcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:59.639 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.615+0000 7f2e316de640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e2c1601f0 con 0x7f2e2c15fe10 2024-02-21T22:52:59.639 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.615+0000 7f2e316de640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e2c0ccac0 con 0x7f2e2c072150 2024-02-21T22:52:59.639 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.615+0000 7f2e316de640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e2c160370 con 0x7f2e2c0d0230 2024-02-21T22:52:59.640 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.615+0000 7f3252a1c640 1 Processor -- start 2024-02-21T22:52:59.640 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.615+0000 7fc696ffd640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc69806e830 0x7fc6980c4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:59.640 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.615+0000 7f9eca3c8640 1 -- 172.21.15.116:0/3839971820 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9ec406ec00 msgr2=0x7f9ec40b4540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:59.640 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.615+0000 7f9eca3c8640 1 --2- 172.21.15.116:0/3839971820 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9ec406ec00 0x7f9ec40b4540 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f9ec406bed0 tx=0x7f9ebc02e330 comp rx=0 tx=0).stop 2024-02-21T22:52:59.641 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.615+0000 7fc696ffd640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc69806e830 0x7fc6980c4980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.116:55604/0 (socket says 172.21.15.116:55604) 2024-02-21T22:52:59.641 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.616+0000 7f22db59e640 1 Processor -- start 2024-02-21T22:52:59.641 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.616+0000 7fc697fff640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc6980c9300 0x7fc6980c5e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:59.642 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.616+0000 7f22db59e640 1 -- start start 2024-02-21T22:52:59.643 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.616+0000 7fc697fff640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6980b1cc0 con 0x7fc698159ad0 2024-02-21T22:52:59.643 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.616+0000 7fc697fff640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6980b1b40 con 0x7fc6980c9300 2024-02-21T22:52:59.643 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.616+0000 7fc697fff640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc698159f00 con 0x7fc69806e830 2024-02-21T22:52:59.643 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.616+0000 7fc696ffd640 1 -- 172.21.15.116:0/4128511891 learned_addr learned my addr 172.21.15.116:0/4128511891 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:52:59.643 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.616+0000 7fc6977fe640 1 --2- 172.21.15.116:0/4128511891 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc6980c9300 0x7fc6980c5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:59.643 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.616+0000 7fc6967fc640 1 --2- 172.21.15.116:0/4128511891 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc698159ad0 0x7fc6980c8dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:59.643 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.616+0000 7fc696ffd640 1 -- 172.21.15.116:0/4128511891 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc6980c9300 msgr2=0x7fc6980c5e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:59.643 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.616+0000 7fc696ffd640 1 --2- 172.21.15.116:0/4128511891 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc6980c9300 0x7fc6980c5e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:59.643 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.616+0000 7fc696ffd640 1 -- 172.21.15.116:0/4128511891 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc698159ad0 msgr2=0x7fc6980c8dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:59.643 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.616+0000 7f845991e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f845406f1a0 0x7f84541585d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:59.644 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.616+0000 7fc696ffd640 1 --2- 172.21.15.116:0/4128511891 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc698159ad0 0x7fc6980c8dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:59.644 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.616+0000 7fc696ffd640 1 -- 172.21.15.116:0/4128511891 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc69815c730 con 0x7fc69806e830 2024-02-21T22:52:59.644 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.616+0000 7f3252a1c640 1 -- start start 2024-02-21T22:52:59.644 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.616+0000 7f845991e640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f84541628a0 0x7f8454165160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:59.645 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.616+0000 7fca56ffd640 1 -- 172.21.15.116:0/1370586682 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca4c00b600 con 0x7fca40004800 2024-02-21T22:52:59.645 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.616+0000 7f8452ffd640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f845406f1a0 0x7f84541585d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:59.645 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.616+0000 7f8452ffd640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f845406f1a0 0x7f84541585d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.116:40944/0 (socket says 172.21.15.116:40944) 2024-02-21T22:52:59.645 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.616+0000 7fca56ffd640 1 -- 172.21.15.116:0/1370586682 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca4c038070 con 0x7fca40004800 2024-02-21T22:52:59.645 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.616+0000 7fca56ffd640 1 -- 172.21.15.116:0/1370586682 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca4c0338e0 con 0x7fca40004800 2024-02-21T22:52:59.646 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.616+0000 7f8452ffd640 1 -- 172.21.15.116:0/817392968 learned_addr learned my addr 172.21.15.116:0/817392968 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:52:59.646 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.616+0000 7fc6967fc640 1 --2- 172.21.15.116:0/4128511891 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc698159ad0 0x7fc6980c8dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T22:52:59.646 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.616+0000 7f845991e640 1 --2- 172.21.15.116:0/817392968 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f84540af4e0 0x7f84541f7430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:59.647 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.615+0000 7f2e2a7fc640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2e2c0d0230 0x7f2e2c0ad290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:59.647 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.615+0000 7f2e2b7fe640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2e2c15fe10 0x7f2e2c0adcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:59.647 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.616+0000 7f2e2b7fe640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2e2c15fe10 0x7f2e2c0adcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:34168/0 (socket says 172.21.15.116:34168) 2024-02-21T22:52:59.647 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.616+0000 7f2e2b7fe640 1 -- 172.21.15.116:0/1225498245 learned_addr learned my addr 172.21.15.116:0/1225498245 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:52:59.647 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.617+0000 7f2e2affd640 1 --2- 172.21.15.116:0/1225498245 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2e2c072150 0x7f2e2c15baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:59.647 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.617+0000 7fca5e895640 1 -- 172.21.15.116:0/1370586682 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fca40004800 msgr2=0x7fca40004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:59.647 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.617+0000 7fca5e895640 1 --2- 172.21.15.116:0/1370586682 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fca40004800 0x7fca40004c80 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fca4c00ba00 tx=0x7fca40005830 comp rx=0 tx=0).stop 2024-02-21T22:52:59.647 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.617+0000 7fc696ffd640 1 --2- 172.21.15.116:0/4128511891 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc69806e830 0x7fc6980c4980 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fc688000c00 tx=0x7fc6880046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:52:59.648 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.617+0000 7f845991e640 1 -- 172.21.15.116:0/817392968 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f845415e390 con 0x7f84541628a0 2024-02-21T22:52:59.648 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.617+0000 7fca5e895640 1 -- 172.21.15.116:0/1370586682 shutdown_connections 2024-02-21T22:52:59.648 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.617+0000 7f84537fe640 1 --2- 172.21.15.116:0/817392968 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f84540af4e0 0x7f84541f7430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:59.648 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.617+0000 7f845991e640 1 -- 172.21.15.116:0/817392968 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84541620a0 con 0x7f845406f1a0 2024-02-21T22:52:59.649 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.617+0000 7f9eca3c8640 1 -- 172.21.15.116:0/3839971820 shutdown_connections 2024-02-21T22:52:59.649 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.617+0000 7f9eca3c8640 1 --2- 172.21.15.116:0/3839971820 >> v2:172.21.15.116:3300/0 conn(0x7f9ec40cd7d0 0x7f9ec415aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:59.649 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.617+0000 7f9eca3c8640 1 --2- 172.21.15.116:0/3839971820 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9ec406ec00 0x7f9ec40b4540 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:59.649 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.617+0000 7f9eca3c8640 1 -- 172.21.15.116:0/3839971820 >> 172.21.15.116:0/3839971820 conn(0x7f9ec40b1e90 msgr2=0x7f9ec406ae40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:52:59.649 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.617+0000 7f845991e640 1 -- 172.21.15.116:0/817392968 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f845406f760 con 0x7f84540af4e0 2024-02-21T22:52:59.649 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.617+0000 7f3252a1c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f324c070b70 0x7f324c14f440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:59.650 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.617+0000 7f3252a1c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f324c0b44a0 0x7f324c15c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:59.650 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.617+0000 7fca5e895640 1 --2- 172.21.15.116:0/1370586682 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fca40004800 0x7fca40004c80 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:59.650 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.617+0000 7fca5e895640 1 -- 172.21.15.116:0/1370586682 >> 172.21.15.116:0/1370586682 conn(0x7fca580b19a0 msgr2=0x7fca580b1db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:52:59.650 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.617+0000 7f3252a1c640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f324c0b48d0 0x7f324c15cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:59.650 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.617+0000 7f3252a1c640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f324c0b2400 con 0x7f324c0b48d0 2024-02-21T22:52:59.650 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.617+0000 7f3252a1c640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f324c15e4a0 con 0x7f324c0b44a0 2024-02-21T22:52:59.651 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.617+0000 7f3252a1c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f324c0b2580 con 0x7f324c070b70 2024-02-21T22:52:59.651 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.617+0000 7f776ffff640 1 Processor -- start 2024-02-21T22:52:59.651 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.617+0000 7f776ffff640 1 -- start start 2024-02-21T22:52:59.651 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.617+0000 7f22db59e640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f22dc0b1430 0x7f22dc1604d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:59.652 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.617+0000 7f324bfff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f324c070b70 0x7f324c14f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:59.652 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.617+0000 7f324bfff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f324c070b70 0x7f324c14f440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.116:55632/0 (socket says 172.21.15.116:55632) 2024-02-21T22:52:59.652 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.617+0000 7f324bfff640 1 -- 172.21.15.116:0/3908767125 learned_addr learned my addr 172.21.15.116:0/3908767125 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:52:59.652 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.617+0000 7f3250fb9640 1 --2- 172.21.15.116:0/3908767125 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f324c0b48d0 0x7f324c15cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:59.652 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.617+0000 7f84527fc640 1 --2- 172.21.15.116:0/817392968 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f84541628a0 0x7f8454165160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:59.652 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.617+0000 7f324b7fe640 1 --2- 172.21.15.116:0/3908767125 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f324c0b44a0 0x7f324c15c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:59.653 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.617+0000 7f2e2affd640 1 -- 172.21.15.116:0/1225498245 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2e2c0d0230 msgr2=0x7f2e2c0ad290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:59.653 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.617+0000 7f2e2affd640 1 --2- 172.21.15.116:0/1225498245 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2e2c0d0230 0x7f2e2c0ad290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:59.653 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.617+0000 7f2e2affd640 1 -- 172.21.15.116:0/1225498245 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2e2c15fe10 msgr2=0x7f2e2c0adcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:59.653 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.617+0000 7fc67f7fe640 1 -- 172.21.15.116:0/4128511891 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc688042070 con 0x7fc69806e830 2024-02-21T22:52:59.653 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.617+0000 7fc67f7fe640 1 -- 172.21.15.116:0/4128511891 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc688032950 con 0x7fc69806e830 2024-02-21T22:52:59.653 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.617+0000 7fc67f7fe640 1 -- 172.21.15.116:0/4128511891 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc688037040 con 0x7fc69806e830 2024-02-21T22:52:59.653 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.617+0000 7fc697fff640 1 -- 172.21.15.116:0/4128511891 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc69815ca10 con 0x7fc69806e830 2024-02-21T22:52:59.653 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.617+0000 7fc697fff640 1 -- 172.21.15.116:0/4128511891 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc69815a330 con 0x7fc69806e830 2024-02-21T22:52:59.654 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.617+0000 7f9eca3c8640 1 -- 172.21.15.116:0/3839971820 shutdown_connections 2024-02-21T22:52:59.654 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.617+0000 7f9eca3c8640 1 -- 172.21.15.116:0/3839971820 wait complete. 2024-02-21T22:52:59.654 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.617+0000 7f84527fc640 1 -- 172.21.15.116:0/817392968 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f84540af4e0 msgr2=0x7f84541f7430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:59.654 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.618+0000 7f84527fc640 1 --2- 172.21.15.116:0/817392968 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f84540af4e0 0x7f84541f7430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:59.654 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.618+0000 7f84527fc640 1 -- 172.21.15.116:0/817392968 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f845406f1a0 msgr2=0x7f84541585d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:59.654 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.618+0000 7f84527fc640 1 --2- 172.21.15.116:0/817392968 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f845406f1a0 0x7f84541585d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:59.654 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.618+0000 7f84527fc640 1 -- 172.21.15.116:0/817392968 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84541640c0 con 0x7f84541628a0 2024-02-21T22:52:59.654 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.618+0000 7f8452ffd640 1 --2- 172.21.15.116:0/817392968 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f845406f1a0 0x7f84541585d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T22:52:59.655 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.618+0000 7f2e2affd640 1 --2- 172.21.15.116:0/1225498245 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2e2c15fe10 0x7f2e2c0adcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:59.655 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.618+0000 7f2e2affd640 1 -- 172.21.15.116:0/1225498245 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e2c0ae6b0 con 0x7f2e2c072150 2024-02-21T22:52:59.655 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.618+0000 7f2e2b7fe640 1 --2- 172.21.15.116:0/1225498245 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2e2c15fe10 0x7f2e2c0adcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T22:52:59.655 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.617+0000 7f324b7fe640 1 -- 172.21.15.116:0/3908767125 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f324c070b70 msgr2=0x7f324c14f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:59.655 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.617+0000 7f324b7fe640 1 --2- 172.21.15.116:0/3908767125 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f324c070b70 0x7f324c14f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:59.655 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.617+0000 7f324b7fe640 1 -- 172.21.15.116:0/3908767125 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f324c0b48d0 msgr2=0x7f324c15cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:59.655 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.617+0000 7f324b7fe640 1 --2- 172.21.15.116:0/3908767125 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f324c0b48d0 0x7f324c15cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:59.655 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.617+0000 7f324b7fe640 1 -- 172.21.15.116:0/3908767125 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f324c151110 con 0x7f324c0b44a0 2024-02-21T22:52:59.656 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.618+0000 7f324b7fe640 1 --2- 172.21.15.116:0/3908767125 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f324c0b44a0 0x7f324c15c6d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3240035000 tx=0x7f32400046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:52:59.656 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.618+0000 7f84527fc640 1 --2- 172.21.15.116:0/817392968 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f84541628a0 0x7f8454165160 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f844c00c780 tx=0x7f844c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:52:59.656 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.618+0000 7f22db59e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f22dc0cd4a0 0x7f22dc14c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:59.656 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.618+0000 7f22db59e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f22dc15dc60 0x7f22dc06cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:59.656 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.618+0000 7f22db59e640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22dc15e040 con 0x7f22dc0b1430 2024-02-21T22:52:59.656 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.618+0000 7f22db59e640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22dc0cb2d0 con 0x7f22dc0cd4a0 2024-02-21T22:52:59.656 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.618+0000 7f22db59e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22dc0aef00 con 0x7f22dc15dc60 2024-02-21T22:52:59.656 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.618+0000 7f22da59c640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f22dc0b1430 0x7f22dc1604d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:59.657 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.618+0000 7f3248ff9640 1 -- 172.21.15.116:0/3908767125 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3240045030 con 0x7f324c0b44a0 2024-02-21T22:52:59.657 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.618+0000 7f2e2affd640 1 --2- 172.21.15.116:0/1225498245 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2e2c072150 0x7f2e2c15baa0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f2e24007db0 tx=0x7f2e2400e4b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:52:59.657 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.618+0000 7fca5e895640 1 -- 172.21.15.116:0/1370586682 shutdown_connections 2024-02-21T22:52:59.658 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.618+0000 7f3248ff9640 1 -- 172.21.15.116:0/3908767125 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f324002e790 con 0x7f324c0b44a0 2024-02-21T22:52:59.658 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.618+0000 7f3252a1c640 1 -- 172.21.15.116:0/3908767125 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f324c1513f0 con 0x7f324c0b44a0 2024-02-21T22:52:59.658 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.618+0000 7f2e137fe640 1 -- 172.21.15.116:0/1225498245 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e24014420 con 0x7f2e2c072150 2024-02-21T22:52:59.658 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.618+0000 7f2e137fe640 1 -- 172.21.15.116:0/1225498245 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e24019070 con 0x7f2e2c072150 2024-02-21T22:52:59.658 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.618+0000 7f2e137fe640 1 -- 172.21.15.116:0/1225498245 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e240147e0 con 0x7f2e2c072150 2024-02-21T22:52:59.658 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.618+0000 7f3252a1c640 1 -- 172.21.15.116:0/3908767125 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f324c1519b0 con 0x7f324c0b44a0 2024-02-21T22:52:59.659 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.618+0000 7f776ffff640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7768038110 0x7f77680dcae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:59.659 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.618+0000 7f843bfff640 1 -- 172.21.15.116:0/817392968 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f844c016020 con 0x7f84541628a0 2024-02-21T22:52:59.659 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.618+0000 7f3248ff9640 1 -- 172.21.15.116:0/3908767125 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f324003b040 con 0x7f324c0b44a0 2024-02-21T22:52:59.659 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.618+0000 7f776ffff640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f776804ffd0 0x7f77680ec1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:59.660 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.619+0000 7fc697fff640 1 -- 172.21.15.116:0/4128511891 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc69815c4e0 con 0x7fc69806e830 2024-02-21T22:52:59.660 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.618+0000 7f843bfff640 1 -- 172.21.15.116:0/817392968 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f844c00aa90 con 0x7f84541628a0 2024-02-21T22:52:59.660 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.618+0000 7f843bfff640 1 -- 172.21.15.116:0/817392968 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f844c00ce30 con 0x7f84541628a0 2024-02-21T22:52:59.660 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.619+0000 7f845991e640 1 -- 172.21.15.116:0/817392968 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84541643a0 con 0x7f84541628a0 2024-02-21T22:52:59.660 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.619+0000 7f776ffff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f77680ead00 0x7f7768049460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:59.661 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.619+0000 7f845991e640 1 -- 172.21.15.116:0/817392968 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8454164960 con 0x7f84541628a0 2024-02-21T22:52:59.661 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.619+0000 7f22d9d9b640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f22dc0cd4a0 0x7f22dc14c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:59.661 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.619+0000 7f22d9d9b640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f22dc0cd4a0 0x7f22dc14c1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.116:40970/0 (socket says 172.21.15.116:40970) 2024-02-21T22:52:59.661 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.619+0000 7f22d9d9b640 1 -- 172.21.15.116:0/565265363 learned_addr learned my addr 172.21.15.116:0/565265363 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:52:59.661 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.619+0000 7f776e7fc640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f776804ffd0 0x7f77680ec1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:59.661 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.619+0000 7f776e7fc640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f776804ffd0 0x7f77680ec1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.116:40978/0 (socket says 172.21.15.116:40978) 2024-02-21T22:52:59.662 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.618+0000 7fca5e895640 1 -- 172.21.15.116:0/1370586682 wait complete. 2024-02-21T22:52:59.662 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.619+0000 7f776e7fc640 1 -- 172.21.15.116:0/341894639 learned_addr learned my addr 172.21.15.116:0/341894639 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:52:59.662 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.619+0000 7f776f7fe640 1 --2- 172.21.15.116:0/341894639 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f77680ead00 0x7f7768049460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:59.663 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.619+0000 7f22d9d9b640 1 -- 172.21.15.116:0/565265363 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f22dc15dc60 msgr2=0x7f22dc06cd00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-21T22:52:59.663 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.619+0000 7f22d9d9b640 1 --2- 172.21.15.116:0/565265363 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f22dc15dc60 0x7f22dc06cd00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:59.663 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.619+0000 7f22d9d9b640 1 -- 172.21.15.116:0/565265363 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f22dc0b1430 msgr2=0x7f22dc1604d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:59.663 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.619+0000 7f22d9d9b640 1 --2- 172.21.15.116:0/565265363 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f22dc0b1430 0x7f22dc1604d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:59.663 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.619+0000 7f22d9d9b640 1 -- 172.21.15.116:0/565265363 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22dc0b26d0 con 0x7f22dc0cd4a0 2024-02-21T22:52:59.663 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.619+0000 7f22da59c640 1 --2- 172.21.15.116:0/565265363 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f22dc0b1430 0x7f22dc1604d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T22:52:59.663 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.619+0000 7f2e316de640 1 -- 172.21.15.116:0/1225498245 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e2c0ac7b0 con 0x7f2e2c072150 2024-02-21T22:52:59.663 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.619+0000 7f2e316de640 1 -- 172.21.15.116:0/1225498245 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e2c0acd70 con 0x7f2e2c072150 2024-02-21T22:52:59.664 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.620+0000 7f22d9d9b640 1 --2- 172.21.15.116:0/565265363 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f22dc0cd4a0 0x7f22dc14c1b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f22d400ccd0 tx=0x7f22d400a5c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:52:59.664 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.620+0000 7fca5e895640 1 Processor -- start 2024-02-21T22:52:59.664 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.620+0000 7f845991e640 1 -- 172.21.15.116:0/817392968 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8454164d60 con 0x7f84541628a0 2024-02-21T22:52:59.664 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.621+0000 7f3248ff9640 1 -- 172.21.15.116:0/3908767125 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f3240048070 con 0x7f324c0b44a0 2024-02-21T22:52:59.665 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.621+0000 7f2e316de640 1 -- 172.21.15.116:0/1225498245 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2e2c0b2b10 con 0x7f2e2c072150 2024-02-21T22:52:59.665 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.621+0000 7f3252a1c640 1 -- 172.21.15.116:0/3908767125 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f322c001030 con 0x7f324c0b44a0 2024-02-21T22:52:59.665 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.621+0000 7f22caffd640 1 -- 172.21.15.116:0/565265363 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22d4003990 con 0x7f22dc0cd4a0 2024-02-21T22:52:59.666 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.621+0000 7f22caffd640 1 -- 172.21.15.116:0/565265363 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22d4003b30 con 0x7f22dc0cd4a0 2024-02-21T22:52:59.666 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.619+0000 7f9eca3c8640 1 Processor -- start 2024-02-21T22:52:59.666 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.619+0000 7f9eca3c8640 1 -- start start 2024-02-21T22:52:59.666 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.621+0000 7f22db59e640 1 -- 172.21.15.116:0/565265363 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22dc0b29b0 con 0x7f22dc0cd4a0 2024-02-21T22:52:59.666 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.620+0000 7f9eca3c8640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9ec406ec00 0x7f9ec41faa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:59.666 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.621+0000 7f9ec3fff640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9ec406ec00 0x7f9ec41faa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:59.667 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.621+0000 7fc67f7fe640 1 -- 172.21.15.116:0/4128511891 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fc688045070 con 0x7fc69806e830 2024-02-21T22:52:59.667 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.621+0000 7f22db59e640 1 -- 172.21.15.116:0/565265363 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22dc0b2f70 con 0x7f22dc0cd4a0 2024-02-21T22:52:59.667 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.621+0000 7f22caffd640 1 -- 172.21.15.116:0/565265363 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22d4004020 con 0x7f22dc0cd4a0 2024-02-21T22:52:59.668 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.620+0000 7fca5e895640 1 -- start start 2024-02-21T22:52:59.668 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.621+0000 7fca5e895640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fca40004800 0x7fca5814bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:59.668 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.621+0000 7fca5e895640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fca580aa340 0x7fca580aa7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:59.668 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.621+0000 7fca5e895640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fca58157760 0x7fca58157c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:59.668 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.621+0000 7f3248ff9640 1 --2- 172.21.15.116:0/3908767125 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f323806b520 0x7f323806d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:59.668 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.621+0000 7fc67f7fe640 1 --2- 172.21.15.116:0/4128511891 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fc68406b5a0 0x7fc68406da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:59.669 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.621+0000 7fca5e895640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca580cec50 con 0x7fca40004800 2024-02-21T22:52:59.669 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.622+0000 7f2e137fe640 1 -- 172.21.15.116:0/1225498245 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f2e24014980 con 0x7f2e2c072150 2024-02-21T22:52:59.669 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.622+0000 7fc67f7fe640 1 -- 172.21.15.116:0/4128511891 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc6880ac800 con 0x7fc69806e830 2024-02-21T22:52:59.670 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.622+0000 7f3248ff9640 1 -- 172.21.15.116:0/3908767125 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f32400ac020 con 0x7f324c0b44a0 2024-02-21T22:52:59.670 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.622+0000 7fca5ce32640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fca58157760 0x7fca58157c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:59.670 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.622+0000 7fca5ce32640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fca58157760 0x7fca58157c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.116:55664/0 (socket says 172.21.15.116:55664) 2024-02-21T22:52:59.670 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.622+0000 7f324bfff640 1 --2- 172.21.15.116:0/3908767125 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f323806b520 0x7f323806d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:59.671 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.622+0000 7fca5ce32640 1 -- 172.21.15.116:0/2161330314 learned_addr learned my addr 172.21.15.116:0/2161330314 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:52:59.671 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.622+0000 7fca5e895640 1 -- 172.21.15.116:0/2161330314 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca580cead0 con 0x7fca580aa340 2024-02-21T22:52:59.671 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.622+0000 7fca57fff640 1 --2- 172.21.15.116:0/2161330314 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fca40004800 0x7fca5814bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:59.671 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.622+0000 7fca5e895640 1 -- 172.21.15.116:0/2161330314 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca580cfcf0 con 0x7fca58157760 2024-02-21T22:52:59.671 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.622+0000 7f3248ff9640 1 --2- 172.21.15.116:0/3908767125 >> [v2:172.21.15.142:6824/3231407772,v1:172.21.15.142:6825/3231407772] conn(0x7f3238073740 0x7f3238075b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:59.671 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.622+0000 7f3248ff9640 1 -- 172.21.15.116:0/3908767125 --> [v2:172.21.15.142:6824/3231407772,v1:172.21.15.142:6825/3231407772] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3240043e50 con 0x7f3238073740 2024-02-21T22:52:59.672 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.622+0000 7f3248ff9640 1 -- 172.21.15.116:0/3908767125 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f32400b3050 con 0x7f324c0b44a0 2024-02-21T22:52:59.672 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.622+0000 7fc67f7fe640 1 --2- 172.21.15.116:0/4128511891 >> [v2:172.21.15.116:6816/172614746,v1:172.21.15.116:6817/172614746] conn(0x7fc684073820 0x7fc684075c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:59.672 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.622+0000 7fc67f7fe640 1 -- 172.21.15.116:0/4128511891 --> [v2:172.21.15.116:6816/172614746,v1:172.21.15.116:6817/172614746] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc688007e60 con 0x7fc684073820 2024-02-21T22:52:59.672 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.621+0000 7f9ec3fff640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9ec406ec00 0x7f9ec41faa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:34202/0 (socket says 172.21.15.116:34202) 2024-02-21T22:52:59.672 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.621+0000 7f9ec3fff640 1 -- 172.21.15.116:0/4207542375 learned_addr learned my addr 172.21.15.116:0/4207542375 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:52:59.672 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.621+0000 7f9eca3c8640 1 --2- 172.21.15.116:0/4207542375 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9ec40cd7d0 0x7f9ec4204800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:59.673 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.622+0000 7fc67f7fe640 1 -- 172.21.15.116:0/4128511891 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc6880acbf0 con 0x7fc69806e830 2024-02-21T22:52:59.673 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.622+0000 7fc6967fc640 1 --2- 172.21.15.116:0/4128511891 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fc68406b5a0 0x7fc68406da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:59.673 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.622+0000 7fc6977fe640 1 --2- 172.21.15.116:0/4128511891 >> [v2:172.21.15.116:6816/172614746,v1:172.21.15.116:6817/172614746] conn(0x7fc684073820 0x7fc684075c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:59.673 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.622+0000 7f3250fb9640 1 --2- 172.21.15.116:0/3908767125 >> [v2:172.21.15.142:6824/3231407772,v1:172.21.15.142:6825/3231407772] conn(0x7f3238073740 0x7f3238075b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:59.674 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.621+0000 7f9eca3c8640 1 --2- 172.21.15.116:0/4207542375 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9ec40cdc60 0x7f9ec4152f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:59.674 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.621+0000 7f9eca3c8640 1 -- 172.21.15.116:0/4207542375 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec40b4c00 con 0x7f9ec406ec00 2024-02-21T22:52:59.674 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.621+0000 7f9eca3c8640 1 -- 172.21.15.116:0/4207542375 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec40b4a80 con 0x7f9ec40cd7d0 2024-02-21T22:52:59.674 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.621+0000 7f9eca3c8640 1 -- 172.21.15.116:0/4207542375 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec406b550 con 0x7f9ec40cdc60 2024-02-21T22:52:59.674 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.621+0000 7f9ec37fe640 1 --2- 172.21.15.116:0/4207542375 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9ec40cd7d0 0x7f9ec4204800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:59.674 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.621+0000 7f9ec8965640 1 --2- 172.21.15.116:0/4207542375 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9ec40cdc60 0x7f9ec4152f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:59.674 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.622+0000 7f9ec3fff640 1 -- 172.21.15.116:0/4207542375 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9ec40cdc60 msgr2=0x7f9ec4152f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:59.674 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.622+0000 7f9ec3fff640 1 --2- 172.21.15.116:0/4207542375 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9ec40cdc60 0x7f9ec4152f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:59.674 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.622+0000 7f9ec3fff640 1 -- 172.21.15.116:0/4207542375 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9ec40cd7d0 msgr2=0x7f9ec4204800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:59.674 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.622+0000 7f9ec3fff640 1 --2- 172.21.15.116:0/4207542375 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9ec40cd7d0 0x7f9ec4204800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:59.674 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.622+0000 7f9ec3fff640 1 -- 172.21.15.116:0/4207542375 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ec4151ec0 con 0x7f9ec406ec00 2024-02-21T22:52:59.674 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.622+0000 7f9ec37fe640 1 --2- 172.21.15.116:0/4207542375 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9ec40cd7d0 0x7f9ec4204800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T22:52:59.674 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.622+0000 7f9ec8965640 1 --2- 172.21.15.116:0/4207542375 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9ec40cdc60 0x7f9ec4152f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T22:52:59.675 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.619+0000 7f776ffff640 1 -- 172.21.15.116:0/341894639 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7768054940 con 0x7f7768038110 2024-02-21T22:52:59.675 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.621+0000 7f776ffff640 1 -- 172.21.15.116:0/341894639 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77680547c0 con 0x7f776804ffd0 2024-02-21T22:52:59.675 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.621+0000 7f776ffff640 1 -- 172.21.15.116:0/341894639 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f776804f550 con 0x7f77680ead00 2024-02-21T22:52:59.675 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.622+0000 7f9ec3fff640 1 --2- 172.21.15.116:0/4207542375 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9ec406ec00 0x7f9ec41faa90 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f9ebc03a040 tx=0x7f9ebc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:52:59.675 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.622+0000 7f324bfff640 1 --2- 172.21.15.116:0/3908767125 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f323806b520 0x7f323806d9e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f323c007fd0 tx=0x7f323c000f10 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:52:59.676 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.622+0000 7f2e137fe640 1 --2- 172.21.15.116:0/1225498245 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f2e1806b5a0 0x7f2e1806da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:59.676 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.622+0000 7fca57fff640 1 -- 172.21.15.116:0/2161330314 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fca58157760 msgr2=0x7fca58157c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:59.676 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.622+0000 7fca57fff640 1 --2- 172.21.15.116:0/2161330314 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fca58157760 0x7fca58157c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:59.676 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.622+0000 7fc6977fe640 1 --2- 172.21.15.116:0/4128511891 >> [v2:172.21.15.116:6816/172614746,v1:172.21.15.116:6817/172614746] conn(0x7fc684073820 0x7fc684075c40 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:52:59.677 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.622+0000 7fca57fff640 1 -- 172.21.15.116:0/2161330314 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fca580aa340 msgr2=0x7fca580aa7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:59.677 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.622+0000 7fca57fff640 1 --2- 172.21.15.116:0/2161330314 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fca580aa340 0x7fca580aa7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:59.677 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.622+0000 7fca57fff640 1 -- 172.21.15.116:0/2161330314 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca5814bff0 con 0x7fca40004800 2024-02-21T22:52:59.677 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.623+0000 7f776effd640 1 --2- 172.21.15.116:0/341894639 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7768038110 0x7f77680dcae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:59.677 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.622+0000 7f843bfff640 1 -- 172.21.15.116:0/817392968 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f844c019020 con 0x7f84541628a0 2024-02-21T22:52:59.678 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.623+0000 7f9ec0ff9640 1 -- 172.21.15.116:0/4207542375 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ebc047070 con 0x7f9ec406ec00 2024-02-21T22:52:59.678 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.623+0000 7f9ec0ff9640 1 -- 172.21.15.116:0/4207542375 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ebc008240 con 0x7f9ec406ec00 2024-02-21T22:52:59.678 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.623+0000 7f2e137fe640 1 -- 172.21.15.116:0/1225498245 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2e2408a980 con 0x7f2e2c072150 2024-02-21T22:52:59.678 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.623+0000 7f2e137fe640 1 --2- 172.21.15.116:0/1225498245 >> [v2:172.21.15.142:6816/1184158716,v1:172.21.15.142:6817/1184158716] conn(0x7f2e180737c0 0x7f2e18075be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:59.678 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.623+0000 7f2e137fe640 1 -- 172.21.15.116:0/1225498245 --> [v2:172.21.15.142:6816/1184158716,v1:172.21.15.142:6817/1184158716] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2e24018ec0 con 0x7f2e180737c0 2024-02-21T22:52:59.678 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.623+0000 7f2e137fe640 1 -- 172.21.15.116:0/1225498245 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2e2408f2a0 con 0x7f2e2c072150 2024-02-21T22:52:59.678 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.623+0000 7f2e2a7fc640 1 --2- 172.21.15.116:0/1225498245 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f2e1806b5a0 0x7f2e1806da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:59.679 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.623+0000 7f3250fb9640 1 --2- 172.21.15.116:0/3908767125 >> [v2:172.21.15.142:6824/3231407772,v1:172.21.15.142:6825/3231407772] conn(0x7f3238073740 0x7f3238075b60 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:52:59.679 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.623+0000 7f776effd640 1 -- 172.21.15.116:0/341894639 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f77680ead00 msgr2=0x7f7768049460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:59.679 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.623+0000 7f776effd640 1 --2- 172.21.15.116:0/341894639 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f77680ead00 0x7f7768049460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:59.679 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.623+0000 7f776effd640 1 -- 172.21.15.116:0/341894639 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f776804ffd0 msgr2=0x7f77680ec1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:59.679 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.623+0000 7f776effd640 1 --2- 172.21.15.116:0/341894639 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f776804ffd0 0x7f77680ec1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:59.679 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.623+0000 7f2e2b7fe640 1 --2- 172.21.15.116:0/1225498245 >> [v2:172.21.15.142:6816/1184158716,v1:172.21.15.142:6817/1184158716] conn(0x7f2e180737c0 0x7f2e18075be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:59.680 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.623+0000 7f776effd640 1 -- 172.21.15.116:0/341894639 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77680dd130 con 0x7f7768038110 2024-02-21T22:52:59.680 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.623+0000 7f22db59e640 1 -- 172.21.15.116:0/565265363 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f22dc0752f0 con 0x7f22dc0cd4a0 2024-02-21T22:52:59.681 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.623+0000 7f9ec0ff9640 1 -- 172.21.15.116:0/4207542375 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ebc008630 con 0x7f9ec406ec00 2024-02-21T22:52:59.681 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.623+0000 7f9eca3c8640 1 -- 172.21.15.116:0/4207542375 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ec41521a0 con 0x7f9ec406ec00 2024-02-21T22:52:59.681 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.623+0000 7f9eca3c8640 1 -- 172.21.15.116:0/4207542375 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ec4152760 con 0x7f9ec406ec00 2024-02-21T22:52:59.681 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.623+0000 7f776effd640 1 --2- 172.21.15.116:0/341894639 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7768038110 0x7f77680dcae0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f776000b3e0 tx=0x7f776000b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:52:59.682 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.623+0000 7fc6967fc640 1 --2- 172.21.15.116:0/4128511891 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fc68406b5a0 0x7fc68406da60 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc69816a0f0 tx=0x7fc68c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:52:59.682 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.623+0000 7f776f7fe640 1 --2- 172.21.15.116:0/341894639 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f77680ead00 0x7f7768049460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T22:52:59.682 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.624+0000 7fc67f7fe640 1 -- 172.21.15.116:0/4128511891 <== osd.1 v2:172.21.15.116:6816/172614746 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fc688007e60 con 0x7fc684073820 2024-02-21T22:52:59.683 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.624+0000 7f77577fe640 1 -- 172.21.15.116:0/341894639 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7760015020 con 0x7f7768038110 2024-02-21T22:52:59.683 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.624+0000 7f77577fe640 1 -- 172.21.15.116:0/341894639 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7760011830 con 0x7f7768038110 2024-02-21T22:52:59.683 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.624+0000 7f77577fe640 1 -- 172.21.15.116:0/341894639 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7760011c00 con 0x7f7768038110 2024-02-21T22:52:59.683 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.624+0000 7f776ffff640 1 -- 172.21.15.116:0/341894639 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77680dd410 con 0x7f7768038110 2024-02-21T22:52:59.683 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.624+0000 7f843bfff640 1 --2- 172.21.15.116:0/817392968 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f844006b520 0x7f844006d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:59.684 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.624+0000 7f776ffff640 1 -- 172.21.15.116:0/341894639 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77680dd9d0 con 0x7f7768038110 2024-02-21T22:52:59.684 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.624+0000 7f22caffd640 1 -- 172.21.15.116:0/565265363 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f22d40041c0 con 0x7f22dc0cd4a0 2024-02-21T22:52:59.684 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.624+0000 7f843bfff640 1 -- 172.21.15.116:0/817392968 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f844c089f60 con 0x7f84541628a0 2024-02-21T22:52:59.684 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.624+0000 7f843bfff640 1 --2- 172.21.15.116:0/817392968 >> [v2:172.21.15.116:6808/1613202231,v1:172.21.15.116:6809/1613202231] conn(0x7f8440073740 0x7f8440075b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:59.684 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.624+0000 7f843bfff640 1 -- 172.21.15.116:0/817392968 --> [v2:172.21.15.116:6808/1613202231,v1:172.21.15.116:6809/1613202231] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f844c008e50 con 0x7f8440073740 2024-02-21T22:52:59.685 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.624+0000 7f3248ff9640 1 -- 172.21.15.116:0/3908767125 <== osd.4 v2:172.21.15.142:6824/3231407772 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f3240043e50 con 0x7f3238073740 2024-02-21T22:52:59.685 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.624+0000 7f843bfff640 1 -- 172.21.15.116:0/817392968 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f844c091050 con 0x7f84541628a0 2024-02-21T22:52:59.685 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.624+0000 7f84537fe640 1 --2- 172.21.15.116:0/817392968 >> [v2:172.21.15.116:6808/1613202231,v1:172.21.15.116:6809/1613202231] conn(0x7f8440073740 0x7f8440075b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:59.685 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.625+0000 7f8452ffd640 1 --2- 172.21.15.116:0/817392968 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f844006b520 0x7f844006d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:59.686 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.625+0000 7f22caffd640 1 --2- 172.21.15.116:0/565265363 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f22bc06b5a0 0x7f22bc06da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:59.686 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.625+0000 7f9eca3c8640 1 -- 172.21.15.116:0/4207542375 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9ec40752f0 con 0x7f9ec406ec00 2024-02-21T22:52:59.686 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.625+0000 7f22caffd640 1 -- 172.21.15.116:0/565265363 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f22d408a620 con 0x7f22dc0cd4a0 2024-02-21T22:52:59.686 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.625+0000 7fca57fff640 1 --2- 172.21.15.116:0/2161330314 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fca40004800 0x7fca5814bab0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fca50007750 tx=0x7fca5000a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:52:59.687 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.625+0000 7f22da59c640 1 --2- 172.21.15.116:0/565265363 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f22bc06b5a0 0x7f22bc06da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:59.687 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.625+0000 7f776ffff640 1 -- 172.21.15.116:0/341894639 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7768005390 con 0x7f7768038110 2024-02-21T22:52:59.687 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.625+0000 7f84537fe640 1 --2- 172.21.15.116:0/817392968 >> [v2:172.21.15.116:6808/1613202231,v1:172.21.15.116:6809/1613202231] conn(0x7f8440073740 0x7f8440075b60 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:52:59.687 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.625+0000 7f8452ffd640 1 --2- 172.21.15.116:0/817392968 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f844006b520 0x7f844006d9e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f84540b20c0 tx=0x7f8444030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:52:59.688 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.625+0000 7f22caffd640 1 --2- 172.21.15.116:0/565265363 >> [v2:172.21.15.116:6800/3106627557,v1:172.21.15.116:6801/3106627557] conn(0x7f22bc0737c0 0x7f22bc075be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:59.688 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.625+0000 7f22caffd640 1 -- 172.21.15.116:0/565265363 --> [v2:172.21.15.116:6800/3106627557,v1:172.21.15.116:6801/3106627557] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f22d401ae50 con 0x7f22bc0737c0 2024-02-21T22:52:59.688 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.626+0000 7f2e2a7fc640 1 --2- 172.21.15.116:0/1225498245 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f2e1806b5a0 0x7f2e1806da60 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f2e20034000 tx=0x7f2e20008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:52:59.688 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.626+0000 7f22dad9d640 1 --2- 172.21.15.116:0/565265363 >> [v2:172.21.15.116:6800/3106627557,v1:172.21.15.116:6801/3106627557] conn(0x7f22bc0737c0 0x7f22bc075be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:59.688 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.626+0000 7f22caffd640 1 -- 172.21.15.116:0/565265363 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f22d4091050 con 0x7f22dc0cd4a0 2024-02-21T22:52:59.689 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.626+0000 7fca54ff9640 1 -- 172.21.15.116:0/2161330314 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca50017020 con 0x7fca40004800 2024-02-21T22:52:59.689 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.626+0000 7fca5e895640 1 -- 172.21.15.116:0/2161330314 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca580ac8d0 con 0x7fca40004800 2024-02-21T22:52:59.689 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.626+0000 7f2e2b7fe640 1 --2- 172.21.15.116:0/1225498245 >> [v2:172.21.15.142:6816/1184158716,v1:172.21.15.142:6817/1184158716] conn(0x7f2e180737c0 0x7f2e18075be0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:52:59.689 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.626+0000 7fca5e895640 1 -- 172.21.15.116:0/2161330314 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca580a9860 con 0x7fca40004800 2024-02-21T22:52:59.690 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.626+0000 7f9ec0ff9640 1 -- 172.21.15.116:0/4207542375 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f9ebc005d10 con 0x7f9ec406ec00 2024-02-21T22:52:59.690 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.627+0000 7f843bfff640 1 -- 172.21.15.116:0/817392968 <== osd.0 v2:172.21.15.116:6808/1613202231 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f844c008e50 con 0x7f8440073740 2024-02-21T22:52:59.690 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.627+0000 7f22dad9d640 1 --2- 172.21.15.116:0/565265363 >> [v2:172.21.15.116:6800/3106627557,v1:172.21.15.116:6801/3106627557] conn(0x7f22bc0737c0 0x7f22bc075be0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:52:59.690 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.627+0000 7f22da59c640 1 --2- 172.21.15.116:0/565265363 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f22bc06b5a0 0x7f22bc06da60 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f22cc00a830 tx=0x7f22cc008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:52:59.691 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.627+0000 7f9ec0ff9640 1 --2- 172.21.15.116:0/4207542375 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f9ea406b5a0 0x7f9ea406da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:59.691 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.627+0000 7f9ec0ff9640 1 -- 172.21.15.116:0/4207542375 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9ebc0ac730 con 0x7f9ec406ec00 2024-02-21T22:52:59.691 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.627+0000 7f9ec0ff9640 1 --2- 172.21.15.116:0/4207542375 >> [v2:172.21.15.142:6808/1272081937,v1:172.21.15.142:6809/1272081937] conn(0x7f9ea40737c0 0x7f9ea4075be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:59.691 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.627+0000 7f9ec0ff9640 1 -- 172.21.15.116:0/4207542375 --> [v2:172.21.15.142:6808/1272081937,v1:172.21.15.142:6809/1272081937] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9ea4076290 con 0x7f9ea40737c0 2024-02-21T22:52:59.691 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.627+0000 7f9ec0ff9640 1 -- 172.21.15.116:0/4207542375 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9ebc0acb20 con 0x7f9ec406ec00 2024-02-21T22:52:59.691 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.627+0000 7f2e137fe640 1 -- 172.21.15.116:0/1225498245 <== osd.5 v2:172.21.15.142:6816/1184158716 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f2e24018ec0 con 0x7f2e180737c0 2024-02-21T22:52:59.692 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.627+0000 7f77577fe640 1 -- 172.21.15.116:0/341894639 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f7760018020 con 0x7f7768038110 2024-02-21T22:52:59.692 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.627+0000 7f77577fe640 1 --2- 172.21.15.116:0/341894639 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f775c06b5a0 0x7f775c06da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:59.692 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.627+0000 7fca54ff9640 1 -- 172.21.15.116:0/2161330314 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca5000abb0 con 0x7fca40004800 2024-02-21T22:52:59.692 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.627+0000 7fca54ff9640 1 -- 172.21.15.116:0/2161330314 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca500133f0 con 0x7fca40004800 2024-02-21T22:52:59.692 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.627+0000 7f77577fe640 1 -- 172.21.15.116:0/341894639 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f776008a050 con 0x7f7768038110 2024-02-21T22:52:59.692 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.627+0000 7f77577fe640 1 --2- 172.21.15.116:0/341894639 >> [v2:172.21.15.116:6824/1029280577,v1:172.21.15.116:6825/1029280577] conn(0x7f775c0737a0 0x7f775c075bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:59.692 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.627+0000 7f77577fe640 1 -- 172.21.15.116:0/341894639 --> [v2:172.21.15.116:6824/1029280577,v1:172.21.15.116:6825/1029280577] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7760004510 con 0x7f775c0737a0 2024-02-21T22:52:59.693 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.627+0000 7f77577fe640 1 -- 172.21.15.116:0/341894639 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7760054ae0 con 0x7f7768038110 2024-02-21T22:52:59.693 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.628+0000 7f22caffd640 1 -- 172.21.15.116:0/565265363 <== osd.3 v2:172.21.15.116:6800/3106627557 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f22d401ae50 con 0x7f22bc0737c0 2024-02-21T22:52:59.693 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.628+0000 7f9ec37fe640 1 --2- 172.21.15.116:0/4207542375 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f9ea406b5a0 0x7f9ea406da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:59.693 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.628+0000 7f9ec8965640 1 --2- 172.21.15.116:0/4207542375 >> [v2:172.21.15.142:6808/1272081937,v1:172.21.15.142:6809/1272081937] conn(0x7f9ea40737c0 0x7f9ea4075be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:59.694 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.628+0000 7f776e7fc640 1 --2- 172.21.15.116:0/341894639 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f775c06b5a0 0x7f775c06da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:59.694 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.628+0000 7f776f7fe640 1 --2- 172.21.15.116:0/341894639 >> [v2:172.21.15.116:6824/1029280577,v1:172.21.15.116:6825/1029280577] conn(0x7f775c0737a0 0x7f775c075bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:59.694 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.628+0000 7fca3e7fc640 1 -- 172.21.15.116:0/2161330314 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fca38001030 con 0x7fca40004800 2024-02-21T22:52:59.694 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.628+0000 7fca54ff9640 1 -- 172.21.15.116:0/2161330314 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fca5001a020 con 0x7fca40004800 2024-02-21T22:52:59.695 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.628+0000 7f776e7fc640 1 --2- 172.21.15.116:0/341894639 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f775c06b5a0 0x7f775c06da60 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f77700507e0 tx=0x7f777006d040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:52:59.695 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.629+0000 7fca54ff9640 1 --2- 172.21.15.116:0/2161330314 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fca4406b550 0x7fca4406da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:59.695 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.629+0000 7f776f7fe640 1 --2- 172.21.15.116:0/341894639 >> [v2:172.21.15.116:6824/1029280577,v1:172.21.15.116:6825/1029280577] conn(0x7f775c0737a0 0x7f775c075bc0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:52:59.695 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.629+0000 7fca54ff9640 1 -- 172.21.15.116:0/2161330314 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fca5008a8f0 con 0x7fca40004800 2024-02-21T22:52:59.696 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.629+0000 7f9ec37fe640 1 --2- 172.21.15.116:0/4207542375 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f9ea406b5a0 0x7f9ea406da60 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f9ec40ab200 tx=0x7f9eb4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:52:59.696 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.629+0000 7fca54ff9640 1 --2- 172.21.15.116:0/2161330314 >> [v2:172.21.15.142:6800/1987868911,v1:172.21.15.142:6801/1987868911] conn(0x7fca44073770 0x7fca44075b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:59.696 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.629+0000 7fca54ff9640 1 -- 172.21.15.116:0/2161330314 --> [v2:172.21.15.142:6800/1987868911,v1:172.21.15.142:6801/1987868911] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fca5000be50 con 0x7fca44073770 2024-02-21T22:52:59.696 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.629+0000 7fca54ff9640 1 -- 172.21.15.116:0/2161330314 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fca5008f2c0 con 0x7fca40004800 2024-02-21T22:52:59.696 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.629+0000 7fca577fe640 1 --2- 172.21.15.116:0/2161330314 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fca4406b550 0x7fca4406da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:59.697 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.629+0000 7f9ec8965640 1 --2- 172.21.15.116:0/4207542375 >> [v2:172.21.15.142:6808/1272081937,v1:172.21.15.142:6809/1272081937] conn(0x7f9ea40737c0 0x7f9ea4075be0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:52:59.697 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.629+0000 7fca5ce32640 1 --2- 172.21.15.116:0/2161330314 >> [v2:172.21.15.142:6800/1987868911,v1:172.21.15.142:6801/1987868911] conn(0x7fca44073770 0x7fca44075b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:59.697 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.630+0000 7fca5ce32640 1 --2- 172.21.15.116:0/2161330314 >> [v2:172.21.15.142:6800/1987868911,v1:172.21.15.142:6801/1987868911] conn(0x7fca44073770 0x7fca44075b90 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:52:59.697 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.630+0000 7f77577fe640 1 -- 172.21.15.116:0/341894639 <== osd.2 v2:172.21.15.116:6824/1029280577 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f7760004510 con 0x7f775c0737a0 2024-02-21T22:52:59.698 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.630+0000 7fca577fe640 1 --2- 172.21.15.116:0/2161330314 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fca4406b550 0x7fca4406da10 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fca400057e0 tx=0x7fca4c032000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:52:59.698 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.630+0000 7f9ec0ff9640 1 -- 172.21.15.116:0/4207542375 <== osd.7 v2:172.21.15.142:6808/1272081937 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f9ea4076290 con 0x7f9ea40737c0 2024-02-21T22:52:59.698 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.631+0000 7fca54ff9640 1 -- 172.21.15.116:0/2161330314 <== osd.6 v2:172.21.15.142:6800/1987868911 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fca5000be50 con 0x7fca44073770 2024-02-21T22:52:59.699 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.655+0000 7f3252a1c640 1 -- 172.21.15.116:0/3908767125 --> [v2:172.21.15.142:6824/3231407772,v1:172.21.15.142:6825/3231407772] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f322c002dd0 con 0x7f3238073740 2024-02-21T22:52:59.699 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.656+0000 7f3248ff9640 1 -- 172.21.15.116:0/3908767125 <== osd.4 v2:172.21.15.142:6824/3231407772 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f322c002dd0 con 0x7f3238073740 2024-02-21T22:52:59.700 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.656+0000 7f32327fc640 1 -- 172.21.15.116:0/3908767125 >> [v2:172.21.15.142:6824/3231407772,v1:172.21.15.142:6825/3231407772] conn(0x7f3238073740 msgr2=0x7f3238075b60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:59.700 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.656+0000 7f32327fc640 1 --2- 172.21.15.116:0/3908767125 >> [v2:172.21.15.142:6824/3231407772,v1:172.21.15.142:6825/3231407772] conn(0x7f3238073740 0x7f3238075b60 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:59.700 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.656+0000 7f32327fc640 1 -- 172.21.15.116:0/3908767125 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f323806b520 msgr2=0x7f323806d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:59.700 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.657+0000 7f32327fc640 1 --2- 172.21.15.116:0/3908767125 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f323806b520 0x7f323806d9e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f323c007fd0 tx=0x7f323c000f10 comp rx=0 tx=0).stop 2024-02-21T22:52:59.700 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.657+0000 7f32327fc640 1 -- 172.21.15.116:0/3908767125 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f324c0b44a0 msgr2=0x7f324c15c6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:59.700 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.657+0000 7f32327fc640 1 --2- 172.21.15.116:0/3908767125 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f324c0b44a0 0x7f324c15c6d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3240035000 tx=0x7f32400046c0 comp rx=0 tx=0).stop 2024-02-21T22:52:59.700 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.657+0000 7fc697fff640 1 -- 172.21.15.116:0/4128511891 --> [v2:172.21.15.116:6816/172614746,v1:172.21.15.116:6817/172614746] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc6980c97b0 con 0x7fc684073820 2024-02-21T22:52:59.701 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.657+0000 7f3250fb9640 1 -- 172.21.15.116:0/3908767125 reap_dead start 2024-02-21T22:52:59.701 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.657+0000 7f32327fc640 1 -- 172.21.15.116:0/3908767125 shutdown_connections 2024-02-21T22:52:59.701 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.657+0000 7f32327fc640 1 -- 172.21.15.116:0/3908767125 >> 172.21.15.116:0/3908767125 conn(0x7f324c0b18e0 msgr2=0x7f324c0d0560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:52:59.701 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.657+0000 7fc67f7fe640 1 -- 172.21.15.116:0/4128511891 <== osd.1 v2:172.21.15.116:6816/172614746 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fc6980c97b0 con 0x7fc684073820 2024-02-21T22:52:59.702 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.657+0000 7f32327fc640 1 -- 172.21.15.116:0/3908767125 shutdown_connections 2024-02-21T22:52:59.702 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.657+0000 7f32327fc640 1 -- 172.21.15.116:0/3908767125 wait complete. 2024-02-21T22:52:59.703 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.658+0000 7fc67d7fa640 1 -- 172.21.15.116:0/4128511891 >> [v2:172.21.15.116:6816/172614746,v1:172.21.15.116:6817/172614746] conn(0x7fc684073820 msgr2=0x7fc684075c40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:59.703 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.658+0000 7fc67d7fa640 1 --2- 172.21.15.116:0/4128511891 >> [v2:172.21.15.116:6816/172614746,v1:172.21.15.116:6817/172614746] conn(0x7fc684073820 0x7fc684075c40 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:59.703 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.659+0000 7fc67d7fa640 1 -- 172.21.15.116:0/4128511891 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fc68406b5a0 msgr2=0x7fc68406da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:59.703 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.659+0000 7fc67d7fa640 1 --2- 172.21.15.116:0/4128511891 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fc68406b5a0 0x7fc68406da60 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc69816a0f0 tx=0x7fc68c008040 comp rx=0 tx=0).stop 2024-02-21T22:52:59.703 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.659+0000 7fc67d7fa640 1 -- 172.21.15.116:0/4128511891 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc69806e830 msgr2=0x7fc6980c4980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:59.703 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.659+0000 7fc67d7fa640 1 --2- 172.21.15.116:0/4128511891 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc69806e830 0x7fc6980c4980 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fc688000c00 tx=0x7fc6880046c0 comp rx=0 tx=0).stop 2024-02-21T22:52:59.703 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.659+0000 7fc6977fe640 1 -- 172.21.15.116:0/4128511891 reap_dead start 2024-02-21T22:52:59.703 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.659+0000 7fc67d7fa640 1 -- 172.21.15.116:0/4128511891 shutdown_connections 2024-02-21T22:52:59.703 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.659+0000 7fc67d7fa640 1 -- 172.21.15.116:0/4128511891 >> 172.21.15.116:0/4128511891 conn(0x7fc6980cf7f0 msgr2=0x7fc6980af530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:52:59.703 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.659+0000 7f845991e640 1 -- 172.21.15.116:0/817392968 --> [v2:172.21.15.116:6808/1613202231,v1:172.21.15.116:6809/1613202231] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f8454164f20 con 0x7f8440073740 2024-02-21T22:52:59.704 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.659+0000 7fc67d7fa640 1 -- 172.21.15.116:0/4128511891 shutdown_connections 2024-02-21T22:52:59.704 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.659+0000 7fc67d7fa640 1 -- 172.21.15.116:0/4128511891 wait complete. 2024-02-21T22:52:59.704 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.659+0000 7f843bfff640 1 -- 172.21.15.116:0/817392968 <== osd.0 v2:172.21.15.116:6808/1613202231 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f8454164f20 con 0x7f8440073740 2024-02-21T22:52:59.705 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.660+0000 7f22db59e640 1 -- 172.21.15.116:0/565265363 --> [v2:172.21.15.116:6800/3106627557,v1:172.21.15.116:6801/3106627557] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f22dc0ca450 con 0x7f22bc0737c0 2024-02-21T22:52:59.705 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.660+0000 7f22caffd640 1 -- 172.21.15.116:0/565265363 <== osd.3 v2:172.21.15.116:6800/3106627557 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f22dc0ca450 con 0x7f22bc0737c0 2024-02-21T22:52:59.706 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.660+0000 7f845991e640 1 -- 172.21.15.116:0/817392968 >> [v2:172.21.15.116:6808/1613202231,v1:172.21.15.116:6809/1613202231] conn(0x7f8440073740 msgr2=0x7f8440075b60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:59.706 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.660+0000 7f845991e640 1 --2- 172.21.15.116:0/817392968 >> [v2:172.21.15.116:6808/1613202231,v1:172.21.15.116:6809/1613202231] conn(0x7f8440073740 0x7f8440075b60 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:59.706 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.661+0000 7f845991e640 1 -- 172.21.15.116:0/817392968 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f844006b520 msgr2=0x7f844006d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:59.706 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.661+0000 7f845991e640 1 --2- 172.21.15.116:0/817392968 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f844006b520 0x7f844006d9e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f84540b20c0 tx=0x7f8444030000 comp rx=0 tx=0).stop 2024-02-21T22:52:59.706 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.661+0000 7f845991e640 1 -- 172.21.15.116:0/817392968 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f84541628a0 msgr2=0x7f8454165160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:59.706 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.661+0000 7f845991e640 1 --2- 172.21.15.116:0/817392968 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f84541628a0 0x7f8454165160 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f844c00c780 tx=0x7f844c00cc40 comp rx=0 tx=0).stop 2024-02-21T22:52:59.707 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.661+0000 7f84537fe640 1 -- 172.21.15.116:0/817392968 reap_dead start 2024-02-21T22:52:59.707 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.661+0000 7f845991e640 1 -- 172.21.15.116:0/817392968 shutdown_connections 2024-02-21T22:52:59.707 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.661+0000 7f845991e640 1 -- 172.21.15.116:0/817392968 >> 172.21.15.116:0/817392968 conn(0x7f84540b2750 msgr2=0x7f8454071990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:52:59.707 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.661+0000 7f845991e640 1 -- 172.21.15.116:0/817392968 shutdown_connections 2024-02-21T22:52:59.707 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.661+0000 7f845991e640 1 -- 172.21.15.116:0/817392968 wait complete. 2024-02-21T22:52:59.707 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.661+0000 7f22c8ff9640 1 -- 172.21.15.116:0/565265363 >> [v2:172.21.15.116:6800/3106627557,v1:172.21.15.116:6801/3106627557] conn(0x7f22bc0737c0 msgr2=0x7f22bc075be0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:59.707 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.661+0000 7f22c8ff9640 1 --2- 172.21.15.116:0/565265363 >> [v2:172.21.15.116:6800/3106627557,v1:172.21.15.116:6801/3106627557] conn(0x7f22bc0737c0 0x7f22bc075be0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:59.707 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.661+0000 7f2e316de640 1 -- 172.21.15.116:0/1225498245 --> [v2:172.21.15.142:6816/1184158716,v1:172.21.15.142:6817/1184158716] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f2e2c0b3350 con 0x7f2e180737c0 2024-02-21T22:52:59.708 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.662+0000 7f22c8ff9640 1 -- 172.21.15.116:0/565265363 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f22bc06b5a0 msgr2=0x7f22bc06da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:59.708 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.662+0000 7f22c8ff9640 1 --2- 172.21.15.116:0/565265363 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f22bc06b5a0 0x7f22bc06da60 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f22cc00a830 tx=0x7f22cc008040 comp rx=0 tx=0).stop 2024-02-21T22:52:59.708 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.662+0000 7f22c8ff9640 1 -- 172.21.15.116:0/565265363 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f22dc0cd4a0 msgr2=0x7f22dc14c1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:59.708 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.662+0000 7f22c8ff9640 1 --2- 172.21.15.116:0/565265363 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f22dc0cd4a0 0x7f22dc14c1b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f22d400ccd0 tx=0x7f22d400a5c0 comp rx=0 tx=0).stop 2024-02-21T22:52:59.708 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.662+0000 7f22dad9d640 1 -- 172.21.15.116:0/565265363 reap_dead start 2024-02-21T22:52:59.708 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.662+0000 7f9eca3c8640 1 -- 172.21.15.116:0/4207542375 --> [v2:172.21.15.142:6808/1272081937,v1:172.21.15.142:6809/1272081937] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f9ec40cf010 con 0x7f9ea40737c0 2024-02-21T22:52:59.708 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.662+0000 7f22c8ff9640 1 -- 172.21.15.116:0/565265363 shutdown_connections 2024-02-21T22:52:59.709 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.662+0000 7f22c8ff9640 1 -- 172.21.15.116:0/565265363 >> 172.21.15.116:0/565265363 conn(0x7f22dc0cf7f0 msgr2=0x7f22dc161520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:52:59.709 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.662+0000 7f9ec0ff9640 1 -- 172.21.15.116:0/4207542375 <== osd.7 v2:172.21.15.142:6808/1272081937 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f9ec40cf010 con 0x7f9ea40737c0 2024-02-21T22:52:59.709 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.662+0000 7f22c8ff9640 1 -- 172.21.15.116:0/565265363 shutdown_connections 2024-02-21T22:52:59.709 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.662+0000 7f22c8ff9640 1 -- 172.21.15.116:0/565265363 wait complete. 2024-02-21T22:52:59.710 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.662+0000 7f2e137fe640 1 -- 172.21.15.116:0/1225498245 <== osd.5 v2:172.21.15.142:6816/1184158716 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f2e2c0b3350 con 0x7f2e180737c0 2024-02-21T22:52:59.710 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.662+0000 7f776ffff640 1 -- 172.21.15.116:0/341894639 --> [v2:172.21.15.116:6824/1029280577,v1:172.21.15.116:6825/1029280577] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f77680ef7a0 con 0x7f775c0737a0 2024-02-21T22:52:59.711 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.663+0000 7f2e117fa640 1 -- 172.21.15.116:0/1225498245 >> [v2:172.21.15.142:6816/1184158716,v1:172.21.15.142:6817/1184158716] conn(0x7f2e180737c0 msgr2=0x7f2e18075be0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:59.711 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.663+0000 7f2e117fa640 1 --2- 172.21.15.116:0/1225498245 >> [v2:172.21.15.142:6816/1184158716,v1:172.21.15.142:6817/1184158716] conn(0x7f2e180737c0 0x7f2e18075be0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:59.711 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.663+0000 7f2e117fa640 1 -- 172.21.15.116:0/1225498245 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f2e1806b5a0 msgr2=0x7f2e1806da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:59.711 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.663+0000 7f2e117fa640 1 --2- 172.21.15.116:0/1225498245 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f2e1806b5a0 0x7f2e1806da60 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f2e20034000 tx=0x7f2e20008030 comp rx=0 tx=0).stop 2024-02-21T22:52:59.711 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.663+0000 7f77577fe640 1 -- 172.21.15.116:0/341894639 <== osd.2 v2:172.21.15.116:6824/1029280577 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f77680ef7a0 con 0x7f775c0737a0 2024-02-21T22:52:59.712 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.663+0000 7f2e117fa640 1 -- 172.21.15.116:0/1225498245 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2e2c072150 msgr2=0x7f2e2c15baa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:59.712 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.663+0000 7f2e117fa640 1 --2- 172.21.15.116:0/1225498245 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2e2c072150 0x7f2e2c15baa0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f2e24007db0 tx=0x7f2e2400e4b0 comp rx=0 tx=0).stop 2024-02-21T22:52:59.712 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.663+0000 7f2e2b7fe640 1 -- 172.21.15.116:0/1225498245 reap_dead start 2024-02-21T22:52:59.712 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.663+0000 7f2e117fa640 1 -- 172.21.15.116:0/1225498245 shutdown_connections 2024-02-21T22:52:59.712 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.663+0000 7f2e117fa640 1 -- 172.21.15.116:0/1225498245 >> 172.21.15.116:0/1225498245 conn(0x7f2e2c0b19a0 msgr2=0x7f2e2c071040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:52:59.713 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.663+0000 7f9eba7fc640 1 -- 172.21.15.116:0/4207542375 >> [v2:172.21.15.142:6808/1272081937,v1:172.21.15.142:6809/1272081937] conn(0x7f9ea40737c0 msgr2=0x7f9ea4075be0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:59.713 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.663+0000 7f9eba7fc640 1 --2- 172.21.15.116:0/4207542375 >> [v2:172.21.15.142:6808/1272081937,v1:172.21.15.142:6809/1272081937] conn(0x7f9ea40737c0 0x7f9ea4075be0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:59.713 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.663+0000 7fca3e7fc640 1 -- 172.21.15.116:0/2161330314 --> [v2:172.21.15.142:6800/1987868911,v1:172.21.15.142:6801/1987868911] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fca38002dd0 con 0x7fca44073770 2024-02-21T22:52:59.713 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.663+0000 7f9eba7fc640 1 -- 172.21.15.116:0/4207542375 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f9ea406b5a0 msgr2=0x7f9ea406da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:59.713 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.663+0000 7f9eba7fc640 1 --2- 172.21.15.116:0/4207542375 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f9ea406b5a0 0x7f9ea406da60 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f9ec40ab200 tx=0x7f9eb4008040 comp rx=0 tx=0).stop 2024-02-21T22:52:59.714 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.664+0000 7f9eba7fc640 1 -- 172.21.15.116:0/4207542375 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9ec406ec00 msgr2=0x7f9ec41faa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:59.714 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.664+0000 7f9eba7fc640 1 --2- 172.21.15.116:0/4207542375 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9ec406ec00 0x7f9ec41faa90 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f9ebc03a040 tx=0x7f9ebc004a40 comp rx=0 tx=0).stop 2024-02-21T22:52:59.714 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.664+0000 7f77557fa640 1 -- 172.21.15.116:0/341894639 >> [v2:172.21.15.116:6824/1029280577,v1:172.21.15.116:6825/1029280577] conn(0x7f775c0737a0 msgr2=0x7f775c075bc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:59.714 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.664+0000 7f9ec8965640 1 -- 172.21.15.116:0/4207542375 reap_dead start 2024-02-21T22:52:59.714 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.664+0000 7f77557fa640 1 --2- 172.21.15.116:0/341894639 >> [v2:172.21.15.116:6824/1029280577,v1:172.21.15.116:6825/1029280577] conn(0x7f775c0737a0 0x7f775c075bc0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:59.715 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.664+0000 7f9eba7fc640 1 -- 172.21.15.116:0/4207542375 shutdown_connections 2024-02-21T22:52:59.715 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.664+0000 7f9eba7fc640 1 -- 172.21.15.116:0/4207542375 >> 172.21.15.116:0/4207542375 conn(0x7f9ec40b1e90 msgr2=0x7f9ec40707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:52:59.715 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.664+0000 7fca54ff9640 1 -- 172.21.15.116:0/2161330314 <== osd.6 v2:172.21.15.142:6800/1987868911 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fca38002dd0 con 0x7fca44073770 2024-02-21T22:52:59.715 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.664+0000 7f77557fa640 1 -- 172.21.15.116:0/341894639 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f775c06b5a0 msgr2=0x7f775c06da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:59.715 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.664+0000 7f77557fa640 1 --2- 172.21.15.116:0/341894639 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f775c06b5a0 0x7f775c06da60 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f77700507e0 tx=0x7f777006d040 comp rx=0 tx=0).stop 2024-02-21T22:52:59.716 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.664+0000 7f77557fa640 1 -- 172.21.15.116:0/341894639 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7768038110 msgr2=0x7f77680dcae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:59.716 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.664+0000 7f77557fa640 1 --2- 172.21.15.116:0/341894639 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7768038110 0x7f77680dcae0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f776000b3e0 tx=0x7f776000b8a0 comp rx=0 tx=0).stop 2024-02-21T22:52:59.716 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.664+0000 7f776f7fe640 1 -- 172.21.15.116:0/341894639 reap_dead start 2024-02-21T22:52:59.716 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.664+0000 7f2e117fa640 1 -- 172.21.15.116:0/1225498245 shutdown_connections 2024-02-21T22:52:59.716 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.664+0000 7f2e117fa640 1 -- 172.21.15.116:0/1225498245 wait complete. 2024-02-21T22:52:59.716 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.664+0000 7f9eba7fc640 1 -- 172.21.15.116:0/4207542375 shutdown_connections 2024-02-21T22:52:59.717 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.664+0000 7f9eba7fc640 1 -- 172.21.15.116:0/4207542375 wait complete. 2024-02-21T22:52:59.717 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.664+0000 7f77557fa640 1 -- 172.21.15.116:0/341894639 shutdown_connections 2024-02-21T22:52:59.717 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.664+0000 7f77557fa640 1 -- 172.21.15.116:0/341894639 >> 172.21.15.116:0/341894639 conn(0x7f7768009fb0 msgr2=0x7f776804a400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:52:59.717 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.664+0000 7fca3e7fc640 1 -- 172.21.15.116:0/2161330314 >> [v2:172.21.15.142:6800/1987868911,v1:172.21.15.142:6801/1987868911] conn(0x7fca44073770 msgr2=0x7fca44075b90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:59.717 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.664+0000 7fca3e7fc640 1 --2- 172.21.15.116:0/2161330314 >> [v2:172.21.15.142:6800/1987868911,v1:172.21.15.142:6801/1987868911] conn(0x7fca44073770 0x7fca44075b90 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:59.718 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.665+0000 7f77557fa640 1 -- 172.21.15.116:0/341894639 shutdown_connections 2024-02-21T22:52:59.718 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.665+0000 7f77557fa640 1 -- 172.21.15.116:0/341894639 wait complete. 2024-02-21T22:52:59.718 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.665+0000 7fca3e7fc640 1 -- 172.21.15.116:0/2161330314 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fca4406b550 msgr2=0x7fca4406da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:59.718 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.665+0000 7fca3e7fc640 1 --2- 172.21.15.116:0/2161330314 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fca4406b550 0x7fca4406da10 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fca400057e0 tx=0x7fca4c032000 comp rx=0 tx=0).stop 2024-02-21T22:52:59.719 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.665+0000 7fca3e7fc640 1 -- 172.21.15.116:0/2161330314 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fca40004800 msgr2=0x7fca5814bab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:59.719 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.665+0000 7fca3e7fc640 1 --2- 172.21.15.116:0/2161330314 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fca40004800 0x7fca5814bab0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fca50007750 tx=0x7fca5000a230 comp rx=0 tx=0).stop 2024-02-21T22:52:59.719 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.665+0000 7fca5ce32640 1 -- 172.21.15.116:0/2161330314 reap_dead start 2024-02-21T22:52:59.719 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.666+0000 7fca3e7fc640 1 -- 172.21.15.116:0/2161330314 shutdown_connections 2024-02-21T22:52:59.719 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.666+0000 7fca3e7fc640 1 -- 172.21.15.116:0/2161330314 >> 172.21.15.116:0/2161330314 conn(0x7fca580b19a0 msgr2=0x7fca580ae990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:52:59.719 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.666+0000 7fca3e7fc640 1 -- 172.21.15.116:0/2161330314 shutdown_connections 2024-02-21T22:52:59.719 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.667+0000 7fca3e7fc640 1 -- 172.21.15.116:0/2161330314 wait complete. 2024-02-21T22:52:59.720 INFO:teuthology.orchestra.run.smithi116.stdout:55834574856 2024-02-21T22:52:59.720 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-02-21T22:52:59.721 INFO:teuthology.orchestra.run.smithi116.stdout:55834574857 2024-02-21T22:52:59.721 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-02-21T22:52:59.722 INFO:teuthology.orchestra.run.smithi116.stdout:55834574855 2024-02-21T22:52:59.722 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-02-21T22:52:59.723 INFO:teuthology.orchestra.run.smithi116.stdout:55834574856 2024-02-21T22:52:59.723 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-02-21T22:52:59.724 INFO:teuthology.orchestra.run.smithi116.stdout:55834574855 2024-02-21T22:52:59.724 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-02-21T22:52:59.725 INFO:teuthology.orchestra.run.smithi116.stdout:55834574856 2024-02-21T22:52:59.725 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-02-21T22:52:59.726 INFO:teuthology.orchestra.run.smithi116.stdout:55834574857 2024-02-21T22:52:59.726 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-02-21T22:52:59.727 INFO:teuthology.orchestra.run.smithi116.stdout:55834574856 2024-02-21T22:52:59.727 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-02-21T22:52:59.931 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.938+0000 7fc7c0836640 1 Processor -- start 2024-02-21T22:52:59.931 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.938+0000 7fc7c0836640 1 -- start start 2024-02-21T22:52:59.931 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.939+0000 7fc7c0836640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc7bc0d0000 0x7fc7bc0b5830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:59.931 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.939+0000 7fc7c0836640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fc7bc14b850 0x7fc7bc166a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:59.931 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.939+0000 7fc7c0836640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7bc06f310 con 0x7fc7bc06ae40 2024-02-21T22:52:59.931 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.939+0000 7fc7c0836640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7bc06f890 con 0x7fc7bc14b850 2024-02-21T22:52:59.931 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.939+0000 7fc7c0836640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7bc06f5b0 con 0x7fc7bc0d0000 2024-02-21T22:52:59.931 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.940+0000 7fc7bad9d640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7fc7bc06ae40 0x7fc7bc06d710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:50894/0 (socket says 172.21.15.116:50894) 2024-02-21T22:52:59.931 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.940+0000 7fc7bad9d640 1 -- 172.21.15.116:0/1321762882 learned_addr learned my addr 172.21.15.116:0/1321762882 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-02-21T22:52:59.932 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.940+0000 7fc7ba59c640 1 --2- 172.21.15.116:0/1321762882 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc7bc0d0000 0x7fc7bc0b5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:59.932 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.940+0000 7fc7b3fff640 1 --2- 172.21.15.116:0/1321762882 >> v2:172.21.15.116:3300/0 conn(0x7fc7bc14b850 0x7fc7bc166a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:59.932 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.940+0000 7fc7ba59c640 1 -- 172.21.15.116:0/1321762882 >> v2:172.21.15.116:3300/0 conn(0x7fc7bc14b850 msgr2=0x7fc7bc166a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:52:59.932 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.940+0000 7fc7ba59c640 1 --2- 172.21.15.116:0/1321762882 >> v2:172.21.15.116:3300/0 conn(0x7fc7bc14b850 0x7fc7bc166a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:59.932 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.940+0000 7fc7b9d9b640 1 -- 172.21.15.116:0/1321762882 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 504016997 0 0) 0x7fc7bc06f310 con 0x7fc7bc06ae40 2024-02-21T22:52:59.932 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.940+0000 7fc7ba59c640 1 -- 172.21.15.116:0/1321762882 >> v1:172.21.15.116:6789/0 conn(0x7fc7bc06ae40 legacy=0x7fc7bc06d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:59.932 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.941+0000 7fc7ba59c640 1 -- 172.21.15.116:0/1321762882 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7bc166230 con 0x7fc7bc0d0000 2024-02-21T22:52:59.933 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.941+0000 7fb2f3e88640 1 Processor -- start 2024-02-21T22:52:59.933 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.941+0000 7fb2f3e88640 1 -- start start 2024-02-21T22:52:59.933 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.941+0000 7fc7b3fff640 1 --2- 172.21.15.116:0/1321762882 >> v2:172.21.15.116:3300/0 conn(0x7fc7bc14b850 0x7fc7bc166a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T22:52:59.934 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.942+0000 7fc7ba59c640 1 --2- 172.21.15.116:0/1321762882 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc7bc0d0000 0x7fc7bc0b5830 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fc7a40097a0 tx=0x7fc7a402b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fa7f8505a9f258d2 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:52:59.934 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.942+0000 7fc7b9d9b640 1 -- 172.21.15.116:0/1321762882 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7a40315a0 con 0x7fc7bc0d0000 2024-02-21T22:52:59.934 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.942+0000 7feae70de640 1 Processor -- start 2024-02-21T22:52:59.934 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.942+0000 7fc7b9d9b640 1 -- 172.21.15.116:0/1321762882 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7a4037070 con 0x7fc7bc0d0000 2024-02-21T22:52:59.934 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.942+0000 7fc7b9d9b640 1 -- 172.21.15.116:0/1321762882 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7a4031960 con 0x7fc7bc0d0000 2024-02-21T22:52:59.935 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.942+0000 7feae70de640 1 -- start start 2024-02-21T22:52:59.935 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.942+0000 7fca29fb4640 1 Processor -- start 2024-02-21T22:52:59.935 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.943+0000 7fca29fb4640 1 -- start start 2024-02-21T22:52:59.936 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.943+0000 7fb2f3e88640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fb2ec0d1c30 0x7fb2ec0d2430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:59.936 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.943+0000 7fb2f3e88640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb2ec0cb930 0x7fb2ec0cbda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:59.936 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.943+0000 7fb2f3e88640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2ec0cfa50 con 0x7fb2ec0d0510 2024-02-21T22:52:59.936 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.943+0000 7fb2f3e88640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2ec0d1450 con 0x7fb2ec0d1c30 2024-02-21T22:52:59.936 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.943+0000 7fb2f3e88640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2ec0cfcc0 con 0x7fb2ec0cb930 2024-02-21T22:52:59.936 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.943+0000 7fbc36073640 1 Processor -- start 2024-02-21T22:52:59.936 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.943+0000 7fbc36073640 1 -- start start 2024-02-21T22:52:59.937 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.943+0000 7f98629cf640 1 Processor -- start 2024-02-21T22:52:59.937 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.943+0000 7f98629cf640 1 -- start start 2024-02-21T22:52:59.937 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.943+0000 7fb2f1c24640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fb2ec0d0510 0x7fb2ec0d08f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.116:59132/0 (socket says 172.21.15.116:59132) 2024-02-21T22:52:59.937 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.943+0000 7fb2f1c24640 1 -- 172.21.15.116:0/1100064947 learned_addr learned my addr 172.21.15.116:0/1100064947 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-02-21T22:52:59.937 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.943+0000 7f86fb473640 1 Processor -- start 2024-02-21T22:52:59.938 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.943+0000 7fb2f0c22640 1 -- 172.21.15.116:0/1100064947 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4188724694 0 0) 0x7fb2ec0cfa50 con 0x7fb2ec0d0510 2024-02-21T22:52:59.938 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.944+0000 7fb2f0c22640 1 -- 172.21.15.116:0/1100064947 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb2d8003520 con 0x7fb2ec0d0510 2024-02-21T22:52:59.938 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.943+0000 7fc7c0836640 1 -- 172.21.15.116:0/1321762882 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc7bc0d0000 msgr2=0x7fc7bc0b5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:59.939 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.943+0000 7fc7c0836640 1 --2- 172.21.15.116:0/1321762882 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc7bc0d0000 0x7fc7bc0b5830 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fc7a40097a0 tx=0x7fc7a402b840 comp rx=0 tx=0).stop 2024-02-21T22:52:59.939 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.944+0000 7fc7c0836640 1 -- 172.21.15.116:0/1321762882 shutdown_connections 2024-02-21T22:52:59.939 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.944+0000 7fc7c0836640 1 --2- 172.21.15.116:0/1321762882 >> v2:172.21.15.116:3300/0 conn(0x7fc7bc14b850 0x7fc7bc166a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:59.939 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.944+0000 7fc7c0836640 1 --2- 172.21.15.116:0/1321762882 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc7bc0d0000 0x7fc7bc0b5830 secure :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fc7a40097a0 tx=0x7fc7a402b840 comp rx=0 tx=0).stop 2024-02-21T22:52:59.939 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.944+0000 7fc7c0836640 1 -- 172.21.15.116:0/1321762882 >> 172.21.15.116:0/1321762882 conn(0x7fc7bc0b2750 msgr2=0x7fc7bc0b2b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:52:59.939 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.943+0000 7f86fb473640 1 -- start start 2024-02-21T22:52:59.940 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.944+0000 7fca29fb4640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fca2415e0e0 0x7fca240d0060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:59.940 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.944+0000 7fca29fb4640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fca2406d560 0x7fca2406da10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:59.940 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.944+0000 7feae70de640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fead80dfef0 0x7fead80085d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:59.941 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.944+0000 7fca29fb4640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca240cfc50 con 0x7fca240d1780 2024-02-21T22:52:59.941 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.944+0000 7fca237fe640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fca2415e0e0 0x7fca240d0060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:59.941 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.944+0000 7fca29fb4640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca240d05a0 con 0x7fca2406d560 2024-02-21T22:52:59.941 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.944+0000 7fca29fb4640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca240d07d0 con 0x7fca2415e0e0 2024-02-21T22:52:59.941 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.944+0000 7fca22ffd640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7fca240d1780 0x7fca240cf540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:50898/0 (socket says 172.21.15.116:50898) 2024-02-21T22:52:59.941 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.944+0000 7fca237fe640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fca2415e0e0 0x7fca240d0060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.116:55690/0 (socket says 172.21.15.116:55690) 2024-02-21T22:52:59.941 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.944+0000 7fca22ffd640 1 -- 172.21.15.116:0/3257246717 learned_addr learned my addr 172.21.15.116:0/3257246717 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-02-21T22:52:59.941 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.944+0000 7feae70de640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fead80e02d0 0x7fead80e3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:59.942 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.944+0000 7fb2f0c22640 1 -- 172.21.15.116:0/1100064947 <== mon.1 v1:172.21.15.142:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 77402628 0 0) 0x7fb2d8003520 con 0x7fb2ec0d0510 2024-02-21T22:52:59.942 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.944+0000 7fb2f1423640 1 --2- 172.21.15.116:0/1100064947 >> v2:172.21.15.116:3300/0 conn(0x7fb2ec0d1c30 0x7fb2ec0d2430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:59.942 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.944+0000 7fb2f0c22640 1 -- 172.21.15.116:0/1100064947 >> v2:172.21.15.142:3300/0 conn(0x7fb2ec0cb930 msgr2=0x7fb2ec0cbda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:52:59.942 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.944+0000 7fb2f0c22640 1 --2- 172.21.15.116:0/1100064947 >> v2:172.21.15.142:3300/0 conn(0x7fb2ec0cb930 0x7fb2ec0cbda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:59.942 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.944+0000 7fb2f0c22640 1 -- 172.21.15.116:0/1100064947 >> v2:172.21.15.116:3300/0 conn(0x7fb2ec0d1c30 msgr2=0x7fb2ec0d2430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:52:59.942 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.944+0000 7fb2f0c22640 1 --2- 172.21.15.116:0/1100064947 >> v2:172.21.15.116:3300/0 conn(0x7fb2ec0d1c30 0x7fb2ec0d2430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:59.942 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.944+0000 7fb2f0c22640 1 -- 172.21.15.116:0/1100064947 --> v1:172.21.15.142:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2ec0cffa0 con 0x7fb2ec0d0510 2024-02-21T22:52:59.943 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.944+0000 7fb2f1423640 1 --2- 172.21.15.116:0/1100064947 >> v2:172.21.15.116:3300/0 conn(0x7fb2ec0d1c30 0x7fb2ec0d2430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T22:52:59.943 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.944+0000 7fca23fff640 1 --2- 172.21.15.116:0/3257246717 >> v2:172.21.15.116:3300/0 conn(0x7fca2406d560 0x7fca2406da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:59.943 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.944+0000 7fca227fc640 1 -- 172.21.15.116:0/3257246717 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2105524954 0 0) 0x7fca240cfc50 con 0x7fca240d1780 2024-02-21T22:52:59.943 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.944+0000 7fca227fc640 1 -- 172.21.15.116:0/3257246717 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca0c003520 con 0x7fca240d1780 2024-02-21T22:52:59.944 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.944+0000 7feae70de640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fead8056590 con 0x7fead80e4100 2024-02-21T22:52:59.944 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.944+0000 7feae567b640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fead80e4100 0x7fead803a920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.116:59146/0 (socket says 172.21.15.116:59146) 2024-02-21T22:52:59.944 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.944+0000 7feae567b640 1 -- 172.21.15.116:0/3543220695 learned_addr learned my addr 172.21.15.116:0/3543220695 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-02-21T22:52:59.944 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.945+0000 7feae4e7a640 1 --2- 172.21.15.116:0/3543220695 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fead80dfef0 0x7fead80085d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:59.944 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.945+0000 7f86fb473640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f86ec0362f0 0x7f86ec00dc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:59.944 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.945+0000 7f86fb473640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f86ec049c00 0x7f86ec00e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:59.944 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.945+0000 7f86fb473640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86ec0548b0 con 0x7f86ec056780 2024-02-21T22:52:59.944 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.945+0000 7f86fb473640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86ec055950 con 0x7f86ec0362f0 2024-02-21T22:52:59.945 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.945+0000 7f86fb473640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86ec0554c0 con 0x7f86ec049c00 2024-02-21T22:52:59.945 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.945+0000 7feadffff640 1 --2- 172.21.15.116:0/3543220695 >> v2:172.21.15.142:3300/0 conn(0x7fead80e02d0 0x7fead80e3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:59.945 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.945+0000 7fca227fc640 1 -- 172.21.15.116:0/3257246717 <== mon.0 v1:172.21.15.116:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1896845620 0 0) 0x7fca0c003520 con 0x7fca240d1780 2024-02-21T22:52:59.945 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.945+0000 7fca227fc640 1 -- 172.21.15.116:0/3257246717 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fca2415e0e0 msgr2=0x7fca240d0060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:52:59.945 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.945+0000 7fca227fc640 1 --2- 172.21.15.116:0/3257246717 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fca2415e0e0 0x7fca240d0060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:59.945 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.945+0000 7fca227fc640 1 -- 172.21.15.116:0/3257246717 >> v2:172.21.15.116:3300/0 conn(0x7fca2406d560 msgr2=0x7fca2406da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:52:59.945 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.945+0000 7fca227fc640 1 --2- 172.21.15.116:0/3257246717 >> v2:172.21.15.116:3300/0 conn(0x7fca2406d560 0x7fca2406da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:59.946 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.945+0000 7fca227fc640 1 -- 172.21.15.116:0/3257246717 --> v1:172.21.15.116:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca2415e4c0 con 0x7fca240d1780 2024-02-21T22:52:59.946 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.945+0000 7fca227fc640 1 -- 172.21.15.116:0/3257246717 <== mon.0 v1:172.21.15.116:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1101981580 0 0) 0x7fca14001670 con 0x7fca240d1780 2024-02-21T22:52:59.946 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.944+0000 7fb2f0c22640 1 -- 172.21.15.116:0/1100064947 <== mon.1 v1:172.21.15.142:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1101981580 0 0) 0x7fb2e8001650 con 0x7fb2ec0d0510 2024-02-21T22:52:59.946 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.945+0000 7fb2f0c22640 1 -- 172.21.15.116:0/1100064947 >> v1:172.21.15.142:6789/0 conn(0x7fb2ec0d0510 legacy=0x7fb2ec0d08f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:59.946 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.945+0000 7fca227fc640 1 -- 172.21.15.116:0/3257246717 >> v1:172.21.15.116:6789/0 conn(0x7fca240d1780 legacy=0x7fca240cf540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:59.947 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.945+0000 7fca227fc640 1 --2- 172.21.15.116:0/3257246717 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fca0c0039e0 0x7fca0c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:59.947 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.945+0000 7fca227fc640 1 --2- 172.21.15.116:0/3257246717 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fca0c004800 0x7fca0c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:59.947 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.945+0000 7fca227fc640 1 --2- 172.21.15.116:0/3257246717 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fca0c0051c0 0x7fca0c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:59.947 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.945+0000 7fca227fc640 1 -- 172.21.15.116:0/3257246717 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca240d07d0 con 0x7fca0c0039e0 2024-02-21T22:52:59.947 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.945+0000 7fca227fc640 1 -- 172.21.15.116:0/3257246717 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca0c00bfb0 con 0x7fca0c0051c0 2024-02-21T22:52:59.947 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.945+0000 7fca227fc640 1 -- 172.21.15.116:0/3257246717 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca0c014990 con 0x7fca0c004800 2024-02-21T22:52:59.947 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.945+0000 7feae70de640 1 -- 172.21.15.116:0/3543220695 --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fead80e4550 con 0x7fead80e02d0 2024-02-21T22:52:59.947 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.945+0000 7feae70de640 1 -- 172.21.15.116:0/3543220695 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fead80094b0 con 0x7fead80dfef0 2024-02-21T22:52:59.948 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.945+0000 7fb2f0c22640 1 --2- 172.21.15.116:0/1100064947 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb2d80039d0 0x7fb2d8003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:59.948 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.945+0000 7fb2f0c22640 1 --2- 172.21.15.116:0/1100064947 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb2d8004800 0x7fb2d8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:59.948 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.944+0000 7fc7c0836640 1 -- 172.21.15.116:0/1321762882 shutdown_connections 2024-02-21T22:52:59.948 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.945+0000 7fc7c0836640 1 -- 172.21.15.116:0/1321762882 wait complete. 2024-02-21T22:52:59.948 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.945+0000 7fb2f0c22640 1 --2- 172.21.15.116:0/1100064947 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb2d80053c0 0x7fb2d800b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:59.949 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.945+0000 7fca22ffd640 1 --2- 172.21.15.116:0/3257246717 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fca0c004800 0x7fca0c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:59.949 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.945+0000 7f98629cf640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f985c15afb0 0x7f985c0af080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:59.949 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.945+0000 7fca237fe640 1 --2- 172.21.15.116:0/3257246717 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fca0c0039e0 0x7fca0c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:59.950 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.945+0000 7f98629cf640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f985c0710e0 con 0x7f985c071c90 2024-02-21T22:52:59.950 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.945+0000 7f98629cf640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f985c0b2d80 con 0x7f985c070b70 2024-02-21T22:52:59.950 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.945+0000 7f98629cf640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f985c15b390 con 0x7f985c15afb0 2024-02-21T22:52:59.950 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.945+0000 7fb2f0c22640 1 -- 172.21.15.116:0/1100064947 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2ec0d1450 con 0x7fb2d8004800 2024-02-21T22:52:59.950 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.945+0000 7fb2f0c22640 1 -- 172.21.15.116:0/1100064947 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2ec0cfcc0 con 0x7fb2d80053c0 2024-02-21T22:52:59.950 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.945+0000 7fb2f0c22640 1 -- 172.21.15.116:0/1100064947 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2d8014b50 con 0x7fb2d80039d0 2024-02-21T22:52:59.950 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.945+0000 7fb2f2425640 1 --2- 172.21.15.116:0/1100064947 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb2d80053c0 0x7fb2d800b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:59.950 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.945+0000 7fb2f2425640 1 -- 172.21.15.116:0/1100064947 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb2d80039d0 msgr2=0x7fb2d8003e10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T22:52:59.950 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.945+0000 7fb2f2425640 1 --2- 172.21.15.116:0/1100064947 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb2d80039d0 0x7fb2d8003e10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:59.950 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.945+0000 7fb2f2425640 1 -- 172.21.15.116:0/1100064947 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb2d8004800 msgr2=0x7fb2d8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:52:59.951 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.945+0000 7fb2f2425640 1 --2- 172.21.15.116:0/1100064947 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb2d8004800 0x7fb2d8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:59.951 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.945+0000 7fb2f2425640 1 -- 172.21.15.116:0/1100064947 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2d8014e10 con 0x7fb2d80053c0 2024-02-21T22:52:59.951 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.946+0000 7fca22ffd640 1 -- 172.21.15.116:0/3257246717 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fca0c0051c0 msgr2=0x7fca0c00b9c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-21T22:52:59.951 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.946+0000 7fca22ffd640 1 --2- 172.21.15.116:0/3257246717 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fca0c0051c0 0x7fca0c00b9c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:59.951 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.946+0000 7fca22ffd640 1 -- 172.21.15.116:0/3257246717 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fca0c0039e0 msgr2=0x7fca0c003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:52:59.951 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.946+0000 7fca22ffd640 1 --2- 172.21.15.116:0/3257246717 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fca0c0039e0 0x7fca0c003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:59.951 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.946+0000 7fca22ffd640 1 -- 172.21.15.116:0/3257246717 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca2415e4c0 con 0x7fca0c004800 2024-02-21T22:52:59.952 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.945+0000 7f86fa471640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f86ec0362f0 0x7f86ec00dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:59.952 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.946+0000 7f86fa471640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f86ec0362f0 0x7f86ec00dc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:34270/0 (socket says 172.21.15.116:34270) 2024-02-21T22:52:59.952 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.946+0000 7f86fa471640 1 -- 172.21.15.116:0/761306064 learned_addr learned my addr 172.21.15.116:0/761306064 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:52:59.952 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.946+0000 7f86fac72640 1 --2- 172.21.15.116:0/761306064 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f86ec049c00 0x7f86ec00e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:59.952 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.946+0000 7f985bfff640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f985c15afb0 0x7f985c0af080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:59.952 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.946+0000 7f985bfff640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f985c15afb0 0x7f985c0af080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.116:41048/0 (socket says 172.21.15.116:41048) 2024-02-21T22:52:59.952 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.946+0000 7f985bfff640 1 -- 172.21.15.116:0/818096632 learned_addr learned my addr 172.21.15.116:0/818096632 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:52:59.953 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.946+0000 7f86fa471640 1 -- 172.21.15.116:0/761306064 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f86ec049c00 msgr2=0x7f86ec00e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:52:59.953 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.944+0000 7fbc36073640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fbc280defa0 0x7fbc280e2d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:59.953 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.944+0000 7fbc36073640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fbc280df400 0x7fbc280e32b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:59.953 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.944+0000 7fbc36073640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc28054910 con 0x7fbc28004af0 2024-02-21T22:52:59.953 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.944+0000 7fbc36073640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc280543e0 con 0x7fbc280df400 2024-02-21T22:52:59.953 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.944+0000 7fbc36073640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc28054bf0 con 0x7fbc280defa0 2024-02-21T22:52:59.953 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.944+0000 7fbc34870640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fbc280defa0 0x7fbc280e2d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:59.953 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.944+0000 7fbc34870640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fbc280defa0 0x7fbc280e2d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.116:41020/0 (socket says 172.21.15.116:41020) 2024-02-21T22:52:59.953 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.944+0000 7fbc34870640 1 -- 172.21.15.116:0/843351080 learned_addr learned my addr 172.21.15.116:0/843351080 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:52:59.953 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.945+0000 7fbc35872640 1 --2- 172.21.15.116:0/843351080 >> v2:172.21.15.116:3300/0 conn(0x7fbc280df400 0x7fbc280e32b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:59.953 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.945+0000 7fbc34870640 1 -- 172.21.15.116:0/843351080 >> v2:172.21.15.116:3300/0 conn(0x7fbc280df400 msgr2=0x7fbc280e32b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:52:59.954 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.945+0000 7fbc34870640 1 --2- 172.21.15.116:0/843351080 >> v2:172.21.15.116:3300/0 conn(0x7fbc280df400 0x7fbc280e32b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:59.954 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.945+0000 7fbc34870640 1 -- 172.21.15.116:0/843351080 >> v1:172.21.15.116:6789/0 conn(0x7fbc28004af0 legacy=0x7fbc2803a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:52:59.954 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.945+0000 7fbc34870640 1 -- 172.21.15.116:0/843351080 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc280062d0 con 0x7fbc280defa0 2024-02-21T22:52:59.954 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.946+0000 7f985bfff640 1 -- 172.21.15.116:0/818096632 >> v1:172.21.15.142:6789/0 conn(0x7f985c070b70 legacy=0x7f985c071580 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T22:52:59.954 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.946+0000 7f985bfff640 1 -- 172.21.15.116:0/818096632 >> v1:172.21.15.116:6789/0 conn(0x7f985c071c90 legacy=0x7f985c0b3860 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T22:52:59.954 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.946+0000 7f985bfff640 1 -- 172.21.15.116:0/818096632 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f985c0b3060 con 0x7f985c15afb0 2024-02-21T22:52:59.954 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.946+0000 7feadf7fe640 1 -- 172.21.15.116:0/3543220695 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1249610460 0 0) 0x7fead8056590 con 0x7fead80e4100 2024-02-21T22:52:59.955 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.946+0000 7feadf7fe640 1 -- 172.21.15.116:0/3543220695 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fead0007930 con 0x7fead80e4100 2024-02-21T22:52:59.955 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.946+0000 7feae4e7a640 1 -- 172.21.15.116:0/3543220695 >> v2:172.21.15.142:3300/0 conn(0x7fead80e02d0 msgr2=0x7fead80e3bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:52:59.955 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.946+0000 7feae4e7a640 1 --2- 172.21.15.116:0/3543220695 >> v2:172.21.15.142:3300/0 conn(0x7fead80e02d0 0x7fead80e3bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:59.955 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.946+0000 7feae4e7a640 1 -- 172.21.15.116:0/3543220695 >> v1:172.21.15.142:6789/0 conn(0x7fead80e4100 legacy=0x7fead803a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:59.955 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.946+0000 7feae4e7a640 1 -- 172.21.15.116:0/3543220695 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fead8056870 con 0x7fead80dfef0 2024-02-21T22:52:59.955 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.946+0000 7fb2f2425640 1 -- 172.21.15.116:0/1100064947 reap_dead start 2024-02-21T22:52:59.955 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.947+0000 7fb2f2425640 1 --2- 172.21.15.116:0/1100064947 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb2d80053c0 0x7fb2d800b9e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb2e4009e40 tx=0x7fb2d8005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a33c8acf2a8d520 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:52:59.956 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.946+0000 7f86fa471640 1 --2- 172.21.15.116:0/761306064 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f86ec049c00 0x7f86ec00e1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:59.956 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.946+0000 7f86fa471640 1 -- 172.21.15.116:0/761306064 >> v1:172.21.15.142:6789/0 conn(0x7f86ec056780 legacy=0x7f86ec0eb120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:59.956 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.946+0000 7f86f946f640 1 -- 172.21.15.116:0/761306064 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 745103854 0 0) 0x7f86ec0548b0 con 0x7f86ec056780 2024-02-21T22:52:59.956 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.946+0000 7f86fa471640 1 -- 172.21.15.116:0/761306064 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86ec054b90 con 0x7f86ec0362f0 2024-02-21T22:52:59.956 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.946+0000 7f86fac72640 1 --2- 172.21.15.116:0/761306064 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f86ec049c00 0x7f86ec00e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T22:52:59.956 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.947+0000 7fb2f0c22640 1 -- 172.21.15.116:0/1100064947 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2e4009a10 con 0x7fb2d80053c0 2024-02-21T22:52:59.956 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.947+0000 7fbc34870640 1 --2- 172.21.15.116:0/843351080 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbc280defa0 0x7fbc280e2d70 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fbc2800c160 tx=0x7fbc2002b880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a5d218ac715e1ea5 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:52:59.957 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.947+0000 7fb2f0c22640 1 -- 172.21.15.116:0/1100064947 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2e4006e50 con 0x7fb2d80053c0 2024-02-21T22:52:59.957 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.947+0000 7fb2f0c22640 1 -- 172.21.15.116:0/1100064947 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2e4003970 con 0x7fb2d80053c0 2024-02-21T22:52:59.957 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.947+0000 7fca22ffd640 1 --2- 172.21.15.116:0/3257246717 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fca0c004800 0x7fca0c004c80 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fca1400c270 tx=0x7fca0c005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=653de03aeda2b226 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:52:59.957 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.947+0000 7feae4e7a640 1 --2- 172.21.15.116:0/3543220695 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fead80dfef0 0x7fead80085d0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fead4013db0 tx=0x7fead4033f10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1f2dde26fbf08de8 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:52:59.958 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.947+0000 7fc7c0836640 1 Processor -- start 2024-02-21T22:52:59.958 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.947+0000 7fbc27fff640 1 -- 172.21.15.116:0/843351080 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc2002e070 con 0x7fbc280defa0 2024-02-21T22:52:59.958 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.947+0000 7fc7c0836640 1 -- start start 2024-02-21T22:52:59.959 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.947+0000 7fbc27fff640 1 -- 172.21.15.116:0/843351080 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc20037070 con 0x7fbc280defa0 2024-02-21T22:52:59.959 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.947+0000 7fbc27fff640 1 -- 172.21.15.116:0/843351080 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc20031a00 con 0x7fbc280defa0 2024-02-21T22:52:59.959 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.947+0000 7feadf7fe640 1 -- 172.21.15.116:0/3543220695 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fead4041070 con 0x7fead80dfef0 2024-02-21T22:52:59.959 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.948+0000 7feadf7fe640 1 -- 172.21.15.116:0/3543220695 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fead4034a40 con 0x7fead80dfef0 2024-02-21T22:52:59.959 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.948+0000 7fb2f3e88640 1 -- 172.21.15.116:0/1100064947 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb2d80053c0 msgr2=0x7fb2d800b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:59.960 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.948+0000 7fb2f3e88640 1 --2- 172.21.15.116:0/1100064947 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb2d80053c0 0x7fb2d800b9e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb2e4009e40 tx=0x7fb2d8005830 comp rx=0 tx=0).stop 2024-02-21T22:52:59.960 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.948+0000 7feadf7fe640 1 -- 172.21.15.116:0/3543220695 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feae0073a20 con 0x7fead80dfef0 2024-02-21T22:52:59.960 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.948+0000 7fb2f3e88640 1 -- 172.21.15.116:0/1100064947 shutdown_connections 2024-02-21T22:52:59.960 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.948+0000 7f86fa471640 1 --2- 172.21.15.116:0/761306064 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f86ec0362f0 0x7f86ec00dc60 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f86e4009870 tx=0x7f86e402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b731629d39e5123 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:52:59.961 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.948+0000 7f86f946f640 1 -- 172.21.15.116:0/761306064 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86e4034070 con 0x7f86ec0362f0 2024-02-21T22:52:59.961 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.948+0000 7f86f946f640 1 -- 172.21.15.116:0/761306064 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86e4030840 con 0x7f86ec0362f0 2024-02-21T22:52:59.961 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.948+0000 7f86f946f640 1 -- 172.21.15.116:0/761306064 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86e4030c10 con 0x7f86ec0362f0 2024-02-21T22:52:59.961 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.948+0000 7fb2f3e88640 1 --2- 172.21.15.116:0/1100064947 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb2d80053c0 0x7fb2d800b9e0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:59.961 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.948+0000 7fb2f3e88640 1 -- 172.21.15.116:0/1100064947 >> 172.21.15.116:0/1100064947 conn(0x7fb2ec0d3e50 msgr2=0x7fb2ec0d4260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:52:59.961 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.947+0000 7fca227fc640 1 -- 172.21.15.116:0/3257246717 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca14007d30 con 0x7fca0c004800 2024-02-21T22:52:59.962 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.947+0000 7fca227fc640 1 -- 172.21.15.116:0/3257246717 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca14030070 con 0x7fca0c004800 2024-02-21T22:52:59.962 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.947+0000 7fca227fc640 1 -- 172.21.15.116:0/3257246717 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca1402cdc0 con 0x7fca0c004800 2024-02-21T22:52:59.962 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.948+0000 7fb2f3e88640 1 -- 172.21.15.116:0/1100064947 shutdown_connections 2024-02-21T22:52:59.962 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.948+0000 7fca29fb4640 1 -- 172.21.15.116:0/3257246717 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fca0c004800 msgr2=0x7fca0c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:59.962 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.948+0000 7fca29fb4640 1 --2- 172.21.15.116:0/3257246717 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fca0c004800 0x7fca0c004c80 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fca1400c270 tx=0x7fca0c005830 comp rx=0 tx=0).stop 2024-02-21T22:52:59.963 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.948+0000 7fca23fff640 1 -- 172.21.15.116:0/3257246717 reap_dead start 2024-02-21T22:52:59.963 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.948+0000 7fb2f3e88640 1 -- 172.21.15.116:0/1100064947 wait complete. 2024-02-21T22:52:59.963 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.948+0000 7fca29fb4640 1 -- 172.21.15.116:0/3257246717 shutdown_connections 2024-02-21T22:52:59.963 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.948+0000 7fca29fb4640 1 -- 172.21.15.116:0/3257246717 >> 172.21.15.116:0/3257246717 conn(0x7fca240d0a80 msgr2=0x7fca240d0e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:52:59.964 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.948+0000 7fc7c0836640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc7bc06ae40 0x7fc7bc161da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:59.964 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.948+0000 7fc7c0836640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc7bc14b850 0x7fc7bc1646c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:59.964 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.947+0000 7f985bfff640 1 --2- 172.21.15.116:0/818096632 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f985c15afb0 0x7f985c0af080 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f98500098a0 tx=0x7f985002b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2b308eefd52ed0fa server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:52:59.964 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.948+0000 7f985affd640 1 -- 172.21.15.116:0/818096632 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9850034070 con 0x7f985c15afb0 2024-02-21T22:52:59.964 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.948+0000 7f985affd640 1 -- 172.21.15.116:0/818096632 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9850030840 con 0x7f985c15afb0 2024-02-21T22:52:59.964 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.948+0000 7f985affd640 1 -- 172.21.15.116:0/818096632 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9850030c10 con 0x7f985c15afb0 2024-02-21T22:52:59.965 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.949+0000 7fca29fb4640 1 -- 172.21.15.116:0/3257246717 shutdown_connections 2024-02-21T22:52:59.965 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.949+0000 7fc7b3fff640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc7bc14b850 0x7fc7bc1646c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:59.965 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.949+0000 7fc7b3fff640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc7bc14b850 0x7fc7bc1646c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:34298/0 (socket says 172.21.15.116:34298) 2024-02-21T22:52:59.965 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.949+0000 7f98629cf640 1 -- 172.21.15.116:0/818096632 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f985c15afb0 msgr2=0x7f985c0af080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:59.965 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.949+0000 7f98629cf640 1 --2- 172.21.15.116:0/818096632 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f985c15afb0 0x7f985c0af080 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f98500098a0 tx=0x7f985002b980 comp rx=0 tx=0).stop 2024-02-21T22:52:59.966 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.949+0000 7fc7b3fff640 1 -- 172.21.15.116:0/3834146844 learned_addr learned my addr 172.21.15.116:0/3834146844 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:52:59.966 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.949+0000 7fbc36073640 1 -- 172.21.15.116:0/843351080 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbc280defa0 msgr2=0x7fbc280e2d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:59.966 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.949+0000 7feae70de640 1 -- 172.21.15.116:0/3543220695 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fead80dfef0 msgr2=0x7fead80085d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:59.966 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.949+0000 7fc7c0836640 1 --2- 172.21.15.116:0/3834146844 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc7bc164c00 0x7fc7bc13c270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:59.967 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.949+0000 7fbc36073640 1 --2- 172.21.15.116:0/843351080 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbc280defa0 0x7fbc280e2d70 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fbc2800c160 tx=0x7fbc2002b880 comp rx=0 tx=0).stop 2024-02-21T22:52:59.967 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.949+0000 7feae70de640 1 --2- 172.21.15.116:0/3543220695 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fead80dfef0 0x7fead80085d0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fead4013db0 tx=0x7fead4033f10 comp rx=0 tx=0).stop 2024-02-21T22:52:59.967 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.949+0000 7fc7c0836640 1 -- 172.21.15.116:0/3834146844 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7bc14bf50 con 0x7fc7bc14b850 2024-02-21T22:52:59.968 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.949+0000 7feae70de640 1 -- 172.21.15.116:0/3543220695 shutdown_connections 2024-02-21T22:52:59.968 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.949+0000 7feae70de640 1 --2- 172.21.15.116:0/3543220695 >> v2:172.21.15.142:3300/0 conn(0x7fead80e02d0 0x7fead80e3bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:59.968 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.949+0000 7feae70de640 1 --2- 172.21.15.116:0/3543220695 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fead80dfef0 0x7fead80085d0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:59.968 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.949+0000 7fbc36073640 1 -- 172.21.15.116:0/843351080 shutdown_connections 2024-02-21T22:52:59.968 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.949+0000 7fbc36073640 1 --2- 172.21.15.116:0/843351080 >> v2:172.21.15.116:3300/0 conn(0x7fbc280df400 0x7fbc280e32b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:59.968 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.949+0000 7fbc36073640 1 --2- 172.21.15.116:0/843351080 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbc280defa0 0x7fbc280e2d70 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:59.968 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.949+0000 7fbc36073640 1 -- 172.21.15.116:0/843351080 >> 172.21.15.116:0/843351080 conn(0x7fbc2800a3f0 msgr2=0x7fbc2800a7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:52:59.969 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.949+0000 7feae70de640 1 -- 172.21.15.116:0/3543220695 >> 172.21.15.116:0/3543220695 conn(0x7fead801ef40 msgr2=0x7fead8055c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:52:59.969 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.949+0000 7feae70de640 1 -- 172.21.15.116:0/3543220695 shutdown_connections 2024-02-21T22:52:59.969 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.949+0000 7fca29fb4640 1 -- 172.21.15.116:0/3257246717 wait complete. 2024-02-21T22:52:59.969 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.949+0000 7fbc36073640 1 -- 172.21.15.116:0/843351080 shutdown_connections 2024-02-21T22:52:59.969 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.949+0000 7feae70de640 1 -- 172.21.15.116:0/3543220695 wait complete. 2024-02-21T22:52:59.970 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.949+0000 7fbc36073640 1 -- 172.21.15.116:0/843351080 wait complete. 2024-02-21T22:52:59.970 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.949+0000 7f98629cf640 1 -- 172.21.15.116:0/818096632 shutdown_connections 2024-02-21T22:52:59.970 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.949+0000 7f98629cf640 1 --2- 172.21.15.116:0/818096632 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f985c15afb0 0x7f985c0af080 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:59.970 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.949+0000 7f98629cf640 1 -- 172.21.15.116:0/818096632 >> 172.21.15.116:0/818096632 conn(0x7f985c0b18e0 msgr2=0x7f985c0b1cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:52:59.970 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.949+0000 7fc7bad9d640 1 --2- 172.21.15.116:0/3834146844 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc7bc164c00 0x7fc7bc13c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:59.971 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.949+0000 7fc7ba59c640 1 --2- 172.21.15.116:0/3834146844 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc7bc06ae40 0x7fc7bc161da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:59.971 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.949+0000 7fc7c0836640 1 -- 172.21.15.116:0/3834146844 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7bc166f70 con 0x7fc7bc164c00 2024-02-21T22:52:59.971 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.949+0000 7fc7c0836640 1 -- 172.21.15.116:0/3834146844 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7bc14c0d0 con 0x7fc7bc06ae40 2024-02-21T22:52:59.971 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.950+0000 7f98629cf640 1 -- 172.21.15.116:0/818096632 shutdown_connections 2024-02-21T22:52:59.971 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.950+0000 7f86fb473640 1 -- 172.21.15.116:0/761306064 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f86ec0362f0 msgr2=0x7f86ec00dc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:59.971 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.950+0000 7f86fb473640 1 --2- 172.21.15.116:0/761306064 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f86ec0362f0 0x7f86ec00dc60 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f86e4009870 tx=0x7f86e402b980 comp rx=0 tx=0).stop 2024-02-21T22:52:59.972 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.950+0000 7fb2f3e88640 1 Processor -- start 2024-02-21T22:52:59.972 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.950+0000 7fb2f3e88640 1 -- start start 2024-02-21T22:52:59.972 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.950+0000 7f86fb473640 1 -- 172.21.15.116:0/761306064 shutdown_connections 2024-02-21T22:52:59.972 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.950+0000 7f86fb473640 1 --2- 172.21.15.116:0/761306064 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f86ec049c00 0x7f86ec00e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:59.972 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.950+0000 7f86fb473640 1 --2- 172.21.15.116:0/761306064 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f86ec0362f0 0x7f86ec00dc60 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:59.972 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.950+0000 7f86fb473640 1 -- 172.21.15.116:0/761306064 >> 172.21.15.116:0/761306064 conn(0x7f86ec056ce0 msgr2=0x7f86ec0570f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:52:59.973 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.950+0000 7fc7b3fff640 1 -- 172.21.15.116:0/3834146844 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc7bc06ae40 msgr2=0x7fc7bc161da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:59.973 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.950+0000 7fc7b3fff640 1 --2- 172.21.15.116:0/3834146844 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc7bc06ae40 0x7fc7bc161da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:59.973 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.950+0000 7fc7b3fff640 1 -- 172.21.15.116:0/3834146844 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc7bc164c00 msgr2=0x7fc7bc13c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:59.973 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.950+0000 7fc7b3fff640 1 --2- 172.21.15.116:0/3834146844 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc7bc164c00 0x7fc7bc13c270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:59.973 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.950+0000 7fc7b3fff640 1 -- 172.21.15.116:0/3834146844 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7bc165460 con 0x7fc7bc14b850 2024-02-21T22:52:59.973 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.950+0000 7f98629cf640 1 -- 172.21.15.116:0/818096632 wait complete. 2024-02-21T22:52:59.973 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.950+0000 7f0d0c35e640 1 Processor -- start 2024-02-21T22:52:59.974 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.950+0000 7fc7b3fff640 1 --2- 172.21.15.116:0/3834146844 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc7bc14b850 0x7fc7bc1646c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fc7ac00d800 tx=0x7fc7ac00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:52:59.974 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.950+0000 7f0d0c35e640 1 -- start start 2024-02-21T22:52:59.974 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.951+0000 7fc7b2ffd640 1 -- 172.21.15.116:0/3834146844 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7ac004030 con 0x7fc7bc14b850 2024-02-21T22:52:59.974 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.951+0000 7fc7c0836640 1 -- 172.21.15.116:0/3834146844 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7bc13b790 con 0x7fc7bc14b850 2024-02-21T22:52:59.975 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.951+0000 7fb2f3e88640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb2d80053c0 0x7fb2ec1555b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:59.975 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.951+0000 7fb2f3e88640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb2ec156290 0x7fb2ec0c81c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:59.975 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.951+0000 7feae70de640 1 Processor -- start 2024-02-21T22:52:59.975 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.951+0000 7fb2f3e88640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb2ec155cb0 0x7fb2ec0c8700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:59.976 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.951+0000 7feae70de640 1 -- start start 2024-02-21T22:52:59.976 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.951+0000 7fbc36073640 1 Processor -- start 2024-02-21T22:52:59.976 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.951+0000 7fca29fb4640 1 Processor -- start 2024-02-21T22:52:59.976 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.951+0000 7fb2f3e88640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2ec0d08f0 con 0x7fb2d80053c0 2024-02-21T22:52:59.977 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.951+0000 7fbc36073640 1 -- start start 2024-02-21T22:52:59.977 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.951+0000 7fb2f3e88640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2ec15e640 con 0x7fb2ec156290 2024-02-21T22:52:59.977 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.951+0000 7fb2f3e88640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2ec0d0a70 con 0x7fb2ec155cb0 2024-02-21T22:52:59.977 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.952+0000 7f0d0c35e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0d040c3110 0x7f0d0406e630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:59.978 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.952+0000 7f0d0c35e640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f0d0406ae40 0x7f0d0406b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:59.978 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.952+0000 7f0d0c35e640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d0406daa0 con 0x7f0d040c34f0 2024-02-21T22:52:59.978 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.952+0000 7f0d0c35e640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d0406cce0 con 0x7f0d0406ae40 2024-02-21T22:52:59.978 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.952+0000 7f0d0c35e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d0406cfc0 con 0x7f0d040c3110 2024-02-21T22:52:59.978 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.951+0000 7f86fb473640 1 -- 172.21.15.116:0/761306064 shutdown_connections 2024-02-21T22:52:59.978 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.951+0000 7f86fb473640 1 -- 172.21.15.116:0/761306064 wait complete. 2024-02-21T22:52:59.978 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.951+0000 7fca29fb4640 1 -- start start 2024-02-21T22:52:59.979 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.952+0000 7fc7c0836640 1 -- 172.21.15.116:0/3834146844 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7bc13bd50 con 0x7fc7bc14b850 2024-02-21T22:52:59.979 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.952+0000 7fc7b2ffd640 1 -- 172.21.15.116:0/3834146844 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7ac0041d0 con 0x7fc7bc14b850 2024-02-21T22:52:59.979 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.953+0000 7fbc36073640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbc28004af0 0x7fbc280d3d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:59.979 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.953+0000 7feae70de640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fead80dfef0 0x7fead80d31e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:59.980 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.953+0000 7fca29fb4640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fca241568f0 0x7fca240cce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:59.980 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.953+0000 7f86fb473640 1 Processor -- start 2024-02-21T22:52:59.980 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.951+0000 7f98629cf640 1 Processor -- start 2024-02-21T22:52:59.980 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.952+0000 7f98629cf640 1 -- start start 2024-02-21T22:52:59.980 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.953+0000 7f98629cf640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f985c070b70 0x7f985c09d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:59.980 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.953+0000 7f98629cf640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f985c071c90 0x7f985c1ec220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:59.980 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.953+0000 7f98629cf640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f985c15afb0 0x7f985c1ed840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:59.980 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.953+0000 7f98629cf640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f985c0af5c0 con 0x7f985c071c90 2024-02-21T22:52:59.981 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.953+0000 7f98629cf640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f985c0713c0 con 0x7f985c15afb0 2024-02-21T22:52:59.981 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.953+0000 7f98629cf640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f985c0b3f70 con 0x7f985c070b70 2024-02-21T22:52:59.981 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.953+0000 7f9860f6c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f985c15afb0 0x7f985c1ed840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:59.981 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.953+0000 7f9860f6c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f985c15afb0 0x7f985c1ed840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.116:41090/0 (socket says 172.21.15.116:41090) 2024-02-21T22:52:59.981 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.953+0000 7f9860f6c640 1 -- 172.21.15.116:0/1402260248 learned_addr learned my addr 172.21.15.116:0/1402260248 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:52:59.981 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.953+0000 7f985bfff640 1 --2- 172.21.15.116:0/1402260248 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f985c070b70 0x7f985c09d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:59.981 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.954+0000 7f9860f6c640 1 -- 172.21.15.116:0/1402260248 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f985c070b70 msgr2=0x7f985c09d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:59.981 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.954+0000 7f9860f6c640 1 --2- 172.21.15.116:0/1402260248 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f985c070b70 0x7f985c09d530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:59.981 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.954+0000 7f9860f6c640 1 -- 172.21.15.116:0/1402260248 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f985c071c90 msgr2=0x7f985c1ec220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:59.981 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.954+0000 7f9860f6c640 1 --2- 172.21.15.116:0/1402260248 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f985c071c90 0x7f985c1ec220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:59.981 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.954+0000 7f9860f6c640 1 -- 172.21.15.116:0/1402260248 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f985c1ec760 con 0x7f985c15afb0 2024-02-21T22:52:59.982 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.953+0000 7f0d0a0fa640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0d040c3110 0x7f0d0406e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:59.982 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.953+0000 7f0d0a0fa640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0d040c3110 0x7f0d0406e630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.116:55736/0 (socket says 172.21.15.116:55736) 2024-02-21T22:52:59.982 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.953+0000 7f0d0a0fa640 1 -- 172.21.15.116:0/1504780239 learned_addr learned my addr 172.21.15.116:0/1504780239 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:52:59.982 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.953+0000 7f0d0a8fb640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f0d0406ae40 0x7f0d0406b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:59.982 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.953+0000 7f0d0a0fa640 1 -- 172.21.15.116:0/1504780239 >> v2:172.21.15.116:3300/0 conn(0x7f0d0406ae40 msgr2=0x7f0d0406b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:52:59.982 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.953+0000 7f0d0a0fa640 1 --2- 172.21.15.116:0/1504780239 >> v2:172.21.15.116:3300/0 conn(0x7f0d0406ae40 0x7f0d0406b2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:59.982 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.953+0000 7f0d0a0fa640 1 -- 172.21.15.116:0/1504780239 >> v1:172.21.15.142:6789/0 conn(0x7f0d040c34f0 legacy=0x7f0d040cbde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:52:59.982 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.953+0000 7f0d0a0fa640 1 -- 172.21.15.116:0/1504780239 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d0406d2a0 con 0x7f0d040c3110 2024-02-21T22:52:59.982 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.953+0000 7fbc36073640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbc280defa0 0x7fbc2804d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:59.982 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.953+0000 7fbc36073640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbc280df400 0x7fbc280dc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:59.982 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.953+0000 7fbc36073640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc280e3bd0 con 0x7fbc28004af0 2024-02-21T22:52:59.983 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.953+0000 7fbc36073640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc280e3a50 con 0x7fbc280defa0 2024-02-21T22:52:59.983 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.953+0000 7fbc35872640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbc280df400 0x7fbc280dc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:59.983 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.953+0000 7fbc35872640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbc280df400 0x7fbc280dc6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.116:55746/0 (socket says 172.21.15.116:55746) 2024-02-21T22:52:59.983 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.953+0000 7fbc35872640 1 -- 172.21.15.116:0/4184274689 learned_addr learned my addr 172.21.15.116:0/4184274689 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:52:59.983 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.953+0000 7fbc36073640 1 -- 172.21.15.116:0/4184274689 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc28037f60 con 0x7fbc280df400 2024-02-21T22:52:59.983 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.953+0000 7fbc34870640 1 --2- 172.21.15.116:0/4184274689 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbc280defa0 0x7fbc2804d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:59.983 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.953+0000 7fbc35071640 1 --2- 172.21.15.116:0/4184274689 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbc28004af0 0x7fbc280d3d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:59.983 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.954+0000 7fbc35872640 1 -- 172.21.15.116:0/4184274689 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbc280defa0 msgr2=0x7fbc2804d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:59.983 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.954+0000 7fbc35872640 1 --2- 172.21.15.116:0/4184274689 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbc280defa0 0x7fbc2804d980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:59.983 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.954+0000 7fbc35872640 1 -- 172.21.15.116:0/4184274689 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbc28004af0 msgr2=0x7fbc280d3d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:59.983 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.954+0000 7fbc35872640 1 --2- 172.21.15.116:0/4184274689 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbc28004af0 0x7fbc280d3d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:59.983 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.954+0000 7fbc35872640 1 -- 172.21.15.116:0/4184274689 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc28036830 con 0x7fbc280df400 2024-02-21T22:52:59.984 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.952+0000 7fb2f1c24640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb2d80053c0 0x7fb2ec1555b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:59.984 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.952+0000 7fb2f1c24640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb2d80053c0 0x7fb2ec1555b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:34306/0 (socket says 172.21.15.116:34306) 2024-02-21T22:52:59.984 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.952+0000 7fb2f1c24640 1 -- 172.21.15.116:0/2581675874 learned_addr learned my addr 172.21.15.116:0/2581675874 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:52:59.984 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.952+0000 7fb2f2425640 1 --2- 172.21.15.116:0/2581675874 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb2ec155cb0 0x7fb2ec0c8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:59.984 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.953+0000 7fb2f1423640 1 --2- 172.21.15.116:0/2581675874 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb2ec156290 0x7fb2ec0c81c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:59.984 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.953+0000 7f86fb473640 1 -- start start 2024-02-21T22:52:59.984 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.953+0000 7fca29fb4640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fca240b06d0 0x7fca2415e690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:59.984 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.953+0000 7fca29fb4640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fca24156cd0 0x7fca241544b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:59.985 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.953+0000 7fca29fb4640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca240cea60 con 0x7fca241568f0 2024-02-21T22:52:59.985 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.953+0000 7fca29fb4640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca2406df50 con 0x7fca24156cd0 2024-02-21T22:52:59.985 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.953+0000 7fca29fb4640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca240ced40 con 0x7fca240b06d0 2024-02-21T22:52:59.985 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.953+0000 7fca237fe640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fca241568f0 0x7fca240cce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:59.985 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.953+0000 7fca237fe640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fca241568f0 0x7fca240cce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:34328/0 (socket says 172.21.15.116:34328) 2024-02-21T22:52:59.985 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.953+0000 7fca237fe640 1 -- 172.21.15.116:0/48654763 learned_addr learned my addr 172.21.15.116:0/48654763 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:52:59.985 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.953+0000 7fca23fff640 1 --2- 172.21.15.116:0/48654763 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fca24156cd0 0x7fca241544b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:59.985 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.953+0000 7fca22ffd640 1 --2- 172.21.15.116:0/48654763 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fca240b06d0 0x7fca2415e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:59.985 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.953+0000 7fc7b2ffd640 1 -- 172.21.15.116:0/3834146844 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7ac009640 con 0x7fc7bc14b850 2024-02-21T22:52:59.986 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.954+0000 7f9860f6c640 1 --2- 172.21.15.116:0/1402260248 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f985c15afb0 0x7f985c1ed840 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f985400be90 tx=0x7f985400bf80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:52:59.986 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.954+0000 7feae70de640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fead80e4100 0x7fead804ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:59.986 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.954+0000 7feae70de640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fead804f290 0x7fead80e2b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:59.986 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.954+0000 7feae70de640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fead8056b50 con 0x7fead80dfef0 2024-02-21T22:52:59.986 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.954+0000 7feae70de640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fead8009140 con 0x7fead804f290 2024-02-21T22:52:59.986 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.954+0000 7feae70de640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fead8008b10 con 0x7fead80e4100 2024-02-21T22:52:59.986 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.954+0000 7feadffff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fead80e4100 0x7fead804ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:59.986 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.954+0000 7feadffff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fead80e4100 0x7fead804ed50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.116:55756/0 (socket says 172.21.15.116:55756) 2024-02-21T22:52:59.986 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.954+0000 7feadffff640 1 -- 172.21.15.116:0/1487133352 learned_addr learned my addr 172.21.15.116:0/1487133352 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:52:59.987 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.954+0000 7f86fb473640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f86ec0362f0 0x7f86ec0dc480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:59.987 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.954+0000 7f86fb473640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f86ec049c00 0x7f86ec04c320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:59.987 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.954+0000 7fbc35872640 1 --2- 172.21.15.116:0/4184274689 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbc280df400 0x7fbc280dc6f0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fbc3006a700 tx=0x7fbc30073540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:52:59.987 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.954+0000 7feae4e7a640 1 --2- 172.21.15.116:0/1487133352 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fead80dfef0 0x7fead80d31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:59.988 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.954+0000 7f86fa471640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f86ec0362f0 0x7f86ec0dc480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:59.988 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.954+0000 7feae567b640 1 --2- 172.21.15.116:0/1487133352 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fead804f290 0x7fead80e2b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:59.988 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.954+0000 7f86fa471640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f86ec0362f0 0x7f86ec0dc480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.116:55766/0 (socket says 172.21.15.116:55766) 2024-02-21T22:52:59.989 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.954+0000 7f86fb473640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f86ec056780 0x7f86ec0e5c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:59.989 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.954+0000 7fc7b2ffd640 1 -- 172.21.15.116:0/3834146844 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fc7ac0097e0 con 0x7fc7bc14b850 2024-02-21T22:52:59.989 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.954+0000 7feadffff640 1 -- 172.21.15.116:0/1487133352 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fead804f290 msgr2=0x7fead80e2b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:59.989 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.954+0000 7feadffff640 1 --2- 172.21.15.116:0/1487133352 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fead804f290 0x7fead80e2b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:59.989 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.954+0000 7feadffff640 1 -- 172.21.15.116:0/1487133352 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fead80dfef0 msgr2=0x7fead80d31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:59.989 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.954+0000 7feadffff640 1 --2- 172.21.15.116:0/1487133352 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fead80dfef0 0x7fead80d31e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:59.989 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.954+0000 7feadffff640 1 -- 172.21.15.116:0/1487133352 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fead80e0860 con 0x7fead80e4100 2024-02-21T22:52:59.989 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.954+0000 7feae567b640 1 --2- 172.21.15.116:0/1487133352 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fead804f290 0x7fead80e2b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T22:52:59.990 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.954+0000 7f86fa471640 1 -- 172.21.15.116:0/2671728769 learned_addr learned my addr 172.21.15.116:0/2671728769 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:52:59.990 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.955+0000 7f86fb473640 1 -- 172.21.15.116:0/2671728769 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86ec052340 con 0x7f86ec049c00 2024-02-21T22:52:59.990 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.954+0000 7f86f9c70640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f86ec049c00 0x7f86ec04c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:59.990 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.955+0000 7fbc25ffb640 1 -- 172.21.15.116:0/4184274689 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc300a9070 con 0x7fbc280df400 2024-02-21T22:52:59.991 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.954+0000 7fc7b2ffd640 1 --2- 172.21.15.116:0/3834146844 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fc7a006b5a0 0x7fc7a006da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:52:59.991 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.955+0000 7f86fb473640 1 -- 172.21.15.116:0/2671728769 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86ec055150 con 0x7f86ec056780 2024-02-21T22:52:59.991 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.955+0000 7f86fb473640 1 -- 172.21.15.116:0/2671728769 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86ec0524c0 con 0x7f86ec0362f0 2024-02-21T22:52:59.991 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.955+0000 7fbc25ffb640 1 -- 172.21.15.116:0/4184274689 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc3006be50 con 0x7fbc280df400 2024-02-21T22:52:59.991 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.955+0000 7fbc36073640 1 -- 172.21.15.116:0/4184274689 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc28036b10 con 0x7fbc280df400 2024-02-21T22:52:59.992 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.955+0000 7fc7b2ffd640 1 -- 172.21.15.116:0/3834146844 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc7ac08a440 con 0x7fc7bc14b850 2024-02-21T22:52:59.992 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.955+0000 7fc7c0836640 1 -- 172.21.15.116:0/3834146844 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc794005290 con 0x7fc7bc14b850 2024-02-21T22:52:59.992 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.955+0000 7feadffff640 1 --2- 172.21.15.116:0/1487133352 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fead80e4100 0x7fead804ed50 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7feacc00fbb0 tx=0x7feacc00d720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:52:59.992 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.955+0000 7f86fac72640 1 --2- 172.21.15.116:0/2671728769 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f86ec056780 0x7f86ec0e5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:59.993 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.954+0000 7fca23fff640 1 -- 172.21.15.116:0/48654763 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fca240b06d0 msgr2=0x7fca2415e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:59.993 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.954+0000 7fca23fff640 1 --2- 172.21.15.116:0/48654763 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fca240b06d0 0x7fca2415e690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:59.993 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.954+0000 7fca23fff640 1 -- 172.21.15.116:0/48654763 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fca241568f0 msgr2=0x7fca240cce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:59.993 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.955+0000 7fca23fff640 1 --2- 172.21.15.116:0/48654763 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fca241568f0 0x7fca240cce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:59.993 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.955+0000 7fca23fff640 1 -- 172.21.15.116:0/48654763 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca240c4ef0 con 0x7fca24156cd0 2024-02-21T22:52:59.993 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.955+0000 7fca23fff640 1 --2- 172.21.15.116:0/48654763 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fca24156cd0 0x7fca241544b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fca2404f9b0 tx=0x7fca1c007f60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:52:59.994 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.954+0000 7f9858ff9640 1 -- 172.21.15.116:0/1402260248 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9854019070 con 0x7f985c15afb0 2024-02-21T22:52:59.994 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.954+0000 7f9858ff9640 1 -- 172.21.15.116:0/1402260248 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9854014440 con 0x7f985c15afb0 2024-02-21T22:52:59.994 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.955+0000 7f9858ff9640 1 -- 172.21.15.116:0/1402260248 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9854014830 con 0x7f985c15afb0 2024-02-21T22:52:59.994 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.955+0000 7f98629cf640 1 -- 172.21.15.116:0/1402260248 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f985c1ec9e0 con 0x7f985c15afb0 2024-02-21T22:52:59.994 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.955+0000 7fc7ba59c640 1 --2- 172.21.15.116:0/3834146844 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fc7a006b5a0 0x7fc7a006da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:52:59.994 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.955+0000 7feadd7fa640 1 -- 172.21.15.116:0/1487133352 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feacc01d070 con 0x7fead80e4100 2024-02-21T22:52:59.995 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.954+0000 7fb2f1c24640 1 -- 172.21.15.116:0/2581675874 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb2ec155cb0 msgr2=0x7fb2ec0c8700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:59.995 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.954+0000 7fb2f1c24640 1 --2- 172.21.15.116:0/2581675874 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb2ec155cb0 0x7fb2ec0c8700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:59.995 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.954+0000 7fb2f1c24640 1 -- 172.21.15.116:0/2581675874 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb2ec156290 msgr2=0x7fb2ec0c81c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:59.995 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.954+0000 7fb2f1c24640 1 --2- 172.21.15.116:0/2581675874 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb2ec156290 0x7fb2ec0c81c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:59.995 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.954+0000 7fb2f1c24640 1 -- 172.21.15.116:0/2581675874 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2ec15cdc0 con 0x7fb2d80053c0 2024-02-21T22:52:59.995 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.955+0000 7f98629cf640 1 -- 172.21.15.116:0/1402260248 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f985c09aba0 con 0x7f985c15afb0 2024-02-21T22:52:59.995 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.955+0000 7feadd7fa640 1 -- 172.21.15.116:0/1487133352 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feacc018640 con 0x7fead80e4100 2024-02-21T22:52:59.996 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.955+0000 7feadd7fa640 1 -- 172.21.15.116:0/1487133352 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feacc018a30 con 0x7fead80e4100 2024-02-21T22:52:59.996 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.955+0000 7feae70de640 1 -- 172.21.15.116:0/1487133352 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fead80e0b40 con 0x7fead80e4100 2024-02-21T22:52:59.996 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.955+0000 7fbc36073640 1 -- 172.21.15.116:0/4184274689 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc280370d0 con 0x7fbc280df400 2024-02-21T22:52:59.996 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.955+0000 7fbc25ffb640 1 -- 172.21.15.116:0/4184274689 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc300a4630 con 0x7fbc280df400 2024-02-21T22:52:59.996 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.955+0000 7feae70de640 1 -- 172.21.15.116:0/1487133352 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fead80e1100 con 0x7fead80e4100 2024-02-21T22:52:59.997 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.955+0000 7f0d0a0fa640 1 --2- 172.21.15.116:0/1504780239 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0d040c3110 0x7f0d0406e630 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f0d00009870 tx=0x7f0d0002b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f83ed6e1ea23941a server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:52:59.997 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.955+0000 7f0d090f8640 1 -- 172.21.15.116:0/1504780239 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d00035020 con 0x7f0d040c3110 2024-02-21T22:52:59.997 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.955+0000 7f0d090f8640 1 -- 172.21.15.116:0/1504780239 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d00031640 con 0x7f0d040c3110 2024-02-21T22:52:59.997 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.955+0000 7f0d090f8640 1 -- 172.21.15.116:0/1504780239 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d00035020 con 0x7f0d040c3110 2024-02-21T22:52:59.997 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.955+0000 7f86f9c70640 1 -- 172.21.15.116:0/2671728769 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f86ec0362f0 msgr2=0x7f86ec0dc480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:59.997 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.955+0000 7f86f9c70640 1 --2- 172.21.15.116:0/2671728769 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f86ec0362f0 0x7f86ec0dc480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:59.997 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.955+0000 7f86f9c70640 1 -- 172.21.15.116:0/2671728769 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f86ec056780 msgr2=0x7f86ec0e5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:52:59.997 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.955+0000 7f86f9c70640 1 --2- 172.21.15.116:0/2671728769 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f86ec056780 0x7f86ec0e5c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:52:59.997 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.956+0000 7f86f9c70640 1 -- 172.21.15.116:0/2671728769 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86ec007ef0 con 0x7f86ec049c00 2024-02-21T22:52:59.998 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.956+0000 7fc7ba59c640 1 --2- 172.21.15.116:0/3834146844 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fc7a006b5a0 0x7fc7a006da60 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fc7a4036000 tx=0x7fc7a403d040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:52:59.998 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.956+0000 7f86f9c70640 1 --2- 172.21.15.116:0/2671728769 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f86ec049c00 0x7f86ec04c320 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f86f000c400 tx=0x7f86f000c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:52:59.998 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.956+0000 7fb2f1c24640 1 --2- 172.21.15.116:0/2581675874 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb2d80053c0 0x7fb2ec1555b0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fb2e800c6b0 tx=0x7fb2e800cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:52:59.999 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.956+0000 7fca0bfff640 1 -- 172.21.15.116:0/48654763 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca1c00ec80 con 0x7fca24156cd0 2024-02-21T22:52:59.999 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.956+0000 7fca0bfff640 1 -- 172.21.15.116:0/48654763 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca1c019070 con 0x7fca24156cd0 2024-02-21T22:52:59.999 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.956+0000 7fca0bfff640 1 -- 172.21.15.116:0/48654763 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca1c014420 con 0x7fca24156cd0 2024-02-21T22:52:59.999 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.957+0000 7fbc36073640 1 -- 172.21.15.116:0/4184274689 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc10005290 con 0x7fbc280df400 2024-02-21T22:52:59.999 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.957+0000 7feae70de640 1 -- 172.21.15.116:0/1487133352 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feac0005290 con 0x7fead80e4100 2024-02-21T22:53:00.000 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.957+0000 7f0d0c35e640 1 -- 172.21.15.116:0/1504780239 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0d040c3110 msgr2=0x7f0d0406e630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:00.000 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.957+0000 7f0d0c35e640 1 --2- 172.21.15.116:0/1504780239 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0d040c3110 0x7f0d0406e630 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f0d00009870 tx=0x7f0d0002b8f0 comp rx=0 tx=0).stop 2024-02-21T22:53:00.000 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.957+0000 7f0d0c35e640 1 -- 172.21.15.116:0/1504780239 shutdown_connections 2024-02-21T22:53:00.000 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.957+0000 7f0d0c35e640 1 --2- 172.21.15.116:0/1504780239 >> v2:172.21.15.116:3300/0 conn(0x7f0d0406ae40 0x7f0d0406b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:00.000 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.957+0000 7f0d0c35e640 1 --2- 172.21.15.116:0/1504780239 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0d040c3110 0x7f0d0406e630 secure :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f0d00009870 tx=0x7f0d0002b8f0 comp rx=0 tx=0).stop 2024-02-21T22:53:00.000 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.957+0000 7f0d0c35e640 1 -- 172.21.15.116:0/1504780239 >> 172.21.15.116:0/1504780239 conn(0x7f0d040cfdc0 msgr2=0x7f0d040d01d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:00.000 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.957+0000 7fca29fb4640 1 -- 172.21.15.116:0/48654763 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca240c51d0 con 0x7fca24156cd0 2024-02-21T22:53:00.001 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.957+0000 7fca29fb4640 1 -- 172.21.15.116:0/48654763 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca2415d4d0 con 0x7fca24156cd0 2024-02-21T22:53:00.001 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.957+0000 7fbc25ffb640 1 -- 172.21.15.116:0/4184274689 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fbc300ac070 con 0x7fbc280df400 2024-02-21T22:53:00.001 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.957+0000 7f9858ff9640 1 -- 172.21.15.116:0/1402260248 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f985401c070 con 0x7f985c15afb0 2024-02-21T22:53:00.001 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.958+0000 7f0d0c35e640 1 -- 172.21.15.116:0/1504780239 shutdown_connections 2024-02-21T22:53:00.002 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.958+0000 7f98629cf640 1 -- 172.21.15.116:0/1402260248 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f985c1ecf00 con 0x7f985c15afb0 2024-02-21T22:53:00.002 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.958+0000 7f9858ff9640 1 --2- 172.21.15.116:0/1402260248 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f984806b5a0 0x7f984806da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:00.002 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.958+0000 7fbc25ffb640 1 --2- 172.21.15.116:0/4184274689 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fbc1406b5d0 0x7fbc1406da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:00.002 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.958+0000 7f9858ff9640 1 -- 172.21.15.116:0/1402260248 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f985408a120 con 0x7f985c15afb0 2024-02-21T22:53:00.003 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.958+0000 7f0d0c35e640 1 -- 172.21.15.116:0/1504780239 wait complete. 2024-02-21T22:53:00.003 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.958+0000 7fbc25ffb640 1 -- 172.21.15.116:0/4184274689 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbc301159c0 con 0x7fbc280df400 2024-02-21T22:53:00.003 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.958+0000 7fbc35071640 1 --2- 172.21.15.116:0/4184274689 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fbc1406b5d0 0x7fbc1406da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:00.003 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.958+0000 7f985bfff640 1 --2- 172.21.15.116:0/1402260248 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f984806b5a0 0x7f984806da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:00.004 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.958+0000 7feadd7fa640 1 -- 172.21.15.116:0/1487133352 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7feacc020070 con 0x7fead80e4100 2024-02-21T22:53:00.004 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.959+0000 7feadd7fa640 1 --2- 172.21.15.116:0/1487133352 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7feac406b520 0x7feac406d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:00.004 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.959+0000 7fbc35071640 1 --2- 172.21.15.116:0/4184274689 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fbc1406b5d0 0x7fbc1406da90 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fbc2c006fd0 tx=0x7fbc2c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:00.005 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.959+0000 7f985bfff640 1 --2- 172.21.15.116:0/1402260248 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f984806b5a0 0x7f984806da60 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f9850036000 tx=0x7f985003b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:00.005 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.959+0000 7fca29fb4640 1 -- 172.21.15.116:0/48654763 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca240752f0 con 0x7fca24156cd0 2024-02-21T22:53:00.005 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.959+0000 7feae4e7a640 1 --2- 172.21.15.116:0/1487133352 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7feac406b520 0x7feac406d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:00.005 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.959+0000 7feadd7fa640 1 -- 172.21.15.116:0/1487133352 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7feacc08a870 con 0x7fead80e4100 2024-02-21T22:53:00.005 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.959+0000 7f0d0c35e640 1 Processor -- start 2024-02-21T22:53:00.006 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.959+0000 7fca0bfff640 1 -- 172.21.15.116:0/48654763 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fca1c0145c0 con 0x7fca24156cd0 2024-02-21T22:53:00.006 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.959+0000 7f0d0c35e640 1 -- start start 2024-02-21T22:53:00.006 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.959+0000 7feae4e7a640 1 --2- 172.21.15.116:0/1487133352 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7feac406b520 0x7feac406d9e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fead403e000 tx=0x7fead4038000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:00.007 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.960+0000 7fca0bfff640 1 --2- 172.21.15.116:0/48654763 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fca1006b550 0x7fca1006da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:00.007 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.960+0000 7fca237fe640 1 --2- 172.21.15.116:0/48654763 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fca1006b550 0x7fca1006da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:00.007 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.960+0000 7f0d0c35e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0d0406ae40 0x7f0d0415bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:00.007 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.960+0000 7fca0bfff640 1 -- 172.21.15.116:0/48654763 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fca1c08a130 con 0x7fca24156cd0 2024-02-21T22:53:00.008 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.960+0000 7f0d0c35e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0d040c34f0 0x7f0d040c8010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:00.008 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.960+0000 7f0d0c35e640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0d040c8e60 0x7f0d040c9820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:00.008 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.960+0000 7f0d0c35e640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d04161c10 con 0x7f0d040c8e60 2024-02-21T22:53:00.008 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.960+0000 7f0d0c35e640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d04161a90 con 0x7f0d040c34f0 2024-02-21T22:53:00.009 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.960+0000 7f0d0c35e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d04161d90 con 0x7f0d0406ae40 2024-02-21T22:53:00.009 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.960+0000 7f0d098f9640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0d040c34f0 0x7f0d040c8010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:00.009 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.960+0000 7f0d0a0fa640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0d0406ae40 0x7f0d0415bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:00.009 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.960+0000 7f0d098f9640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0d040c34f0 0x7f0d040c8010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.116:41132/0 (socket says 172.21.15.116:41132) 2024-02-21T22:53:00.009 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.960+0000 7f0d098f9640 1 -- 172.21.15.116:0/3744867026 learned_addr learned my addr 172.21.15.116:0/3744867026 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:00.009 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.960+0000 7f0d0a8fb640 1 --2- 172.21.15.116:0/3744867026 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0d040c8e60 0x7f0d040c9820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:00.009 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.960+0000 7fca237fe640 1 --2- 172.21.15.116:0/48654763 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fca1006b550 0x7fca1006da10 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fca18009b90 tx=0x7fca18009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:00.010 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.960+0000 7f0d098f9640 1 -- 172.21.15.116:0/3744867026 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0d0406ae40 msgr2=0x7f0d0415bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:00.010 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.960+0000 7f0d098f9640 1 --2- 172.21.15.116:0/3744867026 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0d0406ae40 0x7f0d0415bf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:00.010 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.960+0000 7f0d098f9640 1 -- 172.21.15.116:0/3744867026 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0d040c8e60 msgr2=0x7f0d040c9820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:00.010 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.960+0000 7f0d098f9640 1 --2- 172.21.15.116:0/3744867026 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0d040c8e60 0x7f0d040c9820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:00.010 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.960+0000 7f0d098f9640 1 -- 172.21.15.116:0/3744867026 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d040c6f70 con 0x7f0d040c34f0 2024-02-21T22:53:00.010 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.961+0000 7f0d098f9640 1 --2- 172.21.15.116:0/3744867026 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0d040c34f0 0x7f0d040c8010 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f0cf400b3e0 tx=0x7f0cf400b8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:00.010 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.962+0000 7f86eaffd640 1 -- 172.21.15.116:0/2671728769 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86f0017070 con 0x7f86ec049c00 2024-02-21T22:53:00.011 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.962+0000 7fc7b2ffd640 1 -- 172.21.15.116:0/3834146844 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7fc7ac059210 con 0x7fc7bc14b850 2024-02-21T22:53:00.011 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.962+0000 7fb2de7fc640 1 -- 172.21.15.116:0/2581675874 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2e8018070 con 0x7fb2d80053c0 2024-02-21T22:53:00.011 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.962+0000 7f86fb473640 1 -- 172.21.15.116:0/2671728769 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86ec0081d0 con 0x7f86ec049c00 2024-02-21T22:53:00.012 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.962+0000 7f86fb473640 1 -- 172.21.15.116:0/2671728769 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86ec008790 con 0x7f86ec049c00 2024-02-21T22:53:00.012 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.962+0000 7f86eaffd640 1 -- 172.21.15.116:0/2671728769 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86f00035f0 con 0x7f86ec049c00 2024-02-21T22:53:00.012 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.962+0000 7fb2f3e88640 1 -- 172.21.15.116:0/2581675874 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2ec15d0a0 con 0x7fb2d80053c0 2024-02-21T22:53:00.012 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.962+0000 7fb2f3e88640 1 -- 172.21.15.116:0/2581675874 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2ec15fab0 con 0x7fb2d80053c0 2024-02-21T22:53:00.012 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.962+0000 7fb2de7fc640 1 -- 172.21.15.116:0/2581675874 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2e80072d0 con 0x7fb2d80053c0 2024-02-21T22:53:00.012 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.963+0000 7f9858ff9640 1 -- 172.21.15.116:0/1402260248 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f985c1ecf00 con 0x7f985c15afb0 2024-02-21T22:53:00.013 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.963+0000 7feadd7fa640 1 -- 172.21.15.116:0/1487133352 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7feacc059180 con 0x7fead80e4100 2024-02-21T22:53:00.013 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.963+0000 7f86eaffd640 1 -- 172.21.15.116:0/2671728769 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86f00039e0 con 0x7f86ec049c00 2024-02-21T22:53:00.013 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.963+0000 7fb2de7fc640 1 -- 172.21.15.116:0/2581675874 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2e80047e0 con 0x7fb2d80053c0 2024-02-21T22:53:00.013 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.963+0000 7f86fb473640 1 -- 172.21.15.116:0/2671728769 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86dc005290 con 0x7f86ec049c00 2024-02-21T22:53:00.014 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.964+0000 7fb2f3e88640 1 -- 172.21.15.116:0/2581675874 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2d4005290 con 0x7fb2d80053c0 2024-02-21T22:53:00.014 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.964+0000 7f86eaffd640 1 -- 172.21.15.116:0/2671728769 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f86f001a070 con 0x7f86ec049c00 2024-02-21T22:53:00.014 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.965+0000 7f86eaffd640 1 --2- 172.21.15.116:0/2671728769 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f86d806b4d0 0x7f86d806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:00.015 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.965+0000 7fb2de7fc640 1 -- 172.21.15.116:0/2581675874 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fb2e801b070 con 0x7fb2d80053c0 2024-02-21T22:53:00.015 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.965+0000 7f86eaffd640 1 -- 172.21.15.116:0/2671728769 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f86f00897c0 con 0x7f86ec049c00 2024-02-21T22:53:00.015 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.965+0000 7f86fa471640 1 --2- 172.21.15.116:0/2671728769 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f86d806b4d0 0x7f86d806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:00.015 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.965+0000 7fb2de7fc640 1 --2- 172.21.15.116:0/2581675874 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fb2d006b4d0 0x7fb2d006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:00.016 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.966+0000 7fb2de7fc640 1 -- 172.21.15.116:0/2581675874 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb2e80899b0 con 0x7fb2d80053c0 2024-02-21T22:53:00.016 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.966+0000 7fb2f1423640 1 --2- 172.21.15.116:0/2581675874 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fb2d006b4d0 0x7fb2d006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:00.016 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.966+0000 7f86fa471640 1 --2- 172.21.15.116:0/2671728769 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f86d806b4d0 0x7f86d806d990 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f86e402b9c0 tx=0x7f86e403b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:00.016 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.966+0000 7fb2f1423640 1 --2- 172.21.15.116:0/2581675874 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fb2d006b4d0 0x7fb2d006d990 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fb2ec0b94f0 tx=0x7fb2e0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:00.017 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.967+0000 7f0cfaffd640 1 -- 172.21.15.116:0/3744867026 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cf4015020 con 0x7f0d040c34f0 2024-02-21T22:53:00.017 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.967+0000 7f0cfaffd640 1 -- 172.21.15.116:0/3744867026 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cf4011850 con 0x7f0d040c34f0 2024-02-21T22:53:00.017 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.968+0000 7f0d0c35e640 1 -- 172.21.15.116:0/3744867026 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d040c7250 con 0x7f0d040c34f0 2024-02-21T22:53:00.017 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.968+0000 7f0cfaffd640 1 -- 172.21.15.116:0/3744867026 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cf4011c40 con 0x7f0d040c34f0 2024-02-21T22:53:00.017 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.968+0000 7fca0bfff640 1 -- 172.21.15.116:0/48654763 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7fca1c023020 con 0x7fca24156cd0 2024-02-21T22:53:00.018 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.968+0000 7f0d0c35e640 1 -- 172.21.15.116:0/3744867026 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d040c7810 con 0x7f0d040c34f0 2024-02-21T22:53:00.018 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.969+0000 7f0d0c35e640 1 -- 172.21.15.116:0/3744867026 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d040752f0 con 0x7f0d040c34f0 2024-02-21T22:53:00.018 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.969+0000 7fbc25ffb640 1 -- 172.21.15.116:0/4184274689 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7fbc300e41d0 con 0x7fbc280df400 2024-02-21T22:53:00.019 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.970+0000 7f0cfaffd640 1 -- 172.21.15.116:0/3744867026 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f0cf4018020 con 0x7f0d040c34f0 2024-02-21T22:53:00.019 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.971+0000 7f0cfaffd640 1 --2- 172.21.15.116:0/3744867026 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f0ce806b4d0 0x7f0ce806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:00.019 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.971+0000 7f0cfaffd640 1 -- 172.21.15.116:0/3744867026 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0cf408e060 con 0x7f0d040c34f0 2024-02-21T22:53:00.019 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.971+0000 7f0d0a0fa640 1 --2- 172.21.15.116:0/3744867026 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f0ce806b4d0 0x7f0ce806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:00.019 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.971+0000 7fb2de7fc640 1 -- 172.21.15.116:0/2581675874 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7fb2e8022080 con 0x7fb2d80053c0 2024-02-21T22:53:00.020 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.972+0000 7f0d0a0fa640 1 --2- 172.21.15.116:0/3744867026 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f0ce806b4d0 0x7f0ce806d990 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0d00036000 tx=0x7f0d0003c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:00.020 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.975+0000 7f0cfaffd640 1 -- 172.21.15.116:0/3744867026 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f0cf4057a80 con 0x7f0d040c34f0 2024-02-21T22:53:00.020 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:52:59.981+0000 7f86eaffd640 1 -- 172.21.15.116:0/2671728769 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f86f0021020 con 0x7f86ec049c00 2024-02-21T22:53:00.357 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:00.367+0000 7f98629cf640 1 -- 172.21.15.116:0/1402260248 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f985c0752f0 con 0x7f985c15afb0 2024-02-21T22:53:00.358 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:00.367+0000 7f9858ff9640 1 -- 172.21.15.116:0/1402260248 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f985c1ec760 con 0x7f985c15afb0 2024-02-21T22:53:00.358 INFO:teuthology.orchestra.run.smithi116.stdout:55834574855 2024-02-21T22:53:00.362 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:00.371+0000 7f98427fc640 1 -- 172.21.15.116:0/1402260248 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f984806b5a0 msgr2=0x7f984806da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:00.362 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:00.371+0000 7f98427fc640 1 --2- 172.21.15.116:0/1402260248 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f984806b5a0 0x7f984806da60 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f9850036000 tx=0x7f985003b040 comp rx=0 tx=0).stop 2024-02-21T22:53:00.362 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:00.371+0000 7f98427fc640 1 -- 172.21.15.116:0/1402260248 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f985c15afb0 msgr2=0x7f985c1ed840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:00.362 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:00.371+0000 7f98427fc640 1 --2- 172.21.15.116:0/1402260248 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f985c15afb0 0x7f985c1ed840 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f985400be90 tx=0x7f985400bf80 comp rx=0 tx=0).stop 2024-02-21T22:53:00.362 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:00.371+0000 7f98427fc640 1 -- 172.21.15.116:0/1402260248 shutdown_connections 2024-02-21T22:53:00.362 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:00.371+0000 7f98427fc640 1 --2- 172.21.15.116:0/1402260248 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f985c15afb0 0x7f985c1ed840 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:00.362 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:00.371+0000 7f98427fc640 1 --2- 172.21.15.116:0/1402260248 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f985c071c90 0x7f985c1ec220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:00.362 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:00.371+0000 7f98427fc640 1 --2- 172.21.15.116:0/1402260248 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f984806b5a0 0x7f984806da60 secure :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f9850036000 tx=0x7f985003b040 comp rx=0 tx=0).stop 2024-02-21T22:53:00.363 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:00.371+0000 7f98427fc640 1 --2- 172.21.15.116:0/1402260248 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f985c070b70 0x7f985c09d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:00.363 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:00.371+0000 7f98427fc640 1 -- 172.21.15.116:0/1402260248 >> 172.21.15.116:0/1402260248 conn(0x7f985c0b18e0 msgr2=0x7f985c0ae070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:00.363 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:00.372+0000 7f98427fc640 1 -- 172.21.15.116:0/1402260248 shutdown_connections 2024-02-21T22:53:00.363 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:00.372+0000 7f98427fc640 1 -- 172.21.15.116:0/1402260248 wait complete. 2024-02-21T22:53:00.363 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:00.373+0000 7fc7c0836640 1 -- 172.21.15.116:0/3834146844 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fc794005580 con 0x7fc7bc14b850 2024-02-21T22:53:00.365 INFO:teuthology.orchestra.run.smithi116.stdout:55834574854 2024-02-21T22:53:00.366 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:00.374+0000 7fc7b2ffd640 1 -- 172.21.15.116:0/3834146844 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc7ac058b10 con 0x7fc7bc14b850 2024-02-21T22:53:00.366 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:00.375+0000 7feae70de640 1 -- 172.21.15.116:0/1487133352 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7feac0005850 con 0x7fead80e4100 2024-02-21T22:53:00.366 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:00.376+0000 7feadd7fa640 1 -- 172.21.15.116:0/1487133352 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7feacc05d220 con 0x7fead80e4100 2024-02-21T22:53:00.368 INFO:teuthology.orchestra.run.smithi116.stdout:55834574854 2024-02-21T22:53:00.369 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:00.377+0000 7fc7c0836640 1 -- 172.21.15.116:0/3834146844 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fc7a006b5a0 msgr2=0x7fc7a006da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:00.369 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:00.377+0000 7fc7c0836640 1 --2- 172.21.15.116:0/3834146844 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fc7a006b5a0 0x7fc7a006da60 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fc7a4036000 tx=0x7fc7a403d040 comp rx=0 tx=0).stop 2024-02-21T22:53:00.369 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:00.377+0000 7fc7c0836640 1 -- 172.21.15.116:0/3834146844 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc7bc14b850 msgr2=0x7fc7bc1646c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:00.370 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:00.377+0000 7fc7c0836640 1 --2- 172.21.15.116:0/3834146844 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc7bc14b850 0x7fc7bc1646c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fc7ac00d800 tx=0x7fc7ac00dcc0 comp rx=0 tx=0).stop 2024-02-21T22:53:00.370 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:00.378+0000 7fc7c0836640 1 -- 172.21.15.116:0/3834146844 shutdown_connections 2024-02-21T22:53:00.370 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:00.378+0000 7fc7c0836640 1 --2- 172.21.15.116:0/3834146844 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc7bc164c00 0x7fc7bc13c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:00.370 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:00.378+0000 7fc7c0836640 1 --2- 172.21.15.116:0/3834146844 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc7bc14b850 0x7fc7bc1646c0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:00.370 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:00.378+0000 7fc7c0836640 1 --2- 172.21.15.116:0/3834146844 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fc7a006b5a0 0x7fc7a006da60 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:00.370 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:00.378+0000 7fc7c0836640 1 --2- 172.21.15.116:0/3834146844 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc7bc06ae40 0x7fc7bc161da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:00.370 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:00.378+0000 7fc7c0836640 1 -- 172.21.15.116:0/3834146844 >> 172.21.15.116:0/3834146844 conn(0x7fc7bc0b2750 msgr2=0x7fc7bc0b06a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:00.370 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:00.378+0000 7fc7c0836640 1 -- 172.21.15.116:0/3834146844 shutdown_connections 2024-02-21T22:53:00.370 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:00.378+0000 7fc7c0836640 1 -- 172.21.15.116:0/3834146844 wait complete. 2024-02-21T22:53:00.371 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:00.379+0000 7feae70de640 1 -- 172.21.15.116:0/1487133352 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7feac406b520 msgr2=0x7feac406d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:00.371 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:00.379+0000 7feae70de640 1 --2- 172.21.15.116:0/1487133352 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7feac406b520 0x7feac406d9e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fead403e000 tx=0x7fead4038000 comp rx=0 tx=0).stop 2024-02-21T22:53:00.371 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:00.379+0000 7feae70de640 1 -- 172.21.15.116:0/1487133352 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fead80e4100 msgr2=0x7fead804ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:00.371 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:00.379+0000 7feae70de640 1 --2- 172.21.15.116:0/1487133352 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fead80e4100 0x7fead804ed50 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7feacc00fbb0 tx=0x7feacc00d720 comp rx=0 tx=0).stop 2024-02-21T22:53:00.372 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:00.379+0000 7feae70de640 1 -- 172.21.15.116:0/1487133352 shutdown_connections 2024-02-21T22:53:00.372 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:00.379+0000 7feae70de640 1 --2- 172.21.15.116:0/1487133352 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fead804f290 0x7fead80e2b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:00.372 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:00.379+0000 7feae70de640 1 --2- 172.21.15.116:0/1487133352 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7feac406b520 0x7feac406d9e0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:00.372 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:00.379+0000 7feae70de640 1 --2- 172.21.15.116:0/1487133352 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fead80e4100 0x7fead804ed50 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:00.372 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:00.379+0000 7feae70de640 1 --2- 172.21.15.116:0/1487133352 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fead80dfef0 0x7fead80d31e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:00.372 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:00.379+0000 7feae70de640 1 -- 172.21.15.116:0/1487133352 >> 172.21.15.116:0/1487133352 conn(0x7fead801ef40 msgr2=0x7fead80549f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:00.372 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:00.379+0000 7feae70de640 1 -- 172.21.15.116:0/1487133352 shutdown_connections 2024-02-21T22:53:00.372 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:00.379+0000 7feae70de640 1 -- 172.21.15.116:0/1487133352 wait complete. 2024-02-21T22:53:00.373 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:00.380+0000 7fca29fb4640 1 -- 172.21.15.116:0/48654763 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fca24072750 con 0x7fca24156cd0 2024-02-21T22:53:00.373 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:00.381+0000 7fca0bfff640 1 -- 172.21.15.116:0/48654763 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fca1c059120 con 0x7fca24156cd0 2024-02-21T22:53:00.373 INFO:teuthology.orchestra.run.smithi116.stdout:55834574855 2024-02-21T22:53:00.375 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:00.384+0000 7fca29fb4640 1 -- 172.21.15.116:0/48654763 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fca1006b550 msgr2=0x7fca1006da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:00.375 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:00.384+0000 7fca29fb4640 1 --2- 172.21.15.116:0/48654763 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fca1006b550 0x7fca1006da10 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fca18009b90 tx=0x7fca18009190 comp rx=0 tx=0).stop 2024-02-21T22:53:00.375 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:00.385+0000 7fca29fb4640 1 -- 172.21.15.116:0/48654763 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fca24156cd0 msgr2=0x7fca241544b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:00.375 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:00.385+0000 7fca29fb4640 1 --2- 172.21.15.116:0/48654763 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fca24156cd0 0x7fca241544b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fca2404f9b0 tx=0x7fca1c007f60 comp rx=0 tx=0).stop 2024-02-21T22:53:00.376 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:00.385+0000 7fca29fb4640 1 -- 172.21.15.116:0/48654763 shutdown_connections 2024-02-21T22:53:00.376 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:00.385+0000 7fca29fb4640 1 --2- 172.21.15.116:0/48654763 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fca24156cd0 0x7fca241544b0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:00.376 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:00.385+0000 7fca29fb4640 1 --2- 172.21.15.116:0/48654763 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fca1006b550 0x7fca1006da10 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:00.377 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:00.385+0000 7fca29fb4640 1 --2- 172.21.15.116:0/48654763 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fca240b06d0 0x7fca2415e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:00.377 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:00.385+0000 7fca29fb4640 1 --2- 172.21.15.116:0/48654763 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fca241568f0 0x7fca240cce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:00.377 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:00.385+0000 7fca29fb4640 1 -- 172.21.15.116:0/48654763 >> 172.21.15.116:0/48654763 conn(0x7fca240d0a80 msgr2=0x7fca240cc750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:00.377 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:00.386+0000 7fca29fb4640 1 -- 172.21.15.116:0/48654763 shutdown_connections 2024-02-21T22:53:00.377 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:00.386+0000 7fca29fb4640 1 -- 172.21.15.116:0/48654763 wait complete. 2024-02-21T22:53:00.377 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:00.386+0000 7f0d0c35e640 1 -- 172.21.15.116:0/3744867026 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f0d040c7cb0 con 0x7f0d040c34f0 2024-02-21T22:53:00.378 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:00.386+0000 7fbc36073640 1 -- 172.21.15.116:0/4184274689 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fbc10005580 con 0x7fbc280df400 2024-02-21T22:53:00.378 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:00.387+0000 7fbc25ffb640 1 -- 172.21.15.116:0/4184274689 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fbc300e8270 con 0x7fbc280df400 2024-02-21T22:53:00.378 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:00.387+0000 7f0cfaffd640 1 -- 172.21.15.116:0/3744867026 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0cf405bb20 con 0x7f0d040c34f0 2024-02-21T22:53:00.380 INFO:teuthology.orchestra.run.smithi116.stdout:55834574854 2024-02-21T22:53:00.381 INFO:teuthology.orchestra.run.smithi116.stdout:55834574853 2024-02-21T22:53:00.381 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:00.389+0000 7fb2f3e88640 1 -- 172.21.15.116:0/2581675874 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fb2d4005850 con 0x7fb2d80053c0 2024-02-21T22:53:00.381 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:00.390+0000 7fb2de7fc640 1 -- 172.21.15.116:0/2581675874 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb2e80581c0 con 0x7fb2d80053c0 2024-02-21T22:53:00.381 INFO:teuthology.orchestra.run.smithi116.stdout:55834574853 2024-02-21T22:53:00.381 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:00.390+0000 7fbc36073640 1 -- 172.21.15.116:0/4184274689 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fbc1406b5d0 msgr2=0x7fbc1406da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:00.382 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:00.390+0000 7f0d0c35e640 1 -- 172.21.15.116:0/3744867026 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f0ce806b4d0 msgr2=0x7f0ce806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:00.382 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:00.390+0000 7fbc36073640 1 --2- 172.21.15.116:0/4184274689 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fbc1406b5d0 0x7fbc1406da90 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fbc2c006fd0 tx=0x7fbc2c008040 comp rx=0 tx=0).stop 2024-02-21T22:53:00.382 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:00.390+0000 7f0d0c35e640 1 --2- 172.21.15.116:0/3744867026 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f0ce806b4d0 0x7f0ce806d990 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0d00036000 tx=0x7f0d0003c040 comp rx=0 tx=0).stop 2024-02-21T22:53:00.383 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:00.390+0000 7fbc36073640 1 -- 172.21.15.116:0/4184274689 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbc280df400 msgr2=0x7fbc280dc6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:00.383 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:00.390+0000 7fbc36073640 1 --2- 172.21.15.116:0/4184274689 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbc280df400 0x7fbc280dc6f0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fbc3006a700 tx=0x7fbc30073540 comp rx=0 tx=0).stop 2024-02-21T22:53:00.383 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:00.390+0000 7f0d0c35e640 1 -- 172.21.15.116:0/3744867026 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0d040c34f0 msgr2=0x7f0d040c8010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:00.383 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:00.390+0000 7f0d0c35e640 1 --2- 172.21.15.116:0/3744867026 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0d040c34f0 0x7f0d040c8010 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f0cf400b3e0 tx=0x7f0cf400b8a0 comp rx=0 tx=0).stop 2024-02-21T22:53:00.383 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:00.391+0000 7fbc36073640 1 -- 172.21.15.116:0/4184274689 shutdown_connections 2024-02-21T22:53:00.384 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:00.391+0000 7f0d0c35e640 1 -- 172.21.15.116:0/3744867026 shutdown_connections 2024-02-21T22:53:00.384 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:00.391+0000 7f0d0c35e640 1 --2- 172.21.15.116:0/3744867026 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0d040c8e60 0x7f0d040c9820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:00.385 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:00.391+0000 7f0d0c35e640 1 --2- 172.21.15.116:0/3744867026 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0d040c34f0 0x7f0d040c8010 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:00.385 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:00.391+0000 7f0d0c35e640 1 --2- 172.21.15.116:0/3744867026 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f0ce806b4d0 0x7f0ce806d990 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:00.385 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:00.391+0000 7f0d0c35e640 1 --2- 172.21.15.116:0/3744867026 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0d0406ae40 0x7f0d0415bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:00.385 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:00.391+0000 7f0d0c35e640 1 -- 172.21.15.116:0/3744867026 >> 172.21.15.116:0/3744867026 conn(0x7f0d040cfdc0 msgr2=0x7f0d040cf4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:00.385 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:00.391+0000 7f0d0c35e640 1 -- 172.21.15.116:0/3744867026 shutdown_connections 2024-02-21T22:53:00.385 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:00.391+0000 7f0d0c35e640 1 -- 172.21.15.116:0/3744867026 wait complete. 2024-02-21T22:53:00.385 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:00.391+0000 7f86fb473640 1 -- 172.21.15.116:0/2671728769 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f86dc005850 con 0x7f86ec049c00 2024-02-21T22:53:00.386 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:00.391+0000 7fbc36073640 1 --2- 172.21.15.116:0/4184274689 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fbc1406b5d0 0x7fbc1406da90 secure :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fbc2c006fd0 tx=0x7fbc2c008040 comp rx=0 tx=0).stop 2024-02-21T22:53:00.386 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:00.392+0000 7fbc36073640 1 --2- 172.21.15.116:0/4184274689 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbc280df400 0x7fbc280dc6f0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:00.386 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:00.392+0000 7fbc36073640 1 --2- 172.21.15.116:0/4184274689 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbc280defa0 0x7fbc2804d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:00.386 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:00.392+0000 7fbc36073640 1 --2- 172.21.15.116:0/4184274689 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbc28004af0 0x7fbc280d3d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:00.386 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:00.392+0000 7f86eaffd640 1 -- 172.21.15.116:0/2671728769 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f86f0058040 con 0x7f86ec049c00 2024-02-21T22:53:00.386 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:00.392+0000 7fbc36073640 1 -- 172.21.15.116:0/4184274689 >> 172.21.15.116:0/4184274689 conn(0x7fbc2800a3f0 msgr2=0x7fbc280e2ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:00.387 INFO:teuthology.orchestra.run.smithi116.stdout:55834574854 2024-02-21T22:53:00.387 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:00.393+0000 7fbc36073640 1 -- 172.21.15.116:0/4184274689 shutdown_connections 2024-02-21T22:53:00.387 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:00.393+0000 7fbc36073640 1 -- 172.21.15.116:0/4184274689 wait complete. 2024-02-21T22:53:00.388 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:00.393+0000 7fb2f3e88640 1 -- 172.21.15.116:0/2581675874 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fb2d006b4d0 msgr2=0x7fb2d006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:00.388 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:00.394+0000 7fb2f3e88640 1 --2- 172.21.15.116:0/2581675874 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fb2d006b4d0 0x7fb2d006d990 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fb2ec0b94f0 tx=0x7fb2e0008040 comp rx=0 tx=0).stop 2024-02-21T22:53:00.388 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:00.394+0000 7fb2f3e88640 1 -- 172.21.15.116:0/2581675874 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb2d80053c0 msgr2=0x7fb2ec1555b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:00.388 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:00.394+0000 7fb2f3e88640 1 --2- 172.21.15.116:0/2581675874 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb2d80053c0 0x7fb2ec1555b0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fb2e800c6b0 tx=0x7fb2e800cb70 comp rx=0 tx=0).stop 2024-02-21T22:53:00.388 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:00.394+0000 7fb2f3e88640 1 -- 172.21.15.116:0/2581675874 shutdown_connections 2024-02-21T22:53:00.388 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:00.394+0000 7fb2f3e88640 1 --2- 172.21.15.116:0/2581675874 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fb2d006b4d0 0x7fb2d006d990 secure :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fb2ec0b94f0 tx=0x7fb2e0008040 comp rx=0 tx=0).stop 2024-02-21T22:53:00.389 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:00.394+0000 7fb2f3e88640 1 --2- 172.21.15.116:0/2581675874 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb2ec155cb0 0x7fb2ec0c8700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:00.390 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574855 for osd.1 2024-02-21T22:53:00.390 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:00.394+0000 7fb2f3e88640 1 --2- 172.21.15.116:0/2581675874 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb2ec156290 0x7fb2ec0c81c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:00.390 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:00.394+0000 7fb2f3e88640 1 --2- 172.21.15.116:0/2581675874 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb2d80053c0 0x7fb2ec1555b0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:00.390 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:00.394+0000 7fb2f3e88640 1 -- 172.21.15.116:0/2581675874 >> 172.21.15.116:0/2581675874 conn(0x7fb2ec0d3e50 msgr2=0x7fb2ec0cd670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:00.391 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:00.394+0000 7fb2f3e88640 1 -- 172.21.15.116:0/2581675874 shutdown_connections 2024-02-21T22:53:00.391 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:00.394+0000 7fb2f3e88640 1 -- 172.21.15.116:0/2581675874 wait complete. 2024-02-21T22:53:00.392 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:00.396+0000 7f86fb473640 1 -- 172.21.15.116:0/2671728769 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f86d806b4d0 msgr2=0x7f86d806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:00.392 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:00.396+0000 7f86fb473640 1 --2- 172.21.15.116:0/2671728769 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f86d806b4d0 0x7f86d806d990 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f86e402b9c0 tx=0x7f86e403b040 comp rx=0 tx=0).stop 2024-02-21T22:53:00.392 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:00.396+0000 7f86fb473640 1 -- 172.21.15.116:0/2671728769 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f86ec049c00 msgr2=0x7f86ec04c320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:00.392 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:00.396+0000 7f86fb473640 1 --2- 172.21.15.116:0/2671728769 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f86ec049c00 0x7f86ec04c320 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f86f000c400 tx=0x7f86f000c800 comp rx=0 tx=0).stop 2024-02-21T22:53:00.392 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:00.398+0000 7f86fb473640 1 -- 172.21.15.116:0/2671728769 shutdown_connections 2024-02-21T22:53:00.392 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:00.398+0000 7f86fb473640 1 --2- 172.21.15.116:0/2671728769 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f86ec056780 0x7f86ec0e5c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:00.392 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:00.398+0000 7f86fb473640 1 --2- 172.21.15.116:0/2671728769 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f86ec049c00 0x7f86ec04c320 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:00.392 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:00.398+0000 7f86fb473640 1 --2- 172.21.15.116:0/2671728769 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f86d806b4d0 0x7f86d806d990 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:00.392 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:00.398+0000 7f86fb473640 1 --2- 172.21.15.116:0/2671728769 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f86ec0362f0 0x7f86ec0dc480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:00.392 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:00.398+0000 7f86fb473640 1 -- 172.21.15.116:0/2671728769 >> 172.21.15.116:0/2671728769 conn(0x7f86ec056ce0 msgr2=0x7f86ec0ea4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:00.392 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:00.398+0000 7f86fb473640 1 -- 172.21.15.116:0/2671728769 shutdown_connections 2024-02-21T22:53:00.392 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:00.398+0000 7f86fb473640 1 -- 172.21.15.116:0/2671728769 wait complete. 2024-02-21T22:53:00.393 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574854 for osd.6 2024-02-21T22:53:00.394 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574854 for osd.3 2024-02-21T22:53:00.397 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574855 for osd.5 2024-02-21T22:53:00.399 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574854 for osd.4 2024-02-21T22:53:00.404 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574854 for osd.2 2024-02-21T22:53:00.406 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574853 for osd.0 2024-02-21T22:53:00.406 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574853 for osd.7 2024-02-21T22:53:01.390 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-02-21T22:53:01.394 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-02-21T22:53:01.394 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-02-21T22:53:01.398 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-02-21T22:53:01.400 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-02-21T22:53:01.405 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-02-21T22:53:01.407 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-02-21T22:53:01.407 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-02-21T22:53:01.556 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.562+0000 7f93146de640 1 Processor -- start 2024-02-21T22:53:01.556 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.562+0000 7f93146de640 1 -- start start 2024-02-21T22:53:01.556 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.564+0000 7f93146de640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f93040e0090 0x7f9304034fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:01.556 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.564+0000 7f93146de640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f9304050420 0x7f9304038dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:01.556 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.564+0000 7f93146de640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9304039310 0x7f9304008ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:01.556 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.564+0000 7f93146de640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9304050920 con 0x7f93040e0090 2024-02-21T22:53:01.557 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.564+0000 7f93146de640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9304034d00 con 0x7f9304050420 2024-02-21T22:53:01.557 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.564+0000 7f93146de640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9304007d20 con 0x7f9304039310 2024-02-21T22:53:01.557 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.565+0000 7f9311c79640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f9304050420 0x7f9304038dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:01.557 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.565+0000 7f9311c79640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f9304050420 0x7f9304038dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.116:41148/0 (socket says 172.21.15.116:41148) 2024-02-21T22:53:01.557 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.565+0000 7f9311c79640 1 -- 172.21.15.116:0/3834991701 learned_addr learned my addr 172.21.15.116:0/3834991701 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:01.557 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.565+0000 7f9311c79640 1 -- 172.21.15.116:0/3834991701 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9304039310 msgr2=0x7f9304008ae0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T22:53:01.557 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.565+0000 7f931247a640 1 --2- 172.21.15.116:0/3834991701 >> v2:172.21.15.116:3300/0 conn(0x7f93040e0090 0x7f9304034fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:01.559 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.565+0000 7f9311c79640 1 --2- 172.21.15.116:0/3834991701 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9304039310 0x7f9304008ae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:01.559 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.565+0000 7f9311c79640 1 -- 172.21.15.116:0/3834991701 >> v2:172.21.15.116:3300/0 conn(0x7f93040e0090 msgr2=0x7f9304034fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:53:01.559 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.565+0000 7f9311c79640 1 --2- 172.21.15.116:0/3834991701 >> v2:172.21.15.116:3300/0 conn(0x7f93040e0090 0x7f9304034fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:01.559 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.565+0000 7f9311c79640 1 -- 172.21.15.116:0/3834991701 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9304008000 con 0x7f9304050420 2024-02-21T22:53:01.559 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.567+0000 7f9311c79640 1 --2- 172.21.15.116:0/3834991701 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9304050420 0x7f9304038dd0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f930c062af0 tx=0x7f930c0a9320 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dbb63994c22755ee server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:01.560 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.567+0000 7f931247a640 1 --2- 172.21.15.116:0/3834991701 >> v2:172.21.15.116:3300/0 conn(0x7f93040e0090 0x7f9304034fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T22:53:01.560 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.567+0000 7f9311478640 1 -- 172.21.15.116:0/3834991701 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f930c0b6070 con 0x7f9304050420 2024-02-21T22:53:01.560 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.568+0000 7f9311478640 1 -- 172.21.15.116:0/3834991701 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f930c06be50 con 0x7f9304050420 2024-02-21T22:53:01.561 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.569+0000 7f93146de640 1 -- 172.21.15.116:0/3834991701 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9304050420 msgr2=0x7f9304038dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:01.561 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.569+0000 7f93146de640 1 --2- 172.21.15.116:0/3834991701 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9304050420 0x7f9304038dd0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f930c062af0 tx=0x7f930c0a9320 comp rx=0 tx=0).stop 2024-02-21T22:53:01.561 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.569+0000 7f93146de640 1 -- 172.21.15.116:0/3834991701 shutdown_connections 2024-02-21T22:53:01.561 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.569+0000 7f93146de640 1 --2- 172.21.15.116:0/3834991701 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9304039310 0x7f9304008ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:01.561 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.569+0000 7f93146de640 1 --2- 172.21.15.116:0/3834991701 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9304050420 0x7f9304038dd0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:01.561 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.569+0000 7f93146de640 1 --2- 172.21.15.116:0/3834991701 >> v2:172.21.15.116:3300/0 conn(0x7f93040e0090 0x7f9304034fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:01.561 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.569+0000 7f93146de640 1 -- 172.21.15.116:0/3834991701 >> 172.21.15.116:0/3834991701 conn(0x7f9304055bc0 msgr2=0x7f9304055fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:01.561 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.569+0000 7f93146de640 1 -- 172.21.15.116:0/3834991701 shutdown_connections 2024-02-21T22:53:01.562 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.570+0000 7f93146de640 1 -- 172.21.15.116:0/3834991701 wait complete. 2024-02-21T22:53:01.562 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.571+0000 7f93146de640 1 Processor -- start 2024-02-21T22:53:01.563 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.572+0000 7f93146de640 1 -- start start 2024-02-21T22:53:01.564 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.573+0000 7f93146de640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9304039310 0x7f9304037110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:01.564 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.573+0000 7f93146de640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9304050420 0x7f9304037650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:01.566 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.574+0000 7f931247a640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9304039310 0x7f9304037110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:01.566 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.574+0000 7f931247a640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9304039310 0x7f9304037110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.116:41152/0 (socket says 172.21.15.116:41152) 2024-02-21T22:53:01.566 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.574+0000 7f9311c79640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9304050420 0x7f9304037650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:01.566 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.574+0000 7f9311c79640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9304050420 0x7f9304037650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.116:55804/0 (socket says 172.21.15.116:55804) 2024-02-21T22:53:01.566 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.573+0000 7f93146de640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f93040e0090 0x7f93041852f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:01.566 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.574+0000 7f93146de640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9304009020 con 0x7f93040e0090 2024-02-21T22:53:01.567 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.574+0000 7f93146de640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93040085c0 con 0x7f9304039310 2024-02-21T22:53:01.567 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.574+0000 7f93146de640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93040091a0 con 0x7f9304050420 2024-02-21T22:53:01.567 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.574+0000 7f931247a640 1 -- 172.21.15.116:0/104919859 learned_addr learned my addr 172.21.15.116:0/104919859 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:01.567 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.575+0000 7f9311c79640 1 -- 172.21.15.116:0/104919859 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9304039310 msgr2=0x7f9304037110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:01.567 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.575+0000 7f9311c79640 1 --2- 172.21.15.116:0/104919859 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9304039310 0x7f9304037110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:01.567 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.575+0000 7f9311c79640 1 -- 172.21.15.116:0/104919859 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f93040e0090 msgr2=0x7f93041852f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-21T22:53:01.567 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.575+0000 7f9312c7b640 1 --2- 172.21.15.116:0/104919859 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f93040e0090 0x7f93041852f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:01.567 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.575+0000 7f9311c79640 1 --2- 172.21.15.116:0/104919859 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f93040e0090 0x7f93041852f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:01.567 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.575+0000 7f9311c79640 1 -- 172.21.15.116:0/104919859 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9304036070 con 0x7f9304050420 2024-02-21T22:53:01.567 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.575+0000 7f9311c79640 1 --2- 172.21.15.116:0/104919859 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9304050420 0x7f9304037650 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f930c069af0 tx=0x7f930c0ab070 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:01.567 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.576+0000 7f9312c7b640 1 --2- 172.21.15.116:0/104919859 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f93040e0090 0x7f93041852f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T22:53:01.567 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.576+0000 7f9302ffd640 1 -- 172.21.15.116:0/104919859 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f930c0c1070 con 0x7f9304050420 2024-02-21T22:53:01.568 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.576+0000 7f93146de640 1 -- 172.21.15.116:0/104919859 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9304036350 con 0x7f9304050420 2024-02-21T22:53:01.568 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.576+0000 7f93146de640 1 -- 172.21.15.116:0/104919859 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9304036910 con 0x7f9304050420 2024-02-21T22:53:01.568 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.576+0000 7f9302ffd640 1 -- 172.21.15.116:0/104919859 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f930c0b0b50 con 0x7f9304050420 2024-02-21T22:53:01.568 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.576+0000 7f9302ffd640 1 -- 172.21.15.116:0/104919859 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f930c0b6040 con 0x7f9304050420 2024-02-21T22:53:01.568 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.578+0000 7f9302ffd640 1 -- 172.21.15.116:0/104919859 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f930c0b16c0 con 0x7f9304050420 2024-02-21T22:53:01.570 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.580+0000 7f9302ffd640 1 --2- 172.21.15.116:0/104919859 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f92f006b5d0 0x7f92f006da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:01.570 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.580+0000 7f931247a640 1 --2- 172.21.15.116:0/104919859 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f92f006b5d0 0x7f92f006da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:01.571 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.580+0000 7f9302ffd640 1 -- 172.21.15.116:0/104919859 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f930c126e50 con 0x7f9304050420 2024-02-21T22:53:01.571 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.580+0000 7f931247a640 1 --2- 172.21.15.116:0/104919859 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f92f006b5d0 0x7f92f006da90 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f930800ab80 tx=0x7f9308008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:01.572 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.582+0000 7f93146de640 1 -- 172.21.15.116:0/104919859 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92f4005290 con 0x7f9304050420 2024-02-21T22:53:01.578 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.587+0000 7f9302ffd640 1 -- 172.21.15.116:0/104919859 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f930c0f56f0 con 0x7f9304050420 2024-02-21T22:53:01.608 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.617+0000 7f9b52291640 1 Processor -- start 2024-02-21T22:53:01.610 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.617+0000 7f9b52291640 1 -- start start 2024-02-21T22:53:01.610 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.618+0000 7f9b52291640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f9b4c070b70 0x7f9b4c15ae90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:01.610 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.618+0000 7f9b52291640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f9b4c0b48d0 0x7f9b4c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:01.610 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.618+0000 7f9b52291640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b4c15b480 con 0x7f9b4c0b44a0 2024-02-21T22:53:01.610 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.618+0000 7f9b52291640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b4c15e9c0 con 0x7f9b4c070b70 2024-02-21T22:53:01.610 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.618+0000 7f9b52291640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b4c15dc00 con 0x7f9b4c0b48d0 2024-02-21T22:53:01.610 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.619+0000 7f9b4bfff640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f9b4c070b70 0x7f9b4c15ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:01.611 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.619+0000 7f9b4bfff640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f9b4c070b70 0x7f9b4c15ae90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:34378/0 (socket says 172.21.15.116:34378) 2024-02-21T22:53:01.611 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.619+0000 7f9b4bfff640 1 -- 172.21.15.116:0/781046803 learned_addr learned my addr 172.21.15.116:0/781046803 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:01.611 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.619+0000 7f9b4bfff640 1 -- 172.21.15.116:0/781046803 >> v2:172.21.15.142:3300/0 conn(0x7f9b4c0b48d0 msgr2=0x7f9b4c06c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:53:01.611 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.619+0000 7f9b4bfff640 1 --2- 172.21.15.116:0/781046803 >> v2:172.21.15.142:3300/0 conn(0x7f9b4c0b48d0 0x7f9b4c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:01.611 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.619+0000 7f9b4bfff640 1 -- 172.21.15.116:0/781046803 >> v1:172.21.15.142:6789/0 conn(0x7f9b4c0b44a0 legacy=0x7f9b4c070f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:53:01.611 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.619+0000 7f9b4bfff640 1 -- 172.21.15.116:0/781046803 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b4c15dee0 con 0x7f9b4c070b70 2024-02-21T22:53:01.611 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.620+0000 7f1c8da36640 1 Processor -- start 2024-02-21T22:53:01.611 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.620+0000 7f1c8da36640 1 -- start start 2024-02-21T22:53:01.612 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.620+0000 7fecd1955640 1 Processor -- start 2024-02-21T22:53:01.612 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.621+0000 7fecd1955640 1 -- start start 2024-02-21T22:53:01.612 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.621+0000 7f9b4bfff640 1 --2- 172.21.15.116:0/781046803 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9b4c070b70 0x7f9b4c15ae90 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f9b4c06e670 tx=0x7f9b3c0300a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4eae254a5b6d3e57 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:01.613 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.621+0000 7f9b4affd640 1 -- 172.21.15.116:0/781046803 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b3c036070 con 0x7f9b4c070b70 2024-02-21T22:53:01.613 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.621+0000 7f9b4affd640 1 -- 172.21.15.116:0/781046803 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b3c030e50 con 0x7f9b4c070b70 2024-02-21T22:53:01.613 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.621+0000 7f9b4affd640 1 -- 172.21.15.116:0/781046803 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b3c03a620 con 0x7f9b4c070b70 2024-02-21T22:53:01.613 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.621+0000 7f1c8da36640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f1c88162280 0x7f1c88072030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:01.613 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.621+0000 7f1c8da36640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f1c880aedd0 0x7f1c88162660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:01.613 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.621+0000 7f1c8da36640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c880ce6c0 con 0x7f1c88072570 2024-02-21T22:53:01.613 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.621+0000 7f1c8da36640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c880af340 con 0x7f1c880aedd0 2024-02-21T22:53:01.613 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.621+0000 7f1c8da36640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c880cd900 con 0x7f1c88162280 2024-02-21T22:53:01.614 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.621+0000 7fe1cb71e640 1 Processor -- start 2024-02-21T22:53:01.614 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.622+0000 7f1c867fc640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f1c88072570 0x7f1c880ae6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.116:59198/0 (socket says 172.21.15.116:59198) 2024-02-21T22:53:01.615 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.622+0000 7f1c867fc640 1 -- 172.21.15.116:0/2132051205 learned_addr learned my addr 172.21.15.116:0/2132051205 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-02-21T22:53:01.615 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.622+0000 7f1c86ffd640 1 --2- 172.21.15.116:0/2132051205 >> v2:172.21.15.142:3300/0 conn(0x7f1c88162280 0x7f1c88072030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:01.615 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.622+0000 7fe1cb71e640 1 -- start start 2024-02-21T22:53:01.616 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.622+0000 7fecd1955640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7feccc0c3950 0x7feccc16d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:01.616 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.622+0000 7fecd1955640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feccc162940 con 0x7feccc066c60 2024-02-21T22:53:01.616 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.622+0000 7fecd1955640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feccc0d0180 con 0x7feccc0cf7b0 2024-02-21T22:53:01.617 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.622+0000 7fecd1955640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feccc0d0460 con 0x7feccc0c3950 2024-02-21T22:53:01.618 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.622+0000 7f1c85ffb640 1 -- 172.21.15.116:0/2132051205 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 153506543 0 0) 0x7f1c880ce6c0 con 0x7f1c88072570 2024-02-21T22:53:01.618 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.622+0000 7f1c85ffb640 1 -- 172.21.15.116:0/2132051205 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1c70003520 con 0x7f1c88072570 2024-02-21T22:53:01.618 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.622+0000 7f1c86ffd640 1 -- 172.21.15.116:0/2132051205 >> v2:172.21.15.116:3300/0 conn(0x7f1c880aedd0 msgr2=0x7f1c88162660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:53:01.618 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.622+0000 7f1c86ffd640 1 --2- 172.21.15.116:0/2132051205 >> v2:172.21.15.116:3300/0 conn(0x7f1c880aedd0 0x7f1c88162660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:01.618 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.622+0000 7f9b52291640 1 -- 172.21.15.116:0/781046803 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9b4c070b70 msgr2=0x7f9b4c15ae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:01.618 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.622+0000 7f9b52291640 1 --2- 172.21.15.116:0/781046803 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9b4c070b70 0x7f9b4c15ae90 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f9b4c06e670 tx=0x7f9b3c0300a0 comp rx=0 tx=0).stop 2024-02-21T22:53:01.618 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.622+0000 7f9b52291640 1 -- 172.21.15.116:0/781046803 shutdown_connections 2024-02-21T22:53:01.618 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.622+0000 7f9b52291640 1 --2- 172.21.15.116:0/781046803 >> v2:172.21.15.142:3300/0 conn(0x7f9b4c0b48d0 0x7f9b4c06c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:01.619 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.622+0000 7f9b52291640 1 --2- 172.21.15.116:0/781046803 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9b4c070b70 0x7f9b4c15ae90 secure :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f9b4c06e670 tx=0x7f9b3c0300a0 comp rx=0 tx=0).stop 2024-02-21T22:53:01.619 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.622+0000 7f9b52291640 1 -- 172.21.15.116:0/781046803 >> 172.21.15.116:0/781046803 conn(0x7f9b4c0b18e0 msgr2=0x7f9b4c0b1cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:01.619 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.622+0000 7f1c86ffd640 1 -- 172.21.15.116:0/2132051205 >> v1:172.21.15.142:6789/0 conn(0x7f1c88072570 legacy=0x7f1c880ae6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:01.619 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.622+0000 7f1c86ffd640 1 -- 172.21.15.116:0/2132051205 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c880cdbe0 con 0x7f1c88162280 2024-02-21T22:53:01.619 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.622+0000 7feccaffd640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7feccc0cf7b0 0x7feccc166ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.116:59200/0 (socket says 172.21.15.116:59200) 2024-02-21T22:53:01.620 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.622+0000 7f9b52291640 1 -- 172.21.15.116:0/781046803 shutdown_connections 2024-02-21T22:53:01.620 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.622+0000 7feccaffd640 1 -- 172.21.15.116:0/1277072828 learned_addr learned my addr 172.21.15.116:0/1277072828 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-02-21T22:53:01.620 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.623+0000 7f9b52291640 1 -- 172.21.15.116:0/781046803 wait complete. 2024-02-21T22:53:01.621 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.623+0000 7fe1cb71e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe1c40b2e50 0x7fe1c4072770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:01.621 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.623+0000 7f1c86ffd640 1 --2- 172.21.15.116:0/2132051205 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1c88162280 0x7f1c88072030 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f1c8806bcb0 tx=0x7f1c7802b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f1e64d914647aad3 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:01.621 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.623+0000 7fe1cb71e640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fe1c40b3da0 0x7fe1c416bf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:01.621 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.623+0000 7fe1cb71e640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1c4072e50 con 0x7fe1c40b3230 2024-02-21T22:53:01.621 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.623+0000 7fe1cb71e640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1c4070d30 con 0x7fe1c40b3da0 2024-02-21T22:53:01.621 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.623+0000 7fe1cb71e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1c40b4930 con 0x7fe1c40b2e50 2024-02-21T22:53:01.621 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.623+0000 7fe1c8cb9640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7fe1c40b3230 0x7fe1c40b3690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:50924/0 (socket says 172.21.15.116:50924) 2024-02-21T22:53:01.621 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.623+0000 7fe1c8cb9640 1 -- 172.21.15.116:0/3551034782 learned_addr learned my addr 172.21.15.116:0/3551034782 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-02-21T22:53:01.622 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.623+0000 7f57f7836640 1 Processor -- start 2024-02-21T22:53:01.622 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.623+0000 7feccb7fe640 1 --2- 172.21.15.116:0/1277072828 >> v2:172.21.15.142:3300/0 conn(0x7feccc0c3950 0x7feccc16d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:01.622 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.623+0000 7fecc9ffb640 1 -- 172.21.15.116:0/1277072828 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4289826300 0 0) 0x7fecbc001490 con 0x7feccc066c60 2024-02-21T22:53:01.622 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.623+0000 7fecc9ffb640 1 -- 172.21.15.116:0/1277072828 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fecb8003520 con 0x7feccc066c60 2024-02-21T22:53:01.622 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.623+0000 7fecc9ffb640 1 -- 172.21.15.116:0/1277072828 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 983509235 0 0) 0x7feccc0d0180 con 0x7feccc0cf7b0 2024-02-21T22:53:01.622 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.623+0000 7fecc9ffb640 1 -- 172.21.15.116:0/1277072828 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fecbc001490 con 0x7feccc0cf7b0 2024-02-21T22:53:01.623 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.623+0000 7fe1c94ba640 1 --2- 172.21.15.116:0/3551034782 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe1c40b2e50 0x7fe1c4072770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:01.623 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.624+0000 7f1c85ffb640 1 -- 172.21.15.116:0/2132051205 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c780315a0 con 0x7f1c88162280 2024-02-21T22:53:01.623 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.624+0000 7f1c85ffb640 1 -- 172.21.15.116:0/2132051205 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c78037070 con 0x7f1c88162280 2024-02-21T22:53:01.624 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.624+0000 7fe1c9cbb640 1 --2- 172.21.15.116:0/3551034782 >> v2:172.21.15.116:3300/0 conn(0x7fe1c40b3da0 0x7fe1c416bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:01.624 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.624+0000 7fe1c94ba640 1 -- 172.21.15.116:0/3551034782 >> v2:172.21.15.116:3300/0 conn(0x7fe1c40b3da0 msgr2=0x7fe1c416bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:53:01.624 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.624+0000 7fe1bbfff640 1 -- 172.21.15.116:0/3551034782 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3519443395 0 0) 0x7fe1c4072e50 con 0x7fe1c40b3230 2024-02-21T22:53:01.624 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.624+0000 7f422d111640 1 Processor -- start 2024-02-21T22:53:01.624 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.624+0000 7f1c85ffb640 1 -- 172.21.15.116:0/2132051205 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c78031960 con 0x7f1c88162280 2024-02-21T22:53:01.625 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.624+0000 7f9b52291640 1 Processor -- start 2024-02-21T22:53:01.625 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.624+0000 7f422d111640 1 -- start start 2024-02-21T22:53:01.627 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.625+0000 7f1c8da36640 1 -- 172.21.15.116:0/2132051205 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1c88162280 msgr2=0x7f1c88072030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:01.627 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.625+0000 7f1c8da36640 1 --2- 172.21.15.116:0/2132051205 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1c88162280 0x7f1c88072030 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f1c8806bcb0 tx=0x7f1c7802b840 comp rx=0 tx=0).stop 2024-02-21T22:53:01.627 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.625+0000 7f1c8da36640 1 -- 172.21.15.116:0/2132051205 shutdown_connections 2024-02-21T22:53:01.627 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.625+0000 7f1c8da36640 1 --2- 172.21.15.116:0/2132051205 >> v2:172.21.15.116:3300/0 conn(0x7f1c880aedd0 0x7f1c88162660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:01.627 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.625+0000 7f1c8da36640 1 --2- 172.21.15.116:0/2132051205 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1c88162280 0x7f1c88072030 secure :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f1c8806bcb0 tx=0x7f1c7802b840 comp rx=0 tx=0).stop 2024-02-21T22:53:01.627 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.625+0000 7f1c8da36640 1 -- 172.21.15.116:0/2132051205 >> 172.21.15.116:0/2132051205 conn(0x7f1c880b1e90 msgr2=0x7f1c8806ae40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:01.628 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.624+0000 7feccb7fe640 1 -- 172.21.15.116:0/1277072828 >> v1:172.21.15.142:6789/0 conn(0x7feccc0cf7b0 legacy=0x7feccc166ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:01.628 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.624+0000 7feccb7fe640 1 -- 172.21.15.116:0/1277072828 >> v1:172.21.15.116:6789/0 conn(0x7feccc066c60 legacy=0x7feccc0c3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:01.628 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.624+0000 7fecc9ffb640 1 -- 172.21.15.116:0/1277072828 <== mon.0 v1:172.21.15.116:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3075910892 0 0) 0x7fecb8003520 con 0x7feccc066c60 2024-02-21T22:53:01.628 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.624+0000 7feccb7fe640 1 -- 172.21.15.116:0/1277072828 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feccc0d0740 con 0x7feccc0c3950 2024-02-21T22:53:01.628 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.623+0000 7f57f7836640 1 -- start start 2024-02-21T22:53:01.628 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.625+0000 7f57f7836640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f57f016af60 0x7f57f016d350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:01.628 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.625+0000 7f57f7836640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57f0072e50 con 0x7f57f0072770 2024-02-21T22:53:01.628 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.625+0000 7f57f7836640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57f00b4050 con 0x7f57f00b2e50 2024-02-21T22:53:01.629 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.625+0000 7f3425c08640 1 Processor -- start 2024-02-21T22:53:01.629 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.625+0000 7f57f7836640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57f0070d30 con 0x7f57f016af60 2024-02-21T22:53:01.629 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.625+0000 7feccb7fe640 1 --2- 172.21.15.116:0/1277072828 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feccc0c3950 0x7feccc16d430 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fecc40097a0 tx=0x7fecc402b820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1fd8543767a120dc server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:01.630 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.625+0000 7f1c8da36640 1 -- 172.21.15.116:0/2132051205 shutdown_connections 2024-02-21T22:53:01.630 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.625+0000 7f57f55d2640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f57f00b2e50 0x7f57f00b3230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.116:59210/0 (socket says 172.21.15.116:59210) 2024-02-21T22:53:01.630 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.625+0000 7f57f55d2640 1 -- 172.21.15.116:0/2618351668 learned_addr learned my addr 172.21.15.116:0/2618351668 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-02-21T22:53:01.630 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.625+0000 7f3425c08640 1 -- start start 2024-02-21T22:53:01.631 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.625+0000 7f57f5dd3640 1 --2- 172.21.15.116:0/2618351668 >> v2:172.21.15.116:3300/0 conn(0x7f57f016af60 0x7f57f016d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:01.631 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.626+0000 7f422d111640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f42280b2e50 0x7f4228072770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:01.631 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.626+0000 7f422d111640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4228072e50 con 0x7f42280b3230 2024-02-21T22:53:01.631 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.626+0000 7f422d111640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42280b4930 con 0x7f42280b3da0 2024-02-21T22:53:01.631 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.626+0000 7f422d111640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4228070d30 con 0x7f42280b2e50 2024-02-21T22:53:01.632 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.626+0000 7f4226d9d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f42280b2e50 0x7f4228072770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:01.632 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.625+0000 7f9b52291640 1 -- start start 2024-02-21T22:53:01.632 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.626+0000 7f9b52291640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9b4c0b44a0 0x7f9b4c159840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:01.632 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.626+0000 7f9b52291640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9b4c0b48d0 0x7f9b4c1fc610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:01.632 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.626+0000 7f9b52291640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9b4c152a70 0x7f9b4c157b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:01.632 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.626+0000 7f9b52291640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b4c0b2400 con 0x7f9b4c0b48d0 2024-02-21T22:53:01.632 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.626+0000 7f9b52291640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b4c15e4a0 con 0x7f9b4c152a70 2024-02-21T22:53:01.632 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.626+0000 7f9b52291640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b4c0b2580 con 0x7f9b4c0b44a0 2024-02-21T22:53:01.633 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.626+0000 7f422659c640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f42280b3230 0x7f42280b3690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:50936/0 (socket says 172.21.15.116:50936) 2024-02-21T22:53:01.633 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.626+0000 7f422659c640 1 -- 172.21.15.116:0/1891710052 learned_addr learned my addr 172.21.15.116:0/1891710052 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-02-21T22:53:01.633 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.625+0000 7f1c8da36640 1 -- 172.21.15.116:0/2132051205 wait complete. 2024-02-21T22:53:01.633 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.624+0000 7fe1c94ba640 1 --2- 172.21.15.116:0/3551034782 >> v2:172.21.15.116:3300/0 conn(0x7fe1c40b3da0 0x7fe1c416bf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:01.634 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.624+0000 7fe1c94ba640 1 -- 172.21.15.116:0/3551034782 >> v1:172.21.15.116:6789/0 conn(0x7fe1c40b3230 legacy=0x7fe1c40b3690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:01.634 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.624+0000 7fe1c94ba640 1 -- 172.21.15.116:0/3551034782 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1c40b4c10 con 0x7fe1c40b2e50 2024-02-21T22:53:01.634 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.626+0000 7fe1c94ba640 1 --2- 172.21.15.116:0/3551034782 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe1c40b2e50 0x7fe1c4072770 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fe1bc009d90 tx=0x7fe1bc02bdc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2ca3d8b33f40edd4 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:01.634 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.626+0000 7f57e7fff640 1 -- 172.21.15.116:0/2618351668 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2374870371 0 0) 0x7f57f00b4050 con 0x7f57f00b2e50 2024-02-21T22:53:01.634 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.626+0000 7f57e7fff640 1 -- 172.21.15.116:0/2618351668 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f57dc003520 con 0x7f57f00b2e50 2024-02-21T22:53:01.634 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.626+0000 7f9b4bfff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9b4c0b44a0 0x7f9b4c159840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:01.635 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.626+0000 7f9b4bfff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9b4c0b44a0 0x7f9b4c159840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.116:55826/0 (socket says 172.21.15.116:55826) 2024-02-21T22:53:01.635 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.626+0000 7f9b4bfff640 1 -- 172.21.15.116:0/2020735709 learned_addr learned my addr 172.21.15.116:0/2020735709 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:01.635 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.626+0000 7f9b4b7fe640 1 --2- 172.21.15.116:0/2020735709 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9b4c0b48d0 0x7f9b4c1fc610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:01.635 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.626+0000 7f9b5082e640 1 --2- 172.21.15.116:0/2020735709 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9b4c152a70 0x7f9b4c157b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:01.635 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.626+0000 7f4226d9d640 1 -- 172.21.15.116:0/1891710052 >> v1:172.21.15.142:6789/0 conn(0x7f42280b3da0 legacy=0x7f422816bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:01.636 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.626+0000 7f57e7fff640 1 -- 172.21.15.116:0/2618351668 <== mon.1 v1:172.21.15.142:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2035220678 0 0) 0x7f57dc003520 con 0x7f57f00b2e50 2024-02-21T22:53:01.636 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.626+0000 7f57e7fff640 1 -- 172.21.15.116:0/2618351668 >> v2:172.21.15.116:3300/0 conn(0x7f57f016af60 msgr2=0x7f57f016d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:53:01.636 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.626+0000 7f57e7fff640 1 --2- 172.21.15.116:0/2618351668 >> v2:172.21.15.116:3300/0 conn(0x7f57f016af60 0x7f57f016d350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:01.636 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.626+0000 7f57e7fff640 1 -- 172.21.15.116:0/2618351668 >> v1:172.21.15.116:6789/0 conn(0x7f57f0072770 legacy=0x7f57f00b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:01.637 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.626+0000 7f57e7fff640 1 -- 172.21.15.116:0/2618351668 --> v1:172.21.15.142:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57f00b4930 con 0x7f57f00b2e50 2024-02-21T22:53:01.637 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.626+0000 7f57e7fff640 1 -- 172.21.15.116:0/2618351668 <== mon.1 v1:172.21.15.142:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1101981580 0 0) 0x7f57e80019f0 con 0x7f57f00b2e50 2024-02-21T22:53:01.637 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.626+0000 7f57e7fff640 1 -- 172.21.15.116:0/2618351668 >> v1:172.21.15.142:6789/0 conn(0x7f57f00b2e50 legacy=0x7f57f00b3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:01.637 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.627+0000 7f57e7fff640 1 --2- 172.21.15.116:0/2618351668 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f57dc003a00 0x7f57dc003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:01.637 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.626+0000 7f4226d9d640 1 -- 172.21.15.116:0/1891710052 >> v1:172.21.15.116:6789/0 conn(0x7f42280b3230 legacy=0x7f42280b3690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:01.638 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.626+0000 7f4226d9d640 1 -- 172.21.15.116:0/1891710052 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42280b4c10 con 0x7f42280b2e50 2024-02-21T22:53:01.638 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.626+0000 7f4225d9b640 1 -- 172.21.15.116:0/1891710052 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2317553749 0 0) 0x7f42280b4930 con 0x7f42280b3da0 2024-02-21T22:53:01.638 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.628+0000 7f4226d9d640 1 --2- 172.21.15.116:0/1891710052 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f42280b2e50 0x7f4228072770 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f42180097d0 tx=0x7f421802b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d64209ae3a0e8435 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:01.638 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.627+0000 7f1c8da36640 1 Processor -- start 2024-02-21T22:53:01.638 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.627+0000 7f1c8da36640 1 -- start start 2024-02-21T22:53:01.638 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.627+0000 7f9b4bfff640 1 -- 172.21.15.116:0/2020735709 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9b4c152a70 msgr2=0x7f9b4c157b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:01.638 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.627+0000 7f9b4bfff640 1 --2- 172.21.15.116:0/2020735709 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9b4c152a70 0x7f9b4c157b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:01.639 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.627+0000 7f9b4bfff640 1 -- 172.21.15.116:0/2020735709 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9b4c0b48d0 msgr2=0x7f9b4c1fc610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:01.639 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.627+0000 7f9b4bfff640 1 --2- 172.21.15.116:0/2020735709 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9b4c0b48d0 0x7f9b4c1fc610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:01.639 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.627+0000 7f9b4bfff640 1 -- 172.21.15.116:0/2020735709 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b4c1fcb50 con 0x7f9b4c0b44a0 2024-02-21T22:53:01.639 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.627+0000 7f9b5082e640 1 --2- 172.21.15.116:0/2020735709 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9b4c152a70 0x7f9b4c157b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T22:53:01.639 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.627+0000 7f9b4b7fe640 1 --2- 172.21.15.116:0/2020735709 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9b4c0b48d0 0x7f9b4c1fc610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T22:53:01.639 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.627+0000 7f9b4bfff640 1 --2- 172.21.15.116:0/2020735709 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9b4c0b44a0 0x7f9b4c159840 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f9b3c03c040 tx=0x7f9b3c004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:01.639 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.628+0000 7f9b48ff9640 1 -- 172.21.15.116:0/2020735709 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b3c048070 con 0x7f9b4c0b44a0 2024-02-21T22:53:01.639 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.627+0000 7fe1bbfff640 1 -- 172.21.15.116:0/3551034782 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1bc039070 con 0x7fe1c40b2e50 2024-02-21T22:53:01.639 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.627+0000 7fe1bbfff640 1 -- 172.21.15.116:0/3551034782 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1bc02cb70 con 0x7fe1c40b2e50 2024-02-21T22:53:01.639 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.627+0000 7fe1bbfff640 1 -- 172.21.15.116:0/3551034782 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1bc034440 con 0x7fe1c40b2e50 2024-02-21T22:53:01.640 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.627+0000 7f57e7fff640 1 --2- 172.21.15.116:0/2618351668 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f57dc004800 0x7f57dc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:01.640 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.627+0000 7f57e7fff640 1 --2- 172.21.15.116:0/2618351668 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f57dc0053c0 0x7f57dc00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:01.640 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.627+0000 7f57e7fff640 1 -- 172.21.15.116:0/2618351668 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57f0070d30 con 0x7f57dc003a00 2024-02-21T22:53:01.640 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.627+0000 7f57e7fff640 1 -- 172.21.15.116:0/2618351668 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57dc00c2a0 con 0x7f57dc0053c0 2024-02-21T22:53:01.640 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.627+0000 7f57e7fff640 1 -- 172.21.15.116:0/2618351668 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57dc00c4a0 con 0x7f57dc004800 2024-02-21T22:53:01.640 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.627+0000 7f57f55d2640 1 --2- 172.21.15.116:0/2618351668 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f57dc003a00 0x7f57dc003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:01.640 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.627+0000 7f57f4dd1640 1 --2- 172.21.15.116:0/2618351668 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f57dc004800 0x7f57dc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:01.640 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.627+0000 7f3425c08640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f3420162350 0x7f342006f120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:01.640 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.627+0000 7f3425c08640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f34200cf930 0x7f342006ce30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:01.641 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.627+0000 7f3425c08640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f342006d370 0x7f3420165f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:01.641 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.627+0000 7f3425c08640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34200cc860 con 0x7f342006d370 2024-02-21T22:53:01.641 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.627+0000 7f3425c08640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3420070d50 con 0x7f3420162350 2024-02-21T22:53:01.641 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.627+0000 7f3425c08640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34200b4230 con 0x7f34200cf930 2024-02-21T22:53:01.641 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.627+0000 7f341effd640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f34200cf930 0x7f342006ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:01.641 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.627+0000 7f341effd640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f34200cf930 0x7f342006ce30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.116:55834/0 (socket says 172.21.15.116:55834) 2024-02-21T22:53:01.641 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.627+0000 7f341effd640 1 -- 172.21.15.116:0/3788582333 learned_addr learned my addr 172.21.15.116:0/3788582333 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:01.641 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.627+0000 7f341ffff640 1 --2- 172.21.15.116:0/3788582333 >> v2:172.21.15.116:3300/0 conn(0x7f342006d370 0x7f3420165f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:01.641 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.627+0000 7f341f7fe640 1 --2- 172.21.15.116:0/3788582333 >> v2:172.21.15.142:3300/0 conn(0x7f3420162350 0x7f342006f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:01.641 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.627+0000 7f341f7fe640 1 -- 172.21.15.116:0/3788582333 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f34200cf930 msgr2=0x7f342006ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:53:01.641 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.627+0000 7f341f7fe640 1 --2- 172.21.15.116:0/3788582333 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f34200cf930 0x7f342006ce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:01.641 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.627+0000 7f341f7fe640 1 -- 172.21.15.116:0/3788582333 >> v2:172.21.15.116:3300/0 conn(0x7f342006d370 msgr2=0x7f3420165f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:53:01.641 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.627+0000 7f341f7fe640 1 --2- 172.21.15.116:0/3788582333 >> v2:172.21.15.116:3300/0 conn(0x7f342006d370 0x7f3420165f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:01.641 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.627+0000 7f341f7fe640 1 -- 172.21.15.116:0/3788582333 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34200b4510 con 0x7f3420162350 2024-02-21T22:53:01.642 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.627+0000 7f57f4dd1640 1 -- 172.21.15.116:0/2618351668 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f57dc0053c0 msgr2=0x7f57dc00b9c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T22:53:01.642 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.627+0000 7f57f4dd1640 1 --2- 172.21.15.116:0/2618351668 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f57dc0053c0 0x7f57dc00b9c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:01.642 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.627+0000 7f57f4dd1640 1 -- 172.21.15.116:0/2618351668 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f57dc003a00 msgr2=0x7f57dc003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:53:01.642 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.627+0000 7f57f4dd1640 1 --2- 172.21.15.116:0/2618351668 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f57dc003a00 0x7f57dc003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:01.642 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.627+0000 7f57f4dd1640 1 -- 172.21.15.116:0/2618351668 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57dc003520 con 0x7f57dc004800 2024-02-21T22:53:01.642 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.627+0000 7fe1c9cbb640 1 --2- 172.21.15.116:0/3551034782 >> v2:172.21.15.116:3300/0 conn(0x7fe1c40b3da0 0x7fe1c416bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T22:53:01.642 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.628+0000 7fe1cb71e640 1 -- 172.21.15.116:0/3551034782 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe1c40b2e50 msgr2=0x7fe1c4072770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:01.642 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.628+0000 7fe1cb71e640 1 --2- 172.21.15.116:0/3551034782 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe1c40b2e50 0x7fe1c4072770 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fe1bc009d90 tx=0x7fe1bc02bdc0 comp rx=0 tx=0).stop 2024-02-21T22:53:01.643 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.628+0000 7f9b52291640 1 -- 172.21.15.116:0/2020735709 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b4c159e50 con 0x7f9b4c0b44a0 2024-02-21T22:53:01.643 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.628+0000 7f9b52291640 1 -- 172.21.15.116:0/2020735709 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b4c157330 con 0x7f9b4c0b44a0 2024-02-21T22:53:01.643 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.628+0000 7f9b48ff9640 1 -- 172.21.15.116:0/2020735709 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b3c0395c0 con 0x7f9b4c0b44a0 2024-02-21T22:53:01.643 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.628+0000 7f4225d9b640 1 -- 172.21.15.116:0/1891710052 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42180315a0 con 0x7f42280b2e50 2024-02-21T22:53:01.643 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.628+0000 7f4225d9b640 1 -- 172.21.15.116:0/1891710052 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4218037070 con 0x7f42280b2e50 2024-02-21T22:53:01.643 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.628+0000 7f4225d9b640 1 -- 172.21.15.116:0/1891710052 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42180319a0 con 0x7f42280b2e50 2024-02-21T22:53:01.644 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.628+0000 7f9b48ff9640 1 -- 172.21.15.116:0/2020735709 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b3c039990 con 0x7f9b4c0b44a0 2024-02-21T22:53:01.644 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.628+0000 7fe1cb71e640 1 -- 172.21.15.116:0/3551034782 shutdown_connections 2024-02-21T22:53:01.644 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.628+0000 7fe1cb71e640 1 --2- 172.21.15.116:0/3551034782 >> v2:172.21.15.116:3300/0 conn(0x7fe1c40b3da0 0x7fe1c416bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:01.645 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.628+0000 7fe1cb71e640 1 --2- 172.21.15.116:0/3551034782 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe1c40b2e50 0x7fe1c4072770 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:01.645 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.628+0000 7fe1cb71e640 1 -- 172.21.15.116:0/3551034782 >> 172.21.15.116:0/3551034782 conn(0x7fe1c40b18e0 msgr2=0x7fe1c40b1cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:01.645 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.628+0000 7fe1cb71e640 1 -- 172.21.15.116:0/3551034782 shutdown_connections 2024-02-21T22:53:01.645 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.628+0000 7f57f5dd3640 1 --2- 172.21.15.116:0/2618351668 >> v2:172.21.15.116:3300/0 conn(0x7f57f016af60 0x7f57f016d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T22:53:01.645 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.629+0000 7f57f5dd3640 1 -- 172.21.15.116:0/2618351668 reap_dead start 2024-02-21T22:53:01.646 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.629+0000 7f1c8da36640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1c88072570 0x7f1c8815dc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:01.646 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.629+0000 7f57f4dd1640 1 --2- 172.21.15.116:0/2618351668 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f57dc004800 0x7f57dc004c80 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f57e0001750 tx=0x7f57dc005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=48d05744a8e29896 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:01.648 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.629+0000 7f1c8da36640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1c880aedd0 0x7f1c88151b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:01.648 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.629+0000 7f1c8da36640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1c8815d700 0x7f1c8815fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:01.648 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.629+0000 7f1c86ffd640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1c88072570 0x7f1c8815dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:01.648 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.629+0000 7f1c8da36640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c88162ba0 con 0x7f1c88072570 2024-02-21T22:53:01.648 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.629+0000 7f1c867fc640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1c880aedd0 0x7f1c88151b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:01.648 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.629+0000 7f1c867fc640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1c880aedd0 0x7f1c88151b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.116:41202/0 (socket says 172.21.15.116:41202) 2024-02-21T22:53:01.648 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.629+0000 7f1c867fc640 1 -- 172.21.15.116:0/2483998429 learned_addr learned my addr 172.21.15.116:0/2483998429 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:01.648 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.629+0000 7f1c877fe640 1 --2- 172.21.15.116:0/2483998429 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1c8815d700 0x7f1c8815fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:01.649 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.629+0000 7f422d111640 1 -- 172.21.15.116:0/1891710052 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f42280b2e50 msgr2=0x7f4228072770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:01.649 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.629+0000 7f422d111640 1 --2- 172.21.15.116:0/1891710052 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f42280b2e50 0x7f4228072770 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f42180097d0 tx=0x7f421802b840 comp rx=0 tx=0).stop 2024-02-21T22:53:01.649 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.629+0000 7f341f7fe640 1 --2- 172.21.15.116:0/3788582333 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3420162350 0x7f342006f120 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f3420069090 tx=0x7f341002b7a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=89fd8b2ea1856007 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:01.649 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.629+0000 7f341e7fc640 1 -- 172.21.15.116:0/3788582333 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3410038070 con 0x7f3420162350 2024-02-21T22:53:01.649 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.629+0000 7f341e7fc640 1 -- 172.21.15.116:0/3788582333 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3410031700 con 0x7f3420162350 2024-02-21T22:53:01.649 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.629+0000 7f57e7fff640 1 -- 172.21.15.116:0/2618351668 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57e0001370 con 0x7f57dc004800 2024-02-21T22:53:01.650 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.629+0000 7f1c8da36640 1 -- 172.21.15.116:0/2483998429 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c880ce1a0 con 0x7f1c880aedd0 2024-02-21T22:53:01.650 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.629+0000 7f422d111640 1 -- 172.21.15.116:0/1891710052 shutdown_connections 2024-02-21T22:53:01.650 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.629+0000 7f422d111640 1 --2- 172.21.15.116:0/1891710052 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f42280b2e50 0x7f4228072770 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:01.650 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.629+0000 7f422d111640 1 -- 172.21.15.116:0/1891710052 >> 172.21.15.116:0/1891710052 conn(0x7f42280b18e0 msgr2=0x7f42280b1cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:01.650 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.629+0000 7f1c8da36640 1 -- 172.21.15.116:0/2483998429 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c88162d20 con 0x7f1c8815d700 2024-02-21T22:53:01.651 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.629+0000 7f57e7fff640 1 -- 172.21.15.116:0/2618351668 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57e00052f0 con 0x7f57dc004800 2024-02-21T22:53:01.651 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.629+0000 7f422d111640 1 -- 172.21.15.116:0/1891710052 shutdown_connections 2024-02-21T22:53:01.651 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.630+0000 7f57e7fff640 1 -- 172.21.15.116:0/2618351668 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57e0003830 con 0x7f57dc004800 2024-02-21T22:53:01.652 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.629+0000 7fecc9ffb640 1 -- 172.21.15.116:0/1277072828 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecc4038070 con 0x7feccc0c3950 2024-02-21T22:53:01.652 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.629+0000 7fecc9ffb640 1 -- 172.21.15.116:0/1277072828 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecc4031500 con 0x7feccc0c3950 2024-02-21T22:53:01.652 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.629+0000 7fecd1955640 1 -- 172.21.15.116:0/1277072828 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feccc0c3950 msgr2=0x7feccc16d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:01.652 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.629+0000 7fecd1955640 1 --2- 172.21.15.116:0/1277072828 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feccc0c3950 0x7feccc16d430 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fecc40097a0 tx=0x7fecc402b820 comp rx=0 tx=0).stop 2024-02-21T22:53:01.652 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.630+0000 7fecd1955640 1 -- 172.21.15.116:0/1277072828 shutdown_connections 2024-02-21T22:53:01.652 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.630+0000 7fecd1955640 1 --2- 172.21.15.116:0/1277072828 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feccc0c3950 0x7feccc16d430 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:01.652 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.630+0000 7fecd1955640 1 -- 172.21.15.116:0/1277072828 >> 172.21.15.116:0/1277072828 conn(0x7feccc072340 msgr2=0x7feccc072750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:01.652 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.628+0000 7fe1cb71e640 1 -- 172.21.15.116:0/3551034782 wait complete. 2024-02-21T22:53:01.653 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.630+0000 7fecd1955640 1 -- 172.21.15.116:0/1277072828 shutdown_connections 2024-02-21T22:53:01.653 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.630+0000 7fe1cb71e640 1 Processor -- start 2024-02-21T22:53:01.653 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.630+0000 7fe1cb71e640 1 -- start start 2024-02-21T22:53:01.653 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.630+0000 7f9b48ff9640 1 -- 172.21.15.116:0/2020735709 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f9b3c039b30 con 0x7f9b4c0b44a0 2024-02-21T22:53:01.654 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.630+0000 7f3425c08640 1 -- 172.21.15.116:0/3788582333 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3420162350 msgr2=0x7f342006f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:01.654 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.630+0000 7f3425c08640 1 --2- 172.21.15.116:0/3788582333 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3420162350 0x7f342006f120 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f3420069090 tx=0x7f341002b7a0 comp rx=0 tx=0).stop 2024-02-21T22:53:01.654 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.630+0000 7f3425c08640 1 -- 172.21.15.116:0/3788582333 shutdown_connections 2024-02-21T22:53:01.654 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.630+0000 7f3425c08640 1 --2- 172.21.15.116:0/3788582333 >> v2:172.21.15.116:3300/0 conn(0x7f342006d370 0x7f3420165f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:01.654 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.630+0000 7f3425c08640 1 --2- 172.21.15.116:0/3788582333 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f34200cf930 0x7f342006ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:01.654 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.630+0000 7f1c86ffd640 1 -- 172.21.15.116:0/2483998429 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1c8815d700 msgr2=0x7f1c8815fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:01.654 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.630+0000 7f1c86ffd640 1 --2- 172.21.15.116:0/2483998429 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1c8815d700 0x7f1c8815fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:01.655 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.630+0000 7f3425c08640 1 --2- 172.21.15.116:0/3788582333 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3420162350 0x7f342006f120 secure :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f3420069090 tx=0x7f341002b7a0 comp rx=0 tx=0).stop 2024-02-21T22:53:01.655 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.630+0000 7f3425c08640 1 -- 172.21.15.116:0/3788582333 >> 172.21.15.116:0/3788582333 conn(0x7f34200b1b80 msgr2=0x7f34200b1f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:01.655 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.630+0000 7f1c86ffd640 1 -- 172.21.15.116:0/2483998429 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1c880aedd0 msgr2=0x7f1c88151b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:01.655 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.630+0000 7f1c86ffd640 1 --2- 172.21.15.116:0/2483998429 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1c880aedd0 0x7f1c88151b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:01.655 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.630+0000 7f1c86ffd640 1 -- 172.21.15.116:0/2483998429 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c8814e640 con 0x7f1c88072570 2024-02-21T22:53:01.655 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.630+0000 7fecd1955640 1 -- 172.21.15.116:0/1277072828 wait complete. 2024-02-21T22:53:01.656 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.630+0000 7f57f7836640 1 -- 172.21.15.116:0/2618351668 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f57dc004800 msgr2=0x7f57dc004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:01.656 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.630+0000 7f57f7836640 1 --2- 172.21.15.116:0/2618351668 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f57dc004800 0x7f57dc004c80 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f57e0001750 tx=0x7f57dc005830 comp rx=0 tx=0).stop 2024-02-21T22:53:01.656 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.630+0000 7f3425c08640 1 -- 172.21.15.116:0/3788582333 shutdown_connections 2024-02-21T22:53:01.657 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.630+0000 7f1c86ffd640 1 --2- 172.21.15.116:0/2483998429 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1c88072570 0x7f1c8815dc50 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f1c78033000 tx=0x7f1c780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:01.657 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.630+0000 7f57f7836640 1 -- 172.21.15.116:0/2618351668 shutdown_connections 2024-02-21T22:53:01.657 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.630+0000 7f57f7836640 1 --2- 172.21.15.116:0/2618351668 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f57dc004800 0x7f57dc004c80 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:01.657 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.630+0000 7f57f7836640 1 -- 172.21.15.116:0/2618351668 >> 172.21.15.116:0/2618351668 conn(0x7f57f00b18e0 msgr2=0x7f57f00b1cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:01.657 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.630+0000 7f422d111640 1 -- 172.21.15.116:0/1891710052 wait complete. 2024-02-21T22:53:01.658 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.631+0000 7f57f7836640 1 -- 172.21.15.116:0/2618351668 shutdown_connections 2024-02-21T22:53:01.659 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.631+0000 7fe1cb71e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe1c40b2e50 0x7fe1c4159400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:01.659 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.631+0000 7fe1cb71e640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe1c40b3230 0x7fe1c415c250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:01.659 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.631+0000 7fe1cb71e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe1c40b3da0 0x7fe1c41634e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:01.659 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.631+0000 7fe1cb71e640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1c4071340 con 0x7fe1c40b3230 2024-02-21T22:53:01.659 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.631+0000 7fe1cb71e640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1c40711c0 con 0x7fe1c40b2e50 2024-02-21T22:53:01.659 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.631+0000 7fe1cb71e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1c416c4a0 con 0x7fe1c40b3da0 2024-02-21T22:53:01.659 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.631+0000 7fe1c94ba640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe1c40b2e50 0x7fe1c4159400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:01.659 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.631+0000 7fe1c94ba640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe1c40b2e50 0x7fe1c4159400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.116:41204/0 (socket says 172.21.15.116:41204) 2024-02-21T22:53:01.659 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.631+0000 7fe1c94ba640 1 -- 172.21.15.116:0/2817635151 learned_addr learned my addr 172.21.15.116:0/2817635151 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:01.660 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.631+0000 7fe1c9cbb640 1 --2- 172.21.15.116:0/2817635151 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe1c40b3da0 0x7fe1c41634e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:01.660 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.630+0000 7f9b52291640 1 -- 172.21.15.116:0/2020735709 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b2c005290 con 0x7f9b4c0b44a0 2024-02-21T22:53:01.660 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.631+0000 7f9b48ff9640 1 --2- 172.21.15.116:0/2020735709 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f9b3806b5d0 0x7f9b3806da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:01.660 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.631+0000 7f9b4b7fe640 1 --2- 172.21.15.116:0/2020735709 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f9b3806b5d0 0x7f9b3806da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:01.660 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.631+0000 7f9b48ff9640 1 -- 172.21.15.116:0/2020735709 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9b3c0abdf0 con 0x7f9b4c0b44a0 2024-02-21T22:53:01.660 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.631+0000 7f9b4b7fe640 1 --2- 172.21.15.116:0/2020735709 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f9b3806b5d0 0x7f9b3806da90 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f9b4c159d80 tx=0x7f9b44009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:01.661 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.632+0000 7fe1c8cb9640 1 --2- 172.21.15.116:0/2817635151 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe1c40b3230 0x7fe1c415c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:01.661 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.630+0000 7f3425c08640 1 -- 172.21.15.116:0/3788582333 wait complete. 2024-02-21T22:53:01.661 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.632+0000 7fe1c94ba640 1 -- 172.21.15.116:0/2817635151 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe1c40b3da0 msgr2=0x7fe1c41634e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:01.661 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.632+0000 7fe1c94ba640 1 --2- 172.21.15.116:0/2817635151 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe1c40b3da0 0x7fe1c41634e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:01.662 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.632+0000 7fe1c94ba640 1 -- 172.21.15.116:0/2817635151 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe1c40b3230 msgr2=0x7fe1c415c250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:01.662 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.632+0000 7fe1c94ba640 1 --2- 172.21.15.116:0/2817635151 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe1c40b3230 0x7fe1c415c250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:01.662 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.632+0000 7fe1c94ba640 1 -- 172.21.15.116:0/2817635151 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1c4159940 con 0x7fe1c40b2e50 2024-02-21T22:53:01.662 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.632+0000 7fe1c8cb9640 1 --2- 172.21.15.116:0/2817635151 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe1c40b3230 0x7fe1c415c250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T22:53:01.662 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.632+0000 7f1c6ffff640 1 -- 172.21.15.116:0/2483998429 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c78046650 con 0x7f1c88072570 2024-02-21T22:53:01.662 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.631+0000 7f57f7836640 1 -- 172.21.15.116:0/2618351668 wait complete. 2024-02-21T22:53:01.663 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.632+0000 7f1c8da36640 1 -- 172.21.15.116:0/2483998429 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c8814e900 con 0x7f1c88072570 2024-02-21T22:53:01.663 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.632+0000 7fe1c94ba640 1 --2- 172.21.15.116:0/2817635151 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe1c40b2e50 0x7fe1c4159400 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe1bc000f80 tx=0x7fe1bc004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:01.663 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.632+0000 7f3425c08640 1 Processor -- start 2024-02-21T22:53:01.663 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.632+0000 7f1c8da36640 1 -- 172.21.15.116:0/2483998429 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c8814eec0 con 0x7f1c88072570 2024-02-21T22:53:01.664 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.632+0000 7fe1b9ffb640 1 -- 172.21.15.116:0/2817635151 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1bc044020 con 0x7fe1c40b2e50 2024-02-21T22:53:01.664 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.632+0000 7f3425c08640 1 -- start start 2024-02-21T22:53:01.664 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.632+0000 7fe1cb71e640 1 -- 172.21.15.116:0/2817635151 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1c4165130 con 0x7fe1c40b2e50 2024-02-21T22:53:01.664 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.633+0000 7f57f7836640 1 Processor -- start 2024-02-21T22:53:01.665 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.632+0000 7fe1b9ffb640 1 -- 172.21.15.116:0/2817635151 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1bc03a040 con 0x7fe1c40b2e50 2024-02-21T22:53:01.665 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.633+0000 7f57f7836640 1 -- start start 2024-02-21T22:53:01.665 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.632+0000 7fe1b9ffb640 1 -- 172.21.15.116:0/2817635151 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1bc039070 con 0x7fe1c40b2e50 2024-02-21T22:53:01.665 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.633+0000 7fe1cb71e640 1 -- 172.21.15.116:0/2817635151 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1c4162ce0 con 0x7fe1c40b2e50 2024-02-21T22:53:01.666 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.633+0000 7f422d111640 1 Processor -- start 2024-02-21T22:53:01.666 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.633+0000 7f1c6ffff640 1 -- 172.21.15.116:0/2483998429 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c780467f0 con 0x7f1c88072570 2024-02-21T22:53:01.666 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.634+0000 7f1c6ffff640 1 -- 172.21.15.116:0/2483998429 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c78046be0 con 0x7f1c88072570 2024-02-21T22:53:01.667 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.634+0000 7fecd1955640 1 Processor -- start 2024-02-21T22:53:01.667 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.634+0000 7f422d111640 1 -- start start 2024-02-21T22:53:01.667 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.633+0000 7f3425c08640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f342006d370 0x7f342015c880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:01.668 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.633+0000 7f3425c08640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f34200cf930 0x7f34201f7e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:01.668 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.634+0000 7f3425c08640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f34200af0b0 0x7f3420163f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:01.668 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.634+0000 7f341effd640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f34200cf930 0x7f34201f7e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:01.668 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.634+0000 7f341effd640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f34200cf930 0x7f34201f7e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:34420/0 (socket says 172.21.15.116:34420) 2024-02-21T22:53:01.668 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.634+0000 7f341effd640 1 -- 172.21.15.116:0/213971856 learned_addr learned my addr 172.21.15.116:0/213971856 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:01.668 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.634+0000 7f3425c08640 1 -- 172.21.15.116:0/213971856 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3420162730 con 0x7f34200cf930 2024-02-21T22:53:01.668 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.634+0000 7f3425c08640 1 -- 172.21.15.116:0/213971856 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34200b47f0 con 0x7f342006d370 2024-02-21T22:53:01.668 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.634+0000 7f341f7fe640 1 --2- 172.21.15.116:0/213971856 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f342006d370 0x7f342015c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:01.668 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.634+0000 7f3425c08640 1 -- 172.21.15.116:0/213971856 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34200af7a0 con 0x7f34200af0b0 2024-02-21T22:53:01.668 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.634+0000 7fecd1955640 1 -- start start 2024-02-21T22:53:01.669 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.634+0000 7f341ffff640 1 --2- 172.21.15.116:0/213971856 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f34200af0b0 0x7f3420163f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:01.669 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.634+0000 7f341effd640 1 -- 172.21.15.116:0/213971856 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f34200af0b0 msgr2=0x7f3420163f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:01.669 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.634+0000 7f341effd640 1 --2- 172.21.15.116:0/213971856 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f34200af0b0 0x7f3420163f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:01.669 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.634+0000 7fe1cb71e640 1 -- 172.21.15.116:0/2817635151 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1c40752f0 con 0x7fe1c40b2e50 2024-02-21T22:53:01.670 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.634+0000 7f341effd640 1 -- 172.21.15.116:0/213971856 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f342006d370 msgr2=0x7f342015c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:01.670 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.634+0000 7f341effd640 1 --2- 172.21.15.116:0/213971856 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f342006d370 0x7f342015c880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:01.670 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.634+0000 7f57f7836640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f57dc004800 0x7f57f006dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:01.671 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.634+0000 7f341effd640 1 -- 172.21.15.116:0/213971856 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3420164490 con 0x7f34200cf930 2024-02-21T22:53:01.671 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.635+0000 7f341effd640 1 --2- 172.21.15.116:0/213971856 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f34200cf930 0x7f34201f7e70 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f341400e900 tx=0x7f341400edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:01.671 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.635+0000 7fecd1955640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feccc066c60 0x7feccc1566d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:01.671 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.635+0000 7f1c6dffb640 1 -- 172.21.15.116:0/2483998429 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c68005290 con 0x7f1c88072570 2024-02-21T22:53:01.672 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.635+0000 7fecd1955640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feccc0c3950 0x7feccc0c9c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:01.672 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.635+0000 7fecd1955640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7feccc0cf7b0 0x7feccc0ae0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:01.672 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.635+0000 7feccaffd640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feccc066c60 0x7feccc1566d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:01.672 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.635+0000 7fecd1955640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feccc0cfb90 con 0x7feccc0cf7b0 2024-02-21T22:53:01.672 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.635+0000 7fecd1955640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feccc0d0d00 con 0x7feccc066c60 2024-02-21T22:53:01.672 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.635+0000 7fecd1955640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feccc0cee50 con 0x7feccc0c3950 2024-02-21T22:53:01.672 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.635+0000 7feccaffd640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feccc066c60 0x7feccc1566d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.116:41214/0 (socket says 172.21.15.116:41214) 2024-02-21T22:53:01.672 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.635+0000 7feccaffd640 1 -- 172.21.15.116:0/784989485 learned_addr learned my addr 172.21.15.116:0/784989485 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:01.672 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.635+0000 7feccb7fe640 1 --2- 172.21.15.116:0/784989485 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7feccc0cf7b0 0x7feccc0ae0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:01.673 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.635+0000 7f422d111640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f42280b2e50 0x7f4228156860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:01.673 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.635+0000 7f422d111640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f42280b3230 0x7f4228156df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:01.673 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.635+0000 7fecca7fc640 1 --2- 172.21.15.116:0/784989485 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feccc0c3950 0x7feccc0c9c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:01.674 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.635+0000 7f422d111640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f42280b3da0 0x7f422815e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:01.674 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.635+0000 7f422d111640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4228071340 con 0x7f42280b3230 2024-02-21T22:53:01.674 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.635+0000 7f422d111640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42280711c0 con 0x7f42280b3da0 2024-02-21T22:53:01.674 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.635+0000 7f422d111640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f422816d680 con 0x7f42280b2e50 2024-02-21T22:53:01.674 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.635+0000 7feccb7fe640 1 -- 172.21.15.116:0/784989485 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feccc0c3950 msgr2=0x7feccc0c9c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:01.674 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.635+0000 7feccb7fe640 1 --2- 172.21.15.116:0/784989485 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feccc0c3950 0x7feccc0c9c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:01.674 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.636+0000 7feccb7fe640 1 -- 172.21.15.116:0/784989485 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feccc066c60 msgr2=0x7feccc1566d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:01.675 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.636+0000 7feccb7fe640 1 --2- 172.21.15.116:0/784989485 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feccc066c60 0x7feccc1566d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:01.675 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.636+0000 7feccb7fe640 1 -- 172.21.15.116:0/784989485 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feccc0c7df0 con 0x7feccc0cf7b0 2024-02-21T22:53:01.675 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.635+0000 7f3407fff640 1 -- 172.21.15.116:0/213971856 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3414017070 con 0x7f34200cf930 2024-02-21T22:53:01.675 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.635+0000 7f3407fff640 1 -- 172.21.15.116:0/213971856 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f341400ca00 con 0x7f34200cf930 2024-02-21T22:53:01.675 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.635+0000 7f3425c08640 1 -- 172.21.15.116:0/213971856 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34201f8570 con 0x7f34200cf930 2024-02-21T22:53:01.675 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.636+0000 7f3407fff640 1 -- 172.21.15.116:0/213971856 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f341400cdd0 con 0x7f34200cf930 2024-02-21T22:53:01.675 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.636+0000 7fe1b9ffb640 1 -- 172.21.15.116:0/2817635151 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fe1bc005d10 con 0x7fe1c40b2e50 2024-02-21T22:53:01.676 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.636+0000 7f3425c08640 1 -- 172.21.15.116:0/213971856 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34201f8b30 con 0x7f34200cf930 2024-02-21T22:53:01.676 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.636+0000 7f9b48ff9640 1 -- 172.21.15.116:0/2020735709 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f9b4c1fcb50 con 0x7f9b4c0b44a0 2024-02-21T22:53:01.676 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.636+0000 7fe1b9ffb640 1 --2- 172.21.15.116:0/2817635151 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fe1a806b4d0 0x7fe1a806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:01.677 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.636+0000 7f57f7836640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f57f0164d70 0x7f57f0147970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:01.677 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.636+0000 7f57f7836640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f57f0149180 0x7f57f015e690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:01.677 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.636+0000 7f57f7836640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57f00711c0 con 0x7f57f0149180 2024-02-21T22:53:01.677 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.636+0000 7f57f7836640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57f0072c00 con 0x7f57dc004800 2024-02-21T22:53:01.677 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.636+0000 7f57f7836640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57f0071340 con 0x7f57f0164d70 2024-02-21T22:53:01.677 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.637+0000 7f57f4dd1640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f57f0164d70 0x7f57f0147970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:01.677 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.637+0000 7f57f4dd1640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f57f0164d70 0x7f57f0147970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.116:55922/0 (socket says 172.21.15.116:55922) 2024-02-21T22:53:01.677 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.637+0000 7f57f4dd1640 1 -- 172.21.15.116:0/2497500828 learned_addr learned my addr 172.21.15.116:0/2497500828 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:01.677 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.637+0000 7fe1b9ffb640 1 -- 172.21.15.116:0/2817635151 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe1bc0ad510 con 0x7fe1c40b2e50 2024-02-21T22:53:01.678 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.637+0000 7f3407fff640 1 -- 172.21.15.116:0/213971856 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f341401a070 con 0x7f34200cf930 2024-02-21T22:53:01.678 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.637+0000 7fe1c8cb9640 1 --2- 172.21.15.116:0/2817635151 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fe1a806b4d0 0x7fe1a806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:01.678 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.637+0000 7f57f55d2640 1 --2- 172.21.15.116:0/2497500828 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f57dc004800 0x7f57f006dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:01.679 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.637+0000 7f57f4dd1640 1 -- 172.21.15.116:0/2497500828 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f57dc004800 msgr2=0x7f57f006dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:01.679 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.637+0000 7f57f4dd1640 1 --2- 172.21.15.116:0/2497500828 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f57dc004800 0x7f57f006dfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:01.679 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.637+0000 7f57f4dd1640 1 -- 172.21.15.116:0/2497500828 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f57f0149180 msgr2=0x7f57f015e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:01.679 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.637+0000 7f57f5dd3640 1 --2- 172.21.15.116:0/2497500828 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f57f0149180 0x7f57f015e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:01.679 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.637+0000 7feccb7fe640 1 --2- 172.21.15.116:0/784989485 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7feccc0cf7b0 0x7feccc0ae0b0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fecc4033000 tx=0x7fecc40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:01.679 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.637+0000 7f57f4dd1640 1 --2- 172.21.15.116:0/2497500828 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f57f0149180 0x7f57f015e690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:01.679 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.637+0000 7f57f4dd1640 1 -- 172.21.15.116:0/2497500828 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57f01651f0 con 0x7f57f0164d70 2024-02-21T22:53:01.680 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.637+0000 7f57f55d2640 1 --2- 172.21.15.116:0/2497500828 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f57dc004800 0x7f57f006dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T22:53:01.680 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.637+0000 7f3407fff640 1 --2- 172.21.15.116:0/213971856 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f340c06b520 0x7f340c06d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:01.680 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.637+0000 7f57f5dd3640 1 --2- 172.21.15.116:0/2497500828 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f57f0149180 0x7f57f015e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T22:53:01.680 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.637+0000 7f57f4dd1640 1 --2- 172.21.15.116:0/2497500828 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f57f0164d70 0x7f57f0147970 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f57e0001870 tx=0x7f57e0001120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:01.681 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.637+0000 7f341f7fe640 1 --2- 172.21.15.116:0/213971856 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f340c06b520 0x7f340c06d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:01.681 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.636+0000 7f1c6ffff640 1 -- 172.21.15.116:0/2483998429 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f1c78032430 con 0x7f1c88072570 2024-02-21T22:53:01.681 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.636+0000 7f1c6ffff640 1 --2- 172.21.15.116:0/2483998429 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f1c7406b5d0 0x7f1c7406da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:01.681 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.636+0000 7f1c6ffff640 1 -- 172.21.15.116:0/2483998429 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1c780ac440 con 0x7f1c88072570 2024-02-21T22:53:01.681 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.636+0000 7f1c867fc640 1 --2- 172.21.15.116:0/2483998429 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f1c7406b5d0 0x7f1c7406da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:01.681 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.637+0000 7f1c867fc640 1 --2- 172.21.15.116:0/2483998429 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f1c7406b5d0 0x7f1c7406da90 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f1c7c007fd0 tx=0x7f1c7c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:01.682 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.638+0000 7f57e5ffb640 1 -- 172.21.15.116:0/2497500828 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57e0041020 con 0x7f57f0164d70 2024-02-21T22:53:01.682 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.638+0000 7f57e5ffb640 1 -- 172.21.15.116:0/2497500828 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57e00054a0 con 0x7f57f0164d70 2024-02-21T22:53:01.682 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.638+0000 7f3425c08640 1 -- 172.21.15.116:0/213971856 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34200752f0 con 0x7f34200cf930 2024-02-21T22:53:01.682 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.637+0000 7f4226d9d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f42280b2e50 0x7f4228156860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:01.682 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.638+0000 7f422759e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f42280b3da0 0x7f422815e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:01.682 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.638+0000 7f422759e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f42280b3da0 0x7f422815e670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.116:41222/0 (socket says 172.21.15.116:41222) 2024-02-21T22:53:01.682 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.638+0000 7f422759e640 1 -- 172.21.15.116:0/2306885131 learned_addr learned my addr 172.21.15.116:0/2306885131 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:01.683 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.638+0000 7f422659c640 1 --2- 172.21.15.116:0/2306885131 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f42280b3230 0x7f4228156df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:01.683 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.638+0000 7fe1c8cb9640 1 --2- 172.21.15.116:0/2817635151 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fe1a806b4d0 0x7fe1a806d990 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe1b4000f60 tx=0x7fe1b4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:01.683 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.638+0000 7f57e5ffb640 1 -- 172.21.15.116:0/2497500828 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57e0006be0 con 0x7f57f0164d70 2024-02-21T22:53:01.683 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.638+0000 7f57f7836640 1 -- 172.21.15.116:0/2497500828 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57f01480e0 con 0x7f57f0164d70 2024-02-21T22:53:01.683 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.638+0000 7f57f7836640 1 -- 172.21.15.116:0/2497500828 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57f01486a0 con 0x7f57f0164d70 2024-02-21T22:53:01.684 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.638+0000 7f341f7fe640 1 --2- 172.21.15.116:0/213971856 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f340c06b520 0x7f340c06d9e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f3410035000 tx=0x7f3410008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:01.684 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.638+0000 7f422759e640 1 -- 172.21.15.116:0/2306885131 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f42280b2e50 msgr2=0x7f4228156860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:01.684 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.638+0000 7f422759e640 1 --2- 172.21.15.116:0/2306885131 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f42280b2e50 0x7f4228156860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:01.684 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.638+0000 7f422759e640 1 -- 172.21.15.116:0/2306885131 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f42280b3230 msgr2=0x7f4228156df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:01.684 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.638+0000 7f422759e640 1 --2- 172.21.15.116:0/2306885131 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f42280b3230 0x7f4228156df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:01.684 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.638+0000 7f422759e640 1 -- 172.21.15.116:0/2306885131 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f422809ade0 con 0x7f42280b3da0 2024-02-21T22:53:01.684 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.638+0000 7f422659c640 1 --2- 172.21.15.116:0/2306885131 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f42280b3230 0x7f4228156df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T22:53:01.684 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.638+0000 7f422759e640 1 --2- 172.21.15.116:0/2306885131 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f42280b3da0 0x7f422815e670 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f422000c7b0 tx=0x7f422000cc70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:01.684 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.638+0000 7f4226d9d640 1 --2- 172.21.15.116:0/2306885131 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f42280b2e50 0x7f4228156860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T22:53:01.685 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.640+0000 7f57f7836640 1 -- 172.21.15.116:0/2497500828 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57f00752f0 con 0x7f57f0164d70 2024-02-21T22:53:01.685 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.640+0000 7f420f7fe640 1 -- 172.21.15.116:0/2306885131 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f422000ce60 con 0x7f42280b3da0 2024-02-21T22:53:01.685 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.640+0000 7f57e5ffb640 1 -- 172.21.15.116:0/2497500828 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f57e0044020 con 0x7f57f0164d70 2024-02-21T22:53:01.685 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.640+0000 7f420f7fe640 1 -- 172.21.15.116:0/2306885131 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4220003da0 con 0x7f42280b3da0 2024-02-21T22:53:01.686 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.640+0000 7f422d111640 1 -- 172.21.15.116:0/2306885131 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f422809b0c0 con 0x7f42280b3da0 2024-02-21T22:53:01.686 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.640+0000 7fe1b9ffb640 1 -- 172.21.15.116:0/2817635151 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7fe1bc04e070 con 0x7fe1c40b2e50 2024-02-21T22:53:01.686 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.640+0000 7f57e5ffb640 1 --2- 172.21.15.116:0/2497500828 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f57d406b520 0x7f57d406d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:01.686 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.640+0000 7f57e5ffb640 1 -- 172.21.15.116:0/2497500828 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f57e00abd20 con 0x7f57f0164d70 2024-02-21T22:53:01.686 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.640+0000 7f57f55d2640 1 --2- 172.21.15.116:0/2497500828 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f57d406b520 0x7f57d406d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:01.687 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.641+0000 7f420f7fe640 1 -- 172.21.15.116:0/2306885131 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4220005270 con 0x7f42280b3da0 2024-02-21T22:53:01.687 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.641+0000 7f422d111640 1 -- 172.21.15.116:0/2306885131 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f422809b680 con 0x7f42280b3da0 2024-02-21T22:53:01.687 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.642+0000 7f420f7fe640 1 -- 172.21.15.116:0/2306885131 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f4220005450 con 0x7f42280b3da0 2024-02-21T22:53:01.687 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.641+0000 7f57f55d2640 1 --2- 172.21.15.116:0/2497500828 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f57d406b520 0x7f57d406d9e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f57e80014a0 tx=0x7f57e80020a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:01.688 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.642+0000 7f420f7fe640 1 --2- 172.21.15.116:0/2306885131 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f421406b520 0x7f421406d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:01.688 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.642+0000 7f422d111640 1 -- 172.21.15.116:0/2306885131 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4228071d90 con 0x7f42280b3da0 2024-02-21T22:53:01.688 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.643+0000 7f420f7fe640 1 -- 172.21.15.116:0/2306885131 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f422008d320 con 0x7f42280b3da0 2024-02-21T22:53:01.688 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.643+0000 7f4226d9d640 1 --2- 172.21.15.116:0/2306885131 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f421406b520 0x7f421406d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:01.688 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.643+0000 7f3407fff640 1 -- 172.21.15.116:0/213971856 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3414056a10 con 0x7f34200cf930 2024-02-21T22:53:01.689 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.643+0000 7fecc3fff640 1 -- 172.21.15.116:0/784989485 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecc4043020 con 0x7feccc0cf7b0 2024-02-21T22:53:01.689 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.644+0000 7fecd1955640 1 -- 172.21.15.116:0/784989485 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feccc0c80d0 con 0x7feccc0cf7b0 2024-02-21T22:53:01.689 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.644+0000 7fecd1955640 1 -- 172.21.15.116:0/784989485 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feccc0c8690 con 0x7feccc0cf7b0 2024-02-21T22:53:01.689 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.644+0000 7f1c6ffff640 1 -- 172.21.15.116:0/2483998429 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f1c7804b060 con 0x7f1c88072570 2024-02-21T22:53:01.689 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.645+0000 7f4226d9d640 1 --2- 172.21.15.116:0/2306885131 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f421406b520 0x7f421406d9e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f4218036000 tx=0x7f421803d040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:01.690 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.645+0000 7fecd1955640 1 -- 172.21.15.116:0/784989485 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feccc0752f0 con 0x7feccc0cf7b0 2024-02-21T22:53:01.690 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.647+0000 7f57e5ffb640 1 -- 172.21.15.116:0/2497500828 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f57e004b030 con 0x7f57f0164d70 2024-02-21T22:53:01.690 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.647+0000 7f420f7fe640 1 -- 172.21.15.116:0/2306885131 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f4228071d90 con 0x7f42280b3da0 2024-02-21T22:53:01.690 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.652+0000 7f3407fff640 1 -- 172.21.15.116:0/213971856 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f3414058970 con 0x7f34200cf930 2024-02-21T22:53:01.691 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.652+0000 7fecc3fff640 1 -- 172.21.15.116:0/784989485 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecc4031500 con 0x7feccc0cf7b0 2024-02-21T22:53:01.691 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.652+0000 7fecc3fff640 1 -- 172.21.15.116:0/784989485 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecc4038040 con 0x7feccc0cf7b0 2024-02-21T22:53:01.691 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.654+0000 7fecc3fff640 1 -- 172.21.15.116:0/784989485 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fecc4046020 con 0x7feccc0cf7b0 2024-02-21T22:53:01.691 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.655+0000 7fecc3fff640 1 --2- 172.21.15.116:0/784989485 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fecac06b4d0 0x7fecac06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:01.691 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.655+0000 7fecc3fff640 1 -- 172.21.15.116:0/784989485 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fecc40ac3d0 con 0x7feccc0cf7b0 2024-02-21T22:53:01.692 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.657+0000 7feccaffd640 1 --2- 172.21.15.116:0/784989485 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fecac06b4d0 0x7fecac06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:01.692 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.663+0000 7fecc3fff640 1 -- 172.21.15.116:0/784989485 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7fecc404d030 con 0x7feccc0cf7b0 2024-02-21T22:53:01.692 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.663+0000 7feccaffd640 1 --2- 172.21.15.116:0/784989485 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fecac06b4d0 0x7fecac06d990 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fecb4007fd0 tx=0x7fecb4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:01.986 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.995+0000 7f93146de640 1 -- 172.21.15.116:0/104919859 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f92f4005580 con 0x7f9304050420 2024-02-21T22:53:01.986 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.996+0000 7f9302ffd640 1 -- 172.21.15.116:0/104919859 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f930c0f9790 con 0x7f9304050420 2024-02-21T22:53:01.987 INFO:teuthology.orchestra.run.smithi116.stdout:55834574857 2024-02-21T22:53:01.990 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.999+0000 7f9300ff9640 1 -- 172.21.15.116:0/104919859 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f92f006b5d0 msgr2=0x7f92f006da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:01.990 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.999+0000 7f9300ff9640 1 --2- 172.21.15.116:0/104919859 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f92f006b5d0 0x7f92f006da90 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f930800ab80 tx=0x7f9308008040 comp rx=0 tx=0).stop 2024-02-21T22:53:01.990 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.999+0000 7f9300ff9640 1 -- 172.21.15.116:0/104919859 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9304050420 msgr2=0x7f9304037650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:01.991 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:01.999+0000 7f9300ff9640 1 --2- 172.21.15.116:0/104919859 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9304050420 0x7f9304037650 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f930c069af0 tx=0x7f930c0ab070 comp rx=0 tx=0).stop 2024-02-21T22:53:01.991 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.000+0000 7f9300ff9640 1 -- 172.21.15.116:0/104919859 shutdown_connections 2024-02-21T22:53:01.991 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.000+0000 7f9300ff9640 1 --2- 172.21.15.116:0/104919859 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f93040e0090 0x7f93041852f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:01.991 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.000+0000 7f9300ff9640 1 --2- 172.21.15.116:0/104919859 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f92f006b5d0 0x7f92f006da90 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:01.991 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.000+0000 7f9300ff9640 1 --2- 172.21.15.116:0/104919859 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9304050420 0x7f9304037650 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:01.991 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.000+0000 7f9300ff9640 1 --2- 172.21.15.116:0/104919859 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9304039310 0x7f9304037110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:01.991 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.000+0000 7f9300ff9640 1 -- 172.21.15.116:0/104919859 >> 172.21.15.116:0/104919859 conn(0x7f9304055bc0 msgr2=0x7f9304039760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:01.991 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.001+0000 7f9300ff9640 1 -- 172.21.15.116:0/104919859 shutdown_connections 2024-02-21T22:53:01.992 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.001+0000 7f9300ff9640 1 -- 172.21.15.116:0/104919859 wait complete. 2024-02-21T22:53:02.008 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.1 2024-02-21T22:53:02.008 DEBUG:teuthology.parallel:result is None 2024-02-21T22:53:02.022 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.032+0000 7fe1cb71e640 1 -- 172.21.15.116:0/2817635151 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fe1c40b38e0 con 0x7fe1c40b2e50 2024-02-21T22:53:02.023 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.032+0000 7fe1b9ffb640 1 -- 172.21.15.116:0/2817635151 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe1bc07c370 con 0x7fe1c40b2e50 2024-02-21T22:53:02.023 INFO:teuthology.orchestra.run.smithi116.stdout:55834574856 2024-02-21T22:53:02.025 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.034+0000 7fe1cb71e640 1 -- 172.21.15.116:0/2817635151 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fe1a806b4d0 msgr2=0x7fe1a806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:02.025 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.034+0000 7fe1cb71e640 1 --2- 172.21.15.116:0/2817635151 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fe1a806b4d0 0x7fe1a806d990 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe1b4000f60 tx=0x7fe1b4009040 comp rx=0 tx=0).stop 2024-02-21T22:53:02.025 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.034+0000 7fe1cb71e640 1 -- 172.21.15.116:0/2817635151 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe1c40b2e50 msgr2=0x7fe1c4159400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:02.025 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.034+0000 7fe1cb71e640 1 --2- 172.21.15.116:0/2817635151 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe1c40b2e50 0x7fe1c4159400 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe1bc000f80 tx=0x7fe1bc004a40 comp rx=0 tx=0).stop 2024-02-21T22:53:02.025 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.034+0000 7fe1cb71e640 1 -- 172.21.15.116:0/2817635151 shutdown_connections 2024-02-21T22:53:02.025 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.034+0000 7fe1cb71e640 1 --2- 172.21.15.116:0/2817635151 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fe1a806b4d0 0x7fe1a806d990 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:02.025 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.034+0000 7fe1cb71e640 1 --2- 172.21.15.116:0/2817635151 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe1c40b3da0 0x7fe1c41634e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:02.026 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.034+0000 7fe1cb71e640 1 --2- 172.21.15.116:0/2817635151 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe1c40b3230 0x7fe1c415c250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:02.026 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.034+0000 7fe1cb71e640 1 --2- 172.21.15.116:0/2817635151 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe1c40b2e50 0x7fe1c4159400 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:02.026 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.034+0000 7fe1cb71e640 1 -- 172.21.15.116:0/2817635151 >> 172.21.15.116:0/2817635151 conn(0x7fe1c40b18e0 msgr2=0x7fe1c40b0360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:02.026 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.034+0000 7fe1cb71e640 1 -- 172.21.15.116:0/2817635151 shutdown_connections 2024-02-21T22:53:02.026 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.034+0000 7fe1cb71e640 1 -- 172.21.15.116:0/2817635151 wait complete. 2024-02-21T22:53:02.036 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.2 2024-02-21T22:53:02.036 DEBUG:teuthology.parallel:result is None 2024-02-21T22:53:02.037 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.046+0000 7f9b52291640 1 -- 172.21.15.116:0/2020735709 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f9b2c005580 con 0x7f9b4c0b44a0 2024-02-21T22:53:02.037 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.047+0000 7f9b48ff9640 1 -- 172.21.15.116:0/2020735709 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9b3c010070 con 0x7f9b4c0b44a0 2024-02-21T22:53:02.037 INFO:teuthology.orchestra.run.smithi116.stdout:55834574856 2024-02-21T22:53:02.041 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.050+0000 7f9b52291640 1 -- 172.21.15.116:0/2020735709 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f9b3806b5d0 msgr2=0x7f9b3806da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:02.041 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.050+0000 7f9b52291640 1 --2- 172.21.15.116:0/2020735709 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f9b3806b5d0 0x7f9b3806da90 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f9b4c159d80 tx=0x7f9b44009040 comp rx=0 tx=0).stop 2024-02-21T22:53:02.041 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.050+0000 7f9b52291640 1 -- 172.21.15.116:0/2020735709 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9b4c0b44a0 msgr2=0x7f9b4c159840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:02.041 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.050+0000 7f9b52291640 1 --2- 172.21.15.116:0/2020735709 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9b4c0b44a0 0x7f9b4c159840 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f9b3c03c040 tx=0x7f9b3c004730 comp rx=0 tx=0).stop 2024-02-21T22:53:02.041 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.050+0000 7f9b52291640 1 -- 172.21.15.116:0/2020735709 shutdown_connections 2024-02-21T22:53:02.041 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.050+0000 7f9b52291640 1 --2- 172.21.15.116:0/2020735709 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9b4c152a70 0x7f9b4c157b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:02.041 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.050+0000 7f9b52291640 1 --2- 172.21.15.116:0/2020735709 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9b4c0b48d0 0x7f9b4c1fc610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:02.041 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.050+0000 7f9b52291640 1 --2- 172.21.15.116:0/2020735709 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f9b3806b5d0 0x7f9b3806da90 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:02.041 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.050+0000 7f9b52291640 1 --2- 172.21.15.116:0/2020735709 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9b4c0b44a0 0x7f9b4c159840 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:02.041 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.050+0000 7f9b52291640 1 -- 172.21.15.116:0/2020735709 >> 172.21.15.116:0/2020735709 conn(0x7f9b4c0b18e0 msgr2=0x7f9b4c0ae5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:02.041 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.050+0000 7f9b52291640 1 -- 172.21.15.116:0/2020735709 shutdown_connections 2024-02-21T22:53:02.041 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.050+0000 7f9b52291640 1 -- 172.21.15.116:0/2020735709 wait complete. 2024-02-21T22:53:02.049 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.059+0000 7f57f7836640 1 -- 172.21.15.116:0/2497500828 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f57f006d230 con 0x7f57f0164d70 2024-02-21T22:53:02.049 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.059+0000 7f57e5ffb640 1 -- 172.21.15.116:0/2497500828 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f57e0031e40 con 0x7f57f0164d70 2024-02-21T22:53:02.050 INFO:teuthology.orchestra.run.smithi116.stdout:55834574855 2024-02-21T22:53:02.053 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.062+0000 7f57f7836640 1 -- 172.21.15.116:0/2497500828 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f57d406b520 msgr2=0x7f57d406d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:02.053 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.062+0000 7f57f7836640 1 --2- 172.21.15.116:0/2497500828 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f57d406b520 0x7f57d406d9e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f57e80014a0 tx=0x7f57e80020a0 comp rx=0 tx=0).stop 2024-02-21T22:53:02.053 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.062+0000 7f57f7836640 1 -- 172.21.15.116:0/2497500828 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f57f0164d70 msgr2=0x7f57f0147970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:02.053 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.062+0000 7f57f7836640 1 --2- 172.21.15.116:0/2497500828 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f57f0164d70 0x7f57f0147970 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f57e0001870 tx=0x7f57e0001120 comp rx=0 tx=0).stop 2024-02-21T22:53:02.053 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.062+0000 7f57f7836640 1 -- 172.21.15.116:0/2497500828 shutdown_connections 2024-02-21T22:53:02.053 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.062+0000 7f57f7836640 1 --2- 172.21.15.116:0/2497500828 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f57f0149180 0x7f57f015e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:02.053 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.062+0000 7f57f7836640 1 --2- 172.21.15.116:0/2497500828 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f57d406b520 0x7f57d406d9e0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:02.053 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.062+0000 7f57f7836640 1 --2- 172.21.15.116:0/2497500828 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f57f0164d70 0x7f57f0147970 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:02.053 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.062+0000 7f57f7836640 1 --2- 172.21.15.116:0/2497500828 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f57dc004800 0x7f57f006dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:02.053 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.062+0000 7f57f7836640 1 -- 172.21.15.116:0/2497500828 >> 172.21.15.116:0/2497500828 conn(0x7f57f00b18e0 msgr2=0x7f57f01603c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:02.053 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.062+0000 7f57f7836640 1 -- 172.21.15.116:0/2497500828 shutdown_connections 2024-02-21T22:53:02.053 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.062+0000 7f57f7836640 1 -- 172.21.15.116:0/2497500828 wait complete. 2024-02-21T22:53:02.054 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.062+0000 7f1c6dffb640 1 -- 172.21.15.116:0/2483998429 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f1c68005580 con 0x7f1c88072570 2024-02-21T22:53:02.054 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.063+0000 7f1c6ffff640 1 -- 172.21.15.116:0/2483998429 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1c7807b210 con 0x7f1c88072570 2024-02-21T22:53:02.054 INFO:teuthology.orchestra.run.smithi116.stdout:55834574856 2024-02-21T22:53:02.055 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.4 2024-02-21T22:53:02.055 DEBUG:teuthology.parallel:result is None 2024-02-21T22:53:02.056 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.066+0000 7f1c6dffb640 1 -- 172.21.15.116:0/2483998429 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f1c7406b5d0 msgr2=0x7f1c7406da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:02.056 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.066+0000 7f1c6dffb640 1 --2- 172.21.15.116:0/2483998429 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f1c7406b5d0 0x7f1c7406da90 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f1c7c007fd0 tx=0x7f1c7c009040 comp rx=0 tx=0).stop 2024-02-21T22:53:02.057 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.066+0000 7f1c6dffb640 1 -- 172.21.15.116:0/2483998429 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1c88072570 msgr2=0x7f1c8815dc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:02.057 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.066+0000 7f1c6dffb640 1 --2- 172.21.15.116:0/2483998429 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1c88072570 0x7f1c8815dc50 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f1c78033000 tx=0x7f1c780046c0 comp rx=0 tx=0).stop 2024-02-21T22:53:02.057 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.066+0000 7f1c6dffb640 1 -- 172.21.15.116:0/2483998429 shutdown_connections 2024-02-21T22:53:02.057 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.066+0000 7f1c6dffb640 1 --2- 172.21.15.116:0/2483998429 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f1c7406b5d0 0x7f1c7406da90 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:02.057 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.066+0000 7f1c6dffb640 1 --2- 172.21.15.116:0/2483998429 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1c8815d700 0x7f1c8815fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:02.057 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.066+0000 7f1c6dffb640 1 --2- 172.21.15.116:0/2483998429 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1c880aedd0 0x7f1c88151b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:02.057 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.066+0000 7f1c6dffb640 1 --2- 172.21.15.116:0/2483998429 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1c88072570 0x7f1c8815dc50 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:02.057 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.066+0000 7f1c6dffb640 1 -- 172.21.15.116:0/2483998429 >> 172.21.15.116:0/2483998429 conn(0x7f1c880b1e90 msgr2=0x7f1c88071d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:02.057 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.066+0000 7f1c6dffb640 1 -- 172.21.15.116:0/2483998429 shutdown_connections 2024-02-21T22:53:02.057 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.066+0000 7f1c6dffb640 1 -- 172.21.15.116:0/2483998429 wait complete. 2024-02-21T22:53:02.060 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.070+0000 7fecd1955640 1 -- 172.21.15.116:0/784989485 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7feccc072f30 con 0x7feccc0cf7b0 2024-02-21T22:53:02.061 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.070+0000 7fecc3fff640 1 -- 172.21.15.116:0/784989485 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fecc4030070 con 0x7feccc0cf7b0 2024-02-21T22:53:02.061 INFO:teuthology.orchestra.run.smithi116.stdout:55834574857 2024-02-21T22:53:02.063 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.071+0000 7f3425c08640 1 -- 172.21.15.116:0/213971856 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f342006f1c0 con 0x7f34200cf930 2024-02-21T22:53:02.063 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.071+0000 7f3407fff640 1 -- 172.21.15.116:0/213971856 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f341405ca10 con 0x7f34200cf930 2024-02-21T22:53:02.063 INFO:teuthology.orchestra.run.smithi116.stdout:55834574855 2024-02-21T22:53:02.064 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.071+0000 7f422d111640 1 -- 172.21.15.116:0/2306885131 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f4228071ab0 con 0x7f42280b3da0 2024-02-21T22:53:02.064 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.072+0000 7f420f7fe640 1 -- 172.21.15.116:0/2306885131 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f42200586c0 con 0x7f42280b3da0 2024-02-21T22:53:02.064 INFO:teuthology.orchestra.run.smithi116.stdout:55834574856 2024-02-21T22:53:02.065 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.073+0000 7fecd1955640 1 -- 172.21.15.116:0/784989485 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fecac06b4d0 msgr2=0x7fecac06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:02.065 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.073+0000 7fecd1955640 1 --2- 172.21.15.116:0/784989485 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fecac06b4d0 0x7fecac06d990 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fecb4007fd0 tx=0x7fecb4009040 comp rx=0 tx=0).stop 2024-02-21T22:53:02.065 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.073+0000 7fecd1955640 1 -- 172.21.15.116:0/784989485 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7feccc0cf7b0 msgr2=0x7feccc0ae0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:02.065 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.073+0000 7fecd1955640 1 --2- 172.21.15.116:0/784989485 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7feccc0cf7b0 0x7feccc0ae0b0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fecc4033000 tx=0x7fecc40046c0 comp rx=0 tx=0).stop 2024-02-21T22:53:02.065 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.073+0000 7fecd1955640 1 -- 172.21.15.116:0/784989485 shutdown_connections 2024-02-21T22:53:02.065 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.073+0000 7fecd1955640 1 --2- 172.21.15.116:0/784989485 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7feccc0cf7b0 0x7feccc0ae0b0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:02.065 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.073+0000 7fecd1955640 1 --2- 172.21.15.116:0/784989485 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fecac06b4d0 0x7fecac06d990 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:02.065 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.073+0000 7fecd1955640 1 --2- 172.21.15.116:0/784989485 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feccc0c3950 0x7feccc0c9c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:02.065 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.073+0000 7fecd1955640 1 --2- 172.21.15.116:0/784989485 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feccc066c60 0x7feccc1566d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:02.065 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.073+0000 7fecd1955640 1 -- 172.21.15.116:0/784989485 >> 172.21.15.116:0/784989485 conn(0x7feccc072340 msgr2=0x7feccc0c3240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:02.065 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.073+0000 7fecd1955640 1 -- 172.21.15.116:0/784989485 shutdown_connections 2024-02-21T22:53:02.066 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.073+0000 7fecd1955640 1 -- 172.21.15.116:0/784989485 wait complete. 2024-02-21T22:53:02.066 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.074+0000 7f3425c08640 1 -- 172.21.15.116:0/213971856 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f340c06b520 msgr2=0x7f340c06d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:02.066 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.074+0000 7f3425c08640 1 --2- 172.21.15.116:0/213971856 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f340c06b520 0x7f340c06d9e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f3410035000 tx=0x7f3410008030 comp rx=0 tx=0).stop 2024-02-21T22:53:02.066 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.074+0000 7f3425c08640 1 -- 172.21.15.116:0/213971856 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f34200cf930 msgr2=0x7f34201f7e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:02.066 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.074+0000 7f3425c08640 1 --2- 172.21.15.116:0/213971856 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f34200cf930 0x7f34201f7e70 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f341400e900 tx=0x7f341400edc0 comp rx=0 tx=0).stop 2024-02-21T22:53:02.066 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.074+0000 7f3425c08640 1 -- 172.21.15.116:0/213971856 shutdown_connections 2024-02-21T22:53:02.066 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.074+0000 7f3425c08640 1 --2- 172.21.15.116:0/213971856 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f340c06b520 0x7f340c06d9e0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:02.067 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.074+0000 7f3425c08640 1 --2- 172.21.15.116:0/213971856 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f34200af0b0 0x7f3420163f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:02.067 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.074+0000 7f3425c08640 1 --2- 172.21.15.116:0/213971856 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f34200cf930 0x7f34201f7e70 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:02.067 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.074+0000 7f3425c08640 1 --2- 172.21.15.116:0/213971856 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f342006d370 0x7f342015c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:02.067 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.074+0000 7f3425c08640 1 -- 172.21.15.116:0/213971856 >> 172.21.15.116:0/213971856 conn(0x7f34200b1b80 msgr2=0x7f34200b0140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:02.067 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.074+0000 7f3425c08640 1 -- 172.21.15.116:0/213971856 shutdown_connections 2024-02-21T22:53:02.067 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.074+0000 7f3425c08640 1 -- 172.21.15.116:0/213971856 wait complete. 2024-02-21T22:53:02.068 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.075+0000 7f422d111640 1 -- 172.21.15.116:0/2306885131 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f421406b520 msgr2=0x7f421406d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:02.068 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.075+0000 7f422d111640 1 --2- 172.21.15.116:0/2306885131 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f421406b520 0x7f421406d9e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f4218036000 tx=0x7f421803d040 comp rx=0 tx=0).stop 2024-02-21T22:53:02.068 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.075+0000 7f422d111640 1 -- 172.21.15.116:0/2306885131 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f42280b3da0 msgr2=0x7f422815e670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:02.068 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.075+0000 7f422d111640 1 --2- 172.21.15.116:0/2306885131 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f42280b3da0 0x7f422815e670 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f422000c7b0 tx=0x7f422000cc70 comp rx=0 tx=0).stop 2024-02-21T22:53:02.068 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.075+0000 7f422d111640 1 -- 172.21.15.116:0/2306885131 shutdown_connections 2024-02-21T22:53:02.068 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.075+0000 7f422d111640 1 --2- 172.21.15.116:0/2306885131 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f42280b3da0 0x7f422815e670 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:02.068 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.075+0000 7f422d111640 1 --2- 172.21.15.116:0/2306885131 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f42280b3230 0x7f4228156df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:02.068 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.075+0000 7f422d111640 1 --2- 172.21.15.116:0/2306885131 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f421406b520 0x7f421406d9e0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:02.068 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.075+0000 7f422d111640 1 --2- 172.21.15.116:0/2306885131 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f42280b2e50 0x7f4228156860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:02.068 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.075+0000 7f422d111640 1 -- 172.21.15.116:0/2306885131 >> 172.21.15.116:0/2306885131 conn(0x7f42280b18e0 msgr2=0x7f422806c8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:02.068 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.075+0000 7f422d111640 1 -- 172.21.15.116:0/2306885131 shutdown_connections 2024-02-21T22:53:02.068 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.075+0000 7f422d111640 1 -- 172.21.15.116:0/2306885131 wait complete. 2024-02-21T22:53:02.069 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.0 2024-02-21T22:53:02.069 DEBUG:teuthology.parallel:result is None 2024-02-21T22:53:02.073 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.3 2024-02-21T22:53:02.074 DEBUG:teuthology.parallel:result is None 2024-02-21T22:53:02.078 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.7 2024-02-21T22:53:02.078 DEBUG:teuthology.parallel:result is None 2024-02-21T22:53:02.081 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.5 2024-02-21T22:53:02.081 DEBUG:teuthology.parallel:result is None 2024-02-21T22:53:02.082 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.6 2024-02-21T22:53:02.082 DEBUG:teuthology.parallel:result is None 2024-02-21T22:53:02.083 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-02-21T22:53:02.083 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-21T22:53:02.223 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.232+0000 7fc2da660640 1 Processor -- start 2024-02-21T22:53:02.223 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.232+0000 7fc2da660640 1 -- start start 2024-02-21T22:53:02.224 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.233+0000 7fc2da660640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc2d415e560 0x7fc2d40d1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:02.224 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.233+0000 7fc2da660640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2d40ce8f0 con 0x7fc2d415e180 2024-02-21T22:53:02.224 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.233+0000 7fc2da660640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2d40d1530 con 0x7fc2d40d0fc0 2024-02-21T22:53:02.224 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.233+0000 7fc2da660640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2d40b31b0 con 0x7fc2d415e560 2024-02-21T22:53:02.224 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.233+0000 7fc2d3fff640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7fc2d415e180 0x7fc2d40cf650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:50938/0 (socket says 172.21.15.116:50938) 2024-02-21T22:53:02.225 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.233+0000 7fc2d3fff640 1 -- 172.21.15.116:0/534345133 learned_addr learned my addr 172.21.15.116:0/534345133 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-02-21T22:53:02.225 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.233+0000 7fc2d37fe640 1 --2- 172.21.15.116:0/534345133 >> v2:172.21.15.142:3300/0 conn(0x7fc2d415e560 0x7fc2d40d1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:02.225 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.233+0000 7fc2d2ffd640 1 -- 172.21.15.116:0/534345133 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2889349874 0 0) 0x7fc2c4001110 con 0x7fc2d415e180 2024-02-21T22:53:02.225 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.233+0000 7fc2d2ffd640 1 -- 172.21.15.116:0/534345133 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc2bc003520 con 0x7fc2d415e180 2024-02-21T22:53:02.225 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.234+0000 7fc2d37fe640 1 -- 172.21.15.116:0/534345133 >> v1:172.21.15.142:6789/0 conn(0x7fc2d40d0fc0 legacy=0x7fc2d40b0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:02.225 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.234+0000 7fc2d37fe640 1 -- 172.21.15.116:0/534345133 >> v1:172.21.15.116:6789/0 conn(0x7fc2d415e180 legacy=0x7fc2d40cf650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:02.225 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.234+0000 7fc2d37fe640 1 -- 172.21.15.116:0/534345133 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2d40ceb70 con 0x7fc2d415e560 2024-02-21T22:53:02.226 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.234+0000 7fc2d37fe640 1 --2- 172.21.15.116:0/534345133 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc2d415e560 0x7fc2d40d1bc0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fc2c80097a0 tx=0x7fc2c802b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d1f3a57dde20b845 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:02.226 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.235+0000 7fc2d2ffd640 1 -- 172.21.15.116:0/534345133 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2c8034070 con 0x7fc2d415e560 2024-02-21T22:53:02.226 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.235+0000 7fc2d2ffd640 1 -- 172.21.15.116:0/534345133 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2c8030610 con 0x7fc2d415e560 2024-02-21T22:53:02.226 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.235+0000 7fc2d2ffd640 1 -- 172.21.15.116:0/534345133 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2c80309c0 con 0x7fc2d415e560 2024-02-21T22:53:02.226 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.235+0000 7fc2da660640 1 -- 172.21.15.116:0/534345133 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc2d415e560 msgr2=0x7fc2d40d1bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:02.226 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.235+0000 7fc2da660640 1 --2- 172.21.15.116:0/534345133 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc2d415e560 0x7fc2d40d1bc0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fc2c80097a0 tx=0x7fc2c802b960 comp rx=0 tx=0).stop 2024-02-21T22:53:02.227 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.235+0000 7fc2da660640 1 -- 172.21.15.116:0/534345133 shutdown_connections 2024-02-21T22:53:02.227 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.235+0000 7fc2da660640 1 --2- 172.21.15.116:0/534345133 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc2d415e560 0x7fc2d40d1bc0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:02.227 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.235+0000 7fc2da660640 1 -- 172.21.15.116:0/534345133 >> 172.21.15.116:0/534345133 conn(0x7fc2d40d3de0 msgr2=0x7fc2d40d41f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:02.227 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.235+0000 7fc2da660640 1 -- 172.21.15.116:0/534345133 shutdown_connections 2024-02-21T22:53:02.227 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.235+0000 7fc2da660640 1 -- 172.21.15.116:0/534345133 wait complete. 2024-02-21T22:53:02.229 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.236+0000 7fc2da660640 1 Processor -- start 2024-02-21T22:53:02.229 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.236+0000 7fc2da660640 1 -- start start 2024-02-21T22:53:02.229 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.237+0000 7fc2da660640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc2d40d0fc0 0x7fc2d4152610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:02.229 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.237+0000 7fc2da660640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc2d415e180 0x7fc2d40c8320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:02.229 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.237+0000 7fc2da660640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc2d415e560 0x7fc2d4160940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:02.229 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.237+0000 7fc2da660640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2d40cf1c0 con 0x7fc2d415e560 2024-02-21T22:53:02.229 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.237+0000 7fc2da660640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2d40d2100 con 0x7fc2d415e180 2024-02-21T22:53:02.229 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.237+0000 7fc2da660640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2d40cfd60 con 0x7fc2d40d0fc0 2024-02-21T22:53:02.229 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.237+0000 7fc2d8bfd640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc2d415e560 0x7fc2d4160940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:02.229 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.237+0000 7fc2d8bfd640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc2d415e560 0x7fc2d4160940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:34440/0 (socket says 172.21.15.116:34440) 2024-02-21T22:53:02.229 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.237+0000 7fc2d8bfd640 1 -- 172.21.15.116:0/3876934637 learned_addr learned my addr 172.21.15.116:0/3876934637 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:02.229 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.237+0000 7fc2d3fff640 1 --2- 172.21.15.116:0/3876934637 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc2d40d0fc0 0x7fc2d4152610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:02.230 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.237+0000 7fc2d37fe640 1 --2- 172.21.15.116:0/3876934637 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc2d415e180 0x7fc2d40c8320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:02.230 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.237+0000 7fc2d8bfd640 1 -- 172.21.15.116:0/3876934637 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc2d40d0fc0 msgr2=0x7fc2d4152610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:02.230 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.237+0000 7fc2d8bfd640 1 --2- 172.21.15.116:0/3876934637 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc2d40d0fc0 0x7fc2d4152610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:02.230 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.238+0000 7fc2d8bfd640 1 -- 172.21.15.116:0/3876934637 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc2d415e180 msgr2=0x7fc2d40c8320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:02.230 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.238+0000 7fc2d8bfd640 1 --2- 172.21.15.116:0/3876934637 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc2d415e180 0x7fc2d40c8320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:02.230 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.238+0000 7fc2d8bfd640 1 -- 172.21.15.116:0/3876934637 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2d4152b50 con 0x7fc2d415e560 2024-02-21T22:53:02.230 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.238+0000 7fc2d8bfd640 1 --2- 172.21.15.116:0/3876934637 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc2d415e560 0x7fc2d4160940 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fc2cc00c7a0 tx=0x7fc2cc00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:02.230 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.238+0000 7fc2d0ff9640 1 -- 172.21.15.116:0/3876934637 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2cc003b70 con 0x7fc2d415e560 2024-02-21T22:53:02.230 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.238+0000 7fc2d0ff9640 1 -- 172.21.15.116:0/3876934637 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2cc003d30 con 0x7fc2d415e560 2024-02-21T22:53:02.230 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.238+0000 7fc2da660640 1 -- 172.21.15.116:0/3876934637 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2d415fb80 con 0x7fc2d415e560 2024-02-21T22:53:02.230 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.238+0000 7fc2d0ff9640 1 -- 172.21.15.116:0/3876934637 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2cc00aa90 con 0x7fc2d415e560 2024-02-21T22:53:02.230 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.238+0000 7fc2da660640 1 -- 172.21.15.116:0/3876934637 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2d4160140 con 0x7fc2d415e560 2024-02-21T22:53:02.231 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.239+0000 7fc2da660640 1 -- 172.21.15.116:0/3876934637 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2d40752f0 con 0x7fc2d415e560 2024-02-21T22:53:02.231 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.239+0000 7fc2d0ff9640 1 -- 172.21.15.116:0/3876934637 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fc2cc00ac30 con 0x7fc2d415e560 2024-02-21T22:53:02.231 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.240+0000 7fc2d0ff9640 1 --2- 172.21.15.116:0/3876934637 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fc2c006b4d0 0x7fc2c006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:02.231 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.240+0000 7fc2d0ff9640 1 -- 172.21.15.116:0/3876934637 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc2cc089fd0 con 0x7fc2d415e560 2024-02-21T22:53:02.231 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.240+0000 7fc2d3fff640 1 --2- 172.21.15.116:0/3876934637 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fc2c006b4d0 0x7fc2c006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:02.231 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.240+0000 7fc2d3fff640 1 --2- 172.21.15.116:0/3876934637 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fc2c006b4d0 0x7fc2c006d990 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fc2c40012b0 tx=0x7fc2c4007b70 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:02.234 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.244+0000 7fc2d0ff9640 1 -- 172.21.15.116:0/3876934637 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7fc2cc058810 con 0x7fc2d415e560 2024-02-21T22:53:02.404 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.414+0000 7fc2da660640 1 -- 172.21.15.116:0/3876934637 --> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc2d4155ff0 con 0x7fc2c006b4d0 2024-02-21T22:53:02.410 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.420+0000 7fc2d0ff9640 1 -- 172.21.15.116:0/3876934637 <== mgr.4103 v2:172.21.15.142:6832/1381484782 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251837 (secure 0 0 0) 0x7fc2d4155ff0 con 0x7fc2c006b4d0 2024-02-21T22:53:02.413 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-02-21T22:53:02.414 INFO:teuthology.orchestra.run.smithi116.stderr:dumped all 2024-02-21T22:53:02.416 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.423+0000 7fc2da660640 1 -- 172.21.15.116:0/3876934637 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fc2c006b4d0 msgr2=0x7fc2c006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:02.416 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.423+0000 7fc2da660640 1 --2- 172.21.15.116:0/3876934637 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fc2c006b4d0 0x7fc2c006d990 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fc2c40012b0 tx=0x7fc2c4007b70 comp rx=0 tx=0).stop 2024-02-21T22:53:02.416 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.423+0000 7fc2da660640 1 -- 172.21.15.116:0/3876934637 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc2d415e560 msgr2=0x7fc2d4160940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:02.416 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.423+0000 7fc2da660640 1 --2- 172.21.15.116:0/3876934637 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc2d415e560 0x7fc2d4160940 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fc2cc00c7a0 tx=0x7fc2cc00cc60 comp rx=0 tx=0).stop 2024-02-21T22:53:02.416 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.423+0000 7fc2da660640 1 -- 172.21.15.116:0/3876934637 shutdown_connections 2024-02-21T22:53:02.416 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.423+0000 7fc2da660640 1 --2- 172.21.15.116:0/3876934637 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc2d415e560 0x7fc2d4160940 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:02.416 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.423+0000 7fc2da660640 1 --2- 172.21.15.116:0/3876934637 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc2d415e180 0x7fc2d40c8320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:02.416 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.423+0000 7fc2da660640 1 --2- 172.21.15.116:0/3876934637 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fc2c006b4d0 0x7fc2c006d990 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:02.417 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.423+0000 7fc2da660640 1 --2- 172.21.15.116:0/3876934637 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc2d40d0fc0 0x7fc2d4152610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:02.417 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.423+0000 7fc2da660640 1 -- 172.21.15.116:0/3876934637 >> 172.21.15.116:0/3876934637 conn(0x7fc2d40d3de0 msgr2=0x7fc2d415c730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:02.417 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.423+0000 7fc2da660640 1 -- 172.21.15.116:0/3876934637 shutdown_connections 2024-02-21T22:53:02.417 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.423+0000 7fc2da660640 1 -- 172.21.15.116:0/3876934637 wait complete. 2024-02-21T22:53:02.424 INFO:teuthology.orchestra.run.smithi116.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-02-21T22:53:02.289674+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219016,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755704,"statfs":{"total":773094113280,"available":772869840896,"internally_reserved":0,"allocated":2891776,"data_stored":1753028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.498283"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234219+0000","last_change":"2024-02-21T22:52:50.804119+0000","last_active":"2024-02-21T22:52:52.234219+0000","last_peered":"2024-02-21T22:52:52.234219+0000","last_clean":"2024-02-21T22:52:52.234219+0000","last_became_active":"2024-02-21T22:52:50.801464+0000","last_became_peered":"2024-02-21T22:52:50.801464+0000","last_unstale":"2024-02-21T22:52:52.234219+0000","last_undegraded":"2024-02-21T22:52:52.234219+0000","last_fullsized":"2024-02-21T22:52:52.234219+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:06:29.082788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:51.792663+0000","last_change":"2024-02-21T22:52:50.787683+0000","last_active":"2024-02-21T22:52:51.792663+0000","last_peered":"2024-02-21T22:52:51.792663+0000","last_clean":"2024-02-21T22:52:51.792663+0000","last_became_active":"2024-02-21T22:52:50.787384+0000","last_became_peered":"2024-02-21T22:52:50.787384+0000","last_unstale":"2024-02-21T22:52:51.792663+0000","last_undegraded":"2024-02-21T22:52:51.792663+0000","last_fullsized":"2024-02-21T22:52:51.792663+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:10:56.108581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.233732+0000","last_change":"2024-02-21T22:52:50.786452+0000","last_active":"2024-02-21T22:52:52.233732+0000","last_peered":"2024-02-21T22:52:52.233732+0000","last_clean":"2024-02-21T22:52:52.233732+0000","last_became_active":"2024-02-21T22:52:50.786191+0000","last_became_peered":"2024-02-21T22:52:50.786191+0000","last_unstale":"2024-02-21T22:52:52.233732+0000","last_undegraded":"2024-02-21T22:52:52.233732+0000","last_fullsized":"2024-02-21T22:52:52.233732+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:43:33.767331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.233922+0000","last_change":"2024-02-21T22:52:50.805367+0000","last_active":"2024-02-21T22:52:52.233922+0000","last_peered":"2024-02-21T22:52:52.233922+0000","last_clean":"2024-02-21T22:52:52.233922+0000","last_became_active":"2024-02-21T22:52:50.805067+0000","last_became_peered":"2024-02-21T22:52:50.805067+0000","last_unstale":"2024-02-21T22:52:52.233922+0000","last_undegraded":"2024-02-21T22:52:52.233922+0000","last_fullsized":"2024-02-21T22:52:52.233922+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T02:49:51.875007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234052+0000","last_change":"2024-02-21T22:52:50.793726+0000","last_active":"2024-02-21T22:52:52.234052+0000","last_peered":"2024-02-21T22:52:52.234052+0000","last_clean":"2024-02-21T22:52:52.234052+0000","last_became_active":"2024-02-21T22:52:50.793461+0000","last_became_peered":"2024-02-21T22:52:50.793461+0000","last_unstale":"2024-02-21T22:52:52.234052+0000","last_undegraded":"2024-02-21T22:52:52.234052+0000","last_fullsized":"2024-02-21T22:52:52.234052+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:25:14.399237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.233784+0000","last_change":"2024-02-21T22:52:50.797872+0000","last_active":"2024-02-21T22:52:52.233784+0000","last_peered":"2024-02-21T22:52:52.233784+0000","last_clean":"2024-02-21T22:52:52.233784+0000","last_became_active":"2024-02-21T22:52:50.797547+0000","last_became_peered":"2024-02-21T22:52:50.797547+0000","last_unstale":"2024-02-21T22:52:52.233784+0000","last_undegraded":"2024-02-21T22:52:52.233784+0000","last_fullsized":"2024-02-21T22:52:52.233784+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:38:41.981414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.233678+0000","last_change":"2024-02-21T22:52:50.792977+0000","last_active":"2024-02-21T22:52:52.233678+0000","last_peered":"2024-02-21T22:52:52.233678+0000","last_clean":"2024-02-21T22:52:52.233678+0000","last_became_active":"2024-02-21T22:52:50.792731+0000","last_became_peered":"2024-02-21T22:52:50.792731+0000","last_unstale":"2024-02-21T22:52:52.233678+0000","last_undegraded":"2024-02-21T22:52:52.233678+0000","last_fullsized":"2024-02-21T22:52:52.233678+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T02:49:51.875007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.233592+0000","last_change":"2024-02-21T22:52:50.800588+0000","last_active":"2024-02-21T22:52:52.233592+0000","last_peered":"2024-02-21T22:52:52.233592+0000","last_clean":"2024-02-21T22:52:52.233592+0000","last_became_active":"2024-02-21T22:52:50.800266+0000","last_became_peered":"2024-02-21T22:52:50.800266+0000","last_unstale":"2024-02-21T22:52:52.233592+0000","last_undegraded":"2024-02-21T22:52:52.233592+0000","last_fullsized":"2024-02-21T22:52:52.233592+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:49:26.881791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234360+0000","last_change":"2024-02-21T22:52:50.802133+0000","last_active":"2024-02-21T22:52:52.234360+0000","last_peered":"2024-02-21T22:52:52.234360+0000","last_clean":"2024-02-21T22:52:52.234360+0000","last_became_active":"2024-02-21T22:52:50.801109+0000","last_became_peered":"2024-02-21T22:52:50.801109+0000","last_unstale":"2024-02-21T22:52:52.234360+0000","last_undegraded":"2024-02-21T22:52:52.234360+0000","last_fullsized":"2024-02-21T22:52:52.234360+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:32:36.066162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:51.795991+0000","last_change":"2024-02-21T22:52:50.799972+0000","last_active":"2024-02-21T22:52:51.795991+0000","last_peered":"2024-02-21T22:52:51.795991+0000","last_clean":"2024-02-21T22:52:51.795991+0000","last_became_active":"2024-02-21T22:52:50.799713+0000","last_became_peered":"2024-02-21T22:52:50.799713+0000","last_unstale":"2024-02-21T22:52:51.795991+0000","last_undegraded":"2024-02-21T22:52:51.795991+0000","last_fullsized":"2024-02-21T22:52:51.795991+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:10:56.108581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:51.794860+0000","last_change":"2024-02-21T22:52:50.800180+0000","last_active":"2024-02-21T22:52:51.794860+0000","last_peered":"2024-02-21T22:52:51.794860+0000","last_clean":"2024-02-21T22:52:51.794860+0000","last_became_active":"2024-02-21T22:52:50.799506+0000","last_became_peered":"2024-02-21T22:52:50.799506+0000","last_unstale":"2024-02-21T22:52:51.794860+0000","last_undegraded":"2024-02-21T22:52:51.794860+0000","last_fullsized":"2024-02-21T22:52:51.794860+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:49:26.881791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:51.795709+0000","last_change":"2024-02-21T22:52:50.785668+0000","last_active":"2024-02-21T22:52:51.795709+0000","last_peered":"2024-02-21T22:52:51.795709+0000","last_clean":"2024-02-21T22:52:51.795709+0000","last_became_active":"2024-02-21T22:52:50.785381+0000","last_became_peered":"2024-02-21T22:52:50.785381+0000","last_unstale":"2024-02-21T22:52:51.795709+0000","last_undegraded":"2024-02-21T22:52:51.795709+0000","last_fullsized":"2024-02-21T22:52:51.795709+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:29:58.630598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234333+0000","last_change":"2024-02-21T22:52:50.789689+0000","last_active":"2024-02-21T22:52:52.234333+0000","last_peered":"2024-02-21T22:52:52.234333+0000","last_clean":"2024-02-21T22:52:52.234333+0000","last_became_active":"2024-02-21T22:52:50.789124+0000","last_became_peered":"2024-02-21T22:52:50.789124+0000","last_unstale":"2024-02-21T22:52:52.234333+0000","last_undegraded":"2024-02-21T22:52:52.234333+0000","last_fullsized":"2024-02-21T22:52:52.234333+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:10:56.108581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.233802+0000","last_change":"2024-02-21T22:52:50.787622+0000","last_active":"2024-02-21T22:52:52.233802+0000","last_peered":"2024-02-21T22:52:52.233802+0000","last_clean":"2024-02-21T22:52:52.233802+0000","last_became_active":"2024-02-21T22:52:50.787315+0000","last_became_peered":"2024-02-21T22:52:50.787315+0000","last_unstale":"2024-02-21T22:52:52.233802+0000","last_undegraded":"2024-02-21T22:52:52.233802+0000","last_fullsized":"2024-02-21T22:52:52.233802+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:07:39.283417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:51.792349+0000","last_change":"2024-02-21T22:52:50.785274+0000","last_active":"2024-02-21T22:52:51.792349+0000","last_peered":"2024-02-21T22:52:51.792349+0000","last_clean":"2024-02-21T22:52:51.792349+0000","last_became_active":"2024-02-21T22:52:50.784970+0000","last_became_peered":"2024-02-21T22:52:50.784970+0000","last_unstale":"2024-02-21T22:52:51.792349+0000","last_undegraded":"2024-02-21T22:52:51.792349+0000","last_fullsized":"2024-02-21T22:52:51.792349+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:17:34.365402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234235+0000","last_change":"2024-02-21T22:52:50.797804+0000","last_active":"2024-02-21T22:52:52.234235+0000","last_peered":"2024-02-21T22:52:52.234235+0000","last_clean":"2024-02-21T22:52:52.234235+0000","last_became_active":"2024-02-21T22:52:50.797414+0000","last_became_peered":"2024-02-21T22:52:50.797414+0000","last_unstale":"2024-02-21T22:52:52.234235+0000","last_undegraded":"2024-02-21T22:52:52.234235+0000","last_fullsized":"2024-02-21T22:52:52.234235+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:10:56.108581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234715+0000","last_change":"2024-02-21T22:52:50.808468+0000","last_active":"2024-02-21T22:52:52.234715+0000","last_peered":"2024-02-21T22:52:52.234715+0000","last_clean":"2024-02-21T22:52:52.234715+0000","last_became_active":"2024-02-21T22:52:50.808183+0000","last_became_peered":"2024-02-21T22:52:50.808183+0000","last_unstale":"2024-02-21T22:52:52.234715+0000","last_undegraded":"2024-02-21T22:52:52.234715+0000","last_fullsized":"2024-02-21T22:52:52.234715+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:22:02.404664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.233676+0000","last_change":"2024-02-21T22:52:50.789333+0000","last_active":"2024-02-21T22:52:52.233676+0000","last_peered":"2024-02-21T22:52:52.233676+0000","last_clean":"2024-02-21T22:52:52.233676+0000","last_became_active":"2024-02-21T22:52:50.789054+0000","last_became_peered":"2024-02-21T22:52:50.789054+0000","last_unstale":"2024-02-21T22:52:52.233676+0000","last_undegraded":"2024-02-21T22:52:52.233676+0000","last_fullsized":"2024-02-21T22:52:52.233676+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:31:51.565091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234606+0000","last_change":"2024-02-21T22:52:50.796065+0000","last_active":"2024-02-21T22:52:52.234606+0000","last_peered":"2024-02-21T22:52:52.234606+0000","last_clean":"2024-02-21T22:52:52.234606+0000","last_became_active":"2024-02-21T22:52:50.794895+0000","last_became_peered":"2024-02-21T22:52:50.794895+0000","last_unstale":"2024-02-21T22:52:52.234606+0000","last_undegraded":"2024-02-21T22:52:52.234606+0000","last_fullsized":"2024-02-21T22:52:52.234606+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:03:04.692215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:51.794890+0000","last_change":"2024-02-21T22:52:50.795221+0000","last_active":"2024-02-21T22:52:51.794890+0000","last_peered":"2024-02-21T22:52:51.794890+0000","last_clean":"2024-02-21T22:52:51.794890+0000","last_became_active":"2024-02-21T22:52:50.794693+0000","last_became_peered":"2024-02-21T22:52:50.794693+0000","last_unstale":"2024-02-21T22:52:51.794890+0000","last_undegraded":"2024-02-21T22:52:51.794890+0000","last_fullsized":"2024-02-21T22:52:51.794890+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T10:36:17.566817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234167+0000","last_change":"2024-02-21T22:52:50.793867+0000","last_active":"2024-02-21T22:52:52.234167+0000","last_peered":"2024-02-21T22:52:52.234167+0000","last_clean":"2024-02-21T22:52:52.234167+0000","last_became_active":"2024-02-21T22:52:50.793645+0000","last_became_peered":"2024-02-21T22:52:50.793645+0000","last_unstale":"2024-02-21T22:52:52.234167+0000","last_undegraded":"2024-02-21T22:52:52.234167+0000","last_fullsized":"2024-02-21T22:52:52.234167+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:25:58.111654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.233930+0000","last_change":"2024-02-21T22:52:50.807989+0000","last_active":"2024-02-21T22:52:52.233930+0000","last_peered":"2024-02-21T22:52:52.233930+0000","last_clean":"2024-02-21T22:52:52.233930+0000","last_became_active":"2024-02-21T22:52:50.807712+0000","last_became_peered":"2024-02-21T22:52:50.807712+0000","last_unstale":"2024-02-21T22:52:52.233930+0000","last_undegraded":"2024-02-21T22:52:52.233930+0000","last_fullsized":"2024-02-21T22:52:52.233930+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:36:16.855646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234410+0000","last_change":"2024-02-21T22:52:50.800936+0000","last_active":"2024-02-21T22:52:52.234410+0000","last_peered":"2024-02-21T22:52:52.234410+0000","last_clean":"2024-02-21T22:52:52.234410+0000","last_became_active":"2024-02-21T22:52:50.800431+0000","last_became_peered":"2024-02-21T22:52:50.800431+0000","last_unstale":"2024-02-21T22:52:52.234410+0000","last_undegraded":"2024-02-21T22:52:52.234410+0000","last_fullsized":"2024-02-21T22:52:52.234410+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:38:41.981414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234377+0000","last_change":"2024-02-21T22:52:50.805357+0000","last_active":"2024-02-21T22:52:52.234377+0000","last_peered":"2024-02-21T22:52:52.234377+0000","last_clean":"2024-02-21T22:52:52.234377+0000","last_became_active":"2024-02-21T22:52:50.805060+0000","last_became_peered":"2024-02-21T22:52:50.805060+0000","last_unstale":"2024-02-21T22:52:52.234377+0000","last_undegraded":"2024-02-21T22:52:52.234377+0000","last_fullsized":"2024-02-21T22:52:52.234377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:51:16.039745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234522+0000","last_change":"2024-02-21T22:52:50.797979+0000","last_active":"2024-02-21T22:52:52.234522+0000","last_peered":"2024-02-21T22:52:52.234522+0000","last_clean":"2024-02-21T22:52:52.234522+0000","last_became_active":"2024-02-21T22:52:50.797343+0000","last_became_peered":"2024-02-21T22:52:50.797343+0000","last_unstale":"2024-02-21T22:52:52.234522+0000","last_undegraded":"2024-02-21T22:52:52.234522+0000","last_fullsized":"2024-02-21T22:52:52.234522+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:25:14.399237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:51.795952+0000","last_change":"2024-02-21T22:52:50.797991+0000","last_active":"2024-02-21T22:52:51.795952+0000","last_peered":"2024-02-21T22:52:51.795952+0000","last_clean":"2024-02-21T22:52:51.795952+0000","last_became_active":"2024-02-21T22:52:50.797667+0000","last_became_peered":"2024-02-21T22:52:50.797667+0000","last_unstale":"2024-02-21T22:52:51.795952+0000","last_undegraded":"2024-02-21T22:52:51.795952+0000","last_fullsized":"2024-02-21T22:52:51.795952+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:33:40.513967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:51.792515+0000","last_change":"2024-02-21T22:52:50.788943+0000","last_active":"2024-02-21T22:52:51.792515+0000","last_peered":"2024-02-21T22:52:51.792515+0000","last_clean":"2024-02-21T22:52:51.792515+0000","last_became_active":"2024-02-21T22:52:50.788672+0000","last_became_peered":"2024-02-21T22:52:50.788672+0000","last_unstale":"2024-02-21T22:52:51.792515+0000","last_undegraded":"2024-02-21T22:52:51.792515+0000","last_fullsized":"2024-02-21T22:52:51.792515+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:25:58.111654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234510+0000","last_change":"2024-02-21T22:52:50.797663+0000","last_active":"2024-02-21T22:52:52.234510+0000","last_peered":"2024-02-21T22:52:52.234510+0000","last_clean":"2024-02-21T22:52:52.234510+0000","last_became_active":"2024-02-21T22:52:50.797359+0000","last_became_peered":"2024-02-21T22:52:50.797359+0000","last_unstale":"2024-02-21T22:52:52.234510+0000","last_undegraded":"2024-02-21T22:52:52.234510+0000","last_fullsized":"2024-02-21T22:52:52.234510+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:36:16.855646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234239+0000","last_change":"2024-02-21T22:52:50.788672+0000","last_active":"2024-02-21T22:52:52.234239+0000","last_peered":"2024-02-21T22:52:52.234239+0000","last_clean":"2024-02-21T22:52:52.234239+0000","last_became_active":"2024-02-21T22:52:50.788413+0000","last_became_peered":"2024-02-21T22:52:50.788413+0000","last_unstale":"2024-02-21T22:52:52.234239+0000","last_undegraded":"2024-02-21T22:52:52.234239+0000","last_fullsized":"2024-02-21T22:52:52.234239+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:33:40.513967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234286+0000","last_change":"2024-02-21T22:52:50.808763+0000","last_active":"2024-02-21T22:52:52.234286+0000","last_peered":"2024-02-21T22:52:52.234286+0000","last_clean":"2024-02-21T22:52:52.234286+0000","last_became_active":"2024-02-21T22:52:50.805917+0000","last_became_peered":"2024-02-21T22:52:50.805917+0000","last_unstale":"2024-02-21T22:52:52.234286+0000","last_undegraded":"2024-02-21T22:52:52.234286+0000","last_fullsized":"2024-02-21T22:52:52.234286+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:39:55.210527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.233575+0000","last_change":"2024-02-21T22:52:50.799649+0000","last_active":"2024-02-21T22:52:52.233575+0000","last_peered":"2024-02-21T22:52:52.233575+0000","last_clean":"2024-02-21T22:52:52.233575+0000","last_became_active":"2024-02-21T22:52:50.799372+0000","last_became_peered":"2024-02-21T22:52:50.799372+0000","last_unstale":"2024-02-21T22:52:52.233575+0000","last_undegraded":"2024-02-21T22:52:52.233575+0000","last_fullsized":"2024-02-21T22:52:52.233575+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:20:01.491741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:51.795278+0000","last_change":"2024-02-21T22:52:50.789389+0000","last_active":"2024-02-21T22:52:51.795278+0000","last_peered":"2024-02-21T22:52:51.795278+0000","last_clean":"2024-02-21T22:52:51.795278+0000","last_became_active":"2024-02-21T22:52:50.789121+0000","last_became_peered":"2024-02-21T22:52:50.789121+0000","last_unstale":"2024-02-21T22:52:51.795278+0000","last_undegraded":"2024-02-21T22:52:51.795278+0000","last_fullsized":"2024-02-21T22:52:51.795278+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:58:42.676518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:51.794985+0000","last_change":"2024-02-21T22:52:50.792014+0000","last_active":"2024-02-21T22:52:51.794985+0000","last_peered":"2024-02-21T22:52:51.794985+0000","last_clean":"2024-02-21T22:52:51.794985+0000","last_became_active":"2024-02-21T22:52:50.790916+0000","last_became_peered":"2024-02-21T22:52:50.790916+0000","last_unstale":"2024-02-21T22:52:51.794985+0000","last_undegraded":"2024-02-21T22:52:51.794985+0000","last_fullsized":"2024-02-21T22:52:51.794985+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:04:04.768586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234516+0000","last_change":"2024-02-21T22:52:49.786296+0000","last_active":"2024-02-21T22:52:52.234516+0000","last_peered":"2024-02-21T22:52:52.234516+0000","last_clean":"2024-02-21T22:52:52.234516+0000","last_became_active":"2024-02-21T22:52:49.785971+0000","last_became_peered":"2024-02-21T22:52:49.785971+0000","last_unstale":"2024-02-21T22:52:52.234516+0000","last_undegraded":"2024-02-21T22:52:52.234516+0000","last_fullsized":"2024-02-21T22:52:52.234516+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:23:17.385208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234297+0000","last_change":"2024-02-21T22:52:50.802188+0000","last_active":"2024-02-21T22:52:52.234297+0000","last_peered":"2024-02-21T22:52:52.234297+0000","last_clean":"2024-02-21T22:52:52.234297+0000","last_became_active":"2024-02-21T22:52:50.801916+0000","last_became_peered":"2024-02-21T22:52:50.801916+0000","last_unstale":"2024-02-21T22:52:52.234297+0000","last_undegraded":"2024-02-21T22:52:52.234297+0000","last_fullsized":"2024-02-21T22:52:52.234297+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:10:56.108581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:51.795043+0000","last_change":"2024-02-21T22:52:49.789667+0000","last_active":"2024-02-21T22:52:51.795043+0000","last_peered":"2024-02-21T22:52:51.795043+0000","last_clean":"2024-02-21T22:52:51.795043+0000","last_became_active":"2024-02-21T22:52:49.789375+0000","last_became_peered":"2024-02-21T22:52:49.789375+0000","last_unstale":"2024-02-21T22:52:51.795043+0000","last_undegraded":"2024-02-21T22:52:51.795043+0000","last_fullsized":"2024-02-21T22:52:51.795043+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:04:03.761477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234559+0000","last_change":"2024-02-21T22:52:49.785301+0000","last_active":"2024-02-21T22:52:52.234559+0000","last_peered":"2024-02-21T22:52:52.234559+0000","last_clean":"2024-02-21T22:52:52.234559+0000","last_became_active":"2024-02-21T22:52:49.784975+0000","last_became_peered":"2024-02-21T22:52:49.784975+0000","last_unstale":"2024-02-21T22:52:52.234559+0000","last_undegraded":"2024-02-21T22:52:52.234559+0000","last_fullsized":"2024-02-21T22:52:52.234559+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:57:47.487172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.233732+0000","last_change":"2024-02-21T22:52:50.792749+0000","last_active":"2024-02-21T22:52:52.233732+0000","last_peered":"2024-02-21T22:52:52.233732+0000","last_clean":"2024-02-21T22:52:52.233732+0000","last_became_active":"2024-02-21T22:52:50.792219+0000","last_became_peered":"2024-02-21T22:52:50.792219+0000","last_unstale":"2024-02-21T22:52:52.233732+0000","last_undegraded":"2024-02-21T22:52:52.233732+0000","last_fullsized":"2024-02-21T22:52:52.233732+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T10:36:17.566817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234473+0000","last_change":"2024-02-21T22:52:49.789709+0000","last_active":"2024-02-21T22:52:52.234473+0000","last_peered":"2024-02-21T22:52:52.234473+0000","last_clean":"2024-02-21T22:52:52.234473+0000","last_became_active":"2024-02-21T22:52:49.789393+0000","last_became_peered":"2024-02-21T22:52:49.789393+0000","last_unstale":"2024-02-21T22:52:52.234473+0000","last_undegraded":"2024-02-21T22:52:52.234473+0000","last_fullsized":"2024-02-21T22:52:52.234473+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:04:03.761477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:51.792319+0000","last_change":"2024-02-21T22:52:50.789201+0000","last_active":"2024-02-21T22:52:51.792319+0000","last_peered":"2024-02-21T22:52:51.792319+0000","last_clean":"2024-02-21T22:52:51.792319+0000","last_became_active":"2024-02-21T22:52:50.787792+0000","last_became_peered":"2024-02-21T22:52:50.787792+0000","last_unstale":"2024-02-21T22:52:51.792319+0000","last_undegraded":"2024-02-21T22:52:51.792319+0000","last_fullsized":"2024-02-21T22:52:51.792319+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:49:26.881791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:51.795081+0000","last_change":"2024-02-21T22:52:49.791132+0000","last_active":"2024-02-21T22:52:51.795081+0000","last_peered":"2024-02-21T22:52:51.795081+0000","last_clean":"2024-02-21T22:52:51.795081+0000","last_became_active":"2024-02-21T22:52:49.790747+0000","last_became_peered":"2024-02-21T22:52:49.790747+0000","last_unstale":"2024-02-21T22:52:51.795081+0000","last_undegraded":"2024-02-21T22:52:51.795081+0000","last_fullsized":"2024-02-21T22:52:51.795081+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:57:47.487172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234358+0000","last_change":"2024-02-21T22:52:50.808244+0000","last_active":"2024-02-21T22:52:52.234358+0000","last_peered":"2024-02-21T22:52:52.234358+0000","last_clean":"2024-02-21T22:52:52.234358+0000","last_became_active":"2024-02-21T22:52:50.807811+0000","last_became_peered":"2024-02-21T22:52:50.807811+0000","last_unstale":"2024-02-21T22:52:52.234358+0000","last_undegraded":"2024-02-21T22:52:52.234358+0000","last_fullsized":"2024-02-21T22:52:52.234358+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:32:36.066162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234444+0000","last_change":"2024-02-21T22:52:49.792899+0000","last_active":"2024-02-21T22:52:52.234444+0000","last_peered":"2024-02-21T22:52:52.234444+0000","last_clean":"2024-02-21T22:52:52.234444+0000","last_became_active":"2024-02-21T22:52:49.792617+0000","last_became_peered":"2024-02-21T22:52:49.792617+0000","last_unstale":"2024-02-21T22:52:52.234444+0000","last_undegraded":"2024-02-21T22:52:52.234444+0000","last_fullsized":"2024-02-21T22:52:52.234444+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:06:28.817953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234067+0000","last_change":"2024-02-21T22:52:50.803201+0000","last_active":"2024-02-21T22:52:52.234067+0000","last_peered":"2024-02-21T22:52:52.234067+0000","last_clean":"2024-02-21T22:52:52.234067+0000","last_became_active":"2024-02-21T22:52:50.801870+0000","last_became_peered":"2024-02-21T22:52:50.801870+0000","last_unstale":"2024-02-21T22:52:52.234067+0000","last_undegraded":"2024-02-21T22:52:52.234067+0000","last_fullsized":"2024-02-21T22:52:52.234067+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:17:34.365402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:51.792522+0000","last_change":"2024-02-21T22:52:49.793191+0000","last_active":"2024-02-21T22:52:51.792522+0000","last_peered":"2024-02-21T22:52:51.792522+0000","last_clean":"2024-02-21T22:52:51.792522+0000","last_became_active":"2024-02-21T22:52:49.791992+0000","last_became_peered":"2024-02-21T22:52:49.791992+0000","last_unstale":"2024-02-21T22:52:51.792522+0000","last_undegraded":"2024-02-21T22:52:51.792522+0000","last_fullsized":"2024-02-21T22:52:51.792522+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:04:03.761477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:51.795759+0000","last_change":"2024-02-21T22:52:50.796850+0000","last_active":"2024-02-21T22:52:51.795759+0000","last_peered":"2024-02-21T22:52:51.795759+0000","last_clean":"2024-02-21T22:52:51.795759+0000","last_became_active":"2024-02-21T22:52:50.796589+0000","last_became_peered":"2024-02-21T22:52:50.796589+0000","last_unstale":"2024-02-21T22:52:51.795759+0000","last_undegraded":"2024-02-21T22:52:51.795759+0000","last_fullsized":"2024-02-21T22:52:51.795759+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:06:29.825061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:51.795352+0000","last_change":"2024-02-21T22:52:49.785392+0000","last_active":"2024-02-21T22:52:51.795352+0000","last_peered":"2024-02-21T22:52:51.795352+0000","last_clean":"2024-02-21T22:52:51.795352+0000","last_became_active":"2024-02-21T22:52:49.784936+0000","last_became_peered":"2024-02-21T22:52:49.784936+0000","last_unstale":"2024-02-21T22:52:51.795352+0000","last_undegraded":"2024-02-21T22:52:51.795352+0000","last_fullsized":"2024-02-21T22:52:51.795352+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:01:23.165721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234195+0000","last_change":"2024-02-21T22:52:50.793898+0000","last_active":"2024-02-21T22:52:52.234195+0000","last_peered":"2024-02-21T22:52:52.234195+0000","last_clean":"2024-02-21T22:52:52.234195+0000","last_became_active":"2024-02-21T22:52:50.793620+0000","last_became_peered":"2024-02-21T22:52:50.793620+0000","last_unstale":"2024-02-21T22:52:52.234195+0000","last_undegraded":"2024-02-21T22:52:52.234195+0000","last_fullsized":"2024-02-21T22:52:52.234195+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:13:03.777546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234350+0000","last_change":"2024-02-21T22:52:49.794586+0000","last_active":"2024-02-21T22:52:52.234350+0000","last_peered":"2024-02-21T22:52:52.234350+0000","last_clean":"2024-02-21T22:52:52.234350+0000","last_became_active":"2024-02-21T22:52:49.794288+0000","last_became_peered":"2024-02-21T22:52:49.794288+0000","last_unstale":"2024-02-21T22:52:52.234350+0000","last_undegraded":"2024-02-21T22:52:52.234350+0000","last_fullsized":"2024-02-21T22:52:52.234350+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:37:35.716112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.233964+0000","last_change":"2024-02-21T22:52:50.793467+0000","last_active":"2024-02-21T22:52:52.233964+0000","last_peered":"2024-02-21T22:52:52.233964+0000","last_clean":"2024-02-21T22:52:52.233964+0000","last_became_active":"2024-02-21T22:52:50.793160+0000","last_became_peered":"2024-02-21T22:52:50.793160+0000","last_unstale":"2024-02-21T22:52:52.233964+0000","last_undegraded":"2024-02-21T22:52:52.233964+0000","last_fullsized":"2024-02-21T22:52:52.233964+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T10:36:17.566817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234478+0000","last_change":"2024-02-21T22:52:49.793628+0000","last_active":"2024-02-21T22:52:52.234478+0000","last_peered":"2024-02-21T22:52:52.234478+0000","last_clean":"2024-02-21T22:52:52.234478+0000","last_became_active":"2024-02-21T22:52:49.793291+0000","last_became_peered":"2024-02-21T22:52:49.793291+0000","last_unstale":"2024-02-21T22:52:52.234478+0000","last_undegraded":"2024-02-21T22:52:52.234478+0000","last_fullsized":"2024-02-21T22:52:52.234478+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:29:57.623490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234378+0000","last_change":"2024-02-21T22:52:50.809208+0000","last_active":"2024-02-21T22:52:52.234378+0000","last_peered":"2024-02-21T22:52:52.234378+0000","last_clean":"2024-02-21T22:52:52.234378+0000","last_became_active":"2024-02-21T22:52:50.808950+0000","last_became_peered":"2024-02-21T22:52:50.808950+0000","last_unstale":"2024-02-21T22:52:52.234378+0000","last_undegraded":"2024-02-21T22:52:52.234378+0000","last_fullsized":"2024-02-21T22:52:52.234378+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:51:16.039745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:51.794655+0000","last_change":"2024-02-21T22:52:49.788987+0000","last_active":"2024-02-21T22:52:51.794655+0000","last_peered":"2024-02-21T22:52:51.794655+0000","last_clean":"2024-02-21T22:52:51.794655+0000","last_became_active":"2024-02-21T22:52:49.788704+0000","last_became_peered":"2024-02-21T22:52:49.788704+0000","last_unstale":"2024-02-21T22:52:51.794655+0000","last_undegraded":"2024-02-21T22:52:51.794655+0000","last_fullsized":"2024-02-21T22:52:51.794655+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T10:42:14.273761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:51.795107+0000","last_change":"2024-02-21T22:52:50.789680+0000","last_active":"2024-02-21T22:52:51.795107+0000","last_peered":"2024-02-21T22:52:51.795107+0000","last_clean":"2024-02-21T22:52:51.795107+0000","last_became_active":"2024-02-21T22:52:50.788648+0000","last_became_peered":"2024-02-21T22:52:50.788648+0000","last_unstale":"2024-02-21T22:52:51.795107+0000","last_undegraded":"2024-02-21T22:52:51.795107+0000","last_fullsized":"2024-02-21T22:52:51.795107+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:25:58.111654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.233423+0000","last_change":"2024-02-21T22:52:49.783735+0000","last_active":"2024-02-21T22:52:52.233423+0000","last_peered":"2024-02-21T22:52:52.233423+0000","last_clean":"2024-02-21T22:52:52.233423+0000","last_became_active":"2024-02-21T22:52:49.783350+0000","last_became_peered":"2024-02-21T22:52:49.783350+0000","last_unstale":"2024-02-21T22:52:52.233423+0000","last_undegraded":"2024-02-21T22:52:52.233423+0000","last_fullsized":"2024-02-21T22:52:52.233423+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:57:47.487172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.233816+0000","last_change":"2024-02-21T22:52:50.808882+0000","last_active":"2024-02-21T22:52:52.233816+0000","last_peered":"2024-02-21T22:52:52.233816+0000","last_clean":"2024-02-21T22:52:52.233816+0000","last_became_active":"2024-02-21T22:52:50.808584+0000","last_became_peered":"2024-02-21T22:52:50.808584+0000","last_unstale":"2024-02-21T22:52:52.233816+0000","last_undegraded":"2024-02-21T22:52:52.233816+0000","last_fullsized":"2024-02-21T22:52:52.233816+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:36:16.855646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:51.795199+0000","last_change":"2024-02-21T22:52:49.792856+0000","last_active":"2024-02-21T22:52:51.795199+0000","last_peered":"2024-02-21T22:52:51.795199+0000","last_clean":"2024-02-21T22:52:51.795199+0000","last_became_active":"2024-02-21T22:52:49.792509+0000","last_became_peered":"2024-02-21T22:52:49.792509+0000","last_unstale":"2024-02-21T22:52:51.795199+0000","last_undegraded":"2024-02-21T22:52:51.795199+0000","last_fullsized":"2024-02-21T22:52:51.795199+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:12:21.047751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234103+0000","last_change":"2024-02-21T22:52:50.808696+0000","last_active":"2024-02-21T22:52:52.234103+0000","last_peered":"2024-02-21T22:52:52.234103+0000","last_clean":"2024-02-21T22:52:52.234103+0000","last_became_active":"2024-02-21T22:52:50.808416+0000","last_became_peered":"2024-02-21T22:52:50.808416+0000","last_unstale":"2024-02-21T22:52:52.234103+0000","last_undegraded":"2024-02-21T22:52:52.234103+0000","last_fullsized":"2024-02-21T22:52:52.234103+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:02:22.212238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.233760+0000","last_change":"2024-02-21T22:52:49.789756+0000","last_active":"2024-02-21T22:52:52.233760+0000","last_peered":"2024-02-21T22:52:52.233760+0000","last_clean":"2024-02-21T22:52:52.233760+0000","last_became_active":"2024-02-21T22:52:49.789447+0000","last_became_peered":"2024-02-21T22:52:49.789447+0000","last_unstale":"2024-02-21T22:52:52.233760+0000","last_undegraded":"2024-02-21T22:52:52.233760+0000","last_fullsized":"2024-02-21T22:52:52.233760+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:01:23.165721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234491+0000","last_change":"2024-02-21T22:52:50.809468+0000","last_active":"2024-02-21T22:52:52.234491+0000","last_peered":"2024-02-21T22:52:52.234491+0000","last_clean":"2024-02-21T22:52:52.234491+0000","last_became_active":"2024-02-21T22:52:50.809053+0000","last_became_peered":"2024-02-21T22:52:50.809053+0000","last_unstale":"2024-02-21T22:52:52.234491+0000","last_undegraded":"2024-02-21T22:52:52.234491+0000","last_fullsized":"2024-02-21T22:52:52.234491+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:22:02.404664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:51.792607+0000","last_change":"2024-02-21T22:52:49.791174+0000","last_active":"2024-02-21T22:52:51.792607+0000","last_peered":"2024-02-21T22:52:51.792607+0000","last_clean":"2024-02-21T22:52:51.792607+0000","last_became_active":"2024-02-21T22:52:49.790885+0000","last_became_peered":"2024-02-21T22:52:49.790885+0000","last_unstale":"2024-02-21T22:52:51.792607+0000","last_undegraded":"2024-02-21T22:52:51.792607+0000","last_fullsized":"2024-02-21T22:52:51.792607+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:06:28.817953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234062+0000","last_change":"2024-02-21T22:52:50.802420+0000","last_active":"2024-02-21T22:52:52.234062+0000","last_peered":"2024-02-21T22:52:52.234062+0000","last_clean":"2024-02-21T22:52:52.234062+0000","last_became_active":"2024-02-21T22:52:50.801980+0000","last_became_peered":"2024-02-21T22:52:50.801980+0000","last_unstale":"2024-02-21T22:52:52.234062+0000","last_undegraded":"2024-02-21T22:52:52.234062+0000","last_fullsized":"2024-02-21T22:52:52.234062+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:02:22.212238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.233717+0000","last_change":"2024-02-21T22:52:49.787772+0000","last_active":"2024-02-21T22:52:52.233717+0000","last_peered":"2024-02-21T22:52:52.233717+0000","last_clean":"2024-02-21T22:52:52.233717+0000","last_became_active":"2024-02-21T22:52:49.787483+0000","last_became_peered":"2024-02-21T22:52:49.787483+0000","last_unstale":"2024-02-21T22:52:52.233717+0000","last_undegraded":"2024-02-21T22:52:52.233717+0000","last_fullsized":"2024-02-21T22:52:52.233717+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:04:03.761477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234346+0000","last_change":"2024-02-21T22:52:50.801710+0000","last_active":"2024-02-21T22:52:52.234346+0000","last_peered":"2024-02-21T22:52:52.234346+0000","last_clean":"2024-02-21T22:52:52.234346+0000","last_became_active":"2024-02-21T22:52:50.801446+0000","last_became_peered":"2024-02-21T22:52:50.801446+0000","last_unstale":"2024-02-21T22:52:52.234346+0000","last_undegraded":"2024-02-21T22:52:52.234346+0000","last_fullsized":"2024-02-21T22:52:52.234346+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:39:55.210527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":170,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.233578+0000","last_change":"2024-02-21T22:52:40.336187+0000","last_active":"2024-02-21T22:52:52.233578+0000","last_peered":"2024-02-21T22:52:52.233578+0000","last_clean":"2024-02-21T22:52:52.233578+0000","last_became_active":"2024-02-21T22:52:40.335061+0000","last_became_peered":"2024-02-21T22:52:40.335061+0000","last_unstale":"2024-02-21T22:52:52.233578+0000","last_undegraded":"2024-02-21T22:52:52.233578+0000","last_fullsized":"2024-02-21T22:52:52.233578+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:38.328863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:38.328863+0000","last_clean_scrub_stamp":"2024-02-21T22:52:38.328863+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:33:53.012414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.233685+0000","last_change":"2024-02-21T22:52:49.787124+0000","last_active":"2024-02-21T22:52:52.233685+0000","last_peered":"2024-02-21T22:52:52.233685+0000","last_clean":"2024-02-21T22:52:52.233685+0000","last_became_active":"2024-02-21T22:52:49.786800+0000","last_became_peered":"2024-02-21T22:52:49.786800+0000","last_unstale":"2024-02-21T22:52:52.233685+0000","last_undegraded":"2024-02-21T22:52:52.233685+0000","last_fullsized":"2024-02-21T22:52:52.233685+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:01:23.165721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.233943+0000","last_change":"2024-02-21T22:52:50.800508+0000","last_active":"2024-02-21T22:52:52.233943+0000","last_peered":"2024-02-21T22:52:52.233943+0000","last_clean":"2024-02-21T22:52:52.233943+0000","last_became_active":"2024-02-21T22:52:50.800215+0000","last_became_peered":"2024-02-21T22:52:50.800215+0000","last_unstale":"2024-02-21T22:52:52.233943+0000","last_undegraded":"2024-02-21T22:52:52.233943+0000","last_fullsized":"2024-02-21T22:52:52.233943+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:25:58.111654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.233509+0000","last_change":"2024-02-21T22:52:49.788881+0000","last_active":"2024-02-21T22:52:52.233509+0000","last_peered":"2024-02-21T22:52:52.233509+0000","last_clean":"2024-02-21T22:52:52.233509+0000","last_became_active":"2024-02-21T22:52:49.788611+0000","last_became_peered":"2024-02-21T22:52:49.788611+0000","last_unstale":"2024-02-21T22:52:52.233509+0000","last_undegraded":"2024-02-21T22:52:52.233509+0000","last_fullsized":"2024-02-21T22:52:52.233509+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T10:42:14.273761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.233594+0000","last_change":"2024-02-21T22:52:50.801343+0000","last_active":"2024-02-21T22:52:52.233594+0000","last_peered":"2024-02-21T22:52:52.233594+0000","last_clean":"2024-02-21T22:52:52.233594+0000","last_became_active":"2024-02-21T22:52:50.801029+0000","last_became_peered":"2024-02-21T22:52:50.801029+0000","last_unstale":"2024-02-21T22:52:52.233594+0000","last_undegraded":"2024-02-21T22:52:52.233594+0000","last_fullsized":"2024-02-21T22:52:52.233594+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:00:31.831396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.233662+0000","last_change":"2024-02-21T22:52:49.790068+0000","last_active":"2024-02-21T22:52:52.233662+0000","last_peered":"2024-02-21T22:52:52.233662+0000","last_clean":"2024-02-21T22:52:52.233662+0000","last_became_active":"2024-02-21T22:52:49.789766+0000","last_became_peered":"2024-02-21T22:52:49.789766+0000","last_unstale":"2024-02-21T22:52:52.233662+0000","last_undegraded":"2024-02-21T22:52:52.233662+0000","last_fullsized":"2024-02-21T22:52:52.233662+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T10:42:14.273761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:51.792345+0000","last_change":"2024-02-21T22:52:50.787018+0000","last_active":"2024-02-21T22:52:51.792345+0000","last_peered":"2024-02-21T22:52:51.792345+0000","last_clean":"2024-02-21T22:52:51.792345+0000","last_became_active":"2024-02-21T22:52:50.786695+0000","last_became_peered":"2024-02-21T22:52:50.786695+0000","last_unstale":"2024-02-21T22:52:51.792345+0000","last_undegraded":"2024-02-21T22:52:51.792345+0000","last_fullsized":"2024-02-21T22:52:51.792345+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T10:36:17.566817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234569+0000","last_change":"2024-02-21T22:52:49.789752+0000","last_active":"2024-02-21T22:52:52.234569+0000","last_peered":"2024-02-21T22:52:52.234569+0000","last_clean":"2024-02-21T22:52:52.234569+0000","last_became_active":"2024-02-21T22:52:49.789375+0000","last_became_peered":"2024-02-21T22:52:49.789375+0000","last_unstale":"2024-02-21T22:52:52.234569+0000","last_undegraded":"2024-02-21T22:52:52.234569+0000","last_fullsized":"2024-02-21T22:52:52.234569+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T10:42:14.273761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:51.795446+0000","last_change":"2024-02-21T22:52:50.791657+0000","last_active":"2024-02-21T22:52:51.795446+0000","last_peered":"2024-02-21T22:52:51.795446+0000","last_clean":"2024-02-21T22:52:51.795446+0000","last_became_active":"2024-02-21T22:52:50.791419+0000","last_became_peered":"2024-02-21T22:52:50.791419+0000","last_unstale":"2024-02-21T22:52:51.795446+0000","last_undegraded":"2024-02-21T22:52:51.795446+0000","last_fullsized":"2024-02-21T22:52:51.795446+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T10:42:15.280869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:51.792606+0000","last_change":"2024-02-21T22:52:49.793130+0000","last_active":"2024-02-21T22:52:51.792606+0000","last_peered":"2024-02-21T22:52:51.792606+0000","last_clean":"2024-02-21T22:52:51.792606+0000","last_became_active":"2024-02-21T22:52:49.792824+0000","last_became_peered":"2024-02-21T22:52:49.792824+0000","last_unstale":"2024-02-21T22:52:51.792606+0000","last_undegraded":"2024-02-21T22:52:51.792606+0000","last_fullsized":"2024-02-21T22:52:51.792606+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:01:23.165721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234113+0000","last_change":"2024-02-21T22:52:50.806582+0000","last_active":"2024-02-21T22:52:52.234113+0000","last_peered":"2024-02-21T22:52:52.234113+0000","last_clean":"2024-02-21T22:52:52.234113+0000","last_became_active":"2024-02-21T22:52:50.806257+0000","last_became_peered":"2024-02-21T22:52:50.806257+0000","last_unstale":"2024-02-21T22:52:52.234113+0000","last_undegraded":"2024-02-21T22:52:52.234113+0000","last_fullsized":"2024-02-21T22:52:52.234113+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:13:03.777546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234594+0000","last_change":"2024-02-21T22:52:49.793178+0000","last_active":"2024-02-21T22:52:52.234594+0000","last_peered":"2024-02-21T22:52:52.234594+0000","last_clean":"2024-02-21T22:52:52.234594+0000","last_became_active":"2024-02-21T22:52:49.792301+0000","last_became_peered":"2024-02-21T22:52:49.792301+0000","last_unstale":"2024-02-21T22:52:52.234594+0000","last_undegraded":"2024-02-21T22:52:52.234594+0000","last_fullsized":"2024-02-21T22:52:52.234594+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:53:50.332475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:51.792632+0000","last_change":"2024-02-21T22:52:50.785491+0000","last_active":"2024-02-21T22:52:51.792632+0000","last_peered":"2024-02-21T22:52:51.792632+0000","last_clean":"2024-02-21T22:52:51.792632+0000","last_became_active":"2024-02-21T22:52:50.785220+0000","last_became_peered":"2024-02-21T22:52:50.785220+0000","last_unstale":"2024-02-21T22:52:51.792632+0000","last_undegraded":"2024-02-21T22:52:51.792632+0000","last_fullsized":"2024-02-21T22:52:51.792632+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:33:40.513967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:51.796299+0000","last_change":"2024-02-21T22:52:49.787159+0000","last_active":"2024-02-21T22:52:51.796299+0000","last_peered":"2024-02-21T22:52:51.796299+0000","last_clean":"2024-02-21T22:52:51.796299+0000","last_became_active":"2024-02-21T22:52:49.786876+0000","last_became_peered":"2024-02-21T22:52:49.786876+0000","last_unstale":"2024-02-21T22:52:51.796299+0000","last_undegraded":"2024-02-21T22:52:51.796299+0000","last_fullsized":"2024-02-21T22:52:51.796299+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:20:00.484633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234594+0000","last_change":"2024-02-21T22:52:50.794174+0000","last_active":"2024-02-21T22:52:52.234594+0000","last_peered":"2024-02-21T22:52:52.234594+0000","last_clean":"2024-02-21T22:52:52.234594+0000","last_became_active":"2024-02-21T22:52:50.793881+0000","last_became_peered":"2024-02-21T22:52:50.793881+0000","last_unstale":"2024-02-21T22:52:52.234594+0000","last_undegraded":"2024-02-21T22:52:52.234594+0000","last_fullsized":"2024-02-21T22:52:52.234594+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:02:22.212238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:51.795185+0000","last_change":"2024-02-21T22:52:49.790424+0000","last_active":"2024-02-21T22:52:51.795185+0000","last_peered":"2024-02-21T22:52:51.795185+0000","last_clean":"2024-02-21T22:52:51.795185+0000","last_became_active":"2024-02-21T22:52:49.790147+0000","last_became_peered":"2024-02-21T22:52:49.790147+0000","last_unstale":"2024-02-21T22:52:51.795185+0000","last_undegraded":"2024-02-21T22:52:51.795185+0000","last_fullsized":"2024-02-21T22:52:51.795185+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:23:17.385208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.233852+0000","last_change":"2024-02-21T22:52:50.790678+0000","last_active":"2024-02-21T22:52:52.233852+0000","last_peered":"2024-02-21T22:52:52.233852+0000","last_clean":"2024-02-21T22:52:52.233852+0000","last_became_active":"2024-02-21T22:52:50.790415+0000","last_became_peered":"2024-02-21T22:52:50.790415+0000","last_unstale":"2024-02-21T22:52:52.233852+0000","last_undegraded":"2024-02-21T22:52:52.233852+0000","last_fullsized":"2024-02-21T22:52:52.233852+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:58:42.676518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.233605+0000","last_change":"2024-02-21T22:52:49.794656+0000","last_active":"2024-02-21T22:52:52.233605+0000","last_peered":"2024-02-21T22:52:52.233605+0000","last_clean":"2024-02-21T22:52:52.233605+0000","last_became_active":"2024-02-21T22:52:49.794394+0000","last_became_peered":"2024-02-21T22:52:49.794394+0000","last_unstale":"2024-02-21T22:52:52.233605+0000","last_undegraded":"2024-02-21T22:52:52.233605+0000","last_fullsized":"2024-02-21T22:52:52.233605+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:29:57.623490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:51.795821+0000","last_change":"2024-02-21T22:52:50.792184+0000","last_active":"2024-02-21T22:52:51.795821+0000","last_peered":"2024-02-21T22:52:51.795821+0000","last_clean":"2024-02-21T22:52:51.795821+0000","last_became_active":"2024-02-21T22:52:50.791180+0000","last_became_peered":"2024-02-21T22:52:50.791180+0000","last_unstale":"2024-02-21T22:52:51.795821+0000","last_undegraded":"2024-02-21T22:52:51.795821+0000","last_fullsized":"2024-02-21T22:52:51.795821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:20:01.491741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:51.792408+0000","last_change":"2024-02-21T22:52:49.791409+0000","last_active":"2024-02-21T22:52:51.792408+0000","last_peered":"2024-02-21T22:52:51.792408+0000","last_clean":"2024-02-21T22:52:51.792408+0000","last_became_active":"2024-02-21T22:52:49.791124+0000","last_became_peered":"2024-02-21T22:52:49.791124+0000","last_unstale":"2024-02-21T22:52:51.792408+0000","last_undegraded":"2024-02-21T22:52:51.792408+0000","last_fullsized":"2024-02-21T22:52:51.792408+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T10:42:14.273761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.233884+0000","last_change":"2024-02-21T22:52:50.790359+0000","last_active":"2024-02-21T22:52:52.233884+0000","last_peered":"2024-02-21T22:52:52.233884+0000","last_clean":"2024-02-21T22:52:52.233884+0000","last_became_active":"2024-02-21T22:52:50.790083+0000","last_became_peered":"2024-02-21T22:52:50.790083+0000","last_unstale":"2024-02-21T22:52:52.233884+0000","last_undegraded":"2024-02-21T22:52:52.233884+0000","last_fullsized":"2024-02-21T22:52:52.233884+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:17:34.365402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:51.792512+0000","last_change":"2024-02-21T22:52:49.786337+0000","last_active":"2024-02-21T22:52:51.792512+0000","last_peered":"2024-02-21T22:52:51.792512+0000","last_clean":"2024-02-21T22:52:51.792512+0000","last_became_active":"2024-02-21T22:52:49.786058+0000","last_became_peered":"2024-02-21T22:52:49.786058+0000","last_unstale":"2024-02-21T22:52:51.792512+0000","last_undegraded":"2024-02-21T22:52:51.792512+0000","last_fullsized":"2024-02-21T22:52:51.792512+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:29:57.623490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234482+0000","last_change":"2024-02-21T22:52:50.792676+0000","last_active":"2024-02-21T22:52:52.234482+0000","last_peered":"2024-02-21T22:52:52.234482+0000","last_clean":"2024-02-21T22:52:52.234482+0000","last_became_active":"2024-02-21T22:52:50.792330+0000","last_became_peered":"2024-02-21T22:52:50.792330+0000","last_unstale":"2024-02-21T22:52:52.234482+0000","last_undegraded":"2024-02-21T22:52:52.234482+0000","last_fullsized":"2024-02-21T22:52:52.234482+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T02:49:51.875007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234484+0000","last_change":"2024-02-21T22:52:49.791921+0000","last_active":"2024-02-21T22:52:52.234484+0000","last_peered":"2024-02-21T22:52:52.234484+0000","last_clean":"2024-02-21T22:52:52.234484+0000","last_became_active":"2024-02-21T22:52:49.791614+0000","last_became_peered":"2024-02-21T22:52:49.791614+0000","last_unstale":"2024-02-21T22:52:52.234484+0000","last_undegraded":"2024-02-21T22:52:52.234484+0000","last_fullsized":"2024-02-21T22:52:52.234484+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:06:28.817953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:51.794942+0000","last_change":"2024-02-21T22:52:50.794820+0000","last_active":"2024-02-21T22:52:51.794942+0000","last_peered":"2024-02-21T22:52:51.794942+0000","last_clean":"2024-02-21T22:52:51.794942+0000","last_became_active":"2024-02-21T22:52:50.794504+0000","last_became_peered":"2024-02-21T22:52:50.794504+0000","last_unstale":"2024-02-21T22:52:51.794942+0000","last_undegraded":"2024-02-21T22:52:51.794942+0000","last_fullsized":"2024-02-21T22:52:51.794942+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:17:34.365402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.233975+0000","last_change":"2024-02-21T22:52:50.806225+0000","last_active":"2024-02-21T22:52:52.233975+0000","last_peered":"2024-02-21T22:52:52.233975+0000","last_clean":"2024-02-21T22:52:52.233975+0000","last_became_active":"2024-02-21T22:52:50.805867+0000","last_became_peered":"2024-02-21T22:52:50.805867+0000","last_unstale":"2024-02-21T22:52:52.233975+0000","last_undegraded":"2024-02-21T22:52:52.233975+0000","last_fullsized":"2024-02-21T22:52:52.233975+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:25:14.399237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234362+0000","last_change":"2024-02-21T22:52:49.791427+0000","last_active":"2024-02-21T22:52:52.234362+0000","last_peered":"2024-02-21T22:52:52.234362+0000","last_clean":"2024-02-21T22:52:52.234362+0000","last_became_active":"2024-02-21T22:52:49.790879+0000","last_became_peered":"2024-02-21T22:52:49.790879+0000","last_unstale":"2024-02-21T22:52:52.234362+0000","last_undegraded":"2024-02-21T22:52:52.234362+0000","last_fullsized":"2024-02-21T22:52:52.234362+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:20:00.484633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234211+0000","last_change":"2024-02-21T22:52:50.804074+0000","last_active":"2024-02-21T22:52:52.234211+0000","last_peered":"2024-02-21T22:52:52.234211+0000","last_clean":"2024-02-21T22:52:52.234211+0000","last_became_active":"2024-02-21T22:52:50.803759+0000","last_became_peered":"2024-02-21T22:52:50.803759+0000","last_unstale":"2024-02-21T22:52:52.234211+0000","last_undegraded":"2024-02-21T22:52:52.234211+0000","last_fullsized":"2024-02-21T22:52:52.234211+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:06:29.082788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234445+0000","last_change":"2024-02-21T22:52:49.790281+0000","last_active":"2024-02-21T22:52:52.234445+0000","last_peered":"2024-02-21T22:52:52.234445+0000","last_clean":"2024-02-21T22:52:52.234445+0000","last_became_active":"2024-02-21T22:52:49.790023+0000","last_became_peered":"2024-02-21T22:52:49.790023+0000","last_unstale":"2024-02-21T22:52:52.234445+0000","last_undegraded":"2024-02-21T22:52:52.234445+0000","last_fullsized":"2024-02-21T22:52:52.234445+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:31:50.557983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.233936+0000","last_change":"2024-02-21T22:52:50.801839+0000","last_active":"2024-02-21T22:52:52.233936+0000","last_peered":"2024-02-21T22:52:52.233936+0000","last_clean":"2024-02-21T22:52:52.233936+0000","last_became_active":"2024-02-21T22:52:50.801499+0000","last_became_peered":"2024-02-21T22:52:50.801499+0000","last_unstale":"2024-02-21T22:52:52.233936+0000","last_undegraded":"2024-02-21T22:52:52.233936+0000","last_fullsized":"2024-02-21T22:52:52.233936+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:49:26.881791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234190+0000","last_change":"2024-02-21T22:52:49.792448+0000","last_active":"2024-02-21T22:52:52.234190+0000","last_peered":"2024-02-21T22:52:52.234190+0000","last_clean":"2024-02-21T22:52:52.234190+0000","last_became_active":"2024-02-21T22:52:49.792116+0000","last_became_peered":"2024-02-21T22:52:49.792116+0000","last_unstale":"2024-02-21T22:52:52.234190+0000","last_undegraded":"2024-02-21T22:52:52.234190+0000","last_fullsized":"2024-02-21T22:52:52.234190+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:34:55.953292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234013+0000","last_change":"2024-02-21T22:52:50.791072+0000","last_active":"2024-02-21T22:52:52.234013+0000","last_peered":"2024-02-21T22:52:52.234013+0000","last_clean":"2024-02-21T22:52:52.234013+0000","last_became_active":"2024-02-21T22:52:50.790784+0000","last_became_peered":"2024-02-21T22:52:50.790784+0000","last_unstale":"2024-02-21T22:52:52.234013+0000","last_undegraded":"2024-02-21T22:52:52.234013+0000","last_fullsized":"2024-02-21T22:52:52.234013+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:33:40.513967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234149+0000","last_change":"2024-02-21T22:52:49.792852+0000","last_active":"2024-02-21T22:52:52.234149+0000","last_peered":"2024-02-21T22:52:52.234149+0000","last_clean":"2024-02-21T22:52:52.234149+0000","last_became_active":"2024-02-21T22:52:49.792580+0000","last_became_peered":"2024-02-21T22:52:49.792580+0000","last_unstale":"2024-02-21T22:52:52.234149+0000","last_undegraded":"2024-02-21T22:52:52.234149+0000","last_fullsized":"2024-02-21T22:52:52.234149+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:34:55.953292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":802816,"data_stored":661884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":208896,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":71060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":70934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":212992,"data_stored":71094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":811008,"data_stored":661940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-21T22:53:02.428 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-21T22:53:02.565 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.574+0000 7fa42cd08640 1 Processor -- start 2024-02-21T22:53:02.565 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.574+0000 7fa42cd08640 1 -- start start 2024-02-21T22:53:02.566 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.575+0000 7fa42cd08640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fa4280afa80 0x7fa4280b5990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:02.566 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.575+0000 7fa42cd08640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa42806b550 0x7fa4280b0220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:02.566 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.575+0000 7fa42cd08640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4280afe60 con 0x7fa4280b5ed0 2024-02-21T22:53:02.566 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.575+0000 7fa42cd08640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4280b5500 con 0x7fa4280afa80 2024-02-21T22:53:02.566 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.575+0000 7fa42cd08640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa42815f510 con 0x7fa42806b550 2024-02-21T22:53:02.566 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.575+0000 7fa42659c640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fa4280afa80 0x7fa4280b5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:02.566 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.575+0000 7fa42659c640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fa4280afa80 0x7fa4280b5990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:34442/0 (socket says 172.21.15.116:34442) 2024-02-21T22:53:02.566 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.575+0000 7fa42659c640 1 -- 172.21.15.116:0/2483153551 learned_addr learned my addr 172.21.15.116:0/2483153551 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:02.566 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.575+0000 7fa426d9d640 1 --2- 172.21.15.116:0/2483153551 >> v2:172.21.15.142:3300/0 conn(0x7fa42806b550 0x7fa4280b0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:02.567 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.575+0000 7fa42659c640 1 -- 172.21.15.116:0/2483153551 >> v2:172.21.15.142:3300/0 conn(0x7fa42806b550 msgr2=0x7fa4280b0220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:53:02.567 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.575+0000 7fa42659c640 1 --2- 172.21.15.116:0/2483153551 >> v2:172.21.15.142:3300/0 conn(0x7fa42806b550 0x7fa4280b0220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:02.567 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.575+0000 7fa42659c640 1 -- 172.21.15.116:0/2483153551 >> v1:172.21.15.142:6789/0 conn(0x7fa4280b5ed0 legacy=0x7fa42806ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:02.567 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.575+0000 7fa42659c640 1 -- 172.21.15.116:0/2483153551 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa42815f7f0 con 0x7fa4280afa80 2024-02-21T22:53:02.568 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.576+0000 7fa42659c640 1 --2- 172.21.15.116:0/2483153551 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa4280afa80 0x7fa4280b5990 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa4280720b0 tx=0x7fa41802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6694d954523e7fbf server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:02.568 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.576+0000 7fa42559a640 1 -- 172.21.15.116:0/2483153551 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa418034070 con 0x7fa4280afa80 2024-02-21T22:53:02.568 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.576+0000 7fa42559a640 1 -- 172.21.15.116:0/2483153551 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa418030860 con 0x7fa4280afa80 2024-02-21T22:53:02.568 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.576+0000 7fa42559a640 1 -- 172.21.15.116:0/2483153551 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa418030c30 con 0x7fa4280afa80 2024-02-21T22:53:02.568 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.577+0000 7fa42cd08640 1 -- 172.21.15.116:0/2483153551 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa4280afa80 msgr2=0x7fa4280b5990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:02.569 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.577+0000 7fa42cd08640 1 --2- 172.21.15.116:0/2483153551 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa4280afa80 0x7fa4280b5990 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa4280720b0 tx=0x7fa41802b9a0 comp rx=0 tx=0).stop 2024-02-21T22:53:02.569 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.577+0000 7fa42cd08640 1 -- 172.21.15.116:0/2483153551 shutdown_connections 2024-02-21T22:53:02.569 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.577+0000 7fa42cd08640 1 --2- 172.21.15.116:0/2483153551 >> v2:172.21.15.142:3300/0 conn(0x7fa42806b550 0x7fa4280b0220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:02.569 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.577+0000 7fa42cd08640 1 --2- 172.21.15.116:0/2483153551 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa4280afa80 0x7fa4280b5990 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:02.569 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.577+0000 7fa42cd08640 1 -- 172.21.15.116:0/2483153551 >> 172.21.15.116:0/2483153551 conn(0x7fa4280724f0 msgr2=0x7fa428072900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:02.569 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.577+0000 7fa42cd08640 1 -- 172.21.15.116:0/2483153551 shutdown_connections 2024-02-21T22:53:02.569 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.577+0000 7fa42cd08640 1 -- 172.21.15.116:0/2483153551 wait complete. 2024-02-21T22:53:02.569 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.578+0000 7fa42cd08640 1 Processor -- start 2024-02-21T22:53:02.569 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.578+0000 7fa42cd08640 1 -- start start 2024-02-21T22:53:02.571 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.579+0000 7fa42cd08640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa42806b550 0x7fa42815df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:02.571 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.579+0000 7fa42cd08640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa4280afa80 0x7fa4280c8f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:02.571 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.579+0000 7fa42cd08640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa4280b5ed0 0x7fa4280c94c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:02.571 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.579+0000 7fa42cd08640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4280b08e0 con 0x7fa4280b5ed0 2024-02-21T22:53:02.571 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.579+0000 7fa42cd08640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4280b0760 con 0x7fa42806b550 2024-02-21T22:53:02.571 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.579+0000 7fa42cd08640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4280b0a60 con 0x7fa4280afa80 2024-02-21T22:53:02.572 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.579+0000 7fa426d9d640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa4280b5ed0 0x7fa4280c94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:02.572 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.579+0000 7fa426d9d640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa4280b5ed0 0x7fa4280c94c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:34444/0 (socket says 172.21.15.116:34444) 2024-02-21T22:53:02.572 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.579+0000 7fa426d9d640 1 -- 172.21.15.116:0/3546434665 learned_addr learned my addr 172.21.15.116:0/3546434665 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:02.572 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.579+0000 7fa42659c640 1 --2- 172.21.15.116:0/3546434665 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa42806b550 0x7fa42815df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:02.572 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.579+0000 7fa425d9b640 1 --2- 172.21.15.116:0/3546434665 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa4280afa80 0x7fa4280c8f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:02.572 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.579+0000 7fa426d9d640 1 -- 172.21.15.116:0/3546434665 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa4280afa80 msgr2=0x7fa4280c8f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:02.572 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.579+0000 7fa426d9d640 1 --2- 172.21.15.116:0/3546434665 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa4280afa80 0x7fa4280c8f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:02.572 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.579+0000 7fa426d9d640 1 -- 172.21.15.116:0/3546434665 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa42806b550 msgr2=0x7fa42815df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:02.572 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.579+0000 7fa426d9d640 1 --2- 172.21.15.116:0/3546434665 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa42806b550 0x7fa42815df70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:02.572 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.579+0000 7fa426d9d640 1 -- 172.21.15.116:0/3546434665 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4280cbdb0 con 0x7fa4280b5ed0 2024-02-21T22:53:02.572 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.579+0000 7fa426d9d640 1 --2- 172.21.15.116:0/3546434665 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa4280b5ed0 0x7fa4280c94c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fa42000efc0 tx=0x7fa42000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:02.572 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.579+0000 7fa416ffd640 1 -- 172.21.15.116:0/3546434665 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa420018020 con 0x7fa4280b5ed0 2024-02-21T22:53:02.572 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.579+0000 7fa416ffd640 1 -- 172.21.15.116:0/3546434665 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa420014480 con 0x7fa4280b5ed0 2024-02-21T22:53:02.573 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.579+0000 7fa42cd08640 1 -- 172.21.15.116:0/3546434665 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4280cc090 con 0x7fa4280b5ed0 2024-02-21T22:53:02.573 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.579+0000 7fa416ffd640 1 -- 172.21.15.116:0/3546434665 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa420014870 con 0x7fa4280b5ed0 2024-02-21T22:53:02.573 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.579+0000 7fa42cd08640 1 -- 172.21.15.116:0/3546434665 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa42815e4b0 con 0x7fa4280b5ed0 2024-02-21T22:53:02.573 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.581+0000 7fa42cd08640 1 -- 172.21.15.116:0/3546434665 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4280c7390 con 0x7fa4280b5ed0 2024-02-21T22:53:02.573 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.581+0000 7fa416ffd640 1 -- 172.21.15.116:0/3546434665 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fa42001b020 con 0x7fa4280b5ed0 2024-02-21T22:53:02.573 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.581+0000 7fa416ffd640 1 --2- 172.21.15.116:0/3546434665 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fa40806b4d0 0x7fa40806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:02.574 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.581+0000 7fa416ffd640 1 -- 172.21.15.116:0/3546434665 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa42008afb0 con 0x7fa4280b5ed0 2024-02-21T22:53:02.574 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.581+0000 7fa42659c640 1 --2- 172.21.15.116:0/3546434665 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fa40806b4d0 0x7fa40806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:02.574 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.582+0000 7fa42659c640 1 --2- 172.21.15.116:0/3546434665 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fa40806b4d0 0x7fa40806d990 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fa418036000 tx=0x7fa418008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:02.576 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.585+0000 7fa416ffd640 1 -- 172.21.15.116:0/3546434665 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7fa420022020 con 0x7fa4280b5ed0 2024-02-21T22:53:02.746 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.755+0000 7fa42cd08640 1 -- 172.21.15.116:0/3546434665 --> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa4280752f0 con 0x7fa40806b4d0 2024-02-21T22:53:02.751 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.761+0000 7fa416ffd640 1 -- 172.21.15.116:0/3546434665 <== mgr.4103 v2:172.21.15.142:6832/1381484782 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251837 (secure 0 0 0) 0x7fa4280752f0 con 0x7fa40806b4d0 2024-02-21T22:53:02.754 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-02-21T22:53:02.755 INFO:teuthology.orchestra.run.smithi116.stderr:dumped all 2024-02-21T22:53:02.757 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.764+0000 7fa42cd08640 1 -- 172.21.15.116:0/3546434665 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fa40806b4d0 msgr2=0x7fa40806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:02.757 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.764+0000 7fa42cd08640 1 --2- 172.21.15.116:0/3546434665 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fa40806b4d0 0x7fa40806d990 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fa418036000 tx=0x7fa418008030 comp rx=0 tx=0).stop 2024-02-21T22:53:02.757 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.764+0000 7fa42cd08640 1 -- 172.21.15.116:0/3546434665 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa4280b5ed0 msgr2=0x7fa4280c94c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:02.757 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.764+0000 7fa42cd08640 1 --2- 172.21.15.116:0/3546434665 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa4280b5ed0 0x7fa4280c94c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fa42000efc0 tx=0x7fa42000c490 comp rx=0 tx=0).stop 2024-02-21T22:53:02.757 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.764+0000 7fa42cd08640 1 -- 172.21.15.116:0/3546434665 shutdown_connections 2024-02-21T22:53:02.757 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.764+0000 7fa42cd08640 1 --2- 172.21.15.116:0/3546434665 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa4280b5ed0 0x7fa4280c94c0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:02.757 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.764+0000 7fa42cd08640 1 --2- 172.21.15.116:0/3546434665 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fa40806b4d0 0x7fa40806d990 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:02.758 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.764+0000 7fa42cd08640 1 --2- 172.21.15.116:0/3546434665 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa4280afa80 0x7fa4280c8f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:02.758 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.764+0000 7fa42cd08640 1 --2- 172.21.15.116:0/3546434665 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa42806b550 0x7fa42815df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:02.758 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.764+0000 7fa42cd08640 1 -- 172.21.15.116:0/3546434665 >> 172.21.15.116:0/3546434665 conn(0x7fa4280724f0 msgr2=0x7fa4280728d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:02.758 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.764+0000 7fa42cd08640 1 -- 172.21.15.116:0/3546434665 shutdown_connections 2024-02-21T22:53:02.758 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.764+0000 7fa42cd08640 1 -- 172.21.15.116:0/3546434665 wait complete. 2024-02-21T22:53:02.767 INFO:teuthology.orchestra.run.smithi116.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-02-21T22:53:02.289674+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219016,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755704,"statfs":{"total":773094113280,"available":772869840896,"internally_reserved":0,"allocated":2891776,"data_stored":1753028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.498283"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234219+0000","last_change":"2024-02-21T22:52:50.804119+0000","last_active":"2024-02-21T22:52:52.234219+0000","last_peered":"2024-02-21T22:52:52.234219+0000","last_clean":"2024-02-21T22:52:52.234219+0000","last_became_active":"2024-02-21T22:52:50.801464+0000","last_became_peered":"2024-02-21T22:52:50.801464+0000","last_unstale":"2024-02-21T22:52:52.234219+0000","last_undegraded":"2024-02-21T22:52:52.234219+0000","last_fullsized":"2024-02-21T22:52:52.234219+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:06:29.082788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:51.792663+0000","last_change":"2024-02-21T22:52:50.787683+0000","last_active":"2024-02-21T22:52:51.792663+0000","last_peered":"2024-02-21T22:52:51.792663+0000","last_clean":"2024-02-21T22:52:51.792663+0000","last_became_active":"2024-02-21T22:52:50.787384+0000","last_became_peered":"2024-02-21T22:52:50.787384+0000","last_unstale":"2024-02-21T22:52:51.792663+0000","last_undegraded":"2024-02-21T22:52:51.792663+0000","last_fullsized":"2024-02-21T22:52:51.792663+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:10:56.108581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.233732+0000","last_change":"2024-02-21T22:52:50.786452+0000","last_active":"2024-02-21T22:52:52.233732+0000","last_peered":"2024-02-21T22:52:52.233732+0000","last_clean":"2024-02-21T22:52:52.233732+0000","last_became_active":"2024-02-21T22:52:50.786191+0000","last_became_peered":"2024-02-21T22:52:50.786191+0000","last_unstale":"2024-02-21T22:52:52.233732+0000","last_undegraded":"2024-02-21T22:52:52.233732+0000","last_fullsized":"2024-02-21T22:52:52.233732+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:43:33.767331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.233922+0000","last_change":"2024-02-21T22:52:50.805367+0000","last_active":"2024-02-21T22:52:52.233922+0000","last_peered":"2024-02-21T22:52:52.233922+0000","last_clean":"2024-02-21T22:52:52.233922+0000","last_became_active":"2024-02-21T22:52:50.805067+0000","last_became_peered":"2024-02-21T22:52:50.805067+0000","last_unstale":"2024-02-21T22:52:52.233922+0000","last_undegraded":"2024-02-21T22:52:52.233922+0000","last_fullsized":"2024-02-21T22:52:52.233922+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T02:49:51.875007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234052+0000","last_change":"2024-02-21T22:52:50.793726+0000","last_active":"2024-02-21T22:52:52.234052+0000","last_peered":"2024-02-21T22:52:52.234052+0000","last_clean":"2024-02-21T22:52:52.234052+0000","last_became_active":"2024-02-21T22:52:50.793461+0000","last_became_peered":"2024-02-21T22:52:50.793461+0000","last_unstale":"2024-02-21T22:52:52.234052+0000","last_undegraded":"2024-02-21T22:52:52.234052+0000","last_fullsized":"2024-02-21T22:52:52.234052+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:25:14.399237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.233784+0000","last_change":"2024-02-21T22:52:50.797872+0000","last_active":"2024-02-21T22:52:52.233784+0000","last_peered":"2024-02-21T22:52:52.233784+0000","last_clean":"2024-02-21T22:52:52.233784+0000","last_became_active":"2024-02-21T22:52:50.797547+0000","last_became_peered":"2024-02-21T22:52:50.797547+0000","last_unstale":"2024-02-21T22:52:52.233784+0000","last_undegraded":"2024-02-21T22:52:52.233784+0000","last_fullsized":"2024-02-21T22:52:52.233784+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:38:41.981414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.233678+0000","last_change":"2024-02-21T22:52:50.792977+0000","last_active":"2024-02-21T22:52:52.233678+0000","last_peered":"2024-02-21T22:52:52.233678+0000","last_clean":"2024-02-21T22:52:52.233678+0000","last_became_active":"2024-02-21T22:52:50.792731+0000","last_became_peered":"2024-02-21T22:52:50.792731+0000","last_unstale":"2024-02-21T22:52:52.233678+0000","last_undegraded":"2024-02-21T22:52:52.233678+0000","last_fullsized":"2024-02-21T22:52:52.233678+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T02:49:51.875007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.233592+0000","last_change":"2024-02-21T22:52:50.800588+0000","last_active":"2024-02-21T22:52:52.233592+0000","last_peered":"2024-02-21T22:52:52.233592+0000","last_clean":"2024-02-21T22:52:52.233592+0000","last_became_active":"2024-02-21T22:52:50.800266+0000","last_became_peered":"2024-02-21T22:52:50.800266+0000","last_unstale":"2024-02-21T22:52:52.233592+0000","last_undegraded":"2024-02-21T22:52:52.233592+0000","last_fullsized":"2024-02-21T22:52:52.233592+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:49:26.881791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234360+0000","last_change":"2024-02-21T22:52:50.802133+0000","last_active":"2024-02-21T22:52:52.234360+0000","last_peered":"2024-02-21T22:52:52.234360+0000","last_clean":"2024-02-21T22:52:52.234360+0000","last_became_active":"2024-02-21T22:52:50.801109+0000","last_became_peered":"2024-02-21T22:52:50.801109+0000","last_unstale":"2024-02-21T22:52:52.234360+0000","last_undegraded":"2024-02-21T22:52:52.234360+0000","last_fullsized":"2024-02-21T22:52:52.234360+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:32:36.066162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:51.795991+0000","last_change":"2024-02-21T22:52:50.799972+0000","last_active":"2024-02-21T22:52:51.795991+0000","last_peered":"2024-02-21T22:52:51.795991+0000","last_clean":"2024-02-21T22:52:51.795991+0000","last_became_active":"2024-02-21T22:52:50.799713+0000","last_became_peered":"2024-02-21T22:52:50.799713+0000","last_unstale":"2024-02-21T22:52:51.795991+0000","last_undegraded":"2024-02-21T22:52:51.795991+0000","last_fullsized":"2024-02-21T22:52:51.795991+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:10:56.108581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:51.794860+0000","last_change":"2024-02-21T22:52:50.800180+0000","last_active":"2024-02-21T22:52:51.794860+0000","last_peered":"2024-02-21T22:52:51.794860+0000","last_clean":"2024-02-21T22:52:51.794860+0000","last_became_active":"2024-02-21T22:52:50.799506+0000","last_became_peered":"2024-02-21T22:52:50.799506+0000","last_unstale":"2024-02-21T22:52:51.794860+0000","last_undegraded":"2024-02-21T22:52:51.794860+0000","last_fullsized":"2024-02-21T22:52:51.794860+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:49:26.881791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:51.795709+0000","last_change":"2024-02-21T22:52:50.785668+0000","last_active":"2024-02-21T22:52:51.795709+0000","last_peered":"2024-02-21T22:52:51.795709+0000","last_clean":"2024-02-21T22:52:51.795709+0000","last_became_active":"2024-02-21T22:52:50.785381+0000","last_became_peered":"2024-02-21T22:52:50.785381+0000","last_unstale":"2024-02-21T22:52:51.795709+0000","last_undegraded":"2024-02-21T22:52:51.795709+0000","last_fullsized":"2024-02-21T22:52:51.795709+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:29:58.630598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234333+0000","last_change":"2024-02-21T22:52:50.789689+0000","last_active":"2024-02-21T22:52:52.234333+0000","last_peered":"2024-02-21T22:52:52.234333+0000","last_clean":"2024-02-21T22:52:52.234333+0000","last_became_active":"2024-02-21T22:52:50.789124+0000","last_became_peered":"2024-02-21T22:52:50.789124+0000","last_unstale":"2024-02-21T22:52:52.234333+0000","last_undegraded":"2024-02-21T22:52:52.234333+0000","last_fullsized":"2024-02-21T22:52:52.234333+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:10:56.108581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.233802+0000","last_change":"2024-02-21T22:52:50.787622+0000","last_active":"2024-02-21T22:52:52.233802+0000","last_peered":"2024-02-21T22:52:52.233802+0000","last_clean":"2024-02-21T22:52:52.233802+0000","last_became_active":"2024-02-21T22:52:50.787315+0000","last_became_peered":"2024-02-21T22:52:50.787315+0000","last_unstale":"2024-02-21T22:52:52.233802+0000","last_undegraded":"2024-02-21T22:52:52.233802+0000","last_fullsized":"2024-02-21T22:52:52.233802+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:07:39.283417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:51.792349+0000","last_change":"2024-02-21T22:52:50.785274+0000","last_active":"2024-02-21T22:52:51.792349+0000","last_peered":"2024-02-21T22:52:51.792349+0000","last_clean":"2024-02-21T22:52:51.792349+0000","last_became_active":"2024-02-21T22:52:50.784970+0000","last_became_peered":"2024-02-21T22:52:50.784970+0000","last_unstale":"2024-02-21T22:52:51.792349+0000","last_undegraded":"2024-02-21T22:52:51.792349+0000","last_fullsized":"2024-02-21T22:52:51.792349+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:17:34.365402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234235+0000","last_change":"2024-02-21T22:52:50.797804+0000","last_active":"2024-02-21T22:52:52.234235+0000","last_peered":"2024-02-21T22:52:52.234235+0000","last_clean":"2024-02-21T22:52:52.234235+0000","last_became_active":"2024-02-21T22:52:50.797414+0000","last_became_peered":"2024-02-21T22:52:50.797414+0000","last_unstale":"2024-02-21T22:52:52.234235+0000","last_undegraded":"2024-02-21T22:52:52.234235+0000","last_fullsized":"2024-02-21T22:52:52.234235+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:10:56.108581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234715+0000","last_change":"2024-02-21T22:52:50.808468+0000","last_active":"2024-02-21T22:52:52.234715+0000","last_peered":"2024-02-21T22:52:52.234715+0000","last_clean":"2024-02-21T22:52:52.234715+0000","last_became_active":"2024-02-21T22:52:50.808183+0000","last_became_peered":"2024-02-21T22:52:50.808183+0000","last_unstale":"2024-02-21T22:52:52.234715+0000","last_undegraded":"2024-02-21T22:52:52.234715+0000","last_fullsized":"2024-02-21T22:52:52.234715+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:22:02.404664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.233676+0000","last_change":"2024-02-21T22:52:50.789333+0000","last_active":"2024-02-21T22:52:52.233676+0000","last_peered":"2024-02-21T22:52:52.233676+0000","last_clean":"2024-02-21T22:52:52.233676+0000","last_became_active":"2024-02-21T22:52:50.789054+0000","last_became_peered":"2024-02-21T22:52:50.789054+0000","last_unstale":"2024-02-21T22:52:52.233676+0000","last_undegraded":"2024-02-21T22:52:52.233676+0000","last_fullsized":"2024-02-21T22:52:52.233676+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:31:51.565091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234606+0000","last_change":"2024-02-21T22:52:50.796065+0000","last_active":"2024-02-21T22:52:52.234606+0000","last_peered":"2024-02-21T22:52:52.234606+0000","last_clean":"2024-02-21T22:52:52.234606+0000","last_became_active":"2024-02-21T22:52:50.794895+0000","last_became_peered":"2024-02-21T22:52:50.794895+0000","last_unstale":"2024-02-21T22:52:52.234606+0000","last_undegraded":"2024-02-21T22:52:52.234606+0000","last_fullsized":"2024-02-21T22:52:52.234606+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:03:04.692215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:51.794890+0000","last_change":"2024-02-21T22:52:50.795221+0000","last_active":"2024-02-21T22:52:51.794890+0000","last_peered":"2024-02-21T22:52:51.794890+0000","last_clean":"2024-02-21T22:52:51.794890+0000","last_became_active":"2024-02-21T22:52:50.794693+0000","last_became_peered":"2024-02-21T22:52:50.794693+0000","last_unstale":"2024-02-21T22:52:51.794890+0000","last_undegraded":"2024-02-21T22:52:51.794890+0000","last_fullsized":"2024-02-21T22:52:51.794890+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T10:36:17.566817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234167+0000","last_change":"2024-02-21T22:52:50.793867+0000","last_active":"2024-02-21T22:52:52.234167+0000","last_peered":"2024-02-21T22:52:52.234167+0000","last_clean":"2024-02-21T22:52:52.234167+0000","last_became_active":"2024-02-21T22:52:50.793645+0000","last_became_peered":"2024-02-21T22:52:50.793645+0000","last_unstale":"2024-02-21T22:52:52.234167+0000","last_undegraded":"2024-02-21T22:52:52.234167+0000","last_fullsized":"2024-02-21T22:52:52.234167+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:25:58.111654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.233930+0000","last_change":"2024-02-21T22:52:50.807989+0000","last_active":"2024-02-21T22:52:52.233930+0000","last_peered":"2024-02-21T22:52:52.233930+0000","last_clean":"2024-02-21T22:52:52.233930+0000","last_became_active":"2024-02-21T22:52:50.807712+0000","last_became_peered":"2024-02-21T22:52:50.807712+0000","last_unstale":"2024-02-21T22:52:52.233930+0000","last_undegraded":"2024-02-21T22:52:52.233930+0000","last_fullsized":"2024-02-21T22:52:52.233930+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:36:16.855646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234410+0000","last_change":"2024-02-21T22:52:50.800936+0000","last_active":"2024-02-21T22:52:52.234410+0000","last_peered":"2024-02-21T22:52:52.234410+0000","last_clean":"2024-02-21T22:52:52.234410+0000","last_became_active":"2024-02-21T22:52:50.800431+0000","last_became_peered":"2024-02-21T22:52:50.800431+0000","last_unstale":"2024-02-21T22:52:52.234410+0000","last_undegraded":"2024-02-21T22:52:52.234410+0000","last_fullsized":"2024-02-21T22:52:52.234410+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:38:41.981414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234377+0000","last_change":"2024-02-21T22:52:50.805357+0000","last_active":"2024-02-21T22:52:52.234377+0000","last_peered":"2024-02-21T22:52:52.234377+0000","last_clean":"2024-02-21T22:52:52.234377+0000","last_became_active":"2024-02-21T22:52:50.805060+0000","last_became_peered":"2024-02-21T22:52:50.805060+0000","last_unstale":"2024-02-21T22:52:52.234377+0000","last_undegraded":"2024-02-21T22:52:52.234377+0000","last_fullsized":"2024-02-21T22:52:52.234377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:51:16.039745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234522+0000","last_change":"2024-02-21T22:52:50.797979+0000","last_active":"2024-02-21T22:52:52.234522+0000","last_peered":"2024-02-21T22:52:52.234522+0000","last_clean":"2024-02-21T22:52:52.234522+0000","last_became_active":"2024-02-21T22:52:50.797343+0000","last_became_peered":"2024-02-21T22:52:50.797343+0000","last_unstale":"2024-02-21T22:52:52.234522+0000","last_undegraded":"2024-02-21T22:52:52.234522+0000","last_fullsized":"2024-02-21T22:52:52.234522+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:25:14.399237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:51.795952+0000","last_change":"2024-02-21T22:52:50.797991+0000","last_active":"2024-02-21T22:52:51.795952+0000","last_peered":"2024-02-21T22:52:51.795952+0000","last_clean":"2024-02-21T22:52:51.795952+0000","last_became_active":"2024-02-21T22:52:50.797667+0000","last_became_peered":"2024-02-21T22:52:50.797667+0000","last_unstale":"2024-02-21T22:52:51.795952+0000","last_undegraded":"2024-02-21T22:52:51.795952+0000","last_fullsized":"2024-02-21T22:52:51.795952+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:33:40.513967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:51.792515+0000","last_change":"2024-02-21T22:52:50.788943+0000","last_active":"2024-02-21T22:52:51.792515+0000","last_peered":"2024-02-21T22:52:51.792515+0000","last_clean":"2024-02-21T22:52:51.792515+0000","last_became_active":"2024-02-21T22:52:50.788672+0000","last_became_peered":"2024-02-21T22:52:50.788672+0000","last_unstale":"2024-02-21T22:52:51.792515+0000","last_undegraded":"2024-02-21T22:52:51.792515+0000","last_fullsized":"2024-02-21T22:52:51.792515+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:25:58.111654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234510+0000","last_change":"2024-02-21T22:52:50.797663+0000","last_active":"2024-02-21T22:52:52.234510+0000","last_peered":"2024-02-21T22:52:52.234510+0000","last_clean":"2024-02-21T22:52:52.234510+0000","last_became_active":"2024-02-21T22:52:50.797359+0000","last_became_peered":"2024-02-21T22:52:50.797359+0000","last_unstale":"2024-02-21T22:52:52.234510+0000","last_undegraded":"2024-02-21T22:52:52.234510+0000","last_fullsized":"2024-02-21T22:52:52.234510+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:36:16.855646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234239+0000","last_change":"2024-02-21T22:52:50.788672+0000","last_active":"2024-02-21T22:52:52.234239+0000","last_peered":"2024-02-21T22:52:52.234239+0000","last_clean":"2024-02-21T22:52:52.234239+0000","last_became_active":"2024-02-21T22:52:50.788413+0000","last_became_peered":"2024-02-21T22:52:50.788413+0000","last_unstale":"2024-02-21T22:52:52.234239+0000","last_undegraded":"2024-02-21T22:52:52.234239+0000","last_fullsized":"2024-02-21T22:52:52.234239+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:33:40.513967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234286+0000","last_change":"2024-02-21T22:52:50.808763+0000","last_active":"2024-02-21T22:52:52.234286+0000","last_peered":"2024-02-21T22:52:52.234286+0000","last_clean":"2024-02-21T22:52:52.234286+0000","last_became_active":"2024-02-21T22:52:50.805917+0000","last_became_peered":"2024-02-21T22:52:50.805917+0000","last_unstale":"2024-02-21T22:52:52.234286+0000","last_undegraded":"2024-02-21T22:52:52.234286+0000","last_fullsized":"2024-02-21T22:52:52.234286+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:39:55.210527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.233575+0000","last_change":"2024-02-21T22:52:50.799649+0000","last_active":"2024-02-21T22:52:52.233575+0000","last_peered":"2024-02-21T22:52:52.233575+0000","last_clean":"2024-02-21T22:52:52.233575+0000","last_became_active":"2024-02-21T22:52:50.799372+0000","last_became_peered":"2024-02-21T22:52:50.799372+0000","last_unstale":"2024-02-21T22:52:52.233575+0000","last_undegraded":"2024-02-21T22:52:52.233575+0000","last_fullsized":"2024-02-21T22:52:52.233575+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:20:01.491741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:51.795278+0000","last_change":"2024-02-21T22:52:50.789389+0000","last_active":"2024-02-21T22:52:51.795278+0000","last_peered":"2024-02-21T22:52:51.795278+0000","last_clean":"2024-02-21T22:52:51.795278+0000","last_became_active":"2024-02-21T22:52:50.789121+0000","last_became_peered":"2024-02-21T22:52:50.789121+0000","last_unstale":"2024-02-21T22:52:51.795278+0000","last_undegraded":"2024-02-21T22:52:51.795278+0000","last_fullsized":"2024-02-21T22:52:51.795278+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:58:42.676518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:51.794985+0000","last_change":"2024-02-21T22:52:50.792014+0000","last_active":"2024-02-21T22:52:51.794985+0000","last_peered":"2024-02-21T22:52:51.794985+0000","last_clean":"2024-02-21T22:52:51.794985+0000","last_became_active":"2024-02-21T22:52:50.790916+0000","last_became_peered":"2024-02-21T22:52:50.790916+0000","last_unstale":"2024-02-21T22:52:51.794985+0000","last_undegraded":"2024-02-21T22:52:51.794985+0000","last_fullsized":"2024-02-21T22:52:51.794985+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:04:04.768586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234516+0000","last_change":"2024-02-21T22:52:49.786296+0000","last_active":"2024-02-21T22:52:52.234516+0000","last_peered":"2024-02-21T22:52:52.234516+0000","last_clean":"2024-02-21T22:52:52.234516+0000","last_became_active":"2024-02-21T22:52:49.785971+0000","last_became_peered":"2024-02-21T22:52:49.785971+0000","last_unstale":"2024-02-21T22:52:52.234516+0000","last_undegraded":"2024-02-21T22:52:52.234516+0000","last_fullsized":"2024-02-21T22:52:52.234516+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:23:17.385208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234297+0000","last_change":"2024-02-21T22:52:50.802188+0000","last_active":"2024-02-21T22:52:52.234297+0000","last_peered":"2024-02-21T22:52:52.234297+0000","last_clean":"2024-02-21T22:52:52.234297+0000","last_became_active":"2024-02-21T22:52:50.801916+0000","last_became_peered":"2024-02-21T22:52:50.801916+0000","last_unstale":"2024-02-21T22:52:52.234297+0000","last_undegraded":"2024-02-21T22:52:52.234297+0000","last_fullsized":"2024-02-21T22:52:52.234297+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:10:56.108581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:51.795043+0000","last_change":"2024-02-21T22:52:49.789667+0000","last_active":"2024-02-21T22:52:51.795043+0000","last_peered":"2024-02-21T22:52:51.795043+0000","last_clean":"2024-02-21T22:52:51.795043+0000","last_became_active":"2024-02-21T22:52:49.789375+0000","last_became_peered":"2024-02-21T22:52:49.789375+0000","last_unstale":"2024-02-21T22:52:51.795043+0000","last_undegraded":"2024-02-21T22:52:51.795043+0000","last_fullsized":"2024-02-21T22:52:51.795043+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:04:03.761477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234559+0000","last_change":"2024-02-21T22:52:49.785301+0000","last_active":"2024-02-21T22:52:52.234559+0000","last_peered":"2024-02-21T22:52:52.234559+0000","last_clean":"2024-02-21T22:52:52.234559+0000","last_became_active":"2024-02-21T22:52:49.784975+0000","last_became_peered":"2024-02-21T22:52:49.784975+0000","last_unstale":"2024-02-21T22:52:52.234559+0000","last_undegraded":"2024-02-21T22:52:52.234559+0000","last_fullsized":"2024-02-21T22:52:52.234559+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:57:47.487172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.233732+0000","last_change":"2024-02-21T22:52:50.792749+0000","last_active":"2024-02-21T22:52:52.233732+0000","last_peered":"2024-02-21T22:52:52.233732+0000","last_clean":"2024-02-21T22:52:52.233732+0000","last_became_active":"2024-02-21T22:52:50.792219+0000","last_became_peered":"2024-02-21T22:52:50.792219+0000","last_unstale":"2024-02-21T22:52:52.233732+0000","last_undegraded":"2024-02-21T22:52:52.233732+0000","last_fullsized":"2024-02-21T22:52:52.233732+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T10:36:17.566817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234473+0000","last_change":"2024-02-21T22:52:49.789709+0000","last_active":"2024-02-21T22:52:52.234473+0000","last_peered":"2024-02-21T22:52:52.234473+0000","last_clean":"2024-02-21T22:52:52.234473+0000","last_became_active":"2024-02-21T22:52:49.789393+0000","last_became_peered":"2024-02-21T22:52:49.789393+0000","last_unstale":"2024-02-21T22:52:52.234473+0000","last_undegraded":"2024-02-21T22:52:52.234473+0000","last_fullsized":"2024-02-21T22:52:52.234473+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:04:03.761477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:51.792319+0000","last_change":"2024-02-21T22:52:50.789201+0000","last_active":"2024-02-21T22:52:51.792319+0000","last_peered":"2024-02-21T22:52:51.792319+0000","last_clean":"2024-02-21T22:52:51.792319+0000","last_became_active":"2024-02-21T22:52:50.787792+0000","last_became_peered":"2024-02-21T22:52:50.787792+0000","last_unstale":"2024-02-21T22:52:51.792319+0000","last_undegraded":"2024-02-21T22:52:51.792319+0000","last_fullsized":"2024-02-21T22:52:51.792319+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:49:26.881791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:51.795081+0000","last_change":"2024-02-21T22:52:49.791132+0000","last_active":"2024-02-21T22:52:51.795081+0000","last_peered":"2024-02-21T22:52:51.795081+0000","last_clean":"2024-02-21T22:52:51.795081+0000","last_became_active":"2024-02-21T22:52:49.790747+0000","last_became_peered":"2024-02-21T22:52:49.790747+0000","last_unstale":"2024-02-21T22:52:51.795081+0000","last_undegraded":"2024-02-21T22:52:51.795081+0000","last_fullsized":"2024-02-21T22:52:51.795081+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:57:47.487172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234358+0000","last_change":"2024-02-21T22:52:50.808244+0000","last_active":"2024-02-21T22:52:52.234358+0000","last_peered":"2024-02-21T22:52:52.234358+0000","last_clean":"2024-02-21T22:52:52.234358+0000","last_became_active":"2024-02-21T22:52:50.807811+0000","last_became_peered":"2024-02-21T22:52:50.807811+0000","last_unstale":"2024-02-21T22:52:52.234358+0000","last_undegraded":"2024-02-21T22:52:52.234358+0000","last_fullsized":"2024-02-21T22:52:52.234358+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:32:36.066162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234444+0000","last_change":"2024-02-21T22:52:49.792899+0000","last_active":"2024-02-21T22:52:52.234444+0000","last_peered":"2024-02-21T22:52:52.234444+0000","last_clean":"2024-02-21T22:52:52.234444+0000","last_became_active":"2024-02-21T22:52:49.792617+0000","last_became_peered":"2024-02-21T22:52:49.792617+0000","last_unstale":"2024-02-21T22:52:52.234444+0000","last_undegraded":"2024-02-21T22:52:52.234444+0000","last_fullsized":"2024-02-21T22:52:52.234444+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:06:28.817953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234067+0000","last_change":"2024-02-21T22:52:50.803201+0000","last_active":"2024-02-21T22:52:52.234067+0000","last_peered":"2024-02-21T22:52:52.234067+0000","last_clean":"2024-02-21T22:52:52.234067+0000","last_became_active":"2024-02-21T22:52:50.801870+0000","last_became_peered":"2024-02-21T22:52:50.801870+0000","last_unstale":"2024-02-21T22:52:52.234067+0000","last_undegraded":"2024-02-21T22:52:52.234067+0000","last_fullsized":"2024-02-21T22:52:52.234067+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:17:34.365402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:51.792522+0000","last_change":"2024-02-21T22:52:49.793191+0000","last_active":"2024-02-21T22:52:51.792522+0000","last_peered":"2024-02-21T22:52:51.792522+0000","last_clean":"2024-02-21T22:52:51.792522+0000","last_became_active":"2024-02-21T22:52:49.791992+0000","last_became_peered":"2024-02-21T22:52:49.791992+0000","last_unstale":"2024-02-21T22:52:51.792522+0000","last_undegraded":"2024-02-21T22:52:51.792522+0000","last_fullsized":"2024-02-21T22:52:51.792522+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:04:03.761477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:51.795759+0000","last_change":"2024-02-21T22:52:50.796850+0000","last_active":"2024-02-21T22:52:51.795759+0000","last_peered":"2024-02-21T22:52:51.795759+0000","last_clean":"2024-02-21T22:52:51.795759+0000","last_became_active":"2024-02-21T22:52:50.796589+0000","last_became_peered":"2024-02-21T22:52:50.796589+0000","last_unstale":"2024-02-21T22:52:51.795759+0000","last_undegraded":"2024-02-21T22:52:51.795759+0000","last_fullsized":"2024-02-21T22:52:51.795759+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:06:29.825061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:51.795352+0000","last_change":"2024-02-21T22:52:49.785392+0000","last_active":"2024-02-21T22:52:51.795352+0000","last_peered":"2024-02-21T22:52:51.795352+0000","last_clean":"2024-02-21T22:52:51.795352+0000","last_became_active":"2024-02-21T22:52:49.784936+0000","last_became_peered":"2024-02-21T22:52:49.784936+0000","last_unstale":"2024-02-21T22:52:51.795352+0000","last_undegraded":"2024-02-21T22:52:51.795352+0000","last_fullsized":"2024-02-21T22:52:51.795352+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:01:23.165721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234195+0000","last_change":"2024-02-21T22:52:50.793898+0000","last_active":"2024-02-21T22:52:52.234195+0000","last_peered":"2024-02-21T22:52:52.234195+0000","last_clean":"2024-02-21T22:52:52.234195+0000","last_became_active":"2024-02-21T22:52:50.793620+0000","last_became_peered":"2024-02-21T22:52:50.793620+0000","last_unstale":"2024-02-21T22:52:52.234195+0000","last_undegraded":"2024-02-21T22:52:52.234195+0000","last_fullsized":"2024-02-21T22:52:52.234195+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:13:03.777546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234350+0000","last_change":"2024-02-21T22:52:49.794586+0000","last_active":"2024-02-21T22:52:52.234350+0000","last_peered":"2024-02-21T22:52:52.234350+0000","last_clean":"2024-02-21T22:52:52.234350+0000","last_became_active":"2024-02-21T22:52:49.794288+0000","last_became_peered":"2024-02-21T22:52:49.794288+0000","last_unstale":"2024-02-21T22:52:52.234350+0000","last_undegraded":"2024-02-21T22:52:52.234350+0000","last_fullsized":"2024-02-21T22:52:52.234350+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:37:35.716112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.233964+0000","last_change":"2024-02-21T22:52:50.793467+0000","last_active":"2024-02-21T22:52:52.233964+0000","last_peered":"2024-02-21T22:52:52.233964+0000","last_clean":"2024-02-21T22:52:52.233964+0000","last_became_active":"2024-02-21T22:52:50.793160+0000","last_became_peered":"2024-02-21T22:52:50.793160+0000","last_unstale":"2024-02-21T22:52:52.233964+0000","last_undegraded":"2024-02-21T22:52:52.233964+0000","last_fullsized":"2024-02-21T22:52:52.233964+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T10:36:17.566817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234478+0000","last_change":"2024-02-21T22:52:49.793628+0000","last_active":"2024-02-21T22:52:52.234478+0000","last_peered":"2024-02-21T22:52:52.234478+0000","last_clean":"2024-02-21T22:52:52.234478+0000","last_became_active":"2024-02-21T22:52:49.793291+0000","last_became_peered":"2024-02-21T22:52:49.793291+0000","last_unstale":"2024-02-21T22:52:52.234478+0000","last_undegraded":"2024-02-21T22:52:52.234478+0000","last_fullsized":"2024-02-21T22:52:52.234478+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:29:57.623490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234378+0000","last_change":"2024-02-21T22:52:50.809208+0000","last_active":"2024-02-21T22:52:52.234378+0000","last_peered":"2024-02-21T22:52:52.234378+0000","last_clean":"2024-02-21T22:52:52.234378+0000","last_became_active":"2024-02-21T22:52:50.808950+0000","last_became_peered":"2024-02-21T22:52:50.808950+0000","last_unstale":"2024-02-21T22:52:52.234378+0000","last_undegraded":"2024-02-21T22:52:52.234378+0000","last_fullsized":"2024-02-21T22:52:52.234378+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:51:16.039745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:51.794655+0000","last_change":"2024-02-21T22:52:49.788987+0000","last_active":"2024-02-21T22:52:51.794655+0000","last_peered":"2024-02-21T22:52:51.794655+0000","last_clean":"2024-02-21T22:52:51.794655+0000","last_became_active":"2024-02-21T22:52:49.788704+0000","last_became_peered":"2024-02-21T22:52:49.788704+0000","last_unstale":"2024-02-21T22:52:51.794655+0000","last_undegraded":"2024-02-21T22:52:51.794655+0000","last_fullsized":"2024-02-21T22:52:51.794655+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T10:42:14.273761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:51.795107+0000","last_change":"2024-02-21T22:52:50.789680+0000","last_active":"2024-02-21T22:52:51.795107+0000","last_peered":"2024-02-21T22:52:51.795107+0000","last_clean":"2024-02-21T22:52:51.795107+0000","last_became_active":"2024-02-21T22:52:50.788648+0000","last_became_peered":"2024-02-21T22:52:50.788648+0000","last_unstale":"2024-02-21T22:52:51.795107+0000","last_undegraded":"2024-02-21T22:52:51.795107+0000","last_fullsized":"2024-02-21T22:52:51.795107+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:25:58.111654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.233423+0000","last_change":"2024-02-21T22:52:49.783735+0000","last_active":"2024-02-21T22:52:52.233423+0000","last_peered":"2024-02-21T22:52:52.233423+0000","last_clean":"2024-02-21T22:52:52.233423+0000","last_became_active":"2024-02-21T22:52:49.783350+0000","last_became_peered":"2024-02-21T22:52:49.783350+0000","last_unstale":"2024-02-21T22:52:52.233423+0000","last_undegraded":"2024-02-21T22:52:52.233423+0000","last_fullsized":"2024-02-21T22:52:52.233423+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:57:47.487172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.233816+0000","last_change":"2024-02-21T22:52:50.808882+0000","last_active":"2024-02-21T22:52:52.233816+0000","last_peered":"2024-02-21T22:52:52.233816+0000","last_clean":"2024-02-21T22:52:52.233816+0000","last_became_active":"2024-02-21T22:52:50.808584+0000","last_became_peered":"2024-02-21T22:52:50.808584+0000","last_unstale":"2024-02-21T22:52:52.233816+0000","last_undegraded":"2024-02-21T22:52:52.233816+0000","last_fullsized":"2024-02-21T22:52:52.233816+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:36:16.855646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:51.795199+0000","last_change":"2024-02-21T22:52:49.792856+0000","last_active":"2024-02-21T22:52:51.795199+0000","last_peered":"2024-02-21T22:52:51.795199+0000","last_clean":"2024-02-21T22:52:51.795199+0000","last_became_active":"2024-02-21T22:52:49.792509+0000","last_became_peered":"2024-02-21T22:52:49.792509+0000","last_unstale":"2024-02-21T22:52:51.795199+0000","last_undegraded":"2024-02-21T22:52:51.795199+0000","last_fullsized":"2024-02-21T22:52:51.795199+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:12:21.047751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234103+0000","last_change":"2024-02-21T22:52:50.808696+0000","last_active":"2024-02-21T22:52:52.234103+0000","last_peered":"2024-02-21T22:52:52.234103+0000","last_clean":"2024-02-21T22:52:52.234103+0000","last_became_active":"2024-02-21T22:52:50.808416+0000","last_became_peered":"2024-02-21T22:52:50.808416+0000","last_unstale":"2024-02-21T22:52:52.234103+0000","last_undegraded":"2024-02-21T22:52:52.234103+0000","last_fullsized":"2024-02-21T22:52:52.234103+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:02:22.212238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.233760+0000","last_change":"2024-02-21T22:52:49.789756+0000","last_active":"2024-02-21T22:52:52.233760+0000","last_peered":"2024-02-21T22:52:52.233760+0000","last_clean":"2024-02-21T22:52:52.233760+0000","last_became_active":"2024-02-21T22:52:49.789447+0000","last_became_peered":"2024-02-21T22:52:49.789447+0000","last_unstale":"2024-02-21T22:52:52.233760+0000","last_undegraded":"2024-02-21T22:52:52.233760+0000","last_fullsized":"2024-02-21T22:52:52.233760+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:01:23.165721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234491+0000","last_change":"2024-02-21T22:52:50.809468+0000","last_active":"2024-02-21T22:52:52.234491+0000","last_peered":"2024-02-21T22:52:52.234491+0000","last_clean":"2024-02-21T22:52:52.234491+0000","last_became_active":"2024-02-21T22:52:50.809053+0000","last_became_peered":"2024-02-21T22:52:50.809053+0000","last_unstale":"2024-02-21T22:52:52.234491+0000","last_undegraded":"2024-02-21T22:52:52.234491+0000","last_fullsized":"2024-02-21T22:52:52.234491+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:22:02.404664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:51.792607+0000","last_change":"2024-02-21T22:52:49.791174+0000","last_active":"2024-02-21T22:52:51.792607+0000","last_peered":"2024-02-21T22:52:51.792607+0000","last_clean":"2024-02-21T22:52:51.792607+0000","last_became_active":"2024-02-21T22:52:49.790885+0000","last_became_peered":"2024-02-21T22:52:49.790885+0000","last_unstale":"2024-02-21T22:52:51.792607+0000","last_undegraded":"2024-02-21T22:52:51.792607+0000","last_fullsized":"2024-02-21T22:52:51.792607+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:06:28.817953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234062+0000","last_change":"2024-02-21T22:52:50.802420+0000","last_active":"2024-02-21T22:52:52.234062+0000","last_peered":"2024-02-21T22:52:52.234062+0000","last_clean":"2024-02-21T22:52:52.234062+0000","last_became_active":"2024-02-21T22:52:50.801980+0000","last_became_peered":"2024-02-21T22:52:50.801980+0000","last_unstale":"2024-02-21T22:52:52.234062+0000","last_undegraded":"2024-02-21T22:52:52.234062+0000","last_fullsized":"2024-02-21T22:52:52.234062+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:02:22.212238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.233717+0000","last_change":"2024-02-21T22:52:49.787772+0000","last_active":"2024-02-21T22:52:52.233717+0000","last_peered":"2024-02-21T22:52:52.233717+0000","last_clean":"2024-02-21T22:52:52.233717+0000","last_became_active":"2024-02-21T22:52:49.787483+0000","last_became_peered":"2024-02-21T22:52:49.787483+0000","last_unstale":"2024-02-21T22:52:52.233717+0000","last_undegraded":"2024-02-21T22:52:52.233717+0000","last_fullsized":"2024-02-21T22:52:52.233717+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:04:03.761477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234346+0000","last_change":"2024-02-21T22:52:50.801710+0000","last_active":"2024-02-21T22:52:52.234346+0000","last_peered":"2024-02-21T22:52:52.234346+0000","last_clean":"2024-02-21T22:52:52.234346+0000","last_became_active":"2024-02-21T22:52:50.801446+0000","last_became_peered":"2024-02-21T22:52:50.801446+0000","last_unstale":"2024-02-21T22:52:52.234346+0000","last_undegraded":"2024-02-21T22:52:52.234346+0000","last_fullsized":"2024-02-21T22:52:52.234346+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:39:55.210527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":170,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.233578+0000","last_change":"2024-02-21T22:52:40.336187+0000","last_active":"2024-02-21T22:52:52.233578+0000","last_peered":"2024-02-21T22:52:52.233578+0000","last_clean":"2024-02-21T22:52:52.233578+0000","last_became_active":"2024-02-21T22:52:40.335061+0000","last_became_peered":"2024-02-21T22:52:40.335061+0000","last_unstale":"2024-02-21T22:52:52.233578+0000","last_undegraded":"2024-02-21T22:52:52.233578+0000","last_fullsized":"2024-02-21T22:52:52.233578+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:38.328863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:38.328863+0000","last_clean_scrub_stamp":"2024-02-21T22:52:38.328863+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:33:53.012414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.233685+0000","last_change":"2024-02-21T22:52:49.787124+0000","last_active":"2024-02-21T22:52:52.233685+0000","last_peered":"2024-02-21T22:52:52.233685+0000","last_clean":"2024-02-21T22:52:52.233685+0000","last_became_active":"2024-02-21T22:52:49.786800+0000","last_became_peered":"2024-02-21T22:52:49.786800+0000","last_unstale":"2024-02-21T22:52:52.233685+0000","last_undegraded":"2024-02-21T22:52:52.233685+0000","last_fullsized":"2024-02-21T22:52:52.233685+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:01:23.165721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.233943+0000","last_change":"2024-02-21T22:52:50.800508+0000","last_active":"2024-02-21T22:52:52.233943+0000","last_peered":"2024-02-21T22:52:52.233943+0000","last_clean":"2024-02-21T22:52:52.233943+0000","last_became_active":"2024-02-21T22:52:50.800215+0000","last_became_peered":"2024-02-21T22:52:50.800215+0000","last_unstale":"2024-02-21T22:52:52.233943+0000","last_undegraded":"2024-02-21T22:52:52.233943+0000","last_fullsized":"2024-02-21T22:52:52.233943+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:25:58.111654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.233509+0000","last_change":"2024-02-21T22:52:49.788881+0000","last_active":"2024-02-21T22:52:52.233509+0000","last_peered":"2024-02-21T22:52:52.233509+0000","last_clean":"2024-02-21T22:52:52.233509+0000","last_became_active":"2024-02-21T22:52:49.788611+0000","last_became_peered":"2024-02-21T22:52:49.788611+0000","last_unstale":"2024-02-21T22:52:52.233509+0000","last_undegraded":"2024-02-21T22:52:52.233509+0000","last_fullsized":"2024-02-21T22:52:52.233509+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T10:42:14.273761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.233594+0000","last_change":"2024-02-21T22:52:50.801343+0000","last_active":"2024-02-21T22:52:52.233594+0000","last_peered":"2024-02-21T22:52:52.233594+0000","last_clean":"2024-02-21T22:52:52.233594+0000","last_became_active":"2024-02-21T22:52:50.801029+0000","last_became_peered":"2024-02-21T22:52:50.801029+0000","last_unstale":"2024-02-21T22:52:52.233594+0000","last_undegraded":"2024-02-21T22:52:52.233594+0000","last_fullsized":"2024-02-21T22:52:52.233594+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:00:31.831396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.233662+0000","last_change":"2024-02-21T22:52:49.790068+0000","last_active":"2024-02-21T22:52:52.233662+0000","last_peered":"2024-02-21T22:52:52.233662+0000","last_clean":"2024-02-21T22:52:52.233662+0000","last_became_active":"2024-02-21T22:52:49.789766+0000","last_became_peered":"2024-02-21T22:52:49.789766+0000","last_unstale":"2024-02-21T22:52:52.233662+0000","last_undegraded":"2024-02-21T22:52:52.233662+0000","last_fullsized":"2024-02-21T22:52:52.233662+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T10:42:14.273761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:51.792345+0000","last_change":"2024-02-21T22:52:50.787018+0000","last_active":"2024-02-21T22:52:51.792345+0000","last_peered":"2024-02-21T22:52:51.792345+0000","last_clean":"2024-02-21T22:52:51.792345+0000","last_became_active":"2024-02-21T22:52:50.786695+0000","last_became_peered":"2024-02-21T22:52:50.786695+0000","last_unstale":"2024-02-21T22:52:51.792345+0000","last_undegraded":"2024-02-21T22:52:51.792345+0000","last_fullsized":"2024-02-21T22:52:51.792345+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T10:36:17.566817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234569+0000","last_change":"2024-02-21T22:52:49.789752+0000","last_active":"2024-02-21T22:52:52.234569+0000","last_peered":"2024-02-21T22:52:52.234569+0000","last_clean":"2024-02-21T22:52:52.234569+0000","last_became_active":"2024-02-21T22:52:49.789375+0000","last_became_peered":"2024-02-21T22:52:49.789375+0000","last_unstale":"2024-02-21T22:52:52.234569+0000","last_undegraded":"2024-02-21T22:52:52.234569+0000","last_fullsized":"2024-02-21T22:52:52.234569+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T10:42:14.273761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:51.795446+0000","last_change":"2024-02-21T22:52:50.791657+0000","last_active":"2024-02-21T22:52:51.795446+0000","last_peered":"2024-02-21T22:52:51.795446+0000","last_clean":"2024-02-21T22:52:51.795446+0000","last_became_active":"2024-02-21T22:52:50.791419+0000","last_became_peered":"2024-02-21T22:52:50.791419+0000","last_unstale":"2024-02-21T22:52:51.795446+0000","last_undegraded":"2024-02-21T22:52:51.795446+0000","last_fullsized":"2024-02-21T22:52:51.795446+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T10:42:15.280869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:51.792606+0000","last_change":"2024-02-21T22:52:49.793130+0000","last_active":"2024-02-21T22:52:51.792606+0000","last_peered":"2024-02-21T22:52:51.792606+0000","last_clean":"2024-02-21T22:52:51.792606+0000","last_became_active":"2024-02-21T22:52:49.792824+0000","last_became_peered":"2024-02-21T22:52:49.792824+0000","last_unstale":"2024-02-21T22:52:51.792606+0000","last_undegraded":"2024-02-21T22:52:51.792606+0000","last_fullsized":"2024-02-21T22:52:51.792606+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:01:23.165721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234113+0000","last_change":"2024-02-21T22:52:50.806582+0000","last_active":"2024-02-21T22:52:52.234113+0000","last_peered":"2024-02-21T22:52:52.234113+0000","last_clean":"2024-02-21T22:52:52.234113+0000","last_became_active":"2024-02-21T22:52:50.806257+0000","last_became_peered":"2024-02-21T22:52:50.806257+0000","last_unstale":"2024-02-21T22:52:52.234113+0000","last_undegraded":"2024-02-21T22:52:52.234113+0000","last_fullsized":"2024-02-21T22:52:52.234113+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:13:03.777546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234594+0000","last_change":"2024-02-21T22:52:49.793178+0000","last_active":"2024-02-21T22:52:52.234594+0000","last_peered":"2024-02-21T22:52:52.234594+0000","last_clean":"2024-02-21T22:52:52.234594+0000","last_became_active":"2024-02-21T22:52:49.792301+0000","last_became_peered":"2024-02-21T22:52:49.792301+0000","last_unstale":"2024-02-21T22:52:52.234594+0000","last_undegraded":"2024-02-21T22:52:52.234594+0000","last_fullsized":"2024-02-21T22:52:52.234594+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:53:50.332475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:51.792632+0000","last_change":"2024-02-21T22:52:50.785491+0000","last_active":"2024-02-21T22:52:51.792632+0000","last_peered":"2024-02-21T22:52:51.792632+0000","last_clean":"2024-02-21T22:52:51.792632+0000","last_became_active":"2024-02-21T22:52:50.785220+0000","last_became_peered":"2024-02-21T22:52:50.785220+0000","last_unstale":"2024-02-21T22:52:51.792632+0000","last_undegraded":"2024-02-21T22:52:51.792632+0000","last_fullsized":"2024-02-21T22:52:51.792632+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:33:40.513967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:51.796299+0000","last_change":"2024-02-21T22:52:49.787159+0000","last_active":"2024-02-21T22:52:51.796299+0000","last_peered":"2024-02-21T22:52:51.796299+0000","last_clean":"2024-02-21T22:52:51.796299+0000","last_became_active":"2024-02-21T22:52:49.786876+0000","last_became_peered":"2024-02-21T22:52:49.786876+0000","last_unstale":"2024-02-21T22:52:51.796299+0000","last_undegraded":"2024-02-21T22:52:51.796299+0000","last_fullsized":"2024-02-21T22:52:51.796299+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:20:00.484633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234594+0000","last_change":"2024-02-21T22:52:50.794174+0000","last_active":"2024-02-21T22:52:52.234594+0000","last_peered":"2024-02-21T22:52:52.234594+0000","last_clean":"2024-02-21T22:52:52.234594+0000","last_became_active":"2024-02-21T22:52:50.793881+0000","last_became_peered":"2024-02-21T22:52:50.793881+0000","last_unstale":"2024-02-21T22:52:52.234594+0000","last_undegraded":"2024-02-21T22:52:52.234594+0000","last_fullsized":"2024-02-21T22:52:52.234594+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:02:22.212238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:51.795185+0000","last_change":"2024-02-21T22:52:49.790424+0000","last_active":"2024-02-21T22:52:51.795185+0000","last_peered":"2024-02-21T22:52:51.795185+0000","last_clean":"2024-02-21T22:52:51.795185+0000","last_became_active":"2024-02-21T22:52:49.790147+0000","last_became_peered":"2024-02-21T22:52:49.790147+0000","last_unstale":"2024-02-21T22:52:51.795185+0000","last_undegraded":"2024-02-21T22:52:51.795185+0000","last_fullsized":"2024-02-21T22:52:51.795185+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:23:17.385208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.233852+0000","last_change":"2024-02-21T22:52:50.790678+0000","last_active":"2024-02-21T22:52:52.233852+0000","last_peered":"2024-02-21T22:52:52.233852+0000","last_clean":"2024-02-21T22:52:52.233852+0000","last_became_active":"2024-02-21T22:52:50.790415+0000","last_became_peered":"2024-02-21T22:52:50.790415+0000","last_unstale":"2024-02-21T22:52:52.233852+0000","last_undegraded":"2024-02-21T22:52:52.233852+0000","last_fullsized":"2024-02-21T22:52:52.233852+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:58:42.676518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.233605+0000","last_change":"2024-02-21T22:52:49.794656+0000","last_active":"2024-02-21T22:52:52.233605+0000","last_peered":"2024-02-21T22:52:52.233605+0000","last_clean":"2024-02-21T22:52:52.233605+0000","last_became_active":"2024-02-21T22:52:49.794394+0000","last_became_peered":"2024-02-21T22:52:49.794394+0000","last_unstale":"2024-02-21T22:52:52.233605+0000","last_undegraded":"2024-02-21T22:52:52.233605+0000","last_fullsized":"2024-02-21T22:52:52.233605+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:29:57.623490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:51.795821+0000","last_change":"2024-02-21T22:52:50.792184+0000","last_active":"2024-02-21T22:52:51.795821+0000","last_peered":"2024-02-21T22:52:51.795821+0000","last_clean":"2024-02-21T22:52:51.795821+0000","last_became_active":"2024-02-21T22:52:50.791180+0000","last_became_peered":"2024-02-21T22:52:50.791180+0000","last_unstale":"2024-02-21T22:52:51.795821+0000","last_undegraded":"2024-02-21T22:52:51.795821+0000","last_fullsized":"2024-02-21T22:52:51.795821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:20:01.491741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:51.792408+0000","last_change":"2024-02-21T22:52:49.791409+0000","last_active":"2024-02-21T22:52:51.792408+0000","last_peered":"2024-02-21T22:52:51.792408+0000","last_clean":"2024-02-21T22:52:51.792408+0000","last_became_active":"2024-02-21T22:52:49.791124+0000","last_became_peered":"2024-02-21T22:52:49.791124+0000","last_unstale":"2024-02-21T22:52:51.792408+0000","last_undegraded":"2024-02-21T22:52:51.792408+0000","last_fullsized":"2024-02-21T22:52:51.792408+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T10:42:14.273761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.233884+0000","last_change":"2024-02-21T22:52:50.790359+0000","last_active":"2024-02-21T22:52:52.233884+0000","last_peered":"2024-02-21T22:52:52.233884+0000","last_clean":"2024-02-21T22:52:52.233884+0000","last_became_active":"2024-02-21T22:52:50.790083+0000","last_became_peered":"2024-02-21T22:52:50.790083+0000","last_unstale":"2024-02-21T22:52:52.233884+0000","last_undegraded":"2024-02-21T22:52:52.233884+0000","last_fullsized":"2024-02-21T22:52:52.233884+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:17:34.365402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:51.792512+0000","last_change":"2024-02-21T22:52:49.786337+0000","last_active":"2024-02-21T22:52:51.792512+0000","last_peered":"2024-02-21T22:52:51.792512+0000","last_clean":"2024-02-21T22:52:51.792512+0000","last_became_active":"2024-02-21T22:52:49.786058+0000","last_became_peered":"2024-02-21T22:52:49.786058+0000","last_unstale":"2024-02-21T22:52:51.792512+0000","last_undegraded":"2024-02-21T22:52:51.792512+0000","last_fullsized":"2024-02-21T22:52:51.792512+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:29:57.623490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234482+0000","last_change":"2024-02-21T22:52:50.792676+0000","last_active":"2024-02-21T22:52:52.234482+0000","last_peered":"2024-02-21T22:52:52.234482+0000","last_clean":"2024-02-21T22:52:52.234482+0000","last_became_active":"2024-02-21T22:52:50.792330+0000","last_became_peered":"2024-02-21T22:52:50.792330+0000","last_unstale":"2024-02-21T22:52:52.234482+0000","last_undegraded":"2024-02-21T22:52:52.234482+0000","last_fullsized":"2024-02-21T22:52:52.234482+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T02:49:51.875007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234484+0000","last_change":"2024-02-21T22:52:49.791921+0000","last_active":"2024-02-21T22:52:52.234484+0000","last_peered":"2024-02-21T22:52:52.234484+0000","last_clean":"2024-02-21T22:52:52.234484+0000","last_became_active":"2024-02-21T22:52:49.791614+0000","last_became_peered":"2024-02-21T22:52:49.791614+0000","last_unstale":"2024-02-21T22:52:52.234484+0000","last_undegraded":"2024-02-21T22:52:52.234484+0000","last_fullsized":"2024-02-21T22:52:52.234484+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:06:28.817953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:51.794942+0000","last_change":"2024-02-21T22:52:50.794820+0000","last_active":"2024-02-21T22:52:51.794942+0000","last_peered":"2024-02-21T22:52:51.794942+0000","last_clean":"2024-02-21T22:52:51.794942+0000","last_became_active":"2024-02-21T22:52:50.794504+0000","last_became_peered":"2024-02-21T22:52:50.794504+0000","last_unstale":"2024-02-21T22:52:51.794942+0000","last_undegraded":"2024-02-21T22:52:51.794942+0000","last_fullsized":"2024-02-21T22:52:51.794942+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:17:34.365402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.233975+0000","last_change":"2024-02-21T22:52:50.806225+0000","last_active":"2024-02-21T22:52:52.233975+0000","last_peered":"2024-02-21T22:52:52.233975+0000","last_clean":"2024-02-21T22:52:52.233975+0000","last_became_active":"2024-02-21T22:52:50.805867+0000","last_became_peered":"2024-02-21T22:52:50.805867+0000","last_unstale":"2024-02-21T22:52:52.233975+0000","last_undegraded":"2024-02-21T22:52:52.233975+0000","last_fullsized":"2024-02-21T22:52:52.233975+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:25:14.399237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234362+0000","last_change":"2024-02-21T22:52:49.791427+0000","last_active":"2024-02-21T22:52:52.234362+0000","last_peered":"2024-02-21T22:52:52.234362+0000","last_clean":"2024-02-21T22:52:52.234362+0000","last_became_active":"2024-02-21T22:52:49.790879+0000","last_became_peered":"2024-02-21T22:52:49.790879+0000","last_unstale":"2024-02-21T22:52:52.234362+0000","last_undegraded":"2024-02-21T22:52:52.234362+0000","last_fullsized":"2024-02-21T22:52:52.234362+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:20:00.484633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234211+0000","last_change":"2024-02-21T22:52:50.804074+0000","last_active":"2024-02-21T22:52:52.234211+0000","last_peered":"2024-02-21T22:52:52.234211+0000","last_clean":"2024-02-21T22:52:52.234211+0000","last_became_active":"2024-02-21T22:52:50.803759+0000","last_became_peered":"2024-02-21T22:52:50.803759+0000","last_unstale":"2024-02-21T22:52:52.234211+0000","last_undegraded":"2024-02-21T22:52:52.234211+0000","last_fullsized":"2024-02-21T22:52:52.234211+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:06:29.082788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234445+0000","last_change":"2024-02-21T22:52:49.790281+0000","last_active":"2024-02-21T22:52:52.234445+0000","last_peered":"2024-02-21T22:52:52.234445+0000","last_clean":"2024-02-21T22:52:52.234445+0000","last_became_active":"2024-02-21T22:52:49.790023+0000","last_became_peered":"2024-02-21T22:52:49.790023+0000","last_unstale":"2024-02-21T22:52:52.234445+0000","last_undegraded":"2024-02-21T22:52:52.234445+0000","last_fullsized":"2024-02-21T22:52:52.234445+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:31:50.557983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.233936+0000","last_change":"2024-02-21T22:52:50.801839+0000","last_active":"2024-02-21T22:52:52.233936+0000","last_peered":"2024-02-21T22:52:52.233936+0000","last_clean":"2024-02-21T22:52:52.233936+0000","last_became_active":"2024-02-21T22:52:50.801499+0000","last_became_peered":"2024-02-21T22:52:50.801499+0000","last_unstale":"2024-02-21T22:52:52.233936+0000","last_undegraded":"2024-02-21T22:52:52.233936+0000","last_fullsized":"2024-02-21T22:52:52.233936+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:49:26.881791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234190+0000","last_change":"2024-02-21T22:52:49.792448+0000","last_active":"2024-02-21T22:52:52.234190+0000","last_peered":"2024-02-21T22:52:52.234190+0000","last_clean":"2024-02-21T22:52:52.234190+0000","last_became_active":"2024-02-21T22:52:49.792116+0000","last_became_peered":"2024-02-21T22:52:49.792116+0000","last_unstale":"2024-02-21T22:52:52.234190+0000","last_undegraded":"2024-02-21T22:52:52.234190+0000","last_fullsized":"2024-02-21T22:52:52.234190+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:34:55.953292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234013+0000","last_change":"2024-02-21T22:52:50.791072+0000","last_active":"2024-02-21T22:52:52.234013+0000","last_peered":"2024-02-21T22:52:52.234013+0000","last_clean":"2024-02-21T22:52:52.234013+0000","last_became_active":"2024-02-21T22:52:50.790784+0000","last_became_peered":"2024-02-21T22:52:50.790784+0000","last_unstale":"2024-02-21T22:52:52.234013+0000","last_undegraded":"2024-02-21T22:52:52.234013+0000","last_fullsized":"2024-02-21T22:52:52.234013+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:49.766243+0000","last_clean_scrub_stamp":"2024-02-21T22:52:49.766243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:33:40.513967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-21T22:52:52.234149+0000","last_change":"2024-02-21T22:52:49.792852+0000","last_active":"2024-02-21T22:52:52.234149+0000","last_peered":"2024-02-21T22:52:52.234149+0000","last_clean":"2024-02-21T22:52:52.234149+0000","last_became_active":"2024-02-21T22:52:49.792580+0000","last_became_peered":"2024-02-21T22:52:49.792580+0000","last_unstale":"2024-02-21T22:52:52.234149+0000","last_undegraded":"2024-02-21T22:52:52.234149+0000","last_fullsized":"2024-02-21T22:52:52.234149+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:48.759135+0000","last_clean_scrub_stamp":"2024-02-21T22:52:48.759135+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:34:55.953292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":802816,"data_stored":661884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":208896,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":71060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":70934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":212992,"data_stored":71094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":811008,"data_stored":661940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-21T22:53:02.771 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-02-21T22:53:02.771 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-02-21T22:53:02.772 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-02-21T22:53:02.772 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-02-21T22:53:02.906 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.916+0000 7fd1a1008640 1 Processor -- start 2024-02-21T22:53:02.907 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.916+0000 7fd1a1008640 1 -- start start 2024-02-21T22:53:02.909 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.917+0000 7fd1a1008640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd19c0705c0 0x7fd19c0cefa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:02.909 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.917+0000 7fd1a1008640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd19c06c1d0 0x7fd19c06c960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:02.909 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.917+0000 7fd1a1008640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd19c0709a0 con 0x7fd19c06cea0 2024-02-21T22:53:02.909 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.917+0000 7fd1a1008640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd19c0d0c50 con 0x7fd19c0705c0 2024-02-21T22:53:02.909 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.917+0000 7fd1a1008640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd19c06fbb0 con 0x7fd19c06c1d0 2024-02-21T22:53:02.909 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.917+0000 7fd19b59e640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7fd19c06cea0 0x7fd19c15d840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:50954/0 (socket says 172.21.15.116:50954) 2024-02-21T22:53:02.910 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.917+0000 7fd19b59e640 1 -- 172.21.15.116:0/2537544985 learned_addr learned my addr 172.21.15.116:0/2537544985 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-02-21T22:53:02.910 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.917+0000 7fd19259c640 1 --2- 172.21.15.116:0/2537544985 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd19c06c1d0 0x7fd19c06c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:02.910 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.917+0000 7fd19ad9d640 1 --2- 172.21.15.116:0/2537544985 >> v2:172.21.15.142:3300/0 conn(0x7fd19c0705c0 0x7fd19c0cefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:02.910 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.917+0000 7fd19a59c640 1 -- 172.21.15.116:0/2537544985 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1671788196 0 0) 0x7fd19c0709a0 con 0x7fd19c06cea0 2024-02-21T22:53:02.910 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.917+0000 7fd19a59c640 1 -- 172.21.15.116:0/2537544985 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd188003520 con 0x7fd19c06cea0 2024-02-21T22:53:02.910 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.917+0000 7fd19259c640 1 -- 172.21.15.116:0/2537544985 >> v2:172.21.15.142:3300/0 conn(0x7fd19c0705c0 msgr2=0x7fd19c0cefa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:53:02.910 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.917+0000 7fd19259c640 1 --2- 172.21.15.116:0/2537544985 >> v2:172.21.15.142:3300/0 conn(0x7fd19c0705c0 0x7fd19c0cefa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:02.910 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.917+0000 7fd19259c640 1 -- 172.21.15.116:0/2537544985 >> v1:172.21.15.116:6789/0 conn(0x7fd19c06cea0 legacy=0x7fd19c15d840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:02.910 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.917+0000 7fd19259c640 1 -- 172.21.15.116:0/2537544985 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd19c0cf4e0 con 0x7fd19c06c1d0 2024-02-21T22:53:02.910 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.917+0000 7fd19ad9d640 1 --2- 172.21.15.116:0/2537544985 >> v2:172.21.15.142:3300/0 conn(0x7fd19c0705c0 0x7fd19c0cefa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T22:53:02.910 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.918+0000 7fd19259c640 1 --2- 172.21.15.116:0/2537544985 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd19c06c1d0 0x7fd19c06c960 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fd1840097a0 tx=0x7fd18402b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=940c8dc8b8313a82 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:02.910 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.918+0000 7fd19a59c640 1 -- 172.21.15.116:0/2537544985 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd184035020 con 0x7fd19c06c1d0 2024-02-21T22:53:02.910 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.918+0000 7fd19a59c640 1 -- 172.21.15.116:0/2537544985 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd184031830 con 0x7fd19c06c1d0 2024-02-21T22:53:02.910 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.918+0000 7fd19a59c640 1 -- 172.21.15.116:0/2537544985 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd184031be0 con 0x7fd19c06c1d0 2024-02-21T22:53:02.910 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.918+0000 7fd1a1008640 1 -- 172.21.15.116:0/2537544985 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd19c06c1d0 msgr2=0x7fd19c06c960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:02.911 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.918+0000 7fd1a1008640 1 --2- 172.21.15.116:0/2537544985 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd19c06c1d0 0x7fd19c06c960 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fd1840097a0 tx=0x7fd18402b8d0 comp rx=0 tx=0).stop 2024-02-21T22:53:02.911 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.918+0000 7fd1a1008640 1 -- 172.21.15.116:0/2537544985 shutdown_connections 2024-02-21T22:53:02.911 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.918+0000 7fd1a1008640 1 --2- 172.21.15.116:0/2537544985 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd19c06c1d0 0x7fd19c06c960 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:02.911 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.918+0000 7fd1a1008640 1 --2- 172.21.15.116:0/2537544985 >> v2:172.21.15.142:3300/0 conn(0x7fd19c0705c0 0x7fd19c0cefa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:02.911 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.918+0000 7fd1a1008640 1 -- 172.21.15.116:0/2537544985 >> 172.21.15.116:0/2537544985 conn(0x7fd19c0d1bd0 msgr2=0x7fd19c0d1fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:02.911 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.919+0000 7fd1a1008640 1 -- 172.21.15.116:0/2537544985 shutdown_connections 2024-02-21T22:53:02.911 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.919+0000 7fd1a1008640 1 -- 172.21.15.116:0/2537544985 wait complete. 2024-02-21T22:53:02.914 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.920+0000 7fd1a1008640 1 Processor -- start 2024-02-21T22:53:02.914 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.920+0000 7fd1a1008640 1 -- start start 2024-02-21T22:53:02.914 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.921+0000 7fd1a1008640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd19c06c1d0 0x7fd19c1497e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:02.914 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.921+0000 7fd1a1008640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd19c06cea0 0x7fd19c157a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:02.914 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.921+0000 7fd1a1008640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd19c0705c0 0x7fd19c148eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:02.914 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.921+0000 7fd1a1008640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd19c0d0600 con 0x7fd19c0705c0 2024-02-21T22:53:02.915 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.921+0000 7fd1a1008640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd19c0d0320 con 0x7fd19c06cea0 2024-02-21T22:53:02.915 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.921+0000 7fd1a1008640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd19c0d08e0 con 0x7fd19c06c1d0 2024-02-21T22:53:02.915 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.921+0000 7fd19b59e640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd19c0705c0 0x7fd19c148eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:02.915 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.921+0000 7fd19b59e640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd19c0705c0 0x7fd19c148eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:34448/0 (socket says 172.21.15.116:34448) 2024-02-21T22:53:02.915 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.921+0000 7fd19b59e640 1 -- 172.21.15.116:0/1377043667 learned_addr learned my addr 172.21.15.116:0/1377043667 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:02.915 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.921+0000 7fd19ad9d640 1 --2- 172.21.15.116:0/1377043667 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd19c06c1d0 0x7fd19c1497e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:02.915 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.921+0000 7fd19259c640 1 --2- 172.21.15.116:0/1377043667 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd19c06cea0 0x7fd19c157a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:02.915 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.921+0000 7fd19b59e640 1 -- 172.21.15.116:0/1377043667 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd19c06c1d0 msgr2=0x7fd19c1497e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:02.915 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.921+0000 7fd19b59e640 1 --2- 172.21.15.116:0/1377043667 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd19c06c1d0 0x7fd19c1497e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:02.915 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.921+0000 7fd19b59e640 1 -- 172.21.15.116:0/1377043667 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd19c06cea0 msgr2=0x7fd19c157a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:02.915 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.921+0000 7fd19b59e640 1 --2- 172.21.15.116:0/1377043667 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd19c06cea0 0x7fd19c157a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:02.915 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.921+0000 7fd19b59e640 1 -- 172.21.15.116:0/1377043667 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd19c159fb0 con 0x7fd19c0705c0 2024-02-21T22:53:02.915 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.921+0000 7fd19b59e640 1 --2- 172.21.15.116:0/1377043667 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd19c0705c0 0x7fd19c148eb0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fd19400cb40 tx=0x7fd19400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:02.916 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.921+0000 7fd193fff640 1 -- 172.21.15.116:0/1377043667 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd194017070 con 0x7fd19c0705c0 2024-02-21T22:53:02.916 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.921+0000 7fd193fff640 1 -- 172.21.15.116:0/1377043667 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd19400aca0 con 0x7fd19c0705c0 2024-02-21T22:53:02.916 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.921+0000 7fd1a1008640 1 -- 172.21.15.116:0/1377043667 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd19c15a270 con 0x7fd19c0705c0 2024-02-21T22:53:02.916 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.921+0000 7fd193fff640 1 -- 172.21.15.116:0/1377043667 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd194012620 con 0x7fd19c0705c0 2024-02-21T22:53:02.916 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.921+0000 7fd1a1008640 1 -- 172.21.15.116:0/1377043667 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd19c15a830 con 0x7fd19c0705c0 2024-02-21T22:53:02.916 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.922+0000 7fd1a1008640 1 -- 172.21.15.116:0/1377043667 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd19c0752f0 con 0x7fd19c0705c0 2024-02-21T22:53:02.916 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.923+0000 7fd193fff640 1 -- 172.21.15.116:0/1377043667 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fd19401a070 con 0x7fd19c0705c0 2024-02-21T22:53:02.916 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.923+0000 7fd193fff640 1 --2- 172.21.15.116:0/1377043667 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fd17c06b4d0 0x7fd17c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:02.916 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.923+0000 7fd193fff640 1 -- 172.21.15.116:0/1377043667 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd194089f20 con 0x7fd19c0705c0 2024-02-21T22:53:02.916 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.923+0000 7fd19ad9d640 1 --2- 172.21.15.116:0/1377043667 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fd17c06b4d0 0x7fd17c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:02.916 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.924+0000 7fd19ad9d640 1 --2- 172.21.15.116:0/1377043667 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fd17c06b4d0 0x7fd17c06d990 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fd18c009560 tx=0x7fd18c009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:02.918 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:02.927+0000 7fd193fff640 1 -- 172.21.15.116:0/1377043667 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7fd1940587e0 con 0x7fd19c0705c0 2024-02-21T22:53:03.127 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.136+0000 7fd1a1008640 1 -- 172.21.15.116:0/1377043667 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fd19c0b7b50 con 0x7fd19c0705c0 2024-02-21T22:53:03.127 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.137+0000 7fd193fff640 1 -- 172.21.15.116:0/1377043667 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7fd19405c880 con 0x7fd19c0705c0 2024-02-21T22:53:03.128 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-02-21T22:53:03.128 INFO:teuthology.orchestra.run.smithi116.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-02-21T22:53:03.129 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.139+0000 7fd1a1008640 1 -- 172.21.15.116:0/1377043667 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fd17c06b4d0 msgr2=0x7fd17c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:03.130 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.139+0000 7fd1a1008640 1 --2- 172.21.15.116:0/1377043667 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fd17c06b4d0 0x7fd17c06d990 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fd18c009560 tx=0x7fd18c009190 comp rx=0 tx=0).stop 2024-02-21T22:53:03.130 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.139+0000 7fd1a1008640 1 -- 172.21.15.116:0/1377043667 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd19c0705c0 msgr2=0x7fd19c148eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:03.130 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.139+0000 7fd1a1008640 1 --2- 172.21.15.116:0/1377043667 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd19c0705c0 0x7fd19c148eb0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fd19400cb40 tx=0x7fd19400a060 comp rx=0 tx=0).stop 2024-02-21T22:53:03.130 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.139+0000 7fd1a1008640 1 -- 172.21.15.116:0/1377043667 shutdown_connections 2024-02-21T22:53:03.130 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.139+0000 7fd1a1008640 1 --2- 172.21.15.116:0/1377043667 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd19c0705c0 0x7fd19c148eb0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:03.130 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.139+0000 7fd1a1008640 1 --2- 172.21.15.116:0/1377043667 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd19c06cea0 0x7fd19c157a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:03.130 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.139+0000 7fd1a1008640 1 --2- 172.21.15.116:0/1377043667 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fd17c06b4d0 0x7fd17c06d990 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:03.130 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.139+0000 7fd1a1008640 1 --2- 172.21.15.116:0/1377043667 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd19c06c1d0 0x7fd19c1497e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:03.130 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.139+0000 7fd1a1008640 1 -- 172.21.15.116:0/1377043667 >> 172.21.15.116:0/1377043667 conn(0x7fd19c0d1bd0 msgr2=0x7fd19c06eba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:03.130 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.139+0000 7fd1a1008640 1 -- 172.21.15.116:0/1377043667 shutdown_connections 2024-02-21T22:53:03.130 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.139+0000 7fd1a1008640 1 -- 172.21.15.116:0/1377043667 wait complete. 2024-02-21T22:53:03.140 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-02-21T22:53:03.140 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-21T22:53:03.240 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.249+0000 7f89cc8de640 1 Processor -- start 2024-02-21T22:53:03.240 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.249+0000 7f89cc8de640 1 -- start start 2024-02-21T22:53:03.242 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.250+0000 7f89cc8de640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f89c80afa80 0x7f89c80b5990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:03.242 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.250+0000 7f89cc8de640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89c80afe60 con 0x7f89c806b550 2024-02-21T22:53:03.242 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.250+0000 7f89cc8de640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89c815f510 con 0x7f89c80b5ed0 2024-02-21T22:53:03.242 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.250+0000 7f89cc8de640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89c80b5500 con 0x7f89c80afa80 2024-02-21T22:53:03.242 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.250+0000 7f89c6d9d640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f89c806b550 0x7f89c80b0220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:50960/0 (socket says 172.21.15.116:50960) 2024-02-21T22:53:03.243 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.250+0000 7f89c6d9d640 1 -- 172.21.15.116:0/3690939749 learned_addr learned my addr 172.21.15.116:0/3690939749 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-02-21T22:53:03.243 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.250+0000 7f89c659c640 1 --2- 172.21.15.116:0/3690939749 >> v2:172.21.15.142:3300/0 conn(0x7f89c80afa80 0x7f89c80b5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:03.243 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.250+0000 7f89c5d9b640 1 -- 172.21.15.116:0/3690939749 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3703763213 0 0) 0x7f89c0001490 con 0x7f89c806b550 2024-02-21T22:53:03.243 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.250+0000 7f89c5d9b640 1 -- 172.21.15.116:0/3690939749 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f89b4003520 con 0x7f89c806b550 2024-02-21T22:53:03.243 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.250+0000 7f89c659c640 1 -- 172.21.15.116:0/3690939749 >> v1:172.21.15.142:6789/0 conn(0x7f89c80b5ed0 legacy=0x7f89c806ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:03.243 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.250+0000 7f89c659c640 1 -- 172.21.15.116:0/3690939749 >> v1:172.21.15.116:6789/0 conn(0x7f89c806b550 legacy=0x7f89c80b0220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:03.243 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.250+0000 7f89c659c640 1 -- 172.21.15.116:0/3690939749 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89c815f7f0 con 0x7f89c80afa80 2024-02-21T22:53:03.243 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.251+0000 7f89c659c640 1 --2- 172.21.15.116:0/3690939749 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f89c80afa80 0x7f89c80b5990 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f89b80097a0 tx=0x7f89b802b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2c8dda2ef7a7cf96 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:03.243 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.251+0000 7f89c5d9b640 1 -- 172.21.15.116:0/3690939749 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89b8034070 con 0x7f89c80afa80 2024-02-21T22:53:03.243 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.251+0000 7f89c5d9b640 1 -- 172.21.15.116:0/3690939749 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89b8030610 con 0x7f89c80afa80 2024-02-21T22:53:03.243 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.251+0000 7f89c5d9b640 1 -- 172.21.15.116:0/3690939749 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89b80309e0 con 0x7f89c80afa80 2024-02-21T22:53:03.243 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.252+0000 7f89cc8de640 1 -- 172.21.15.116:0/3690939749 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f89c80afa80 msgr2=0x7f89c80b5990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:03.243 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.252+0000 7f89cc8de640 1 --2- 172.21.15.116:0/3690939749 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f89c80afa80 0x7f89c80b5990 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f89b80097a0 tx=0x7f89b802b960 comp rx=0 tx=0).stop 2024-02-21T22:53:03.244 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.252+0000 7f89cc8de640 1 -- 172.21.15.116:0/3690939749 shutdown_connections 2024-02-21T22:53:03.244 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.252+0000 7f89cc8de640 1 --2- 172.21.15.116:0/3690939749 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f89c80afa80 0x7f89c80b5990 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:03.244 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.252+0000 7f89cc8de640 1 -- 172.21.15.116:0/3690939749 >> 172.21.15.116:0/3690939749 conn(0x7f89c80724f0 msgr2=0x7f89c8072900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:03.244 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.252+0000 7f89cc8de640 1 -- 172.21.15.116:0/3690939749 shutdown_connections 2024-02-21T22:53:03.244 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.252+0000 7f89cc8de640 1 -- 172.21.15.116:0/3690939749 wait complete. 2024-02-21T22:53:03.247 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.253+0000 7f89cc8de640 1 Processor -- start 2024-02-21T22:53:03.247 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.253+0000 7f89cc8de640 1 -- start start 2024-02-21T22:53:03.247 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.254+0000 7f89cc8de640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f89c806b550 0x7f89c8159440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:03.247 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.254+0000 7f89cc8de640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f89c80afa80 0x7f89c815b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:03.247 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.254+0000 7f89cc8de640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f89c80b5ed0 0x7f89c815d000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:03.247 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.254+0000 7f89cc8de640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89c80b0ab0 con 0x7f89c806b550 2024-02-21T22:53:03.247 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.254+0000 7f89cc8de640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89c80b0930 con 0x7f89c80afa80 2024-02-21T22:53:03.247 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.254+0000 7f89cc8de640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89c80b0c30 con 0x7f89c80b5ed0 2024-02-21T22:53:03.247 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.254+0000 7f89c659c640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f89c806b550 0x7f89c8159440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:03.247 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.254+0000 7f89c659c640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f89c806b550 0x7f89c8159440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:34450/0 (socket says 172.21.15.116:34450) 2024-02-21T22:53:03.247 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.254+0000 7f89c659c640 1 -- 172.21.15.116:0/3003097674 learned_addr learned my addr 172.21.15.116:0/3003097674 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:03.247 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.254+0000 7f89c6d9d640 1 --2- 172.21.15.116:0/3003097674 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f89c80b5ed0 0x7f89c815d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:03.248 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.254+0000 7f89bffff640 1 --2- 172.21.15.116:0/3003097674 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f89c80afa80 0x7f89c815b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:03.248 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.254+0000 7f89c659c640 1 -- 172.21.15.116:0/3003097674 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f89c80b5ed0 msgr2=0x7f89c815d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:03.248 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.254+0000 7f89c659c640 1 --2- 172.21.15.116:0/3003097674 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f89c80b5ed0 0x7f89c815d000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:03.248 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.254+0000 7f89c659c640 1 -- 172.21.15.116:0/3003097674 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f89c80afa80 msgr2=0x7f89c815b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:03.248 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.254+0000 7f89c659c640 1 --2- 172.21.15.116:0/3003097674 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f89c80afa80 0x7f89c815b8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:03.248 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.254+0000 7f89c659c640 1 -- 172.21.15.116:0/3003097674 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89c8159b40 con 0x7f89c806b550 2024-02-21T22:53:03.248 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.254+0000 7f89c659c640 1 --2- 172.21.15.116:0/3003097674 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f89c806b550 0x7f89c8159440 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f89b80098c0 tx=0x7f89b80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:03.248 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.254+0000 7f89beffd640 1 -- 172.21.15.116:0/3003097674 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89b8034040 con 0x7f89c806b550 2024-02-21T22:53:03.248 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.254+0000 7f89beffd640 1 -- 172.21.15.116:0/3003097674 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89b8030410 con 0x7f89c806b550 2024-02-21T22:53:03.248 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.254+0000 7f89cc8de640 1 -- 172.21.15.116:0/3003097674 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89c8159e20 con 0x7f89c806b550 2024-02-21T22:53:03.248 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.254+0000 7f89beffd640 1 -- 172.21.15.116:0/3003097674 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89b8039c50 con 0x7f89c806b550 2024-02-21T22:53:03.248 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.254+0000 7f89cc8de640 1 -- 172.21.15.116:0/3003097674 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89c80c5500 con 0x7f89c806b550 2024-02-21T22:53:03.248 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.255+0000 7f89cc8de640 1 -- 172.21.15.116:0/3003097674 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89c80752f0 con 0x7f89c806b550 2024-02-21T22:53:03.248 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.256+0000 7f89beffd640 1 -- 172.21.15.116:0/3003097674 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f89b8037070 con 0x7f89c806b550 2024-02-21T22:53:03.249 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.256+0000 7f89beffd640 1 --2- 172.21.15.116:0/3003097674 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f89a806b4d0 0x7f89a806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:03.249 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.256+0000 7f89beffd640 1 -- 172.21.15.116:0/3003097674 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f89b80ac050 con 0x7f89c806b550 2024-02-21T22:53:03.249 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.256+0000 7f89bffff640 1 --2- 172.21.15.116:0/3003097674 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f89a806b4d0 0x7f89a806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:03.249 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.257+0000 7f89bffff640 1 --2- 172.21.15.116:0/3003097674 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f89a806b4d0 0x7f89a806d990 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f89c809e4c0 tx=0x7f89b0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:03.251 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.260+0000 7f89beffd640 1 -- 172.21.15.116:0/3003097674 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f89b80305e0 con 0x7f89c806b550 2024-02-21T22:53:03.422 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.432+0000 7f89cc8de640 1 -- 172.21.15.116:0/3003097674 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f89c80c5740 con 0x7f89c806b550 2024-02-21T22:53:03.423 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.433+0000 7f89beffd640 1 -- 172.21.15.116:0/3003097674 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16653 (secure 0 0 0) 0x7f89b807a880 con 0x7f89c806b550 2024-02-21T22:53:03.424 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-02-21T22:53:03.424 INFO:teuthology.orchestra.run.smithi116.stdout:{"epoch":20,"fsid":"7c298660-5f63-4b5c-a800-58c5be9a8445","created":"2024-02-21T22:52:25.994613+0000","modified":"2024-02-21T22:52:51.786454+0000","last_up_change":"2024-02-21T22:52:37.313595+0000","last_in_change":"2024-02-21T22:52:28.176031+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-21T22:52:38.328796+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-21T22:52:48.145152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-21T22:52:49.096955+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4f09126b-b5e4-4876-8b08-f5cbb967388a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":1613202231},{"type":"v1","addr":"172.21.15.116:6809","nonce":1613202231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":1613202231},{"type":"v1","addr":"172.21.15.116:6811","nonce":1613202231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":1613202231},{"type":"v1","addr":"172.21.15.116:6815","nonce":1613202231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":1613202231},{"type":"v1","addr":"172.21.15.116:6813","nonce":1613202231}]},"public_addr":"172.21.15.116:6809/1613202231","cluster_addr":"172.21.15.116:6811/1613202231","heartbeat_back_addr":"172.21.15.116:6815/1613202231","heartbeat_front_addr":"172.21.15.116:6813/1613202231","state":["exists","up"]},{"osd":1,"uuid":"7272c51d-51f9-4536-931d-33ad7a4b377e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6816","nonce":172614746},{"type":"v1","addr":"172.21.15.116:6817","nonce":172614746}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":172614746},{"type":"v1","addr":"172.21.15.116:6819","nonce":172614746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":172614746},{"type":"v1","addr":"172.21.15.116:6823","nonce":172614746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":172614746},{"type":"v1","addr":"172.21.15.116:6821","nonce":172614746}]},"public_addr":"172.21.15.116:6817/172614746","cluster_addr":"172.21.15.116:6819/172614746","heartbeat_back_addr":"172.21.15.116:6823/172614746","heartbeat_front_addr":"172.21.15.116:6821/172614746","state":["exists","up"]},{"osd":2,"uuid":"2589616c-adf1-4187-aac3-735256cf624b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":1029280577},{"type":"v1","addr":"172.21.15.116:6825","nonce":1029280577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":1029280577},{"type":"v1","addr":"172.21.15.116:6827","nonce":1029280577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":1029280577},{"type":"v1","addr":"172.21.15.116:6831","nonce":1029280577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":1029280577},{"type":"v1","addr":"172.21.15.116:6829","nonce":1029280577}]},"public_addr":"172.21.15.116:6825/1029280577","cluster_addr":"172.21.15.116:6827/1029280577","heartbeat_back_addr":"172.21.15.116:6831/1029280577","heartbeat_front_addr":"172.21.15.116:6829/1029280577","state":["exists","up"]},{"osd":3,"uuid":"0fd2e563-7c5b-46f6-82c2-b60c86072c93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":3106627557},{"type":"v1","addr":"172.21.15.116:6801","nonce":3106627557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":3106627557},{"type":"v1","addr":"172.21.15.116:6803","nonce":3106627557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":3106627557},{"type":"v1","addr":"172.21.15.116:6807","nonce":3106627557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":3106627557},{"type":"v1","addr":"172.21.15.116:6805","nonce":3106627557}]},"public_addr":"172.21.15.116:6801/3106627557","cluster_addr":"172.21.15.116:6803/3106627557","heartbeat_back_addr":"172.21.15.116:6807/3106627557","heartbeat_front_addr":"172.21.15.116:6805/3106627557","state":["exists","up"]},{"osd":4,"uuid":"79ae35b7-dda8-4ab8-96ce-47515afde082","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":3231407772},{"type":"v1","addr":"172.21.15.142:6825","nonce":3231407772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":3231407772},{"type":"v1","addr":"172.21.15.142:6827","nonce":3231407772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":3231407772},{"type":"v1","addr":"172.21.15.142:6831","nonce":3231407772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":3231407772},{"type":"v1","addr":"172.21.15.142:6829","nonce":3231407772}]},"public_addr":"172.21.15.142:6825/3231407772","cluster_addr":"172.21.15.142:6827/3231407772","heartbeat_back_addr":"172.21.15.142:6831/3231407772","heartbeat_front_addr":"172.21.15.142:6829/3231407772","state":["exists","up"]},{"osd":5,"uuid":"3166eb2c-3fcf-41c8-9362-45bafaabaa39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":1184158716},{"type":"v1","addr":"172.21.15.142:6817","nonce":1184158716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":1184158716},{"type":"v1","addr":"172.21.15.142:6819","nonce":1184158716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":1184158716},{"type":"v1","addr":"172.21.15.142:6823","nonce":1184158716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":1184158716},{"type":"v1","addr":"172.21.15.142:6821","nonce":1184158716}]},"public_addr":"172.21.15.142:6817/1184158716","cluster_addr":"172.21.15.142:6819/1184158716","heartbeat_back_addr":"172.21.15.142:6823/1184158716","heartbeat_front_addr":"172.21.15.142:6821/1184158716","state":["exists","up"]},{"osd":6,"uuid":"f9aa9672-7527-43e2-963e-b61868e5e63f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":1987868911},{"type":"v1","addr":"172.21.15.142:6801","nonce":1987868911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":1987868911},{"type":"v1","addr":"172.21.15.142:6803","nonce":1987868911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":1987868911},{"type":"v1","addr":"172.21.15.142:6807","nonce":1987868911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":1987868911},{"type":"v1","addr":"172.21.15.142:6805","nonce":1987868911}]},"public_addr":"172.21.15.142:6801/1987868911","cluster_addr":"172.21.15.142:6803/1987868911","heartbeat_back_addr":"172.21.15.142:6807/1987868911","heartbeat_front_addr":"172.21.15.142:6805/1987868911","state":["exists","up"]},{"osd":7,"uuid":"7ed29226-fc42-4382-a91a-fa50f7ec5426","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":1272081937},{"type":"v1","addr":"172.21.15.142:6809","nonce":1272081937}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":1272081937},{"type":"v1","addr":"172.21.15.142:6811","nonce":1272081937}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":1272081937},{"type":"v1","addr":"172.21.15.142:6815","nonce":1272081937}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":1272081937},{"type":"v1","addr":"172.21.15.142:6813","nonce":1272081937}]},"public_addr":"172.21.15.142:6809/1272081937","cluster_addr":"172.21.15.142:6811/1272081937","heartbeat_back_addr":"172.21.15.142:6815/1272081937","heartbeat_front_addr":"172.21.15.142:6813/1272081937","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.350998+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.307201+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.289112+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.243888+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.312091+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.370472+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.275659+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.289297+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-21T22:53:03.426 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.435+0000 7f89cc8de640 1 -- 172.21.15.116:0/3003097674 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f89a806b4d0 msgr2=0x7f89a806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:03.426 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.435+0000 7f89cc8de640 1 --2- 172.21.15.116:0/3003097674 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f89a806b4d0 0x7f89a806d990 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f89c809e4c0 tx=0x7f89b0009040 comp rx=0 tx=0).stop 2024-02-21T22:53:03.426 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.435+0000 7f89cc8de640 1 -- 172.21.15.116:0/3003097674 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f89c806b550 msgr2=0x7f89c8159440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:03.426 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.435+0000 7f89cc8de640 1 --2- 172.21.15.116:0/3003097674 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f89c806b550 0x7f89c8159440 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f89b80098c0 tx=0x7f89b80046c0 comp rx=0 tx=0).stop 2024-02-21T22:53:03.426 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.435+0000 7f89cc8de640 1 -- 172.21.15.116:0/3003097674 shutdown_connections 2024-02-21T22:53:03.426 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.435+0000 7f89cc8de640 1 --2- 172.21.15.116:0/3003097674 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f89a806b4d0 0x7f89a806d990 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:03.426 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.435+0000 7f89cc8de640 1 --2- 172.21.15.116:0/3003097674 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f89c80b5ed0 0x7f89c815d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:03.427 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.435+0000 7f89cc8de640 1 --2- 172.21.15.116:0/3003097674 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f89c80afa80 0x7f89c815b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:03.427 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.435+0000 7f89cc8de640 1 --2- 172.21.15.116:0/3003097674 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f89c806b550 0x7f89c8159440 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:03.427 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.435+0000 7f89cc8de640 1 -- 172.21.15.116:0/3003097674 >> 172.21.15.116:0/3003097674 conn(0x7f89c80724f0 msgr2=0x7f89c80d01e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:03.427 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.435+0000 7f89cc8de640 1 -- 172.21.15.116:0/3003097674 shutdown_connections 2024-02-21T22:53:03.427 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.435+0000 7f89cc8de640 1 -- 172.21.15.116:0/3003097674 wait complete. 2024-02-21T22:53:03.437 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-21T22:52:38.328796+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-02-21T22:52:48.145152+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-02-21T22:52:49.096955+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-21T22:53:03.437 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-21T22:53:03.540 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.549+0000 7f125d984640 1 Processor -- start 2024-02-21T22:53:03.540 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.550+0000 7f125d984640 1 -- start start 2024-02-21T22:53:03.542 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.550+0000 7f125d984640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f12580d0ca0 0x7f12580d4940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:03.542 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.550+0000 7f125d984640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12580ceea0 con 0x7f12580d2840 2024-02-21T22:53:03.542 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.550+0000 7f125d984640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12580cf180 con 0x7f12580d2400 2024-02-21T22:53:03.542 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.550+0000 7f125d984640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12580cf460 con 0x7f12580d0ca0 2024-02-21T22:53:03.542 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.550+0000 7f12577fe640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f12580d2840 0x7f125815e180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:50976/0 (socket says 172.21.15.116:50976) 2024-02-21T22:53:03.543 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.550+0000 7f12577fe640 1 -- 172.21.15.116:0/1699614759 learned_addr learned my addr 172.21.15.116:0/1699614759 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-02-21T22:53:03.543 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.550+0000 7f1256ffd640 1 --2- 172.21.15.116:0/1699614759 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f12580d0ca0 0x7f12580d4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:03.543 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.551+0000 7f1255ffb640 1 -- 172.21.15.116:0/1699614759 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4247574272 0 0) 0x7f12580ceea0 con 0x7f12580d2840 2024-02-21T22:53:03.543 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.551+0000 7f1255ffb640 1 -- 172.21.15.116:0/1699614759 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1240003520 con 0x7f12580d2840 2024-02-21T22:53:03.543 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.551+0000 7f1255ffb640 1 -- 172.21.15.116:0/1699614759 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1145973260 0 0) 0x7f12580cf180 con 0x7f12580d2400 2024-02-21T22:53:03.543 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.551+0000 7f1255ffb640 1 -- 172.21.15.116:0/1699614759 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f12580ceea0 con 0x7f12580d2400 2024-02-21T22:53:03.543 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.551+0000 7f1256ffd640 1 -- 172.21.15.116:0/1699614759 >> v1:172.21.15.142:6789/0 conn(0x7f12580d2400 legacy=0x7f125815da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:03.543 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.551+0000 7f1256ffd640 1 -- 172.21.15.116:0/1699614759 >> v1:172.21.15.116:6789/0 conn(0x7f12580d2840 legacy=0x7f125815e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:03.543 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.551+0000 7f1256ffd640 1 -- 172.21.15.116:0/1699614759 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12580cf740 con 0x7f12580d0ca0 2024-02-21T22:53:03.543 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.552+0000 7f1256ffd640 1 --2- 172.21.15.116:0/1699614759 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f12580d0ca0 0x7f12580d4940 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f1248009dc0 tx=0x7f124802bfa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e1c112398e266ad3 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:03.543 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.552+0000 7f1255ffb640 1 -- 172.21.15.116:0/1699614759 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1248039070 con 0x7f12580d0ca0 2024-02-21T22:53:03.543 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.552+0000 7f1255ffb640 1 -- 172.21.15.116:0/1699614759 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f124802cd50 con 0x7f12580d0ca0 2024-02-21T22:53:03.543 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.552+0000 7f1255ffb640 1 -- 172.21.15.116:0/1699614759 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1248034640 con 0x7f12580d0ca0 2024-02-21T22:53:03.546 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.552+0000 7f125d984640 1 -- 172.21.15.116:0/1699614759 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f12580d0ca0 msgr2=0x7f12580d4940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:03.546 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.552+0000 7f125d984640 1 --2- 172.21.15.116:0/1699614759 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f12580d0ca0 0x7f12580d4940 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f1248009dc0 tx=0x7f124802bfa0 comp rx=0 tx=0).stop 2024-02-21T22:53:03.546 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.552+0000 7f125d984640 1 -- 172.21.15.116:0/1699614759 shutdown_connections 2024-02-21T22:53:03.546 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.552+0000 7f125d984640 1 --2- 172.21.15.116:0/1699614759 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f12580d0ca0 0x7f12580d4940 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:03.547 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.552+0000 7f125d984640 1 -- 172.21.15.116:0/1699614759 >> 172.21.15.116:0/1699614759 conn(0x7f12580d3e20 msgr2=0x7f12580d4230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:03.547 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.552+0000 7f125d984640 1 -- 172.21.15.116:0/1699614759 shutdown_connections 2024-02-21T22:53:03.547 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.552+0000 7f125d984640 1 -- 172.21.15.116:0/1699614759 wait complete. 2024-02-21T22:53:03.547 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.553+0000 7f125d984640 1 Processor -- start 2024-02-21T22:53:03.547 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.554+0000 7f125d984640 1 -- start start 2024-02-21T22:53:03.547 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.554+0000 7f125d984640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f12580d0ca0 0x7f125815f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:03.547 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.554+0000 7f125d984640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f12580d2400 0x7f125814f270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:03.547 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.554+0000 7f125d984640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f12580d2840 0x7f12580b3780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:03.547 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.554+0000 7f125d984640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12580d1080 con 0x7f12580d0ca0 2024-02-21T22:53:03.547 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.554+0000 7f125d984640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12580d2cd0 con 0x7f12580d2840 2024-02-21T22:53:03.547 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.554+0000 7f125d984640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12580d1200 con 0x7f12580d2400 2024-02-21T22:53:03.548 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.554+0000 7f1256ffd640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f12580d0ca0 0x7f125815f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:03.548 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.554+0000 7f1256ffd640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f12580d0ca0 0x7f125815f360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:34462/0 (socket says 172.21.15.116:34462) 2024-02-21T22:53:03.548 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.554+0000 7f1256ffd640 1 -- 172.21.15.116:0/3921355464 learned_addr learned my addr 172.21.15.116:0/3921355464 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:03.548 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.555+0000 7f12577fe640 1 --2- 172.21.15.116:0/3921355464 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f12580d2840 0x7f12580b3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:03.548 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.555+0000 7f12567fc640 1 --2- 172.21.15.116:0/3921355464 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f12580d2400 0x7f125814f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:03.548 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.555+0000 7f1256ffd640 1 -- 172.21.15.116:0/3921355464 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f12580d2400 msgr2=0x7f125814f270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:03.548 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.555+0000 7f1256ffd640 1 --2- 172.21.15.116:0/3921355464 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f12580d2400 0x7f125814f270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:03.548 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.555+0000 7f1256ffd640 1 -- 172.21.15.116:0/3921355464 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f12580d2840 msgr2=0x7f12580b3780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:03.548 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.555+0000 7f1256ffd640 1 --2- 172.21.15.116:0/3921355464 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f12580d2840 0x7f12580b3780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:03.548 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.555+0000 7f1256ffd640 1 -- 172.21.15.116:0/3921355464 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f125814f7b0 con 0x7f12580d0ca0 2024-02-21T22:53:03.548 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.555+0000 7f12567fc640 1 --2- 172.21.15.116:0/3921355464 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f12580d2400 0x7f125814f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T22:53:03.548 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.555+0000 7f12577fe640 1 --2- 172.21.15.116:0/3921355464 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f12580d2840 0x7f12580b3780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T22:53:03.548 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.555+0000 7f1256ffd640 1 --2- 172.21.15.116:0/3921355464 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f12580d0ca0 0x7f125815f360 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f1248009ee0 tx=0x7f1248004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:03.548 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.555+0000 7f123ffff640 1 -- 172.21.15.116:0/3921355464 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1248044020 con 0x7f12580d0ca0 2024-02-21T22:53:03.549 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.555+0000 7f123ffff640 1 -- 172.21.15.116:0/3921355464 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f124803f470 con 0x7f12580d0ca0 2024-02-21T22:53:03.549 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.555+0000 7f125d984640 1 -- 172.21.15.116:0/3921355464 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1258160840 con 0x7f12580d0ca0 2024-02-21T22:53:03.549 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.555+0000 7f123ffff640 1 -- 172.21.15.116:0/3921355464 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1248039040 con 0x7f12580d0ca0 2024-02-21T22:53:03.549 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.555+0000 7f125d984640 1 -- 172.21.15.116:0/3921355464 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1258160e00 con 0x7f12580d0ca0 2024-02-21T22:53:03.549 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.556+0000 7f125d984640 1 -- 172.21.15.116:0/3921355464 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12580752f0 con 0x7f12580d0ca0 2024-02-21T22:53:03.550 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.556+0000 7f123ffff640 1 -- 172.21.15.116:0/3921355464 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f1248047020 con 0x7f12580d0ca0 2024-02-21T22:53:03.550 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.557+0000 7f123ffff640 1 --2- 172.21.15.116:0/3921355464 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f124406b4d0 0x7f124406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:03.550 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.557+0000 7f123ffff640 1 -- 172.21.15.116:0/3921355464 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f12480acc00 con 0x7f12580d0ca0 2024-02-21T22:53:03.550 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.557+0000 7f12567fc640 1 --2- 172.21.15.116:0/3921355464 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f124406b4d0 0x7f124406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:03.550 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.557+0000 7f12567fc640 1 --2- 172.21.15.116:0/3921355464 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f124406b4d0 0x7f124406d990 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f12580b57c0 tx=0x7f124c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:03.551 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.561+0000 7f123ffff640 1 -- 172.21.15.116:0/3921355464 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f12480b3080 con 0x7f12580d0ca0 2024-02-21T22:53:03.721 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.730+0000 7f125d984640 1 -- 172.21.15.116:0/3921355464 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f12580d21e0 con 0x7f12580d0ca0 2024-02-21T22:53:03.721 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.730+0000 7f123ffff640 1 -- 172.21.15.116:0/3921355464 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f124804e030 con 0x7f12580d0ca0 2024-02-21T22:53:03.721 INFO:teuthology.orchestra.run.smithi116.stdout:pg_num: 1 2024-02-21T22:53:03.723 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.732+0000 7f125d984640 1 -- 172.21.15.116:0/3921355464 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f124406b4d0 msgr2=0x7f124406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:03.723 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.732+0000 7f125d984640 1 --2- 172.21.15.116:0/3921355464 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f124406b4d0 0x7f124406d990 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f12580b57c0 tx=0x7f124c009040 comp rx=0 tx=0).stop 2024-02-21T22:53:03.723 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.732+0000 7f125d984640 1 -- 172.21.15.116:0/3921355464 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f12580d0ca0 msgr2=0x7f125815f360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:03.723 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.732+0000 7f125d984640 1 --2- 172.21.15.116:0/3921355464 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f12580d0ca0 0x7f125815f360 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f1248009ee0 tx=0x7f1248004a40 comp rx=0 tx=0).stop 2024-02-21T22:53:03.723 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.732+0000 7f125d984640 1 -- 172.21.15.116:0/3921355464 shutdown_connections 2024-02-21T22:53:03.723 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.732+0000 7f125d984640 1 --2- 172.21.15.116:0/3921355464 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f12580d2840 0x7f12580b3780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:03.723 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.732+0000 7f125d984640 1 --2- 172.21.15.116:0/3921355464 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f124406b4d0 0x7f124406d990 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:03.724 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.732+0000 7f125d984640 1 --2- 172.21.15.116:0/3921355464 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f12580d2400 0x7f125814f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:03.724 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.732+0000 7f125d984640 1 --2- 172.21.15.116:0/3921355464 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f12580d0ca0 0x7f125815f360 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:03.724 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.732+0000 7f125d984640 1 -- 172.21.15.116:0/3921355464 >> 172.21.15.116:0/3921355464 conn(0x7f12580d3e20 msgr2=0x7f125806cc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:03.724 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.732+0000 7f125d984640 1 -- 172.21.15.116:0/3921355464 shutdown_connections 2024-02-21T22:53:03.724 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.732+0000 7f125d984640 1 -- 172.21.15.116:0/3921355464 wait complete. 2024-02-21T22:53:03.734 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-02-21T22:53:03.839 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.848+0000 7f6fe3a20640 1 Processor -- start 2024-02-21T22:53:03.839 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.848+0000 7f6fe3a20640 1 -- start start 2024-02-21T22:53:03.840 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.849+0000 7f6fe3a20640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f6fdc15dfe0 0x7f6fdc06eb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:03.840 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.849+0000 7f6fe3a20640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6fdc162840 0x7f6fdc06f540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:03.840 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.849+0000 7f6fe3a20640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fdc0d0030 con 0x7f6fdc0d0df0 2024-02-21T22:53:03.840 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.849+0000 7f6fe3a20640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fdc0d0310 con 0x7f6fdc15dfe0 2024-02-21T22:53:03.840 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.849+0000 7f6fe3a20640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fdc0d05f0 con 0x7f6fdc162840 2024-02-21T22:53:03.840 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.849+0000 7f6fe17bc640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f6fdc15dfe0 0x7f6fdc06eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:03.841 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.849+0000 7f6fe17bc640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f6fdc15dfe0 0x7f6fdc06eb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:34468/0 (socket says 172.21.15.116:34468) 2024-02-21T22:53:03.841 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.849+0000 7f6fe17bc640 1 -- 172.21.15.116:0/3985721716 learned_addr learned my addr 172.21.15.116:0/3985721716 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:03.841 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.849+0000 7f6fe0fbb640 1 --2- 172.21.15.116:0/3985721716 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6fdc162840 0x7f6fdc06f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:03.841 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.849+0000 7f6fe17bc640 1 -- 172.21.15.116:0/3985721716 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6fdc162840 msgr2=0x7f6fdc06f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:53:03.841 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.849+0000 7f6fe17bc640 1 --2- 172.21.15.116:0/3985721716 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6fdc162840 0x7f6fdc06f540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:03.841 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.849+0000 7f6fe17bc640 1 -- 172.21.15.116:0/3985721716 >> v1:172.21.15.142:6789/0 conn(0x7f6fdc0d0df0 legacy=0x7f6fdc0cc200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:03.841 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.849+0000 7f6fe17bc640 1 -- 172.21.15.116:0/3985721716 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fdc0d08d0 con 0x7f6fdc15dfe0 2024-02-21T22:53:03.842 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.850+0000 7f6fe17bc640 1 --2- 172.21.15.116:0/3985721716 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6fdc15dfe0 0x7f6fdc06eb50 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f6fd8009870 tx=0x7f6fd802b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=253addfe629dcee8 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:03.842 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.850+0000 7f6fd3fff640 1 -- 172.21.15.116:0/3985721716 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fd80317c0 con 0x7f6fdc15dfe0 2024-02-21T22:53:03.842 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.850+0000 7f6fd3fff640 1 -- 172.21.15.116:0/3985721716 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fd8037070 con 0x7f6fdc15dfe0 2024-02-21T22:53:03.843 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.850+0000 7f6fd3fff640 1 -- 172.21.15.116:0/3985721716 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fd8031b80 con 0x7f6fdc15dfe0 2024-02-21T22:53:03.843 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.851+0000 7f6fe3a20640 1 -- 172.21.15.116:0/3985721716 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6fdc15dfe0 msgr2=0x7f6fdc06eb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:03.843 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.851+0000 7f6fe3a20640 1 --2- 172.21.15.116:0/3985721716 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6fdc15dfe0 0x7f6fdc06eb50 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f6fd8009870 tx=0x7f6fd802b860 comp rx=0 tx=0).stop 2024-02-21T22:53:03.843 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.851+0000 7f6fe3a20640 1 -- 172.21.15.116:0/3985721716 shutdown_connections 2024-02-21T22:53:03.843 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.851+0000 7f6fe3a20640 1 --2- 172.21.15.116:0/3985721716 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6fdc162840 0x7f6fdc06f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:03.843 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.851+0000 7f6fe3a20640 1 --2- 172.21.15.116:0/3985721716 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6fdc15dfe0 0x7f6fdc06eb50 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:03.843 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.851+0000 7f6fe3a20640 1 -- 172.21.15.116:0/3985721716 >> 172.21.15.116:0/3985721716 conn(0x7f6fdc0b36c0 msgr2=0x7f6fdc0b3ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:03.843 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.851+0000 7f6fe3a20640 1 -- 172.21.15.116:0/3985721716 shutdown_connections 2024-02-21T22:53:03.843 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.851+0000 7f6fe3a20640 1 -- 172.21.15.116:0/3985721716 wait complete. 2024-02-21T22:53:03.843 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.852+0000 7f6fe3a20640 1 Processor -- start 2024-02-21T22:53:03.843 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.852+0000 7f6fe3a20640 1 -- start start 2024-02-21T22:53:03.846 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.853+0000 7f6fe3a20640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6fdc0d0df0 0x7f6fdc0c7fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:03.846 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.853+0000 7f6fe3a20640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6fdc15dfe0 0x7f6fdc1529e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:03.846 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.853+0000 7f6fe3a20640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6fdc162840 0x7f6fdc0c5fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:03.846 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.853+0000 7f6fe3a20640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fdc06f090 con 0x7f6fdc0d0df0 2024-02-21T22:53:03.846 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.853+0000 7f6fe3a20640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fdc15e3c0 con 0x7f6fdc15dfe0 2024-02-21T22:53:03.846 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.853+0000 7f6fe3a20640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fdc06f210 con 0x7f6fdc162840 2024-02-21T22:53:03.846 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.853+0000 7f6fe17bc640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6fdc0d0df0 0x7f6fdc0c7fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:03.846 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.853+0000 7f6fe17bc640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6fdc0d0df0 0x7f6fdc0c7fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:34470/0 (socket says 172.21.15.116:34470) 2024-02-21T22:53:03.846 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.853+0000 7f6fe17bc640 1 -- 172.21.15.116:0/661930842 learned_addr learned my addr 172.21.15.116:0/661930842 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:03.846 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.853+0000 7f6fe1fbd640 1 --2- 172.21.15.116:0/661930842 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6fdc162840 0x7f6fdc0c5fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:03.846 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.853+0000 7f6fe0fbb640 1 --2- 172.21.15.116:0/661930842 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6fdc15dfe0 0x7f6fdc1529e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:03.847 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.853+0000 7f6fe17bc640 1 -- 172.21.15.116:0/661930842 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6fdc162840 msgr2=0x7f6fdc0c5fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:03.847 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.853+0000 7f6fe17bc640 1 --2- 172.21.15.116:0/661930842 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6fdc162840 0x7f6fdc0c5fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:03.847 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.853+0000 7f6fe17bc640 1 -- 172.21.15.116:0/661930842 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6fdc15dfe0 msgr2=0x7f6fdc1529e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:03.847 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.853+0000 7f6fe17bc640 1 --2- 172.21.15.116:0/661930842 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6fdc15dfe0 0x7f6fdc1529e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:03.847 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.853+0000 7f6fe17bc640 1 -- 172.21.15.116:0/661930842 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fdc0c6f20 con 0x7f6fdc0d0df0 2024-02-21T22:53:03.847 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.853+0000 7f6fe17bc640 1 --2- 172.21.15.116:0/661930842 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6fdc0d0df0 0x7f6fdc0c7fc0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f6fd802b8a0 tx=0x7f6fd80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:03.847 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.853+0000 7f6fd1ffb640 1 -- 172.21.15.116:0/661930842 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fd8032650 con 0x7f6fdc0d0df0 2024-02-21T22:53:03.847 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.853+0000 7f6fd1ffb640 1 -- 172.21.15.116:0/661930842 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fd80327f0 con 0x7f6fdc0d0df0 2024-02-21T22:53:03.847 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.853+0000 7f6fd1ffb640 1 -- 172.21.15.116:0/661930842 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fd8032be0 con 0x7f6fdc0d0df0 2024-02-21T22:53:03.847 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.853+0000 7f6fe3a20640 1 -- 172.21.15.116:0/661930842 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fdc0c7200 con 0x7f6fdc0d0df0 2024-02-21T22:53:03.847 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.854+0000 7f6fe3a20640 1 -- 172.21.15.116:0/661930842 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fdc0c77c0 con 0x7f6fdc0d0df0 2024-02-21T22:53:03.847 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.855+0000 7f6fe3a20640 1 -- 172.21.15.116:0/661930842 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fdc0c7c00 con 0x7f6fdc0d0df0 2024-02-21T22:53:03.847 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.855+0000 7f6fd1ffb640 1 -- 172.21.15.116:0/661930842 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f6fd804c060 con 0x7f6fdc0d0df0 2024-02-21T22:53:03.847 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.855+0000 7f6fd1ffb640 1 --2- 172.21.15.116:0/661930842 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f6fc006b4d0 0x7f6fc006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:03.847 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.855+0000 7f6fd1ffb640 1 -- 172.21.15.116:0/661930842 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6fd80abbe0 con 0x7f6fdc0d0df0 2024-02-21T22:53:03.848 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.856+0000 7f6fe0fbb640 1 --2- 172.21.15.116:0/661930842 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f6fc006b4d0 0x7f6fc006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:03.848 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.856+0000 7f6fe0fbb640 1 --2- 172.21.15.116:0/661930842 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f6fc006b4d0 0x7f6fc006d990 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f6fdc0b7ae0 tx=0x7f6fcc009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:03.850 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:03.860+0000 7f6fd1ffb640 1 -- 172.21.15.116:0/661930842 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f6fd8040070 con 0x7f6fdc0d0df0 2024-02-21T22:53:04.020 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.029+0000 7f6fe3a20640 1 -- 172.21.15.116:0/661930842 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6fdc0752f0 con 0x7f6fdc0d0df0 2024-02-21T22:53:04.020 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.030+0000 7f6fd1ffb640 1 -- 172.21.15.116:0/661930842 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6fd807a410 con 0x7f6fdc0d0df0 2024-02-21T22:53:04.020 INFO:teuthology.orchestra.run.smithi116.stdout:pg_num: 32 2024-02-21T22:53:04.022 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.032+0000 7f6fe3a20640 1 -- 172.21.15.116:0/661930842 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f6fc006b4d0 msgr2=0x7f6fc006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:04.022 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.032+0000 7f6fe3a20640 1 --2- 172.21.15.116:0/661930842 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f6fc006b4d0 0x7f6fc006d990 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f6fdc0b7ae0 tx=0x7f6fcc009190 comp rx=0 tx=0).stop 2024-02-21T22:53:04.023 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.032+0000 7f6fe3a20640 1 -- 172.21.15.116:0/661930842 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6fdc0d0df0 msgr2=0x7f6fdc0c7fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:04.023 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.032+0000 7f6fe3a20640 1 --2- 172.21.15.116:0/661930842 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6fdc0d0df0 0x7f6fdc0c7fc0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f6fd802b8a0 tx=0x7f6fd80046c0 comp rx=0 tx=0).stop 2024-02-21T22:53:04.023 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.032+0000 7f6fe3a20640 1 -- 172.21.15.116:0/661930842 shutdown_connections 2024-02-21T22:53:04.023 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.032+0000 7f6fe3a20640 1 --2- 172.21.15.116:0/661930842 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f6fc006b4d0 0x7f6fc006d990 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:04.023 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.032+0000 7f6fe3a20640 1 --2- 172.21.15.116:0/661930842 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6fdc162840 0x7f6fdc0c5fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:04.023 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.032+0000 7f6fe3a20640 1 --2- 172.21.15.116:0/661930842 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6fdc15dfe0 0x7f6fdc1529e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:04.023 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.032+0000 7f6fe3a20640 1 --2- 172.21.15.116:0/661930842 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6fdc0d0df0 0x7f6fdc0c7fc0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:04.023 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.032+0000 7f6fe3a20640 1 -- 172.21.15.116:0/661930842 >> 172.21.15.116:0/661930842 conn(0x7f6fdc0b36c0 msgr2=0x7f6fdc06f4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:04.023 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.032+0000 7f6fe3a20640 1 -- 172.21.15.116:0/661930842 shutdown_connections 2024-02-21T22:53:04.023 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.032+0000 7f6fe3a20640 1 -- 172.21.15.116:0/661930842 wait complete. 2024-02-21T22:53:04.033 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-02-21T22:53:04.136 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.145+0000 7f0993708640 1 Processor -- start 2024-02-21T22:53:04.136 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.145+0000 7f0993708640 1 -- start start 2024-02-21T22:53:04.137 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.146+0000 7f0993708640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f098c15ca60 0x7f098c0cf240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:04.137 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.146+0000 7f0993708640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f098c15a9a0 con 0x7f098c0b2c70 2024-02-21T22:53:04.137 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.146+0000 7f0993708640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f098c15ac80 con 0x7f098c06d200 2024-02-21T22:53:04.137 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.146+0000 7f0993708640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f098c15af60 con 0x7f098c15ca60 2024-02-21T22:53:04.137 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.146+0000 7f0990ca3640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f098c15ca60 0x7f098c0cf240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:04.137 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.146+0000 7f0991ca5640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f098c0b2c70 0x7f098c163eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:50982/0 (socket says 172.21.15.116:50982) 2024-02-21T22:53:04.137 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.146+0000 7f0991ca5640 1 -- 172.21.15.116:0/396573222 learned_addr learned my addr 172.21.15.116:0/396573222 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-02-21T22:53:04.137 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.146+0000 7f0990ca3640 1 -- 172.21.15.116:0/396573222 >> v1:172.21.15.142:6789/0 conn(0x7f098c06d200 legacy=0x7f098c06d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:04.138 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.146+0000 7f0990ca3640 1 -- 172.21.15.116:0/396573222 >> v1:172.21.15.116:6789/0 conn(0x7f098c0b2c70 legacy=0x7f098c163eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:04.138 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.146+0000 7f0983fff640 1 -- 172.21.15.116:0/396573222 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2773226554 0 0) 0x7f098c15a9a0 con 0x7f098c0b2c70 2024-02-21T22:53:04.138 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.146+0000 7f0990ca3640 1 -- 172.21.15.116:0/396573222 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f098c15b240 con 0x7f098c15ca60 2024-02-21T22:53:04.139 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.147+0000 7f0990ca3640 1 --2- 172.21.15.116:0/396573222 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f098c15ca60 0x7f098c0cf240 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f097c0097d0 tx=0x7f097c02b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebc698aac78b24c4 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:04.139 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.147+0000 7f0983fff640 1 -- 172.21.15.116:0/396573222 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f097c034070 con 0x7f098c15ca60 2024-02-21T22:53:04.139 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.147+0000 7f0983fff640 1 -- 172.21.15.116:0/396573222 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f097c030610 con 0x7f098c15ca60 2024-02-21T22:53:04.139 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.147+0000 7f0983fff640 1 -- 172.21.15.116:0/396573222 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f097c0309e0 con 0x7f098c15ca60 2024-02-21T22:53:04.139 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.148+0000 7f0993708640 1 -- 172.21.15.116:0/396573222 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f098c15ca60 msgr2=0x7f098c0cf240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:04.139 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.148+0000 7f0993708640 1 --2- 172.21.15.116:0/396573222 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f098c15ca60 0x7f098c0cf240 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f097c0097d0 tx=0x7f097c02b960 comp rx=0 tx=0).stop 2024-02-21T22:53:04.139 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.148+0000 7f0993708640 1 -- 172.21.15.116:0/396573222 shutdown_connections 2024-02-21T22:53:04.139 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.148+0000 7f0993708640 1 --2- 172.21.15.116:0/396573222 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f098c15ca60 0x7f098c0cf240 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:04.139 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.148+0000 7f0993708640 1 -- 172.21.15.116:0/396573222 >> 172.21.15.116:0/396573222 conn(0x7f098c0b1740 msgr2=0x7f098c0b1b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:04.139 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.148+0000 7f0993708640 1 -- 172.21.15.116:0/396573222 shutdown_connections 2024-02-21T22:53:04.139 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.148+0000 7f0993708640 1 -- 172.21.15.116:0/396573222 wait complete. 2024-02-21T22:53:04.142 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.149+0000 7f0993708640 1 Processor -- start 2024-02-21T22:53:04.142 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.149+0000 7f0993708640 1 -- start start 2024-02-21T22:53:04.142 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.150+0000 7f0993708640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f098c06d200 0x7f098c14a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:04.142 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.150+0000 7f0993708640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f098c0b2c70 0x7f098c0b1010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:04.142 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.150+0000 7f0993708640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f098c15ca60 0x7f098c14ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:04.142 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.150+0000 7f0993708640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f098c1582b0 con 0x7f098c0b2c70 2024-02-21T22:53:04.142 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.150+0000 7f0993708640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f098c158130 con 0x7f098c06d200 2024-02-21T22:53:04.142 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.150+0000 7f0993708640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f098c1655d0 con 0x7f098c15ca60 2024-02-21T22:53:04.142 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.150+0000 7f0990ca3640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f098c0b2c70 0x7f098c0b1010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:04.143 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.150+0000 7f0990ca3640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f098c0b2c70 0x7f098c0b1010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:34492/0 (socket says 172.21.15.116:34492) 2024-02-21T22:53:04.143 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.150+0000 7f0990ca3640 1 -- 172.21.15.116:0/3446191420 learned_addr learned my addr 172.21.15.116:0/3446191420 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:04.143 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.150+0000 7f09914a4640 1 --2- 172.21.15.116:0/3446191420 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f098c06d200 0x7f098c14a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:04.143 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.150+0000 7f0991ca5640 1 --2- 172.21.15.116:0/3446191420 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f098c15ca60 0x7f098c14ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:04.143 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.150+0000 7f0990ca3640 1 -- 172.21.15.116:0/3446191420 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f098c15ca60 msgr2=0x7f098c14ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:04.143 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.150+0000 7f0990ca3640 1 --2- 172.21.15.116:0/3446191420 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f098c15ca60 0x7f098c14ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:04.143 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.150+0000 7f0990ca3640 1 -- 172.21.15.116:0/3446191420 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f098c06d200 msgr2=0x7f098c14a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:04.143 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.150+0000 7f0990ca3640 1 --2- 172.21.15.116:0/3446191420 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f098c06d200 0x7f098c14a050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:04.143 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.150+0000 7f0990ca3640 1 -- 172.21.15.116:0/3446191420 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f098c1f7d20 con 0x7f098c0b2c70 2024-02-21T22:53:04.143 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.150+0000 7f0990ca3640 1 --2- 172.21.15.116:0/3446191420 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f098c0b2c70 0x7f098c0b1010 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f097c000c00 tx=0x7f097c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:04.143 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.150+0000 7f0981ffb640 1 -- 172.21.15.116:0/3446191420 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f097c047070 con 0x7f098c0b2c70 2024-02-21T22:53:04.143 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.150+0000 7f0981ffb640 1 -- 172.21.15.116:0/3446191420 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f097c039a10 con 0x7f098c0b2c70 2024-02-21T22:53:04.143 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.150+0000 7f0993708640 1 -- 172.21.15.116:0/3446191420 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f098c0af800 con 0x7f098c0b2c70 2024-02-21T22:53:04.143 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.151+0000 7f0981ffb640 1 -- 172.21.15.116:0/3446191420 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f097c034040 con 0x7f098c0b2c70 2024-02-21T22:53:04.144 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.151+0000 7f0993708640 1 -- 172.21.15.116:0/3446191420 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f098c14b050 con 0x7f098c0b2c70 2024-02-21T22:53:04.144 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.152+0000 7f0993708640 1 -- 172.21.15.116:0/3446191420 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f098c0752f0 con 0x7f098c0b2c70 2024-02-21T22:53:04.144 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.152+0000 7f0981ffb640 1 -- 172.21.15.116:0/3446191420 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f097c04a070 con 0x7f098c0b2c70 2024-02-21T22:53:04.144 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.152+0000 7f0981ffb640 1 --2- 172.21.15.116:0/3446191420 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f097006b500 0x7f097006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:04.144 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.153+0000 7f0981ffb640 1 -- 172.21.15.116:0/3446191420 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f097c0abd30 con 0x7f098c0b2c70 2024-02-21T22:53:04.145 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.153+0000 7f09914a4640 1 --2- 172.21.15.116:0/3446191420 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f097006b500 0x7f097006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:04.145 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.153+0000 7f09914a4640 1 --2- 172.21.15.116:0/3446191420 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f097006b500 0x7f097006d9c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f098c14cfc0 tx=0x7f0988009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:04.147 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.157+0000 7f0981ffb640 1 -- 172.21.15.116:0/3446191420 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f097c07a6f0 con 0x7f098c0b2c70 2024-02-21T22:53:04.320 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.328+0000 7f0993708640 1 -- 172.21.15.116:0/3446191420 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f098c071bc0 con 0x7f098c0b2c70 2024-02-21T22:53:04.320 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.328+0000 7f0981ffb640 1 -- 172.21.15.116:0/3446191420 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f097c07e790 con 0x7f098c0b2c70 2024-02-21T22:53:04.321 INFO:teuthology.orchestra.run.smithi116.stdout:pg_num: 64 2024-02-21T22:53:04.322 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.330+0000 7f0993708640 1 -- 172.21.15.116:0/3446191420 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f097006b500 msgr2=0x7f097006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:04.322 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.330+0000 7f0993708640 1 --2- 172.21.15.116:0/3446191420 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f097006b500 0x7f097006d9c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f098c14cfc0 tx=0x7f0988009040 comp rx=0 tx=0).stop 2024-02-21T22:53:04.322 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.330+0000 7f0993708640 1 -- 172.21.15.116:0/3446191420 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f098c0b2c70 msgr2=0x7f098c0b1010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:04.322 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.330+0000 7f0993708640 1 --2- 172.21.15.116:0/3446191420 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f098c0b2c70 0x7f098c0b1010 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f097c000c00 tx=0x7f097c0046c0 comp rx=0 tx=0).stop 2024-02-21T22:53:04.322 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.330+0000 7f0993708640 1 -- 172.21.15.116:0/3446191420 shutdown_connections 2024-02-21T22:53:04.322 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.330+0000 7f0993708640 1 --2- 172.21.15.116:0/3446191420 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f097006b500 0x7f097006d9c0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:04.322 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.330+0000 7f0993708640 1 --2- 172.21.15.116:0/3446191420 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f098c15ca60 0x7f098c14ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:04.322 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.330+0000 7f0993708640 1 --2- 172.21.15.116:0/3446191420 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f098c0b2c70 0x7f098c0b1010 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:04.322 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.330+0000 7f0993708640 1 --2- 172.21.15.116:0/3446191420 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f098c06d200 0x7f098c14a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:04.322 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.330+0000 7f0993708640 1 -- 172.21.15.116:0/3446191420 >> 172.21.15.116:0/3446191420 conn(0x7f098c0b1740 msgr2=0x7f098c072180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:04.322 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.331+0000 7f0993708640 1 -- 172.21.15.116:0/3446191420 shutdown_connections 2024-02-21T22:53:04.322 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.331+0000 7f0993708640 1 -- 172.21.15.116:0/3446191420 wait complete. 2024-02-21T22:53:04.332 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-21T22:53:04.433 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.440+0000 7faad9288640 1 Processor -- start 2024-02-21T22:53:04.433 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.440+0000 7faad9288640 1 -- start start 2024-02-21T22:53:04.433 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.441+0000 7faad9288640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faad415c190 0x7faad40cfcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:04.433 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.441+0000 7faad9288640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7faad40cc990 0x7faad415fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:04.433 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.441+0000 7faad9288640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faad40cf530 con 0x7faad40d28d0 2024-02-21T22:53:04.434 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.441+0000 7faad9288640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faad40b2d50 con 0x7faad40cc990 2024-02-21T22:53:04.434 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.441+0000 7faad9288640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faad40b3310 con 0x7faad415c190 2024-02-21T22:53:04.434 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.441+0000 7faad37fe640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7faad40d28d0 0x7faad40b1540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:50994/0 (socket says 172.21.15.116:50994) 2024-02-21T22:53:04.434 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.441+0000 7faad37fe640 1 -- 172.21.15.116:0/4246373544 learned_addr learned my addr 172.21.15.116:0/4246373544 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-02-21T22:53:04.434 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.441+0000 7faad2ffd640 1 --2- 172.21.15.116:0/4246373544 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faad415c190 0x7faad40cfcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:04.434 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.441+0000 7faad27fc640 1 --2- 172.21.15.116:0/4246373544 >> v2:172.21.15.142:3300/0 conn(0x7faad40cc990 0x7faad415fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:04.434 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.442+0000 7faad1ffb640 1 -- 172.21.15.116:0/4246373544 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1559527139 0 0) 0x7faacc001110 con 0x7faad40d28d0 2024-02-21T22:53:04.434 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.442+0000 7faad1ffb640 1 -- 172.21.15.116:0/4246373544 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faabc003520 con 0x7faad40d28d0 2024-02-21T22:53:04.434 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.442+0000 7faad2ffd640 1 -- 172.21.15.116:0/4246373544 >> v2:172.21.15.142:3300/0 conn(0x7faad40cc990 msgr2=0x7faad415fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:53:04.434 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.442+0000 7faad2ffd640 1 --2- 172.21.15.116:0/4246373544 >> v2:172.21.15.142:3300/0 conn(0x7faad40cc990 0x7faad415fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:04.434 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.442+0000 7faad2ffd640 1 -- 172.21.15.116:0/4246373544 >> v1:172.21.15.116:6789/0 conn(0x7faad40d28d0 legacy=0x7faad40b1540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:04.435 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.442+0000 7faad2ffd640 1 -- 172.21.15.116:0/4246373544 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faad40b26d0 con 0x7faad415c190 2024-02-21T22:53:04.435 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.442+0000 7faad27fc640 1 --2- 172.21.15.116:0/4246373544 >> v2:172.21.15.142:3300/0 conn(0x7faad40cc990 0x7faad415fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T22:53:04.435 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.442+0000 7faad2ffd640 1 --2- 172.21.15.116:0/4246373544 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faad415c190 0x7faad40cfcf0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7faac4009d90 tx=0x7faac402bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1b78be833a64ba58 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:04.435 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.443+0000 7faad1ffb640 1 -- 172.21.15.116:0/4246373544 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faac4039070 con 0x7faad415c190 2024-02-21T22:53:04.435 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.443+0000 7faad1ffb640 1 -- 172.21.15.116:0/4246373544 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faac402cc50 con 0x7faad415c190 2024-02-21T22:53:04.435 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.443+0000 7faad1ffb640 1 -- 172.21.15.116:0/4246373544 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faac4034440 con 0x7faad415c190 2024-02-21T22:53:04.439 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.443+0000 7faad9288640 1 -- 172.21.15.116:0/4246373544 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faad415c190 msgr2=0x7faad40cfcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:04.439 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.443+0000 7faad9288640 1 --2- 172.21.15.116:0/4246373544 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faad415c190 0x7faad40cfcf0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7faac4009d90 tx=0x7faac402bea0 comp rx=0 tx=0).stop 2024-02-21T22:53:04.439 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.443+0000 7faad9288640 1 -- 172.21.15.116:0/4246373544 shutdown_connections 2024-02-21T22:53:04.439 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.443+0000 7faad9288640 1 --2- 172.21.15.116:0/4246373544 >> v2:172.21.15.142:3300/0 conn(0x7faad40cc990 0x7faad415fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:04.439 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.443+0000 7faad9288640 1 --2- 172.21.15.116:0/4246373544 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faad415c190 0x7faad40cfcf0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:04.439 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.443+0000 7faad9288640 1 -- 172.21.15.116:0/4246373544 >> 172.21.15.116:0/4246373544 conn(0x7faad40d1be0 msgr2=0x7faad40d1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:04.439 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.443+0000 7faad9288640 1 -- 172.21.15.116:0/4246373544 shutdown_connections 2024-02-21T22:53:04.440 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.443+0000 7faad9288640 1 -- 172.21.15.116:0/4246373544 wait complete. 2024-02-21T22:53:04.440 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.444+0000 7faad9288640 1 Processor -- start 2024-02-21T22:53:04.440 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.444+0000 7faad9288640 1 -- start start 2024-02-21T22:53:04.440 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.445+0000 7faad9288640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faad40cc990 0x7faad41539b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:04.440 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.445+0000 7faad9288640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faad40d28d0 0x7faad40c99f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:04.440 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.445+0000 7faad9288640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faad415c190 0x7faad415eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:04.440 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.445+0000 7faad9288640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faad40b2fa0 con 0x7faad40d28d0 2024-02-21T22:53:04.440 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.445+0000 7faad9288640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faad40d0230 con 0x7faad415c190 2024-02-21T22:53:04.440 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.445+0000 7faad9288640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faad415c570 con 0x7faad40cc990 2024-02-21T22:53:04.440 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.445+0000 7faad27fc640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faad40d28d0 0x7faad40c99f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:04.440 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.445+0000 7faad27fc640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faad40d28d0 0x7faad40c99f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:34496/0 (socket says 172.21.15.116:34496) 2024-02-21T22:53:04.441 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.445+0000 7faad27fc640 1 -- 172.21.15.116:0/3881192815 learned_addr learned my addr 172.21.15.116:0/3881192815 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:04.441 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.445+0000 7faad2ffd640 1 --2- 172.21.15.116:0/3881192815 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faad40cc990 0x7faad41539b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:04.441 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.445+0000 7faad37fe640 1 --2- 172.21.15.116:0/3881192815 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faad415c190 0x7faad415eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:04.441 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.446+0000 7faad27fc640 1 -- 172.21.15.116:0/3881192815 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faad40cc990 msgr2=0x7faad41539b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:04.441 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.446+0000 7faad27fc640 1 --2- 172.21.15.116:0/3881192815 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faad40cc990 0x7faad41539b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:04.441 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.446+0000 7faad27fc640 1 -- 172.21.15.116:0/3881192815 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faad415c190 msgr2=0x7faad415eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:04.441 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.446+0000 7faad27fc640 1 --2- 172.21.15.116:0/3881192815 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faad415c190 0x7faad415eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:04.441 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.446+0000 7faad27fc640 1 -- 172.21.15.116:0/3881192815 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faad4153ef0 con 0x7faad40d28d0 2024-02-21T22:53:04.441 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.446+0000 7faad37fe640 1 --2- 172.21.15.116:0/3881192815 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faad415c190 0x7faad415eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T22:53:04.441 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.446+0000 7faad2ffd640 1 --2- 172.21.15.116:0/3881192815 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faad40cc990 0x7faad41539b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T22:53:04.441 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.446+0000 7faad27fc640 1 --2- 172.21.15.116:0/3881192815 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faad40d28d0 0x7faad40c99f0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7faac800e9b0 tx=0x7faac800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:04.442 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.446+0000 7faabb7fe640 1 -- 172.21.15.116:0/3881192815 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faac8017070 con 0x7faad40d28d0 2024-02-21T22:53:04.442 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.446+0000 7faabb7fe640 1 -- 172.21.15.116:0/3881192815 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faac800ca00 con 0x7faad40d28d0 2024-02-21T22:53:04.442 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.446+0000 7faabb7fe640 1 -- 172.21.15.116:0/3881192815 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faac800cdf0 con 0x7faad40d28d0 2024-02-21T22:53:04.442 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.446+0000 7faad9288640 1 -- 172.21.15.116:0/3881192815 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faad40ca950 con 0x7faad40d28d0 2024-02-21T22:53:04.442 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.446+0000 7faad9288640 1 -- 172.21.15.116:0/3881192815 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faad40caf10 con 0x7faad40d28d0 2024-02-21T22:53:04.442 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.447+0000 7faad9288640 1 -- 172.21.15.116:0/3881192815 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faad40752f0 con 0x7faad40d28d0 2024-02-21T22:53:04.442 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.447+0000 7faabb7fe640 1 -- 172.21.15.116:0/3881192815 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7faac801a070 con 0x7faad40d28d0 2024-02-21T22:53:04.442 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.447+0000 7faabb7fe640 1 --2- 172.21.15.116:0/3881192815 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7faac006b500 0x7faac006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:04.442 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.448+0000 7faabb7fe640 1 -- 172.21.15.116:0/3881192815 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7faac808a130 con 0x7faad40d28d0 2024-02-21T22:53:04.442 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.448+0000 7faad2ffd640 1 --2- 172.21.15.116:0/3881192815 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7faac006b500 0x7faac006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:04.442 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.448+0000 7faad2ffd640 1 --2- 172.21.15.116:0/3881192815 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7faac006b500 0x7faac006d9c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7faac4036000 tx=0x7faac4030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:04.443 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.452+0000 7faabb7fe640 1 -- 172.21.15.116:0/3881192815 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7faac80588e0 con 0x7faad40d28d0 2024-02-21T22:53:04.652 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.661+0000 7faad9288640 1 -- 172.21.15.116:0/3881192815 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faad40cd970 con 0x7faad40d28d0 2024-02-21T22:53:04.652 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.662+0000 7faabb7fe640 1 -- 172.21.15.116:0/3881192815 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4941 (secure 0 0 0) 0x7faac805c980 con 0x7faad40d28d0 2024-02-21T22:53:04.653 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-02-21T22:53:04.653 INFO:teuthology.orchestra.run.smithi116.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6834/1717961923","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":1717961923},{"type":"v1","addr":"172.21.15.116:6834","nonce":1717961923}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6835/2228298220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6833","nonce":2228298220},{"type":"v1","addr":"172.21.15.116:6835","nonce":2228298220}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4285,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/1675920719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":1675920719},{"type":"v1","addr":"172.21.15.142:6837","nonce":1675920719}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-21T22:52:50.128732+0000","modified":"2024-02-21T22:52:52.125495+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6836/939436511","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":939436511},{"type":"v1","addr":"172.21.15.142:6836","nonce":939436511}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-02-21T22:53:04.653 INFO:teuthology.orchestra.run.smithi116.stderr:dumped fsmap epoch 6 2024-02-21T22:53:04.655 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.664+0000 7faad9288640 1 -- 172.21.15.116:0/3881192815 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7faac006b500 msgr2=0x7faac006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:04.655 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.664+0000 7faad9288640 1 --2- 172.21.15.116:0/3881192815 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7faac006b500 0x7faac006d9c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7faac4036000 tx=0x7faac4030000 comp rx=0 tx=0).stop 2024-02-21T22:53:04.655 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.664+0000 7faad9288640 1 -- 172.21.15.116:0/3881192815 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faad40d28d0 msgr2=0x7faad40c99f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:04.655 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.664+0000 7faad9288640 1 --2- 172.21.15.116:0/3881192815 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faad40d28d0 0x7faad40c99f0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7faac800e9b0 tx=0x7faac800ee70 comp rx=0 tx=0).stop 2024-02-21T22:53:04.655 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.664+0000 7faad9288640 1 -- 172.21.15.116:0/3881192815 shutdown_connections 2024-02-21T22:53:04.655 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.664+0000 7faad9288640 1 --2- 172.21.15.116:0/3881192815 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faad415c190 0x7faad415eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:04.655 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.664+0000 7faad9288640 1 --2- 172.21.15.116:0/3881192815 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faad40d28d0 0x7faad40c99f0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:04.655 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.664+0000 7faad9288640 1 --2- 172.21.15.116:0/3881192815 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7faac006b500 0x7faac006d9c0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:04.655 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.664+0000 7faad9288640 1 --2- 172.21.15.116:0/3881192815 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faad40cc990 0x7faad41539b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:04.655 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.664+0000 7faad9288640 1 -- 172.21.15.116:0/3881192815 >> 172.21.15.116:0/3881192815 conn(0x7faad40d1be0 msgr2=0x7faad40ccdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:04.655 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.664+0000 7faad9288640 1 -- 172.21.15.116:0/3881192815 shutdown_connections 2024-02-21T22:53:04.656 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.664+0000 7faad9288640 1 -- 172.21.15.116:0/3881192815 wait complete. 2024-02-21T22:53:04.666 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-21T22:53:04.766 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.776+0000 7f946cd1e640 1 Processor -- start 2024-02-21T22:53:04.767 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.776+0000 7f946cd1e640 1 -- start start 2024-02-21T22:53:04.769 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.777+0000 7f946cd1e640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f946815afb0 0x7f94680af080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:04.769 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.777+0000 7f946cd1e640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f9468071c90 0x7f94680b3860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:04.769 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.777+0000 7f946cd1e640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94680710e0 con 0x7f9468070b70 2024-02-21T22:53:04.769 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.777+0000 7f946cd1e640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f946815b390 con 0x7f946815afb0 2024-02-21T22:53:04.769 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.777+0000 7f946cd1e640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94680713c0 con 0x7f9468071c90 2024-02-21T22:53:04.769 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.777+0000 7f946659c640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f946815afb0 0x7f94680af080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:04.769 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.777+0000 7f946659c640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f946815afb0 0x7f94680af080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:34500/0 (socket says 172.21.15.116:34500) 2024-02-21T22:53:04.769 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.777+0000 7f946659c640 1 -- 172.21.15.116:0/467360492 learned_addr learned my addr 172.21.15.116:0/467360492 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:04.770 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.777+0000 7f9466d9d640 1 --2- 172.21.15.116:0/467360492 >> v2:172.21.15.142:3300/0 conn(0x7f9468071c90 0x7f94680b3860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:04.770 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.777+0000 7f946659c640 1 -- 172.21.15.116:0/467360492 >> v2:172.21.15.142:3300/0 conn(0x7f9468071c90 msgr2=0x7f94680b3860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:53:04.770 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.777+0000 7f946659c640 1 --2- 172.21.15.116:0/467360492 >> v2:172.21.15.142:3300/0 conn(0x7f9468071c90 0x7f94680b3860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:04.770 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.777+0000 7f946659c640 1 -- 172.21.15.116:0/467360492 >> v1:172.21.15.142:6789/0 conn(0x7f9468070b70 legacy=0x7f9468071580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:04.770 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.777+0000 7f946659c640 1 -- 172.21.15.116:0/467360492 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94680b2d80 con 0x7f946815afb0 2024-02-21T22:53:04.770 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.778+0000 7f946659c640 1 --2- 172.21.15.116:0/467360492 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f946815afb0 0x7f94680af080 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f9458009870 tx=0x7f945802ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a197f1a776a9fc4 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:04.770 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.778+0000 7f9465d9b640 1 -- 172.21.15.116:0/467360492 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f945802f840 con 0x7f946815afb0 2024-02-21T22:53:04.770 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.778+0000 7f9465d9b640 1 -- 172.21.15.116:0/467360492 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f945802f9e0 con 0x7f946815afb0 2024-02-21T22:53:04.770 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.778+0000 7f9465d9b640 1 -- 172.21.15.116:0/467360492 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f945802fdb0 con 0x7f946815afb0 2024-02-21T22:53:04.770 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.778+0000 7f946cd1e640 1 -- 172.21.15.116:0/467360492 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f946815afb0 msgr2=0x7f94680af080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:04.770 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.778+0000 7f946cd1e640 1 --2- 172.21.15.116:0/467360492 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f946815afb0 0x7f94680af080 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f9458009870 tx=0x7f945802ba20 comp rx=0 tx=0).stop 2024-02-21T22:53:04.770 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.778+0000 7f946cd1e640 1 -- 172.21.15.116:0/467360492 shutdown_connections 2024-02-21T22:53:04.770 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.778+0000 7f946cd1e640 1 --2- 172.21.15.116:0/467360492 >> v2:172.21.15.142:3300/0 conn(0x7f9468071c90 0x7f94680b3860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:04.770 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.778+0000 7f946cd1e640 1 --2- 172.21.15.116:0/467360492 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f946815afb0 0x7f94680af080 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:04.770 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.778+0000 7f946cd1e640 1 -- 172.21.15.116:0/467360492 >> 172.21.15.116:0/467360492 conn(0x7f94680b18e0 msgr2=0x7f94680b1cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:04.771 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.779+0000 7f946cd1e640 1 -- 172.21.15.116:0/467360492 shutdown_connections 2024-02-21T22:53:04.771 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.779+0000 7f946cd1e640 1 -- 172.21.15.116:0/467360492 wait complete. 2024-02-21T22:53:04.777 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.780+0000 7f946cd1e640 1 Processor -- start 2024-02-21T22:53:04.777 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.780+0000 7f946cd1e640 1 -- start start 2024-02-21T22:53:04.777 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.781+0000 7f946cd1e640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9468070b70 0x7f9468155840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:04.777 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.781+0000 7f946cd1e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9468071c90 0x7f94680c5560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:04.778 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.781+0000 7f946cd1e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f946815afb0 0x7f94680ade10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:04.778 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.781+0000 7f946cd1e640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94680af5c0 con 0x7f9468070b70 2024-02-21T22:53:04.778 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.781+0000 7f946cd1e640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94680b3340 con 0x7f9468071c90 2024-02-21T22:53:04.778 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.781+0000 7f946cd1e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94680b3da0 con 0x7f946815afb0 2024-02-21T22:53:04.778 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.781+0000 7f946659c640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9468070b70 0x7f9468155840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:04.778 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.781+0000 7f946659c640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9468070b70 0x7f9468155840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:34506/0 (socket says 172.21.15.116:34506) 2024-02-21T22:53:04.778 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.781+0000 7f946659c640 1 -- 172.21.15.116:0/585099380 learned_addr learned my addr 172.21.15.116:0/585099380 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:04.778 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.781+0000 7f945ffff640 1 --2- 172.21.15.116:0/585099380 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9468071c90 0x7f94680c5560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:04.778 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.781+0000 7f9466d9d640 1 --2- 172.21.15.116:0/585099380 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f946815afb0 0x7f94680ade10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:04.778 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.781+0000 7f946659c640 1 -- 172.21.15.116:0/585099380 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f946815afb0 msgr2=0x7f94680ade10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:04.778 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.781+0000 7f946659c640 1 --2- 172.21.15.116:0/585099380 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f946815afb0 0x7f94680ade10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:04.778 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.781+0000 7f946659c640 1 -- 172.21.15.116:0/585099380 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9468071c90 msgr2=0x7f94680c5560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:04.779 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.781+0000 7f946659c640 1 --2- 172.21.15.116:0/585099380 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9468071c90 0x7f94680c5560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:04.779 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.781+0000 7f946659c640 1 -- 172.21.15.116:0/585099380 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94681f1b10 con 0x7f9468070b70 2024-02-21T22:53:04.779 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.781+0000 7f946659c640 1 --2- 172.21.15.116:0/585099380 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9468070b70 0x7f9468155840 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f945802ba60 tx=0x7f9458004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:04.779 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.781+0000 7f945effd640 1 -- 172.21.15.116:0/585099380 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9458047070 con 0x7f9468070b70 2024-02-21T22:53:04.779 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.781+0000 7f945effd640 1 -- 172.21.15.116:0/585099380 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9458037bc0 con 0x7f9468070b70 2024-02-21T22:53:04.779 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.781+0000 7f946cd1e640 1 -- 172.21.15.116:0/585099380 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94680c6020 con 0x7f9468070b70 2024-02-21T22:53:04.779 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.781+0000 7f945effd640 1 -- 172.21.15.116:0/585099380 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9458042480 con 0x7f9468070b70 2024-02-21T22:53:04.779 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.781+0000 7f946cd1e640 1 -- 172.21.15.116:0/585099380 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94680c65e0 con 0x7f9468070b70 2024-02-21T22:53:04.779 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.782+0000 7f946cd1e640 1 -- 172.21.15.116:0/585099380 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94681f1ce0 con 0x7f9468070b70 2024-02-21T22:53:04.779 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.783+0000 7f945effd640 1 -- 172.21.15.116:0/585099380 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f945804a070 con 0x7f9468070b70 2024-02-21T22:53:04.779 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.783+0000 7f945effd640 1 --2- 172.21.15.116:0/585099380 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f944806b4d0 0x7f944806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:04.779 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.783+0000 7f945effd640 1 -- 172.21.15.116:0/585099380 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f94580ac210 con 0x7f9468070b70 2024-02-21T22:53:04.779 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.783+0000 7f945ffff640 1 --2- 172.21.15.116:0/585099380 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f944806b4d0 0x7f944806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:04.780 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.783+0000 7f945ffff640 1 --2- 172.21.15.116:0/585099380 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f944806b4d0 0x7f944806d990 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f9468150f90 tx=0x7f9450009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:04.780 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.787+0000 7f945effd640 1 -- 172.21.15.116:0/585099380 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f9458033030 con 0x7f9468070b70 2024-02-21T22:53:04.953 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.963+0000 7f946cd1e640 1 -- 172.21.15.116:0/585099380 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f94680752f0 con 0x7f9468070b70 2024-02-21T22:53:04.954 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.964+0000 7f945effd640 1 -- 172.21.15.116:0/585099380 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16653 (secure 0 0 0) 0x7f945807aad0 con 0x7f9468070b70 2024-02-21T22:53:04.954 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-02-21T22:53:04.955 INFO:teuthology.orchestra.run.smithi116.stdout:{"epoch":20,"fsid":"7c298660-5f63-4b5c-a800-58c5be9a8445","created":"2024-02-21T22:52:25.994613+0000","modified":"2024-02-21T22:52:51.786454+0000","last_up_change":"2024-02-21T22:52:37.313595+0000","last_in_change":"2024-02-21T22:52:28.176031+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-21T22:52:38.328796+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-21T22:52:48.145152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-21T22:52:49.096955+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4f09126b-b5e4-4876-8b08-f5cbb967388a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":1613202231},{"type":"v1","addr":"172.21.15.116:6809","nonce":1613202231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":1613202231},{"type":"v1","addr":"172.21.15.116:6811","nonce":1613202231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":1613202231},{"type":"v1","addr":"172.21.15.116:6815","nonce":1613202231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":1613202231},{"type":"v1","addr":"172.21.15.116:6813","nonce":1613202231}]},"public_addr":"172.21.15.116:6809/1613202231","cluster_addr":"172.21.15.116:6811/1613202231","heartbeat_back_addr":"172.21.15.116:6815/1613202231","heartbeat_front_addr":"172.21.15.116:6813/1613202231","state":["exists","up"]},{"osd":1,"uuid":"7272c51d-51f9-4536-931d-33ad7a4b377e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6816","nonce":172614746},{"type":"v1","addr":"172.21.15.116:6817","nonce":172614746}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":172614746},{"type":"v1","addr":"172.21.15.116:6819","nonce":172614746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":172614746},{"type":"v1","addr":"172.21.15.116:6823","nonce":172614746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":172614746},{"type":"v1","addr":"172.21.15.116:6821","nonce":172614746}]},"public_addr":"172.21.15.116:6817/172614746","cluster_addr":"172.21.15.116:6819/172614746","heartbeat_back_addr":"172.21.15.116:6823/172614746","heartbeat_front_addr":"172.21.15.116:6821/172614746","state":["exists","up"]},{"osd":2,"uuid":"2589616c-adf1-4187-aac3-735256cf624b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":1029280577},{"type":"v1","addr":"172.21.15.116:6825","nonce":1029280577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":1029280577},{"type":"v1","addr":"172.21.15.116:6827","nonce":1029280577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":1029280577},{"type":"v1","addr":"172.21.15.116:6831","nonce":1029280577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":1029280577},{"type":"v1","addr":"172.21.15.116:6829","nonce":1029280577}]},"public_addr":"172.21.15.116:6825/1029280577","cluster_addr":"172.21.15.116:6827/1029280577","heartbeat_back_addr":"172.21.15.116:6831/1029280577","heartbeat_front_addr":"172.21.15.116:6829/1029280577","state":["exists","up"]},{"osd":3,"uuid":"0fd2e563-7c5b-46f6-82c2-b60c86072c93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":3106627557},{"type":"v1","addr":"172.21.15.116:6801","nonce":3106627557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":3106627557},{"type":"v1","addr":"172.21.15.116:6803","nonce":3106627557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":3106627557},{"type":"v1","addr":"172.21.15.116:6807","nonce":3106627557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":3106627557},{"type":"v1","addr":"172.21.15.116:6805","nonce":3106627557}]},"public_addr":"172.21.15.116:6801/3106627557","cluster_addr":"172.21.15.116:6803/3106627557","heartbeat_back_addr":"172.21.15.116:6807/3106627557","heartbeat_front_addr":"172.21.15.116:6805/3106627557","state":["exists","up"]},{"osd":4,"uuid":"79ae35b7-dda8-4ab8-96ce-47515afde082","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":3231407772},{"type":"v1","addr":"172.21.15.142:6825","nonce":3231407772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":3231407772},{"type":"v1","addr":"172.21.15.142:6827","nonce":3231407772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":3231407772},{"type":"v1","addr":"172.21.15.142:6831","nonce":3231407772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":3231407772},{"type":"v1","addr":"172.21.15.142:6829","nonce":3231407772}]},"public_addr":"172.21.15.142:6825/3231407772","cluster_addr":"172.21.15.142:6827/3231407772","heartbeat_back_addr":"172.21.15.142:6831/3231407772","heartbeat_front_addr":"172.21.15.142:6829/3231407772","state":["exists","up"]},{"osd":5,"uuid":"3166eb2c-3fcf-41c8-9362-45bafaabaa39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":1184158716},{"type":"v1","addr":"172.21.15.142:6817","nonce":1184158716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":1184158716},{"type":"v1","addr":"172.21.15.142:6819","nonce":1184158716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":1184158716},{"type":"v1","addr":"172.21.15.142:6823","nonce":1184158716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":1184158716},{"type":"v1","addr":"172.21.15.142:6821","nonce":1184158716}]},"public_addr":"172.21.15.142:6817/1184158716","cluster_addr":"172.21.15.142:6819/1184158716","heartbeat_back_addr":"172.21.15.142:6823/1184158716","heartbeat_front_addr":"172.21.15.142:6821/1184158716","state":["exists","up"]},{"osd":6,"uuid":"f9aa9672-7527-43e2-963e-b61868e5e63f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":1987868911},{"type":"v1","addr":"172.21.15.142:6801","nonce":1987868911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":1987868911},{"type":"v1","addr":"172.21.15.142:6803","nonce":1987868911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":1987868911},{"type":"v1","addr":"172.21.15.142:6807","nonce":1987868911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":1987868911},{"type":"v1","addr":"172.21.15.142:6805","nonce":1987868911}]},"public_addr":"172.21.15.142:6801/1987868911","cluster_addr":"172.21.15.142:6803/1987868911","heartbeat_back_addr":"172.21.15.142:6807/1987868911","heartbeat_front_addr":"172.21.15.142:6805/1987868911","state":["exists","up"]},{"osd":7,"uuid":"7ed29226-fc42-4382-a91a-fa50f7ec5426","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":1272081937},{"type":"v1","addr":"172.21.15.142:6809","nonce":1272081937}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":1272081937},{"type":"v1","addr":"172.21.15.142:6811","nonce":1272081937}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":1272081937},{"type":"v1","addr":"172.21.15.142:6815","nonce":1272081937}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":1272081937},{"type":"v1","addr":"172.21.15.142:6813","nonce":1272081937}]},"public_addr":"172.21.15.142:6809/1272081937","cluster_addr":"172.21.15.142:6811/1272081937","heartbeat_back_addr":"172.21.15.142:6815/1272081937","heartbeat_front_addr":"172.21.15.142:6813/1272081937","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.350998+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.307201+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.289112+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.243888+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.312091+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.370472+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.275659+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.289297+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-21T22:53:04.956 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.966+0000 7f946cd1e640 1 -- 172.21.15.116:0/585099380 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f944806b4d0 msgr2=0x7f944806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:04.957 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.966+0000 7f946cd1e640 1 --2- 172.21.15.116:0/585099380 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f944806b4d0 0x7f944806d990 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f9468150f90 tx=0x7f9450009040 comp rx=0 tx=0).stop 2024-02-21T22:53:04.957 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.966+0000 7f946cd1e640 1 -- 172.21.15.116:0/585099380 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9468070b70 msgr2=0x7f9468155840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:04.957 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.966+0000 7f946cd1e640 1 --2- 172.21.15.116:0/585099380 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9468070b70 0x7f9468155840 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f945802ba60 tx=0x7f9458004730 comp rx=0 tx=0).stop 2024-02-21T22:53:04.957 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.966+0000 7f946cd1e640 1 -- 172.21.15.116:0/585099380 shutdown_connections 2024-02-21T22:53:04.957 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.966+0000 7f946cd1e640 1 --2- 172.21.15.116:0/585099380 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f944806b4d0 0x7f944806d990 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:04.957 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.966+0000 7f946cd1e640 1 --2- 172.21.15.116:0/585099380 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f946815afb0 0x7f94680ade10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:04.957 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.966+0000 7f946cd1e640 1 --2- 172.21.15.116:0/585099380 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9468071c90 0x7f94680c5560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:04.957 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.966+0000 7f946cd1e640 1 --2- 172.21.15.116:0/585099380 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9468070b70 0x7f9468155840 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:04.957 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.966+0000 7f946cd1e640 1 -- 172.21.15.116:0/585099380 >> 172.21.15.116:0/585099380 conn(0x7f94680b18e0 msgr2=0x7f94680aece0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:04.957 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.966+0000 7f946cd1e640 1 -- 172.21.15.116:0/585099380 shutdown_connections 2024-02-21T22:53:04.957 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:04.966+0000 7f946cd1e640 1 -- 172.21.15.116:0/585099380 wait complete. 2024-02-21T22:53:04.967 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-21T22:52:38.328796+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-02-21T22:52:48.145152+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-02-21T22:52:49.096955+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-21T22:53:04.968 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-21T22:53:05.071 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.081+0000 7f7d4631e640 1 Processor -- start 2024-02-21T22:53:05.072 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.081+0000 7f7d4631e640 1 -- start start 2024-02-21T22:53:05.073 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.082+0000 7f7d4631e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7d400d2bf0 0x7f7d400b11f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:05.073 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.082+0000 7f7d4631e640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f7d400b2e70 0x7f7d400b1730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:05.073 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.082+0000 7f7d4631e640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d400d1e80 con 0x7f7d4015e3d0 2024-02-21T22:53:05.073 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.082+0000 7f7d4631e640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d4015e7b0 con 0x7f7d400b2e70 2024-02-21T22:53:05.073 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.082+0000 7f7d4631e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d400d2120 con 0x7f7d400d2bf0 2024-02-21T22:53:05.073 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.082+0000 7f7d448bb640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f7d400b2e70 0x7f7d400b1730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:05.073 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.082+0000 7f7d3f7fe640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7d400d2bf0 0x7f7d400b11f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:05.073 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.082+0000 7f7d3ffff640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f7d4015e3d0 0x7f7d400d24e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.116:59284/0 (socket says 172.21.15.116:59284) 2024-02-21T22:53:05.073 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.082+0000 7f7d3ffff640 1 -- 172.21.15.116:0/2954657092 learned_addr learned my addr 172.21.15.116:0/2954657092 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-02-21T22:53:05.073 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.082+0000 7f7d3f7fe640 1 -- 172.21.15.116:0/2954657092 >> v2:172.21.15.142:3300/0 conn(0x7f7d400b2e70 msgr2=0x7f7d400b1730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:53:05.073 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.082+0000 7f7d3f7fe640 1 --2- 172.21.15.116:0/2954657092 >> v2:172.21.15.142:3300/0 conn(0x7f7d400b2e70 0x7f7d400b1730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:05.074 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.082+0000 7f7d3f7fe640 1 -- 172.21.15.116:0/2954657092 >> v1:172.21.15.142:6789/0 conn(0x7f7d4015e3d0 legacy=0x7f7d400d24e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:05.074 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.082+0000 7f7d3effd640 1 -- 172.21.15.116:0/2954657092 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 99967119 0 0) 0x7f7d400d1e80 con 0x7f7d4015e3d0 2024-02-21T22:53:05.074 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.082+0000 7f7d3f7fe640 1 -- 172.21.15.116:0/2954657092 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d400cfde0 con 0x7f7d400d2bf0 2024-02-21T22:53:05.074 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.082+0000 7f7d448bb640 1 --2- 172.21.15.116:0/2954657092 >> v2:172.21.15.142:3300/0 conn(0x7f7d400b2e70 0x7f7d400b1730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T22:53:05.075 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.083+0000 7f7d3f7fe640 1 --2- 172.21.15.116:0/2954657092 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7d400d2bf0 0x7f7d400b11f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f7d340097a0 tx=0x7f7d3402b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e4b2c05214194a6d server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:05.075 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.083+0000 7f7d3effd640 1 -- 172.21.15.116:0/2954657092 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d34035020 con 0x7f7d400d2bf0 2024-02-21T22:53:05.075 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.083+0000 7f7d3effd640 1 -- 172.21.15.116:0/2954657092 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d34031830 con 0x7f7d400d2bf0 2024-02-21T22:53:05.075 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.083+0000 7f7d3effd640 1 -- 172.21.15.116:0/2954657092 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d34031c00 con 0x7f7d400d2bf0 2024-02-21T22:53:05.075 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.084+0000 7f7d4631e640 1 -- 172.21.15.116:0/2954657092 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7d400d2bf0 msgr2=0x7f7d400b11f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:05.075 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.084+0000 7f7d4631e640 1 --2- 172.21.15.116:0/2954657092 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7d400d2bf0 0x7f7d400b11f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f7d340097a0 tx=0x7f7d3402b8d0 comp rx=0 tx=0).stop 2024-02-21T22:53:05.075 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.084+0000 7f7d4631e640 1 -- 172.21.15.116:0/2954657092 shutdown_connections 2024-02-21T22:53:05.075 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.084+0000 7f7d4631e640 1 --2- 172.21.15.116:0/2954657092 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7d400d2bf0 0x7f7d400b11f0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:05.075 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.084+0000 7f7d4631e640 1 --2- 172.21.15.116:0/2954657092 >> v2:172.21.15.142:3300/0 conn(0x7f7d400b2e70 0x7f7d400b1730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:05.076 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.084+0000 7f7d4631e640 1 -- 172.21.15.116:0/2954657092 >> 172.21.15.116:0/2954657092 conn(0x7f7d400d3f00 msgr2=0x7f7d400d4310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:05.076 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.084+0000 7f7d4631e640 1 -- 172.21.15.116:0/2954657092 shutdown_connections 2024-02-21T22:53:05.076 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.084+0000 7f7d4631e640 1 -- 172.21.15.116:0/2954657092 wait complete. 2024-02-21T22:53:05.076 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.085+0000 7f7d4631e640 1 Processor -- start 2024-02-21T22:53:05.078 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.085+0000 7f7d4631e640 1 -- start start 2024-02-21T22:53:05.078 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.086+0000 7f7d4631e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7d400b2e70 0x7f7d400cdb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:05.078 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.086+0000 7f7d4631e640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7d400d2bf0 0x7f7d401504f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:05.078 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.086+0000 7f7d4631e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7d4015e3d0 0x7f7d400cc380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:05.078 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.086+0000 7f7d4631e640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d400d0fa0 con 0x7f7d400d2bf0 2024-02-21T22:53:05.078 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.086+0000 7f7d4631e640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d400b0cd0 con 0x7f7d400b2e70 2024-02-21T22:53:05.078 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.086+0000 7f7d4631e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d400d1120 con 0x7f7d4015e3d0 2024-02-21T22:53:05.078 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.086+0000 7f7d3f7fe640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7d400d2bf0 0x7f7d401504f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:05.078 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.086+0000 7f7d3f7fe640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7d400d2bf0 0x7f7d401504f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:34520/0 (socket says 172.21.15.116:34520) 2024-02-21T22:53:05.079 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.086+0000 7f7d3f7fe640 1 -- 172.21.15.116:0/3623369010 learned_addr learned my addr 172.21.15.116:0/3623369010 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:05.079 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.086+0000 7f7d448bb640 1 --2- 172.21.15.116:0/3623369010 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7d4015e3d0 0x7f7d400cc380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:05.079 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.086+0000 7f7d3ffff640 1 --2- 172.21.15.116:0/3623369010 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7d400b2e70 0x7f7d400cdb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:05.079 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.086+0000 7f7d3f7fe640 1 -- 172.21.15.116:0/3623369010 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7d4015e3d0 msgr2=0x7f7d400cc380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:05.079 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.086+0000 7f7d3f7fe640 1 --2- 172.21.15.116:0/3623369010 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7d4015e3d0 0x7f7d400cc380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:05.079 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.086+0000 7f7d3f7fe640 1 -- 172.21.15.116:0/3623369010 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7d400b2e70 msgr2=0x7f7d400cdb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:05.079 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.086+0000 7f7d3f7fe640 1 --2- 172.21.15.116:0/3623369010 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7d400b2e70 0x7f7d400cdb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:05.079 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.086+0000 7f7d3f7fe640 1 -- 172.21.15.116:0/3623369010 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d400cd2a0 con 0x7f7d400d2bf0 2024-02-21T22:53:05.079 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.086+0000 7f7d448bb640 1 --2- 172.21.15.116:0/3623369010 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7d4015e3d0 0x7f7d400cc380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T22:53:05.079 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.086+0000 7f7d3f7fe640 1 --2- 172.21.15.116:0/3623369010 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7d400d2bf0 0x7f7d401504f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f7d340097a0 tx=0x7f7d340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:05.079 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.086+0000 7f7d3cff9640 1 -- 172.21.15.116:0/3623369010 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d34035040 con 0x7f7d400d2bf0 2024-02-21T22:53:05.079 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.086+0000 7f7d3cff9640 1 -- 172.21.15.116:0/3623369010 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d34004230 con 0x7f7d400d2bf0 2024-02-21T22:53:05.079 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.086+0000 7f7d4631e640 1 -- 172.21.15.116:0/3623369010 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d400cd580 con 0x7f7d400d2bf0 2024-02-21T22:53:05.079 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.087+0000 7f7d3cff9640 1 -- 172.21.15.116:0/3623369010 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d3403a640 con 0x7f7d400d2bf0 2024-02-21T22:53:05.080 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.087+0000 7f7d4631e640 1 -- 172.21.15.116:0/3623369010 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d400cbe60 con 0x7f7d400d2bf0 2024-02-21T22:53:05.080 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.088+0000 7f7d4631e640 1 -- 172.21.15.116:0/3623369010 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d400752f0 con 0x7f7d400d2bf0 2024-02-21T22:53:05.080 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.088+0000 7f7d3cff9640 1 -- 172.21.15.116:0/3623369010 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f7d34038020 con 0x7f7d400d2bf0 2024-02-21T22:53:05.080 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.088+0000 7f7d3cff9640 1 --2- 172.21.15.116:0/3623369010 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f7d2c06b4d0 0x7f7d2c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:05.080 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.088+0000 7f7d3cff9640 1 -- 172.21.15.116:0/3623369010 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7d340abd90 con 0x7f7d400d2bf0 2024-02-21T22:53:05.080 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.088+0000 7f7d3ffff640 1 --2- 172.21.15.116:0/3623369010 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f7d2c06b4d0 0x7f7d2c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:05.081 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.089+0000 7f7d3ffff640 1 --2- 172.21.15.116:0/3623369010 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f7d2c06b4d0 0x7f7d2c06d990 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f7d30000f60 tx=0x7f7d30007d50 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:05.083 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.092+0000 7f7d3cff9640 1 -- 172.21.15.116:0/3623369010 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f7d3407aca0 con 0x7f7d400d2bf0 2024-02-21T22:53:05.253 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.262+0000 7f7d4631e640 1 -- 172.21.15.116:0/3623369010 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7d400d22c0 con 0x7f7d400d2bf0 2024-02-21T22:53:05.253 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.262+0000 7f7d3cff9640 1 -- 172.21.15.116:0/3623369010 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7d3407a5a0 con 0x7f7d400d2bf0 2024-02-21T22:53:05.253 INFO:teuthology.orchestra.run.smithi116.stdout:pg_num: 1 2024-02-21T22:53:05.255 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.264+0000 7f7d4631e640 1 -- 172.21.15.116:0/3623369010 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f7d2c06b4d0 msgr2=0x7f7d2c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:05.255 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.264+0000 7f7d4631e640 1 --2- 172.21.15.116:0/3623369010 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f7d2c06b4d0 0x7f7d2c06d990 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f7d30000f60 tx=0x7f7d30007d50 comp rx=0 tx=0).stop 2024-02-21T22:53:05.255 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.264+0000 7f7d4631e640 1 -- 172.21.15.116:0/3623369010 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7d400d2bf0 msgr2=0x7f7d401504f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:05.256 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.264+0000 7f7d4631e640 1 --2- 172.21.15.116:0/3623369010 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7d400d2bf0 0x7f7d401504f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f7d340097a0 tx=0x7f7d340046c0 comp rx=0 tx=0).stop 2024-02-21T22:53:05.256 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.264+0000 7f7d4631e640 1 -- 172.21.15.116:0/3623369010 shutdown_connections 2024-02-21T22:53:05.256 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.264+0000 7f7d4631e640 1 --2- 172.21.15.116:0/3623369010 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f7d2c06b4d0 0x7f7d2c06d990 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:05.256 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.264+0000 7f7d4631e640 1 --2- 172.21.15.116:0/3623369010 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7d4015e3d0 0x7f7d400cc380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:05.256 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.264+0000 7f7d4631e640 1 --2- 172.21.15.116:0/3623369010 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7d400d2bf0 0x7f7d401504f0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:05.256 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.264+0000 7f7d4631e640 1 --2- 172.21.15.116:0/3623369010 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7d400b2e70 0x7f7d400cdb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:05.256 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.264+0000 7f7d4631e640 1 -- 172.21.15.116:0/3623369010 >> 172.21.15.116:0/3623369010 conn(0x7f7d400d3f00 msgr2=0x7f7d4006c610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:05.256 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.264+0000 7f7d4631e640 1 -- 172.21.15.116:0/3623369010 shutdown_connections 2024-02-21T22:53:05.256 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.264+0000 7f7d4631e640 1 -- 172.21.15.116:0/3623369010 wait complete. 2024-02-21T22:53:05.266 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-02-21T22:53:05.369 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.378+0000 7f1041dcc640 1 Processor -- start 2024-02-21T22:53:05.369 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.378+0000 7f1041dcc640 1 -- start start 2024-02-21T22:53:05.371 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.379+0000 7f1041dcc640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f103c1456c0 0x7f103c0b2260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:05.372 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.379+0000 7f1041dcc640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f103c15f920 0x7f103c15fd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:05.372 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.379+0000 7f1041dcc640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f103c0b3c30 con 0x7f103c1602a0 2024-02-21T22:53:05.372 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.379+0000 7f1041dcc640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f103c0b3f10 con 0x7f103c15f920 2024-02-21T22:53:05.372 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.379+0000 7f1041dcc640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f103c0b41f0 con 0x7f103c1456c0 2024-02-21T22:53:05.372 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.379+0000 7f103b7fe640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f103c1456c0 0x7f103c0b2260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:05.372 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.379+0000 7f103affd640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f103c15f920 0x7f103c15fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:05.372 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.379+0000 7f103bfff640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f103c1602a0 0x7f103c0ce090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.116:59288/0 (socket says 172.21.15.116:59288) 2024-02-21T22:53:05.372 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.379+0000 7f103bfff640 1 -- 172.21.15.116:0/4019118379 learned_addr learned my addr 172.21.15.116:0/4019118379 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-02-21T22:53:05.372 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.379+0000 7f103a7fc640 1 -- 172.21.15.116:0/4019118379 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4068286545 0 0) 0x7f103c0b3c30 con 0x7f103c1602a0 2024-02-21T22:53:05.372 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.379+0000 7f103a7fc640 1 -- 172.21.15.116:0/4019118379 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1024003520 con 0x7f103c1602a0 2024-02-21T22:53:05.372 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.379+0000 7f103affd640 1 -- 172.21.15.116:0/4019118379 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f103c1456c0 msgr2=0x7f103c0b2260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:53:05.373 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.380+0000 7f103affd640 1 --2- 172.21.15.116:0/4019118379 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f103c1456c0 0x7f103c0b2260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:05.373 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.380+0000 7f103affd640 1 -- 172.21.15.116:0/4019118379 >> v1:172.21.15.142:6789/0 conn(0x7f103c1602a0 legacy=0x7f103c0ce090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:05.373 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.380+0000 7f103affd640 1 -- 172.21.15.116:0/4019118379 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f103c06cb10 con 0x7f103c15f920 2024-02-21T22:53:05.373 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.380+0000 7f103b7fe640 1 --2- 172.21.15.116:0/4019118379 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f103c1456c0 0x7f103c0b2260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T22:53:05.373 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.380+0000 7f103affd640 1 --2- 172.21.15.116:0/4019118379 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f103c15f920 0x7f103c15fd60 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f10300097a0 tx=0x7f103002b820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d1134b38cf15506d server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:05.373 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.380+0000 7f103a7fc640 1 -- 172.21.15.116:0/4019118379 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1030031780 con 0x7f103c15f920 2024-02-21T22:53:05.373 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.380+0000 7f103a7fc640 1 -- 172.21.15.116:0/4019118379 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1030037070 con 0x7f103c15f920 2024-02-21T22:53:05.373 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.380+0000 7f103a7fc640 1 -- 172.21.15.116:0/4019118379 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1030031b40 con 0x7f103c15f920 2024-02-21T22:53:05.373 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.381+0000 7f1041dcc640 1 -- 172.21.15.116:0/4019118379 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f103c15f920 msgr2=0x7f103c15fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:05.373 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.381+0000 7f1041dcc640 1 --2- 172.21.15.116:0/4019118379 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f103c15f920 0x7f103c15fd60 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f10300097a0 tx=0x7f103002b820 comp rx=0 tx=0).stop 2024-02-21T22:53:05.373 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.381+0000 7f1041dcc640 1 -- 172.21.15.116:0/4019118379 shutdown_connections 2024-02-21T22:53:05.373 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.381+0000 7f1041dcc640 1 --2- 172.21.15.116:0/4019118379 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f103c15f920 0x7f103c15fd60 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:05.374 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.381+0000 7f1041dcc640 1 --2- 172.21.15.116:0/4019118379 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f103c1456c0 0x7f103c0b2260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:05.374 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.381+0000 7f1041dcc640 1 -- 172.21.15.116:0/4019118379 >> 172.21.15.116:0/4019118379 conn(0x7f103c0b1740 msgr2=0x7f103c0b1b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:05.374 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.381+0000 7f1041dcc640 1 -- 172.21.15.116:0/4019118379 shutdown_connections 2024-02-21T22:53:05.374 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.381+0000 7f1041dcc640 1 -- 172.21.15.116:0/4019118379 wait complete. 2024-02-21T22:53:05.378 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.382+0000 7f1041dcc640 1 Processor -- start 2024-02-21T22:53:05.378 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.382+0000 7f1041dcc640 1 -- start start 2024-02-21T22:53:05.378 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.383+0000 7f1041dcc640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f103c1456c0 0x7f103c141760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:05.378 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.383+0000 7f1041dcc640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f103c15f920 0x7f103c15d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:05.378 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.383+0000 7f1041dcc640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f103c1602a0 0x7f103c1f48c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:05.378 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.383+0000 7f1041dcc640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f103c06e040 con 0x7f103c1602a0 2024-02-21T22:53:05.378 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.383+0000 7f1041dcc640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f103c145aa0 con 0x7f103c1456c0 2024-02-21T22:53:05.378 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.383+0000 7f1041dcc640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f103c06e1c0 con 0x7f103c15f920 2024-02-21T22:53:05.379 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.383+0000 7f103bfff640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f103c1602a0 0x7f103c1f48c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:05.379 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.383+0000 7f103bfff640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f103c1602a0 0x7f103c1f48c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:34526/0 (socket says 172.21.15.116:34526) 2024-02-21T22:53:05.379 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.383+0000 7f103bfff640 1 -- 172.21.15.116:0/2990620359 learned_addr learned my addr 172.21.15.116:0/2990620359 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:05.379 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.383+0000 7f103affd640 1 --2- 172.21.15.116:0/2990620359 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f103c15f920 0x7f103c15d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:05.379 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.383+0000 7f103b7fe640 1 --2- 172.21.15.116:0/2990620359 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f103c1456c0 0x7f103c141760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:05.379 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.383+0000 7f103bfff640 1 -- 172.21.15.116:0/2990620359 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f103c15f920 msgr2=0x7f103c15d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:05.379 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.383+0000 7f103bfff640 1 --2- 172.21.15.116:0/2990620359 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f103c15f920 0x7f103c15d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:05.379 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.383+0000 7f103bfff640 1 -- 172.21.15.116:0/2990620359 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f103c1456c0 msgr2=0x7f103c141760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:05.379 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.383+0000 7f103bfff640 1 --2- 172.21.15.116:0/2990620359 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f103c1456c0 0x7f103c141760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:05.379 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.383+0000 7f103bfff640 1 -- 172.21.15.116:0/2990620359 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f103c15dba0 con 0x7f103c1602a0 2024-02-21T22:53:05.379 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.384+0000 7f103bfff640 1 --2- 172.21.15.116:0/2990620359 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f103c1602a0 0x7f103c1f48c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f103400caa0 tx=0x7f103400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:05.379 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.384+0000 7f1023fff640 1 -- 172.21.15.116:0/2990620359 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1034017070 con 0x7f103c1602a0 2024-02-21T22:53:05.379 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.384+0000 7f1023fff640 1 -- 172.21.15.116:0/2990620359 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f103400ac00 con 0x7f103c1602a0 2024-02-21T22:53:05.379 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.384+0000 7f1041dcc640 1 -- 172.21.15.116:0/2990620359 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f103c15de80 con 0x7f103c1602a0 2024-02-21T22:53:05.379 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.384+0000 7f1023fff640 1 -- 172.21.15.116:0/2990620359 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1034012400 con 0x7f103c1602a0 2024-02-21T22:53:05.380 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.384+0000 7f1041dcc640 1 -- 172.21.15.116:0/2990620359 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f103c15e440 con 0x7f103c1602a0 2024-02-21T22:53:05.380 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.385+0000 7f1041dcc640 1 -- 172.21.15.116:0/2990620359 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f103c0752f0 con 0x7f103c1602a0 2024-02-21T22:53:05.380 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.385+0000 7f1023fff640 1 -- 172.21.15.116:0/2990620359 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f103401a070 con 0x7f103c1602a0 2024-02-21T22:53:05.380 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.386+0000 7f1023fff640 1 --2- 172.21.15.116:0/2990620359 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f102806b4d0 0x7f102806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:05.380 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.386+0000 7f103b7fe640 1 --2- 172.21.15.116:0/2990620359 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f102806b4d0 0x7f102806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:05.380 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.386+0000 7f1023fff640 1 -- 172.21.15.116:0/2990620359 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1034089f70 con 0x7f103c1602a0 2024-02-21T22:53:05.380 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.386+0000 7f103b7fe640 1 --2- 172.21.15.116:0/2990620359 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f102806b4d0 0x7f102806d990 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f102c009560 tx=0x7f102c009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:05.380 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.390+0000 7f1023fff640 1 -- 172.21.15.116:0/2990620359 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f10340587b0 con 0x7f103c1602a0 2024-02-21T22:53:05.554 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.564+0000 7f1041dcc640 1 -- 172.21.15.116:0/2990620359 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f103c0ccb50 con 0x7f103c1602a0 2024-02-21T22:53:05.555 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.564+0000 7f1023fff640 1 -- 172.21.15.116:0/2990620359 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f103405c850 con 0x7f103c1602a0 2024-02-21T22:53:05.555 INFO:teuthology.orchestra.run.smithi116.stdout:pg_num: 32 2024-02-21T22:53:05.557 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.566+0000 7f1041dcc640 1 -- 172.21.15.116:0/2990620359 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f102806b4d0 msgr2=0x7f102806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:05.557 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.566+0000 7f1041dcc640 1 --2- 172.21.15.116:0/2990620359 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f102806b4d0 0x7f102806d990 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f102c009560 tx=0x7f102c009190 comp rx=0 tx=0).stop 2024-02-21T22:53:05.557 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.566+0000 7f1041dcc640 1 -- 172.21.15.116:0/2990620359 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f103c1602a0 msgr2=0x7f103c1f48c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:05.557 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.566+0000 7f1041dcc640 1 --2- 172.21.15.116:0/2990620359 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f103c1602a0 0x7f103c1f48c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f103400caa0 tx=0x7f103400cf60 comp rx=0 tx=0).stop 2024-02-21T22:53:05.557 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.566+0000 7f1041dcc640 1 -- 172.21.15.116:0/2990620359 shutdown_connections 2024-02-21T22:53:05.557 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.566+0000 7f1041dcc640 1 --2- 172.21.15.116:0/2990620359 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f103c1602a0 0x7f103c1f48c0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:05.557 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.566+0000 7f1041dcc640 1 --2- 172.21.15.116:0/2990620359 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f102806b4d0 0x7f102806d990 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:05.558 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.566+0000 7f1041dcc640 1 --2- 172.21.15.116:0/2990620359 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f103c15f920 0x7f103c15d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:05.558 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.566+0000 7f1041dcc640 1 --2- 172.21.15.116:0/2990620359 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f103c1456c0 0x7f103c141760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:05.558 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.566+0000 7f1041dcc640 1 -- 172.21.15.116:0/2990620359 >> 172.21.15.116:0/2990620359 conn(0x7f103c0b1740 msgr2=0x7f103c142fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:05.558 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.566+0000 7f1041dcc640 1 -- 172.21.15.116:0/2990620359 shutdown_connections 2024-02-21T22:53:05.558 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.566+0000 7f1041dcc640 1 -- 172.21.15.116:0/2990620359 wait complete. 2024-02-21T22:53:05.568 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-02-21T22:53:05.671 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.681+0000 7fa4997f0640 1 Processor -- start 2024-02-21T22:53:05.672 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.681+0000 7fa4997f0640 1 -- start start 2024-02-21T22:53:05.680 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.681+0000 7fa4997f0640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa4940b4790 0x7fa4940d4940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:05.680 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.681+0000 7fa4997f0640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4940ceea0 con 0x7fa4940d0ca0 2024-02-21T22:53:05.681 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.681+0000 7fa4997f0640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4940cf180 con 0x7fa4940d2b10 2024-02-21T22:53:05.681 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.681+0000 7fa4997f0640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4940cf460 con 0x7fa4940b4790 2024-02-21T22:53:05.681 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.681+0000 7fa492ffd640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7fa4940d0ca0 0x7fa4940d2400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:46722/0 (socket says 172.21.15.116:46722) 2024-02-21T22:53:05.681 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.681+0000 7fa492ffd640 1 -- 172.21.15.116:0/2091512593 learned_addr learned my addr 172.21.15.116:0/2091512593 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-02-21T22:53:05.681 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.682+0000 7fa4937fe640 1 --2- 172.21.15.116:0/2091512593 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa4940b4790 0x7fa4940d4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:05.681 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.682+0000 7fa491ffb640 1 -- 172.21.15.116:0/2091512593 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1221702454 0 0) 0x7fa4940ceea0 con 0x7fa4940d0ca0 2024-02-21T22:53:05.681 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.682+0000 7fa491ffb640 1 -- 172.21.15.116:0/2091512593 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa47c003520 con 0x7fa4940d0ca0 2024-02-21T22:53:05.681 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.682+0000 7fa491ffb640 1 -- 172.21.15.116:0/2091512593 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1994446426 0 0) 0x7fa4940cf180 con 0x7fa4940d2b10 2024-02-21T22:53:05.681 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.682+0000 7fa491ffb640 1 -- 172.21.15.116:0/2091512593 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa4940ceea0 con 0x7fa4940d2b10 2024-02-21T22:53:05.681 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.682+0000 7fa4937fe640 1 -- 172.21.15.116:0/2091512593 >> v1:172.21.15.142:6789/0 conn(0x7fa4940d2b10 legacy=0x7fa49415da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:05.681 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.682+0000 7fa4937fe640 1 -- 172.21.15.116:0/2091512593 >> v1:172.21.15.116:6789/0 conn(0x7fa4940d0ca0 legacy=0x7fa4940d2400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:05.682 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.682+0000 7fa4937fe640 1 -- 172.21.15.116:0/2091512593 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4940cf740 con 0x7fa4940b4790 2024-02-21T22:53:05.682 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.683+0000 7fa4937fe640 1 --2- 172.21.15.116:0/2091512593 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa4940b4790 0x7fa4940d4940 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa48c009dc0 tx=0x7fa48c02bfa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=22536b471c02fe08 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:05.682 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.683+0000 7fa491ffb640 1 -- 172.21.15.116:0/2091512593 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa48c039070 con 0x7fa4940b4790 2024-02-21T22:53:05.682 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.683+0000 7fa491ffb640 1 -- 172.21.15.116:0/2091512593 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa48c02cd50 con 0x7fa4940b4790 2024-02-21T22:53:05.682 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.683+0000 7fa491ffb640 1 -- 172.21.15.116:0/2091512593 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa48c034660 con 0x7fa4940b4790 2024-02-21T22:53:05.682 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.683+0000 7fa4997f0640 1 -- 172.21.15.116:0/2091512593 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa4940b4790 msgr2=0x7fa4940d4940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:05.682 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.683+0000 7fa4997f0640 1 --2- 172.21.15.116:0/2091512593 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa4940b4790 0x7fa4940d4940 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa48c009dc0 tx=0x7fa48c02bfa0 comp rx=0 tx=0).stop 2024-02-21T22:53:05.682 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.683+0000 7fa4997f0640 1 -- 172.21.15.116:0/2091512593 shutdown_connections 2024-02-21T22:53:05.682 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.683+0000 7fa4997f0640 1 --2- 172.21.15.116:0/2091512593 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa4940b4790 0x7fa4940d4940 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:05.682 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.683+0000 7fa4997f0640 1 -- 172.21.15.116:0/2091512593 >> 172.21.15.116:0/2091512593 conn(0x7fa4940d3e20 msgr2=0x7fa4940d4230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:05.682 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.683+0000 7fa4997f0640 1 -- 172.21.15.116:0/2091512593 shutdown_connections 2024-02-21T22:53:05.682 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.683+0000 7fa4997f0640 1 -- 172.21.15.116:0/2091512593 wait complete. 2024-02-21T22:53:05.683 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.685+0000 7fa4997f0640 1 Processor -- start 2024-02-21T22:53:05.683 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.685+0000 7fa4997f0640 1 -- start start 2024-02-21T22:53:05.683 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.685+0000 7fa4997f0640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa4940b4790 0x7fa4941f4470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:05.683 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.685+0000 7fa4997f0640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa4940d0ca0 0x7fa4940b8dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:05.683 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.685+0000 7fa4997f0640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa4940d2b10 0x7fa49415e360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:05.683 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.685+0000 7fa4997f0640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4940d1200 con 0x7fa4940d2b10 2024-02-21T22:53:05.683 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.685+0000 7fa4997f0640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4940d1080 con 0x7fa4940d0ca0 2024-02-21T22:53:05.683 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.685+0000 7fa4997f0640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4940ceaa0 con 0x7fa4940b4790 2024-02-21T22:53:05.683 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.685+0000 7fa4937fe640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa4940d2b10 0x7fa49415e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:05.683 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.685+0000 7fa4937fe640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa4940d2b10 0x7fa49415e360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:45344/0 (socket says 172.21.15.116:45344) 2024-02-21T22:53:05.683 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.686+0000 7fa4937fe640 1 -- 172.21.15.116:0/376029682 learned_addr learned my addr 172.21.15.116:0/376029682 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:05.683 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.686+0000 7fa492ffd640 1 --2- 172.21.15.116:0/376029682 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa4940b4790 0x7fa4941f4470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:05.683 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.686+0000 7fa4927fc640 1 --2- 172.21.15.116:0/376029682 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa4940d0ca0 0x7fa4940b8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:05.683 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.686+0000 7fa4937fe640 1 -- 172.21.15.116:0/376029682 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa4940b4790 msgr2=0x7fa4941f4470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:05.683 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.686+0000 7fa4937fe640 1 --2- 172.21.15.116:0/376029682 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa4940b4790 0x7fa4941f4470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:05.683 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.686+0000 7fa4937fe640 1 -- 172.21.15.116:0/376029682 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa4940d0ca0 msgr2=0x7fa4940b8dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:05.684 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.686+0000 7fa4937fe640 1 --2- 172.21.15.116:0/376029682 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa4940d0ca0 0x7fa4940b8dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:05.684 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.686+0000 7fa4937fe640 1 -- 172.21.15.116:0/376029682 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa49406c560 con 0x7fa4940d2b10 2024-02-21T22:53:05.684 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.686+0000 7fa4937fe640 1 --2- 172.21.15.116:0/376029682 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa4940d2b10 0x7fa49415e360 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fa48c009dc0 tx=0x7fa48c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:05.684 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.686+0000 7fa47b7fe640 1 -- 172.21.15.116:0/376029682 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa48c039050 con 0x7fa4940d2b10 2024-02-21T22:53:05.684 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.686+0000 7fa47b7fe640 1 -- 172.21.15.116:0/376029682 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa48c045070 con 0x7fa4940d2b10 2024-02-21T22:53:05.684 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.686+0000 7fa4997f0640 1 -- 172.21.15.116:0/376029682 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4940b7f30 con 0x7fa4940d2b10 2024-02-21T22:53:05.684 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.686+0000 7fa47b7fe640 1 -- 172.21.15.116:0/376029682 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa48c009450 con 0x7fa4940d2b10 2024-02-21T22:53:05.684 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.686+0000 7fa4997f0640 1 -- 172.21.15.116:0/376029682 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4940b7170 con 0x7fa4940d2b10 2024-02-21T22:53:05.684 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.687+0000 7fa4997f0640 1 -- 172.21.15.116:0/376029682 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4940752f0 con 0x7fa4940d2b10 2024-02-21T22:53:05.684 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.688+0000 7fa47b7fe640 1 -- 172.21.15.116:0/376029682 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fa48c03e850 con 0x7fa4940d2b10 2024-02-21T22:53:05.684 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.688+0000 7fa47b7fe640 1 --2- 172.21.15.116:0/376029682 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fa48006b4d0 0x7fa48006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:05.684 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.688+0000 7fa47b7fe640 1 -- 172.21.15.116:0/376029682 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa48c0ace00 con 0x7fa4940d2b10 2024-02-21T22:53:05.684 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.688+0000 7fa492ffd640 1 --2- 172.21.15.116:0/376029682 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fa48006b4d0 0x7fa48006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:05.685 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.689+0000 7fa492ffd640 1 --2- 172.21.15.116:0/376029682 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fa48006b4d0 0x7fa48006d990 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa484000f60 tx=0x7fa484007d70 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:05.685 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.692+0000 7fa47b7fe640 1 -- 172.21.15.116:0/376029682 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7fa48c07b7e0 con 0x7fa4940d2b10 2024-02-21T22:53:05.857 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.867+0000 7fa4997f0640 1 -- 172.21.15.116:0/376029682 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa49408d560 con 0x7fa4940d2b10 2024-02-21T22:53:05.858 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.867+0000 7fa47b7fe640 1 -- 172.21.15.116:0/376029682 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa48c07f880 con 0x7fa4940d2b10 2024-02-21T22:53:05.858 INFO:teuthology.orchestra.run.smithi116.stdout:pg_num: 64 2024-02-21T22:53:05.860 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.869+0000 7fa4997f0640 1 -- 172.21.15.116:0/376029682 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fa48006b4d0 msgr2=0x7fa48006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:05.860 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.869+0000 7fa4997f0640 1 --2- 172.21.15.116:0/376029682 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fa48006b4d0 0x7fa48006d990 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa484000f60 tx=0x7fa484007d70 comp rx=0 tx=0).stop 2024-02-21T22:53:05.860 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.869+0000 7fa4997f0640 1 -- 172.21.15.116:0/376029682 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa4940d2b10 msgr2=0x7fa49415e360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:05.860 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.869+0000 7fa4997f0640 1 --2- 172.21.15.116:0/376029682 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa4940d2b10 0x7fa49415e360 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fa48c009dc0 tx=0x7fa48c004a40 comp rx=0 tx=0).stop 2024-02-21T22:53:05.860 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.869+0000 7fa4997f0640 1 -- 172.21.15.116:0/376029682 shutdown_connections 2024-02-21T22:53:05.860 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.869+0000 7fa4997f0640 1 --2- 172.21.15.116:0/376029682 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa4940d2b10 0x7fa49415e360 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:05.860 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.869+0000 7fa4997f0640 1 --2- 172.21.15.116:0/376029682 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa4940d0ca0 0x7fa4940b8dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:05.860 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.869+0000 7fa4997f0640 1 --2- 172.21.15.116:0/376029682 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fa48006b4d0 0x7fa48006d990 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:05.860 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.869+0000 7fa4997f0640 1 --2- 172.21.15.116:0/376029682 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa4940b4790 0x7fa4941f4470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:05.860 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.869+0000 7fa4997f0640 1 -- 172.21.15.116:0/376029682 >> 172.21.15.116:0/376029682 conn(0x7fa4940d3e20 msgr2=0x7fa49406cdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:05.860 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.869+0000 7fa4997f0640 1 -- 172.21.15.116:0/376029682 shutdown_connections 2024-02-21T22:53:05.860 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.869+0000 7fa4997f0640 1 -- 172.21.15.116:0/376029682 wait complete. 2024-02-21T22:53:05.870 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-21T22:53:05.970 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.980+0000 7fe9715e0640 1 Processor -- start 2024-02-21T22:53:05.971 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.980+0000 7fe9715e0640 1 -- start start 2024-02-21T22:53:05.973 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.981+0000 7fe9715e0640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fe96c15e560 0x7fe96c0d1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:05.973 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.981+0000 7fe9715e0640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe96c0ce8f0 con 0x7fe96c0d0fc0 2024-02-21T22:53:05.973 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.981+0000 7fe9715e0640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe96c0d1530 con 0x7fe96c15e180 2024-02-21T22:53:05.973 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.981+0000 7fe9715e0640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe96c0b31b0 con 0x7fe96c15e560 2024-02-21T22:53:05.973 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.981+0000 7fe96b7fe640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7fe96c0d0fc0 0x7fe96c0b0a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:46724/0 (socket says 172.21.15.116:46724) 2024-02-21T22:53:05.973 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.981+0000 7fe96b7fe640 1 -- 172.21.15.116:0/1464828405 learned_addr learned my addr 172.21.15.116:0/1464828405 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-02-21T22:53:05.973 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.981+0000 7fe963fff640 1 --2- 172.21.15.116:0/1464828405 >> v2:172.21.15.142:3300/0 conn(0x7fe96c15e560 0x7fe96c0d1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:05.974 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.981+0000 7fe96a7fc640 1 -- 172.21.15.116:0/1464828405 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 254916604 0 0) 0x7fe964001490 con 0x7fe96c0d0fc0 2024-02-21T22:53:05.974 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.981+0000 7fe96a7fc640 1 -- 172.21.15.116:0/1464828405 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe958003520 con 0x7fe96c0d0fc0 2024-02-21T22:53:05.974 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.981+0000 7fe96a7fc640 1 -- 172.21.15.116:0/1464828405 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 731167854 0 0) 0x7fe96c0d1530 con 0x7fe96c15e180 2024-02-21T22:53:05.974 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.981+0000 7fe96a7fc640 1 -- 172.21.15.116:0/1464828405 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe964001490 con 0x7fe96c15e180 2024-02-21T22:53:05.974 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.981+0000 7fe963fff640 1 -- 172.21.15.116:0/1464828405 >> v1:172.21.15.142:6789/0 conn(0x7fe96c15e180 legacy=0x7fe96c0cf650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:05.974 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.981+0000 7fe963fff640 1 -- 172.21.15.116:0/1464828405 >> v1:172.21.15.116:6789/0 conn(0x7fe96c0d0fc0 legacy=0x7fe96c0b0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:05.974 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.981+0000 7fe963fff640 1 -- 172.21.15.116:0/1464828405 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe96c0ceb70 con 0x7fe96c15e560 2024-02-21T22:53:05.974 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.982+0000 7fe963fff640 1 --2- 172.21.15.116:0/1464828405 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe96c15e560 0x7fe96c0d1bc0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fe9540097a0 tx=0x7fe95402b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=37baa6701f2028d6 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:05.974 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.982+0000 7fe96a7fc640 1 -- 172.21.15.116:0/1464828405 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe954034070 con 0x7fe96c15e560 2024-02-21T22:53:05.974 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.982+0000 7fe96a7fc640 1 -- 172.21.15.116:0/1464828405 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe954030610 con 0x7fe96c15e560 2024-02-21T22:53:05.974 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.982+0000 7fe96a7fc640 1 -- 172.21.15.116:0/1464828405 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9540309c0 con 0x7fe96c15e560 2024-02-21T22:53:05.974 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.982+0000 7fe9715e0640 1 -- 172.21.15.116:0/1464828405 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe96c15e560 msgr2=0x7fe96c0d1bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:05.974 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.982+0000 7fe9715e0640 1 --2- 172.21.15.116:0/1464828405 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe96c15e560 0x7fe96c0d1bc0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fe9540097a0 tx=0x7fe95402b960 comp rx=0 tx=0).stop 2024-02-21T22:53:05.974 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.983+0000 7fe9715e0640 1 -- 172.21.15.116:0/1464828405 shutdown_connections 2024-02-21T22:53:05.974 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.983+0000 7fe9715e0640 1 --2- 172.21.15.116:0/1464828405 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe96c15e560 0x7fe96c0d1bc0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:05.975 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.983+0000 7fe9715e0640 1 -- 172.21.15.116:0/1464828405 >> 172.21.15.116:0/1464828405 conn(0x7fe96c0d3de0 msgr2=0x7fe96c0d41f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:05.975 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.983+0000 7fe9715e0640 1 -- 172.21.15.116:0/1464828405 shutdown_connections 2024-02-21T22:53:05.975 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.983+0000 7fe9715e0640 1 -- 172.21.15.116:0/1464828405 wait complete. 2024-02-21T22:53:05.978 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.984+0000 7fe9715e0640 1 Processor -- start 2024-02-21T22:53:05.978 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.984+0000 7fe9715e0640 1 -- start start 2024-02-21T22:53:05.978 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.984+0000 7fe9715e0640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe96c0d0fc0 0x7fe96c150bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:05.978 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.984+0000 7fe9715e0640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe96c15e180 0x7fe96c15fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:05.978 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.984+0000 7fe9715e0640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe96c15e560 0x7fe96c0cc4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:05.978 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.984+0000 7fe9715e0640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe96c0cf1c0 con 0x7fe96c15e180 2024-02-21T22:53:05.978 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.984+0000 7fe9715e0640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe96c0d2100 con 0x7fe96c15e560 2024-02-21T22:53:05.978 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.984+0000 7fe9715e0640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe96c0cfd60 con 0x7fe96c0d0fc0 2024-02-21T22:53:05.979 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.984+0000 7fe963fff640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe96c15e180 0x7fe96c15fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:05.979 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.984+0000 7fe963fff640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe96c15e180 0x7fe96c15fa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:45350/0 (socket says 172.21.15.116:45350) 2024-02-21T22:53:05.979 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.984+0000 7fe963fff640 1 -- 172.21.15.116:0/1355544013 learned_addr learned my addr 172.21.15.116:0/1355544013 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:05.979 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.985+0000 7fe96affd640 1 --2- 172.21.15.116:0/1355544013 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe96c0d0fc0 0x7fe96c150bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:05.979 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.985+0000 7fe96b7fe640 1 --2- 172.21.15.116:0/1355544013 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe96c15e560 0x7fe96c0cc4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:05.979 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.985+0000 7fe963fff640 1 -- 172.21.15.116:0/1355544013 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe96c0d0fc0 msgr2=0x7fe96c150bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:05.979 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.985+0000 7fe963fff640 1 --2- 172.21.15.116:0/1355544013 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe96c0d0fc0 0x7fe96c150bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:05.979 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.985+0000 7fe963fff640 1 -- 172.21.15.116:0/1355544013 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe96c15e560 msgr2=0x7fe96c0cc4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:05.979 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.985+0000 7fe963fff640 1 --2- 172.21.15.116:0/1355544013 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe96c15e560 0x7fe96c0cc4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:05.979 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.985+0000 7fe963fff640 1 -- 172.21.15.116:0/1355544013 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe96c151670 con 0x7fe96c15e180 2024-02-21T22:53:05.979 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.985+0000 7fe963fff640 1 --2- 172.21.15.116:0/1355544013 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe96c15e180 0x7fe96c15fa10 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fe9540098c0 tx=0x7fe9540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:05.979 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.985+0000 7fe9637fe640 1 -- 172.21.15.116:0/1355544013 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe954034040 con 0x7fe96c15e180 2024-02-21T22:53:05.979 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.985+0000 7fe9637fe640 1 -- 172.21.15.116:0/1355544013 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe95403aaa0 con 0x7fe96c15e180 2024-02-21T22:53:05.979 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.985+0000 7fe9715e0640 1 -- 172.21.15.116:0/1355544013 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe96c151950 con 0x7fe96c15e180 2024-02-21T22:53:05.980 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.985+0000 7fe9637fe640 1 -- 172.21.15.116:0/1355544013 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe954006e10 con 0x7fe96c15e180 2024-02-21T22:53:05.980 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.985+0000 7fe9715e0640 1 -- 172.21.15.116:0/1355544013 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe96c151f10 con 0x7fe96c15e180 2024-02-21T22:53:05.980 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.986+0000 7fe9715e0640 1 -- 172.21.15.116:0/1355544013 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe96c0752f0 con 0x7fe96c15e180 2024-02-21T22:53:05.980 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.986+0000 7fe9637fe640 1 -- 172.21.15.116:0/1355544013 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fe95404b020 con 0x7fe96c15e180 2024-02-21T22:53:05.980 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.987+0000 7fe9637fe640 1 --2- 172.21.15.116:0/1355544013 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fe94c06b500 0x7fe94c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:05.980 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.987+0000 7fe9637fe640 1 -- 172.21.15.116:0/1355544013 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe9540abdb0 con 0x7fe96c15e180 2024-02-21T22:53:05.980 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.987+0000 7fe96affd640 1 --2- 172.21.15.116:0/1355544013 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fe94c06b500 0x7fe94c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:05.980 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.987+0000 7fe96affd640 1 --2- 172.21.15.116:0/1355544013 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fe94c06b500 0x7fe94c06d9c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fe95c007fd0 tx=0x7fe95c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:05.981 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:05.991+0000 7fe9637fe640 1 -- 172.21.15.116:0/1355544013 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7fe95403f070 con 0x7fe96c15e180 2024-02-21T22:53:06.187 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:06.197+0000 7fe9715e0640 1 -- 172.21.15.116:0/1355544013 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe96c0d4d10 con 0x7fe96c15e180 2024-02-21T22:53:06.188 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:06.197+0000 7fe9637fe640 1 -- 172.21.15.116:0/1355544013 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4941 (secure 0 0 0) 0x7fe95407a550 con 0x7fe96c15e180 2024-02-21T22:53:06.188 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-02-21T22:53:06.188 INFO:teuthology.orchestra.run.smithi116.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6834/1717961923","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":1717961923},{"type":"v1","addr":"172.21.15.116:6834","nonce":1717961923}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6835/2228298220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6833","nonce":2228298220},{"type":"v1","addr":"172.21.15.116:6835","nonce":2228298220}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4285,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/1675920719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":1675920719},{"type":"v1","addr":"172.21.15.142:6837","nonce":1675920719}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-21T22:52:50.128732+0000","modified":"2024-02-21T22:52:52.125495+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6836/939436511","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":939436511},{"type":"v1","addr":"172.21.15.142:6836","nonce":939436511}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-02-21T22:53:06.189 INFO:teuthology.orchestra.run.smithi116.stderr:dumped fsmap epoch 6 2024-02-21T22:53:06.190 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:06.199+0000 7fe9715e0640 1 -- 172.21.15.116:0/1355544013 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fe94c06b500 msgr2=0x7fe94c06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:06.190 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:06.199+0000 7fe9715e0640 1 --2- 172.21.15.116:0/1355544013 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fe94c06b500 0x7fe94c06d9c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fe95c007fd0 tx=0x7fe95c009040 comp rx=0 tx=0).stop 2024-02-21T22:53:06.190 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:06.199+0000 7fe9715e0640 1 -- 172.21.15.116:0/1355544013 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe96c15e180 msgr2=0x7fe96c15fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:06.190 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:06.199+0000 7fe9715e0640 1 --2- 172.21.15.116:0/1355544013 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe96c15e180 0x7fe96c15fa10 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fe9540098c0 tx=0x7fe9540046c0 comp rx=0 tx=0).stop 2024-02-21T22:53:06.190 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:06.199+0000 7fe9715e0640 1 -- 172.21.15.116:0/1355544013 shutdown_connections 2024-02-21T22:53:06.191 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:06.199+0000 7fe9715e0640 1 --2- 172.21.15.116:0/1355544013 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe96c15e560 0x7fe96c0cc4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:06.191 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:06.199+0000 7fe9715e0640 1 --2- 172.21.15.116:0/1355544013 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe96c15e180 0x7fe96c15fa10 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:06.191 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:06.199+0000 7fe9715e0640 1 --2- 172.21.15.116:0/1355544013 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fe94c06b500 0x7fe94c06d9c0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:06.191 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:06.199+0000 7fe9715e0640 1 --2- 172.21.15.116:0/1355544013 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe96c0d0fc0 0x7fe96c150bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:06.191 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:06.199+0000 7fe9715e0640 1 -- 172.21.15.116:0/1355544013 >> 172.21.15.116:0/1355544013 conn(0x7fe96c0d3de0 msgr2=0x7fe96c0b0a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:06.191 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:06.199+0000 7fe9715e0640 1 -- 172.21.15.116:0/1355544013 shutdown_connections 2024-02-21T22:53:06.191 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:06.199+0000 7fe9715e0640 1 -- 172.21.15.116:0/1355544013 wait complete. 2024-02-21T22:53:06.201 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-21T22:53:06.301 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:06.310+0000 7f6cf2d71640 1 Processor -- start 2024-02-21T22:53:06.301 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:06.310+0000 7f6cf2d71640 1 -- start start 2024-02-21T22:53:06.304 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:06.311+0000 7f6cf2d71640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6cec0d1c30 0x7f6cec0d2430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:06.304 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:06.311+0000 7f6cf2d71640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cec0cfa50 con 0x7f6cec0cb930 2024-02-21T22:53:06.304 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:06.311+0000 7f6cf2d71640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cec0cfcc0 con 0x7f6cec0d0510 2024-02-21T22:53:06.304 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:06.311+0000 7f6cf2d71640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cec0d1450 con 0x7f6cec0d1c30 2024-02-21T22:53:06.304 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:06.311+0000 7f6cf130e640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f6cec0cb930 0x7f6cec0cbdc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:46740/0 (socket says 172.21.15.116:46740) 2024-02-21T22:53:06.304 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:06.311+0000 7f6cf130e640 1 -- 172.21.15.116:0/1113575027 learned_addr learned my addr 172.21.15.116:0/1113575027 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-02-21T22:53:06.304 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:06.311+0000 7f6cebfff640 1 --2- 172.21.15.116:0/1113575027 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6cec0d1c30 0x7f6cec0d2430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:06.304 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:06.312+0000 7f6ceb7fe640 1 -- 172.21.15.116:0/1113575027 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1536194454 0 0) 0x7f6cec0cfa50 con 0x7f6cec0cb930 2024-02-21T22:53:06.304 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:06.312+0000 7f6ceb7fe640 1 -- 172.21.15.116:0/1113575027 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6cd4003520 con 0x7f6cec0cb930 2024-02-21T22:53:06.304 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:06.312+0000 7f6ceb7fe640 1 -- 172.21.15.116:0/1113575027 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3630069589 0 0) 0x7f6cec0cfcc0 con 0x7f6cec0d0510 2024-02-21T22:53:06.304 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:06.312+0000 7f6cebfff640 1 -- 172.21.15.116:0/1113575027 >> v1:172.21.15.142:6789/0 conn(0x7f6cec0d0510 legacy=0x7f6cec0d08f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:06.304 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:06.312+0000 7f6cebfff640 1 -- 172.21.15.116:0/1113575027 >> v1:172.21.15.116:6789/0 conn(0x7f6cec0cb930 legacy=0x7f6cec0cbdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:06.305 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:06.312+0000 7f6cebfff640 1 -- 172.21.15.116:0/1113575027 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cec0cffa0 con 0x7f6cec0d1c30 2024-02-21T22:53:06.305 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:06.312+0000 7f6cebfff640 1 --2- 172.21.15.116:0/1113575027 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6cec0d1c30 0x7f6cec0d2430 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f6ce00097d0 tx=0x7f6ce002b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=63dee31e6ca7af5b server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:06.305 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:06.313+0000 7f6ceb7fe640 1 -- 172.21.15.116:0/1113575027 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ce0035020 con 0x7f6cec0d1c30 2024-02-21T22:53:06.305 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:06.313+0000 7f6ceb7fe640 1 -- 172.21.15.116:0/1113575027 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ce0031800 con 0x7f6cec0d1c30 2024-02-21T22:53:06.305 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:06.313+0000 7f6ceb7fe640 1 -- 172.21.15.116:0/1113575027 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ce0031bd0 con 0x7f6cec0d1c30 2024-02-21T22:53:06.305 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:06.313+0000 7f6cf2d71640 1 -- 172.21.15.116:0/1113575027 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6cec0d1c30 msgr2=0x7f6cec0d2430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:06.305 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:06.313+0000 7f6cf2d71640 1 --2- 172.21.15.116:0/1113575027 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6cec0d1c30 0x7f6cec0d2430 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f6ce00097d0 tx=0x7f6ce002b8a0 comp rx=0 tx=0).stop 2024-02-21T22:53:06.305 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:06.313+0000 7f6cf2d71640 1 -- 172.21.15.116:0/1113575027 shutdown_connections 2024-02-21T22:53:06.305 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:06.313+0000 7f6cf2d71640 1 --2- 172.21.15.116:0/1113575027 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6cec0d1c30 0x7f6cec0d2430 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:06.305 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:06.313+0000 7f6cf2d71640 1 -- 172.21.15.116:0/1113575027 >> 172.21.15.116:0/1113575027 conn(0x7f6cec0d3e50 msgr2=0x7f6cec0d4260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:06.305 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:06.313+0000 7f6cf2d71640 1 -- 172.21.15.116:0/1113575027 shutdown_connections 2024-02-21T22:53:06.305 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:06.313+0000 7f6cf2d71640 1 -- 172.21.15.116:0/1113575027 wait complete. 2024-02-21T22:53:06.309 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:06.314+0000 7f6cf2d71640 1 Processor -- start 2024-02-21T22:53:06.309 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:06.314+0000 7f6cf2d71640 1 -- start start 2024-02-21T22:53:06.309 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:06.315+0000 7f6cf2d71640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6cec0cb930 0x7f6cec14d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:06.309 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:06.315+0000 7f6cf2d71640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6cec0d0510 0x7f6cec0b1430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:06.310 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:06.315+0000 7f6cf2d71640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6cec0d1c30 0x7f6cec15c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:06.310 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:06.315+0000 7f6cf2d71640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cec0d2970 con 0x7f6cec0cb930 2024-02-21T22:53:06.310 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:06.315+0000 7f6cf2d71640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cec15e640 con 0x7f6cec0d1c30 2024-02-21T22:53:06.310 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:06.315+0000 7f6cf2d71640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cec0d2af0 con 0x7f6cec0d0510 2024-02-21T22:53:06.310 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:06.315+0000 7f6cf0b0d640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6cec0cb930 0x7f6cec14d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:06.310 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:06.315+0000 7f6cf0b0d640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6cec0cb930 0x7f6cec14d410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:45352/0 (socket says 172.21.15.116:45352) 2024-02-21T22:53:06.310 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:06.315+0000 7f6cf0b0d640 1 -- 172.21.15.116:0/3764580243 learned_addr learned my addr 172.21.15.116:0/3764580243 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:06.310 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:06.315+0000 7f6cebfff640 1 --2- 172.21.15.116:0/3764580243 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6cec0d0510 0x7f6cec0b1430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:06.310 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:06.315+0000 7f6cf130e640 1 --2- 172.21.15.116:0/3764580243 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6cec0d1c30 0x7f6cec15c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:06.310 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:06.315+0000 7f6cf0b0d640 1 -- 172.21.15.116:0/3764580243 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6cec0d0510 msgr2=0x7f6cec0b1430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:06.310 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:06.316+0000 7f6cf0b0d640 1 --2- 172.21.15.116:0/3764580243 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6cec0d0510 0x7f6cec0b1430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:06.310 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:06.316+0000 7f6cf0b0d640 1 -- 172.21.15.116:0/3764580243 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6cec0d1c30 msgr2=0x7f6cec15c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:06.310 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:06.316+0000 7f6cf0b0d640 1 --2- 172.21.15.116:0/3764580243 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6cec0d1c30 0x7f6cec15c4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:06.310 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:06.316+0000 7f6cf0b0d640 1 -- 172.21.15.116:0/3764580243 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cec14d950 con 0x7f6cec0cb930 2024-02-21T22:53:06.311 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:06.316+0000 7f6cf0b0d640 1 --2- 172.21.15.116:0/3764580243 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6cec0cb930 0x7f6cec14d410 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f6ce400c8c0 tx=0x7f6ce400cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:06.311 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:06.316+0000 7f6ce97fa640 1 -- 172.21.15.116:0/3764580243 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ce4017070 con 0x7f6cec0cb930 2024-02-21T22:53:06.311 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:06.316+0000 7f6ce97fa640 1 -- 172.21.15.116:0/3764580243 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ce4003dc0 con 0x7f6cec0cb930 2024-02-21T22:53:06.311 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:06.316+0000 7f6cf2d71640 1 -- 172.21.15.116:0/3764580243 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cec158220 con 0x7f6cec0cb930 2024-02-21T22:53:06.311 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:06.316+0000 7f6ce97fa640 1 -- 172.21.15.116:0/3764580243 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ce40052b0 con 0x7f6cec0cb930 2024-02-21T22:53:06.311 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:06.316+0000 7f6cf2d71640 1 -- 172.21.15.116:0/3764580243 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cec1587e0 con 0x7f6cec0cb930 2024-02-21T22:53:06.311 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:06.317+0000 7f6cf2d71640 1 -- 172.21.15.116:0/3764580243 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cec0752f0 con 0x7f6cec0cb930 2024-02-21T22:53:06.311 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:06.317+0000 7f6ce97fa640 1 -- 172.21.15.116:0/3764580243 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f6ce401a070 con 0x7f6cec0cb930 2024-02-21T22:53:06.311 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:06.318+0000 7f6ce97fa640 1 --2- 172.21.15.116:0/3764580243 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f6cd806b4d0 0x7f6cd806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:06.311 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:06.318+0000 7f6ce97fa640 1 -- 172.21.15.116:0/3764580243 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6ce4089890 con 0x7f6cec0cb930 2024-02-21T22:53:06.312 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:06.318+0000 7f6cebfff640 1 --2- 172.21.15.116:0/3764580243 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f6cd806b4d0 0x7f6cd806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:06.312 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:06.318+0000 7f6cebfff640 1 --2- 172.21.15.116:0/3764580243 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f6cd806b4d0 0x7f6cd806d990 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f6ce0036000 tx=0x7f6ce0008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:06.312 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:06.322+0000 7f6ce97fa640 1 -- 172.21.15.116:0/3764580243 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f6cec14d950 con 0x7f6cec0cb930 2024-02-21T22:53:06.483 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:06.493+0000 7f6cf2d71640 1 -- 172.21.15.116:0/3764580243 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6cec15d6d0 con 0x7f6cec0cb930 2024-02-21T22:53:06.484 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:06.494+0000 7f6ce97fa640 1 -- 172.21.15.116:0/3764580243 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16653 (secure 0 0 0) 0x7f6ce40580b0 con 0x7f6cec0cb930 2024-02-21T22:53:06.485 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-02-21T22:53:06.485 INFO:teuthology.orchestra.run.smithi116.stdout:{"epoch":20,"fsid":"7c298660-5f63-4b5c-a800-58c5be9a8445","created":"2024-02-21T22:52:25.994613+0000","modified":"2024-02-21T22:52:51.786454+0000","last_up_change":"2024-02-21T22:52:37.313595+0000","last_in_change":"2024-02-21T22:52:28.176031+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-21T22:52:38.328796+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-21T22:52:48.145152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-21T22:52:49.096955+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4f09126b-b5e4-4876-8b08-f5cbb967388a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":1613202231},{"type":"v1","addr":"172.21.15.116:6809","nonce":1613202231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":1613202231},{"type":"v1","addr":"172.21.15.116:6811","nonce":1613202231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":1613202231},{"type":"v1","addr":"172.21.15.116:6815","nonce":1613202231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":1613202231},{"type":"v1","addr":"172.21.15.116:6813","nonce":1613202231}]},"public_addr":"172.21.15.116:6809/1613202231","cluster_addr":"172.21.15.116:6811/1613202231","heartbeat_back_addr":"172.21.15.116:6815/1613202231","heartbeat_front_addr":"172.21.15.116:6813/1613202231","state":["exists","up"]},{"osd":1,"uuid":"7272c51d-51f9-4536-931d-33ad7a4b377e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6816","nonce":172614746},{"type":"v1","addr":"172.21.15.116:6817","nonce":172614746}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":172614746},{"type":"v1","addr":"172.21.15.116:6819","nonce":172614746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":172614746},{"type":"v1","addr":"172.21.15.116:6823","nonce":172614746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":172614746},{"type":"v1","addr":"172.21.15.116:6821","nonce":172614746}]},"public_addr":"172.21.15.116:6817/172614746","cluster_addr":"172.21.15.116:6819/172614746","heartbeat_back_addr":"172.21.15.116:6823/172614746","heartbeat_front_addr":"172.21.15.116:6821/172614746","state":["exists","up"]},{"osd":2,"uuid":"2589616c-adf1-4187-aac3-735256cf624b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":1029280577},{"type":"v1","addr":"172.21.15.116:6825","nonce":1029280577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":1029280577},{"type":"v1","addr":"172.21.15.116:6827","nonce":1029280577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":1029280577},{"type":"v1","addr":"172.21.15.116:6831","nonce":1029280577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":1029280577},{"type":"v1","addr":"172.21.15.116:6829","nonce":1029280577}]},"public_addr":"172.21.15.116:6825/1029280577","cluster_addr":"172.21.15.116:6827/1029280577","heartbeat_back_addr":"172.21.15.116:6831/1029280577","heartbeat_front_addr":"172.21.15.116:6829/1029280577","state":["exists","up"]},{"osd":3,"uuid":"0fd2e563-7c5b-46f6-82c2-b60c86072c93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":3106627557},{"type":"v1","addr":"172.21.15.116:6801","nonce":3106627557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":3106627557},{"type":"v1","addr":"172.21.15.116:6803","nonce":3106627557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":3106627557},{"type":"v1","addr":"172.21.15.116:6807","nonce":3106627557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":3106627557},{"type":"v1","addr":"172.21.15.116:6805","nonce":3106627557}]},"public_addr":"172.21.15.116:6801/3106627557","cluster_addr":"172.21.15.116:6803/3106627557","heartbeat_back_addr":"172.21.15.116:6807/3106627557","heartbeat_front_addr":"172.21.15.116:6805/3106627557","state":["exists","up"]},{"osd":4,"uuid":"79ae35b7-dda8-4ab8-96ce-47515afde082","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":3231407772},{"type":"v1","addr":"172.21.15.142:6825","nonce":3231407772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":3231407772},{"type":"v1","addr":"172.21.15.142:6827","nonce":3231407772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":3231407772},{"type":"v1","addr":"172.21.15.142:6831","nonce":3231407772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":3231407772},{"type":"v1","addr":"172.21.15.142:6829","nonce":3231407772}]},"public_addr":"172.21.15.142:6825/3231407772","cluster_addr":"172.21.15.142:6827/3231407772","heartbeat_back_addr":"172.21.15.142:6831/3231407772","heartbeat_front_addr":"172.21.15.142:6829/3231407772","state":["exists","up"]},{"osd":5,"uuid":"3166eb2c-3fcf-41c8-9362-45bafaabaa39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":1184158716},{"type":"v1","addr":"172.21.15.142:6817","nonce":1184158716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":1184158716},{"type":"v1","addr":"172.21.15.142:6819","nonce":1184158716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":1184158716},{"type":"v1","addr":"172.21.15.142:6823","nonce":1184158716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":1184158716},{"type":"v1","addr":"172.21.15.142:6821","nonce":1184158716}]},"public_addr":"172.21.15.142:6817/1184158716","cluster_addr":"172.21.15.142:6819/1184158716","heartbeat_back_addr":"172.21.15.142:6823/1184158716","heartbeat_front_addr":"172.21.15.142:6821/1184158716","state":["exists","up"]},{"osd":6,"uuid":"f9aa9672-7527-43e2-963e-b61868e5e63f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":1987868911},{"type":"v1","addr":"172.21.15.142:6801","nonce":1987868911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":1987868911},{"type":"v1","addr":"172.21.15.142:6803","nonce":1987868911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":1987868911},{"type":"v1","addr":"172.21.15.142:6807","nonce":1987868911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":1987868911},{"type":"v1","addr":"172.21.15.142:6805","nonce":1987868911}]},"public_addr":"172.21.15.142:6801/1987868911","cluster_addr":"172.21.15.142:6803/1987868911","heartbeat_back_addr":"172.21.15.142:6807/1987868911","heartbeat_front_addr":"172.21.15.142:6805/1987868911","state":["exists","up"]},{"osd":7,"uuid":"7ed29226-fc42-4382-a91a-fa50f7ec5426","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":1272081937},{"type":"v1","addr":"172.21.15.142:6809","nonce":1272081937}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":1272081937},{"type":"v1","addr":"172.21.15.142:6811","nonce":1272081937}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":1272081937},{"type":"v1","addr":"172.21.15.142:6815","nonce":1272081937}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":1272081937},{"type":"v1","addr":"172.21.15.142:6813","nonce":1272081937}]},"public_addr":"172.21.15.142:6809/1272081937","cluster_addr":"172.21.15.142:6811/1272081937","heartbeat_back_addr":"172.21.15.142:6815/1272081937","heartbeat_front_addr":"172.21.15.142:6813/1272081937","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.350998+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.307201+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.289112+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.243888+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.312091+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.370472+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.275659+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.289297+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-21T22:53:06.487 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:06.496+0000 7f6cf2d71640 1 -- 172.21.15.116:0/3764580243 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f6cd806b4d0 msgr2=0x7f6cd806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:06.487 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:06.496+0000 7f6cf2d71640 1 --2- 172.21.15.116:0/3764580243 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f6cd806b4d0 0x7f6cd806d990 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f6ce0036000 tx=0x7f6ce0008030 comp rx=0 tx=0).stop 2024-02-21T22:53:06.487 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:06.496+0000 7f6cf2d71640 1 -- 172.21.15.116:0/3764580243 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6cec0cb930 msgr2=0x7f6cec14d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:06.487 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:06.496+0000 7f6cf2d71640 1 --2- 172.21.15.116:0/3764580243 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6cec0cb930 0x7f6cec14d410 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f6ce400c8c0 tx=0x7f6ce400cd80 comp rx=0 tx=0).stop 2024-02-21T22:53:06.487 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:06.496+0000 7f6cf2d71640 1 -- 172.21.15.116:0/3764580243 shutdown_connections 2024-02-21T22:53:06.487 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:06.496+0000 7f6cf2d71640 1 --2- 172.21.15.116:0/3764580243 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6cec0d1c30 0x7f6cec15c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:06.487 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:06.496+0000 7f6cf2d71640 1 --2- 172.21.15.116:0/3764580243 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f6cd806b4d0 0x7f6cd806d990 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:06.487 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:06.496+0000 7f6cf2d71640 1 --2- 172.21.15.116:0/3764580243 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6cec0d0510 0x7f6cec0b1430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:06.487 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:06.496+0000 7f6cf2d71640 1 --2- 172.21.15.116:0/3764580243 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6cec0cb930 0x7f6cec14d410 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:06.488 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:06.496+0000 7f6cf2d71640 1 -- 172.21.15.116:0/3764580243 >> 172.21.15.116:0/3764580243 conn(0x7f6cec0d3e50 msgr2=0x7f6cec0ccc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:06.488 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:06.496+0000 7f6cf2d71640 1 -- 172.21.15.116:0/3764580243 shutdown_connections 2024-02-21T22:53:06.488 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:06.496+0000 7f6cf2d71640 1 -- 172.21.15.116:0/3764580243 wait complete. 2024-02-21T22:53:06.498 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-21T22:53:06.597 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:06.606+0000 7fef33b15640 1 Processor -- start 2024-02-21T22:53:06.597 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:06.606+0000 7fef33b15640 1 -- start start 2024-02-21T22:53:06.598 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:06.607+0000 7fef33b15640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fef2c0b0290 0x7fef2c06f290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:06.598 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:06.607+0000 7fef33b15640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fef2c0b3f90 0x7fef2c06ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:06.598 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:06.607+0000 7fef33b15640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef2c15f570 con 0x7fef2c06b380 2024-02-21T22:53:06.598 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:06.607+0000 7fef33b15640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef2c072c90 con 0x7fef2c0b0290 2024-02-21T22:53:06.599 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:06.607+0000 7fef33b15640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef2c15f0e0 con 0x7fef2c0b3f90 2024-02-21T22:53:06.599 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:06.607+0000 7fef318b1640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fef2c0b0290 0x7fef2c06f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:06.599 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:06.607+0000 7fef320b2640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7fef2c06b380 0x7fef2c161bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:46742/0 (socket says 172.21.15.116:46742) 2024-02-21T22:53:06.599 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:06.607+0000 7fef320b2640 1 -- 172.21.15.116:0/618620925 learned_addr learned my addr 172.21.15.116:0/618620925 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-02-21T22:53:06.599 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:06.607+0000 7fef310b0640 1 --2- 172.21.15.116:0/618620925 >> v2:172.21.15.142:3300/0 conn(0x7fef2c0b3f90 0x7fef2c06ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:06.599 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:06.608+0000 7fef318b1640 1 -- 172.21.15.116:0/618620925 >> v2:172.21.15.142:3300/0 conn(0x7fef2c0b3f90 msgr2=0x7fef2c06ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:53:06.599 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:06.608+0000 7fef318b1640 1 --2- 172.21.15.116:0/618620925 >> v2:172.21.15.142:3300/0 conn(0x7fef2c0b3f90 0x7fef2c06ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:06.599 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:06.608+0000 7fef318b1640 1 -- 172.21.15.116:0/618620925 >> v1:172.21.15.116:6789/0 conn(0x7fef2c06b380 legacy=0x7fef2c161bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:06.599 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:06.608+0000 7fef308af640 1 -- 172.21.15.116:0/618620925 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2935748050 0 0) 0x7fef2c15f570 con 0x7fef2c06b380 2024-02-21T22:53:06.599 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:06.608+0000 7fef318b1640 1 -- 172.21.15.116:0/618620925 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef2c15e7b0 con 0x7fef2c0b0290 2024-02-21T22:53:06.601 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:06.608+0000 7fef318b1640 1 --2- 172.21.15.116:0/618620925 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fef2c0b0290 0x7fef2c06f290 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fef2c067d20 tx=0x7fef2802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69ffc6068646465a server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:06.601 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:06.609+0000 7fef308af640 1 -- 172.21.15.116:0/618620925 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef280315a0 con 0x7fef2c0b0290 2024-02-21T22:53:06.601 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:06.609+0000 7fef308af640 1 -- 172.21.15.116:0/618620925 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef28037070 con 0x7fef2c0b0290 2024-02-21T22:53:06.601 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:06.609+0000 7fef308af640 1 -- 172.21.15.116:0/618620925 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef28031960 con 0x7fef2c0b0290 2024-02-21T22:53:06.601 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:06.609+0000 7fef33b15640 1 -- 172.21.15.116:0/618620925 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fef2c0b0290 msgr2=0x7fef2c06f290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:06.601 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:06.609+0000 7fef33b15640 1 --2- 172.21.15.116:0/618620925 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fef2c0b0290 0x7fef2c06f290 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fef2c067d20 tx=0x7fef2802b840 comp rx=0 tx=0).stop 2024-02-21T22:53:06.601 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:06.609+0000 7fef33b15640 1 -- 172.21.15.116:0/618620925 shutdown_connections 2024-02-21T22:53:06.601 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:06.609+0000 7fef33b15640 1 --2- 172.21.15.116:0/618620925 >> v2:172.21.15.142:3300/0 conn(0x7fef2c0b3f90 0x7fef2c06ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:06.601 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:06.609+0000 7fef33b15640 1 --2- 172.21.15.116:0/618620925 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fef2c0b0290 0x7fef2c06f290 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:06.601 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:06.609+0000 7fef33b15640 1 -- 172.21.15.116:0/618620925 >> 172.21.15.116:0/618620925 conn(0x7fef2c0b29f0 msgr2=0x7fef2c0b2e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:06.601 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:06.609+0000 7fef33b15640 1 -- 172.21.15.116:0/618620925 shutdown_connections 2024-02-21T22:53:06.601 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:06.609+0000 7fef33b15640 1 -- 172.21.15.116:0/618620925 wait complete. 2024-02-21T22:53:06.601 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:06.610+0000 7fef33b15640 1 Processor -- start 2024-02-21T22:53:06.602 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:06.610+0000 7fef33b15640 1 -- start start 2024-02-21T22:53:06.604 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:06.611+0000 7fef33b15640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fef2c06b380 0x7fef2c1fc650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:06.604 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:06.611+0000 7fef33b15640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fef2c0b0290 0x7fef2c0b1bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:06.604 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:06.611+0000 7fef33b15640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fef2c0b3f90 0x7fef2c14d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:06.604 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:06.611+0000 7fef33b15640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef2c15ed70 con 0x7fef2c06b380 2024-02-21T22:53:06.604 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:06.611+0000 7fef33b15640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef2c06b7b0 con 0x7fef2c0b3f90 2024-02-21T22:53:06.604 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:06.611+0000 7fef33b15640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef2c0b0670 con 0x7fef2c0b0290 2024-02-21T22:53:06.604 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:06.611+0000 7fef318b1640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fef2c06b380 0x7fef2c1fc650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:06.604 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:06.611+0000 7fef318b1640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fef2c06b380 0x7fef2c1fc650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:45376/0 (socket says 172.21.15.116:45376) 2024-02-21T22:53:06.605 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:06.611+0000 7fef318b1640 1 -- 172.21.15.116:0/3378395240 learned_addr learned my addr 172.21.15.116:0/3378395240 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:06.605 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:06.611+0000 7fef310b0640 1 --2- 172.21.15.116:0/3378395240 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fef2c0b0290 0x7fef2c0b1bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:06.605 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:06.611+0000 7fef320b2640 1 --2- 172.21.15.116:0/3378395240 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fef2c0b3f90 0x7fef2c14d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:06.605 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:06.611+0000 7fef318b1640 1 -- 172.21.15.116:0/3378395240 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fef2c0b0290 msgr2=0x7fef2c0b1bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:06.605 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:06.611+0000 7fef318b1640 1 --2- 172.21.15.116:0/3378395240 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fef2c0b0290 0x7fef2c0b1bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:06.605 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:06.611+0000 7fef318b1640 1 -- 172.21.15.116:0/3378395240 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fef2c0b3f90 msgr2=0x7fef2c14d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:06.605 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:06.611+0000 7fef318b1640 1 --2- 172.21.15.116:0/3378395240 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fef2c0b3f90 0x7fef2c14d440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:06.605 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:06.611+0000 7fef318b1640 1 -- 172.21.15.116:0/3378395240 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef2c1fcb90 con 0x7fef2c06b380 2024-02-21T22:53:06.605 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:06.612+0000 7fef318b1640 1 --2- 172.21.15.116:0/3378395240 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fef2c06b380 0x7fef2c1fc650 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fef28000c00 tx=0x7fef280046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:06.605 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:06.612+0000 7fef227fc640 1 -- 172.21.15.116:0/3378395240 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef28032630 con 0x7fef2c06b380 2024-02-21T22:53:06.605 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:06.612+0000 7fef227fc640 1 -- 172.21.15.116:0/3378395240 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef280327f0 con 0x7fef2c06b380 2024-02-21T22:53:06.605 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:06.612+0000 7fef33b15640 1 -- 172.21.15.116:0/3378395240 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef2c0d0430 con 0x7fef2c06b380 2024-02-21T22:53:06.605 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:06.612+0000 7fef227fc640 1 -- 172.21.15.116:0/3378395240 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef28032be0 con 0x7fef2c06b380 2024-02-21T22:53:06.605 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:06.612+0000 7fef33b15640 1 -- 172.21.15.116:0/3378395240 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef2c14e3f0 con 0x7fef2c06b380 2024-02-21T22:53:06.606 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:06.613+0000 7fef33b15640 1 -- 172.21.15.116:0/3378395240 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef2c0752f0 con 0x7fef2c06b380 2024-02-21T22:53:06.606 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:06.613+0000 7fef227fc640 1 -- 172.21.15.116:0/3378395240 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fef2804d3f0 con 0x7fef2c06b380 2024-02-21T22:53:06.606 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:06.613+0000 7fef227fc640 1 --2- 172.21.15.116:0/3378395240 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fef1006b4d0 0x7fef1006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:06.606 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:06.614+0000 7fef227fc640 1 -- 172.21.15.116:0/3378395240 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fef2802f030 con 0x7fef2c06b380 2024-02-21T22:53:06.606 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:06.614+0000 7fef310b0640 1 --2- 172.21.15.116:0/3378395240 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fef1006b4d0 0x7fef1006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:06.607 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:06.614+0000 7fef310b0640 1 --2- 172.21.15.116:0/3378395240 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fef1006b4d0 0x7fef1006d990 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fef2c1526f0 tx=0x7fef1c009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:06.608 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:06.618+0000 7fef227fc640 1 -- 172.21.15.116:0/3378395240 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7fef2c1fcb90 con 0x7fef2c06b380 2024-02-21T22:53:06.823 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:06.832+0000 7fef33b15640 1 -- 172.21.15.116:0/3378395240 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fef2c06b100 con 0x7fef2c06b380 2024-02-21T22:53:06.823 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:06.832+0000 7fef227fc640 1 -- 172.21.15.116:0/3378395240 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4941 (secure 0 0 0) 0x7fef28040070 con 0x7fef2c06b380 2024-02-21T22:53:06.823 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-02-21T22:53:06.824 INFO:teuthology.orchestra.run.smithi116.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6834/1717961923","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":1717961923},{"type":"v1","addr":"172.21.15.116:6834","nonce":1717961923}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6835/2228298220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6833","nonce":2228298220},{"type":"v1","addr":"172.21.15.116:6835","nonce":2228298220}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4285,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/1675920719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":1675920719},{"type":"v1","addr":"172.21.15.142:6837","nonce":1675920719}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-21T22:52:50.128732+0000","modified":"2024-02-21T22:52:52.125495+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6836/939436511","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":939436511},{"type":"v1","addr":"172.21.15.142:6836","nonce":939436511}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-02-21T22:53:06.824 INFO:teuthology.orchestra.run.smithi116.stderr:dumped fsmap epoch 6 2024-02-21T22:53:06.825 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:06.835+0000 7fef33b15640 1 -- 172.21.15.116:0/3378395240 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fef1006b4d0 msgr2=0x7fef1006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:06.826 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:06.835+0000 7fef33b15640 1 --2- 172.21.15.116:0/3378395240 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fef1006b4d0 0x7fef1006d990 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fef2c1526f0 tx=0x7fef1c009190 comp rx=0 tx=0).stop 2024-02-21T22:53:06.826 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:06.835+0000 7fef33b15640 1 -- 172.21.15.116:0/3378395240 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fef2c06b380 msgr2=0x7fef2c1fc650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:06.826 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:06.835+0000 7fef33b15640 1 --2- 172.21.15.116:0/3378395240 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fef2c06b380 0x7fef2c1fc650 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fef28000c00 tx=0x7fef280046c0 comp rx=0 tx=0).stop 2024-02-21T22:53:06.826 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:06.835+0000 7fef33b15640 1 -- 172.21.15.116:0/3378395240 shutdown_connections 2024-02-21T22:53:06.826 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:06.835+0000 7fef33b15640 1 --2- 172.21.15.116:0/3378395240 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fef2c0b3f90 0x7fef2c14d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:06.826 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:06.835+0000 7fef33b15640 1 --2- 172.21.15.116:0/3378395240 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fef1006b4d0 0x7fef1006d990 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:06.826 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:06.835+0000 7fef33b15640 1 --2- 172.21.15.116:0/3378395240 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fef2c0b0290 0x7fef2c0b1bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:06.826 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:06.835+0000 7fef33b15640 1 --2- 172.21.15.116:0/3378395240 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fef2c06b380 0x7fef2c1fc650 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:06.826 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:06.835+0000 7fef33b15640 1 -- 172.21.15.116:0/3378395240 >> 172.21.15.116:0/3378395240 conn(0x7fef2c0b29f0 msgr2=0x7fef2c06da00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:06.826 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:06.835+0000 7fef33b15640 1 -- 172.21.15.116:0/3378395240 shutdown_connections 2024-02-21T22:53:06.826 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:06.835+0000 7fef33b15640 1 -- 172.21.15.116:0/3378395240 wait complete. 2024-02-21T22:53:07.239 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-02-21T22:52:50.128732+0000', 'modified': '2024-02-21T22:52:52.125495+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4290}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4290': {'gid': 4290, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.142:6836/939436511', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.142:6835', 'nonce': 939436511}, {'type': 'v1', 'addr': '172.21.15.142:6836', 'nonce': 939436511}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-02-21T22:53:07.239 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-02-21T22:53:07.239 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-02-21T22:53:07.345 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.355+0000 7fec13c2d640 1 Processor -- start 2024-02-21T22:53:07.345 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.355+0000 7fec13c2d640 1 -- start start 2024-02-21T22:53:07.347 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.355+0000 7fec13c2d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fec0c15afb0 0x7fec0c0af080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:07.347 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.356+0000 7fec13c2d640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fec0c070b70 0x7fec0c071580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:07.347 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.356+0000 7fec13c2d640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fec0c071ac0 0x7fec0c0ad560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:07.348 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.356+0000 7fec13c2d640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec0c15b390 con 0x7fec0c071ac0 2024-02-21T22:53:07.348 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.356+0000 7fec13c2d640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec0c0713c0 con 0x7fec0c070b70 2024-02-21T22:53:07.348 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.356+0000 7fec13c2d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec0c0710e0 con 0x7fec0c15afb0 2024-02-21T22:53:07.348 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.356+0000 7fec121ca640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fec0c071ac0 0x7fec0c0ad560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:07.348 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.356+0000 7fec121ca640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fec0c071ac0 0x7fec0c0ad560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:45386/0 (socket says 172.21.15.116:45386) 2024-02-21T22:53:07.348 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.356+0000 7fec121ca640 1 -- 172.21.15.116:0/3348778801 learned_addr learned my addr 172.21.15.116:0/3348778801 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:07.348 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.356+0000 7fec111c8640 1 --2- 172.21.15.116:0/3348778801 >> v2:172.21.15.142:3300/0 conn(0x7fec0c070b70 0x7fec0c071580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:07.348 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.356+0000 7fec119c9640 1 --2- 172.21.15.116:0/3348778801 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fec0c15afb0 0x7fec0c0af080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:07.348 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.356+0000 7fec121ca640 1 -- 172.21.15.116:0/3348778801 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fec0c15afb0 msgr2=0x7fec0c0af080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:53:07.348 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.356+0000 7fec121ca640 1 --2- 172.21.15.116:0/3348778801 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fec0c15afb0 0x7fec0c0af080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:07.348 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.356+0000 7fec121ca640 1 -- 172.21.15.116:0/3348778801 >> v2:172.21.15.142:3300/0 conn(0x7fec0c070b70 msgr2=0x7fec0c071580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:53:07.348 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.356+0000 7fec121ca640 1 --2- 172.21.15.116:0/3348778801 >> v2:172.21.15.142:3300/0 conn(0x7fec0c070b70 0x7fec0c071580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:07.348 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.356+0000 7fec121ca640 1 -- 172.21.15.116:0/3348778801 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec0c0b2d80 con 0x7fec0c071ac0 2024-02-21T22:53:07.349 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.357+0000 7fec121ca640 1 --2- 172.21.15.116:0/3348778801 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fec0c071ac0 0x7fec0c0ad560 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fec0c06c470 tx=0x7fec0802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0419499e2023271 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:07.349 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.357+0000 7fec109c7640 1 -- 172.21.15.116:0/3348778801 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec08034070 con 0x7fec0c071ac0 2024-02-21T22:53:07.349 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.357+0000 7fec109c7640 1 -- 172.21.15.116:0/3348778801 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec08030860 con 0x7fec0c071ac0 2024-02-21T22:53:07.349 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.357+0000 7fec109c7640 1 -- 172.21.15.116:0/3348778801 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec08030c30 con 0x7fec0c071ac0 2024-02-21T22:53:07.351 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.357+0000 7fec13c2d640 1 -- 172.21.15.116:0/3348778801 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fec0c071ac0 msgr2=0x7fec0c0ad560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:07.351 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.357+0000 7fec13c2d640 1 --2- 172.21.15.116:0/3348778801 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fec0c071ac0 0x7fec0c0ad560 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fec0c06c470 tx=0x7fec0802b9a0 comp rx=0 tx=0).stop 2024-02-21T22:53:07.352 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.357+0000 7fec13c2d640 1 -- 172.21.15.116:0/3348778801 shutdown_connections 2024-02-21T22:53:07.352 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.357+0000 7fec13c2d640 1 --2- 172.21.15.116:0/3348778801 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fec0c071ac0 0x7fec0c0ad560 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:07.352 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.357+0000 7fec13c2d640 1 --2- 172.21.15.116:0/3348778801 >> v2:172.21.15.142:3300/0 conn(0x7fec0c070b70 0x7fec0c071580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:07.352 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.357+0000 7fec13c2d640 1 --2- 172.21.15.116:0/3348778801 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fec0c15afb0 0x7fec0c0af080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:07.352 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.357+0000 7fec13c2d640 1 -- 172.21.15.116:0/3348778801 >> 172.21.15.116:0/3348778801 conn(0x7fec0c0b18e0 msgr2=0x7fec0c0b1cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:07.352 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.357+0000 7fec13c2d640 1 -- 172.21.15.116:0/3348778801 shutdown_connections 2024-02-21T22:53:07.352 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.358+0000 7fec13c2d640 1 -- 172.21.15.116:0/3348778801 wait complete. 2024-02-21T22:53:07.352 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.359+0000 7fec13c2d640 1 Processor -- start 2024-02-21T22:53:07.352 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.359+0000 7fec13c2d640 1 -- start start 2024-02-21T22:53:07.352 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.359+0000 7fec13c2d640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fec0c070b70 0x7fec0c1497a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:07.352 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.359+0000 7fec13c2d640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fec0c071ac0 0x7fec0c15c860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:07.352 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.359+0000 7fec13c2d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fec0c15afb0 0x7fec0c0ccde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:07.352 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.359+0000 7fec13c2d640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec0c0af5c0 con 0x7fec0c070b70 2024-02-21T22:53:07.352 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.359+0000 7fec13c2d640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec0c0b3340 con 0x7fec0c071ac0 2024-02-21T22:53:07.353 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.359+0000 7fec13c2d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec0c0adaa0 con 0x7fec0c15afb0 2024-02-21T22:53:07.353 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.359+0000 7fec119c9640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fec0c070b70 0x7fec0c1497a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:07.353 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.359+0000 7fec119c9640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fec0c070b70 0x7fec0c1497a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:45390/0 (socket says 172.21.15.116:45390) 2024-02-21T22:53:07.353 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.359+0000 7fec119c9640 1 -- 172.21.15.116:0/1289058859 learned_addr learned my addr 172.21.15.116:0/1289058859 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:07.353 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.360+0000 7fec111c8640 1 --2- 172.21.15.116:0/1289058859 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fec0c071ac0 0x7fec0c15c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:07.353 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.360+0000 7fec121ca640 1 --2- 172.21.15.116:0/1289058859 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fec0c15afb0 0x7fec0c0ccde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:07.353 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.360+0000 7fec119c9640 1 -- 172.21.15.116:0/1289058859 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fec0c15afb0 msgr2=0x7fec0c0ccde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:07.353 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.360+0000 7fec119c9640 1 --2- 172.21.15.116:0/1289058859 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fec0c15afb0 0x7fec0c0ccde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:07.353 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.360+0000 7fec119c9640 1 -- 172.21.15.116:0/1289058859 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fec0c071ac0 msgr2=0x7fec0c15c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:07.353 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.360+0000 7fec119c9640 1 --2- 172.21.15.116:0/1289058859 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fec0c071ac0 0x7fec0c15c860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:07.353 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.360+0000 7fec119c9640 1 -- 172.21.15.116:0/1289058859 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec0c15bc80 con 0x7fec0c070b70 2024-02-21T22:53:07.353 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.360+0000 7fec119c9640 1 --2- 172.21.15.116:0/1289058859 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fec0c070b70 0x7fec0c1497a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fec04009d10 tx=0x7fec0400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:07.353 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.360+0000 7fec027fc640 1 -- 172.21.15.116:0/1289058859 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec04018020 con 0x7fec0c070b70 2024-02-21T22:53:07.353 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.360+0000 7fec027fc640 1 -- 172.21.15.116:0/1289058859 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec04014480 con 0x7fec0c070b70 2024-02-21T22:53:07.353 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.360+0000 7fec13c2d640 1 -- 172.21.15.116:0/1289058859 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec0c15bf60 con 0x7fec0c070b70 2024-02-21T22:53:07.354 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.360+0000 7fec027fc640 1 -- 172.21.15.116:0/1289058859 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec04014830 con 0x7fec0c070b70 2024-02-21T22:53:07.354 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.360+0000 7fec13c2d640 1 -- 172.21.15.116:0/1289058859 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec0c15b510 con 0x7fec0c070b70 2024-02-21T22:53:07.362 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.362+0000 7fec027fc640 1 -- 172.21.15.116:0/1289058859 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fec04005d10 con 0x7fec0c070b70 2024-02-21T22:53:07.362 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.362+0000 7fec027fc640 1 --2- 172.21.15.116:0/1289058859 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7febf006b4d0 0x7febf006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:07.362 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.362+0000 7fec027fc640 1 -- 172.21.15.116:0/1289058859 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fec0408ab70 con 0x7fec0c070b70 2024-02-21T22:53:07.362 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.362+0000 7fec111c8640 1 --2- 172.21.15.116:0/1289058859 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7febf006b4d0 0x7febf006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:07.362 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.363+0000 7fec111c8640 1 --2- 172.21.15.116:0/1289058859 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7febf006b4d0 0x7febf006d990 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fec0c15c720 tx=0x7febfc009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:07.362 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.363+0000 7fec16a07740 1 Processor -- start 2024-02-21T22:53:07.362 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.363+0000 7fec16a07740 1 -- start start 2024-02-21T22:53:07.362 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.364+0000 7fec16a07740 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x556c24b69070 0x556c24b69450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:07.362 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.364+0000 7fec16a07740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556c24b39090 0x556c24b662e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:07.362 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.364+0000 7fec16a07740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556c24b3cbf0 0x556c24b66820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:07.362 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.364+0000 7fec16a07740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c24aa2860 con 0x556c24b3cbf0 2024-02-21T22:53:07.362 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.364+0000 7fec16a07740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c24a4b980 con 0x556c24b39090 2024-02-21T22:53:07.362 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.364+0000 7fec16a07740 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x556c24a9eaa0 con 0x556c24b69070 2024-02-21T22:53:07.363 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.364+0000 7fec121ca640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556c24b3cbf0 0x556c24b66820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:07.363 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.364+0000 7fec111c8640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556c24b39090 0x556c24b662e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:07.363 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.364+0000 7fec119c9640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x556c24b69070 0x556c24b69450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:07.363 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.364+0000 7fec111c8640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556c24b39090 0x556c24b662e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.116:38940/0 (socket says 172.21.15.116:38940) 2024-02-21T22:53:07.363 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.364+0000 7fec111c8640 1 -- 172.21.15.116:0/2762649409 learned_addr learned my addr 172.21.15.116:0/2762649409 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:07.363 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.364+0000 7fec121ca640 1 --2- 172.21.15.116:0/2762649409 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556c24b3cbf0 0x556c24b66820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:45404/0 (socket says 172.21.15.116:45404) 2024-02-21T22:53:07.363 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.364+0000 7fec119c9640 1 -- 172.21.15.116:0/2762649409 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556c24b39090 msgr2=0x556c24b662e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:53:07.363 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.364+0000 7fec119c9640 1 --2- 172.21.15.116:0/2762649409 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556c24b39090 0x556c24b662e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:07.363 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.364+0000 7fec119c9640 1 -- 172.21.15.116:0/2762649409 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556c24b3cbf0 msgr2=0x556c24b66820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:53:07.363 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.364+0000 7fec119c9640 1 --2- 172.21.15.116:0/2762649409 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556c24b3cbf0 0x556c24b66820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:07.363 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.364+0000 7fec119c9640 1 -- 172.21.15.116:0/2762649409 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556c24a60c60 con 0x556c24b69070 2024-02-21T22:53:07.363 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.364+0000 7fec111c8640 1 --2- 172.21.15.116:0/2762649409 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556c24b39090 0x556c24b662e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T22:53:07.363 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.364+0000 7fec121ca640 1 --2- 172.21.15.116:0/2762649409 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556c24b3cbf0 0x556c24b66820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T22:53:07.363 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.365+0000 7fec119c9640 1 --2- 172.21.15.116:0/2762649409 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x556c24b69070 0x556c24b69450 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fec04089070 tx=0x7fec04059460 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2871e8c5fb0bcb6 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:07.364 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.365+0000 7febef7fe640 1 -- 172.21.15.116:0/2762649409 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec040576a0 con 0x556c24b69070 2024-02-21T22:53:07.364 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.365+0000 7febef7fe640 1 -- 172.21.15.116:0/2762649409 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec0405d160 con 0x556c24b69070 2024-02-21T22:53:07.364 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.365+0000 7febef7fe640 1 -- 172.21.15.116:0/2762649409 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec040587f0 con 0x556c24b69070 2024-02-21T22:53:07.364 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.365+0000 7fec16a07740 1 -- 172.21.15.116:0/2762649409 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x556c24b69070 msgr2=0x556c24b69450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:07.364 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.365+0000 7fec16a07740 1 --2- 172.21.15.116:0/2762649409 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x556c24b69070 0x556c24b69450 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fec04089070 tx=0x7fec04059460 comp rx=0 tx=0).stop 2024-02-21T22:53:07.364 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.365+0000 7fec16a07740 1 -- 172.21.15.116:0/2762649409 shutdown_connections 2024-02-21T22:53:07.364 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.365+0000 7fec16a07740 1 --2- 172.21.15.116:0/2762649409 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556c24b3cbf0 0x556c24b66820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:07.364 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.365+0000 7fec16a07740 1 --2- 172.21.15.116:0/2762649409 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556c24b39090 0x556c24b662e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:07.364 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.365+0000 7fec16a07740 1 --2- 172.21.15.116:0/2762649409 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x556c24b69070 0x556c24b69450 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:07.364 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.365+0000 7fec16a07740 1 -- 172.21.15.116:0/2762649409 >> 172.21.15.116:0/2762649409 conn(0x556c24b3b300 msgr2=0x556c24b83e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:07.364 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.365+0000 7fec16a07740 1 -- 172.21.15.116:0/2762649409 shutdown_connections 2024-02-21T22:53:07.364 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.365+0000 7fec16a07740 1 -- 172.21.15.116:0/2762649409 wait complete. 2024-02-21T22:53:07.364 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.366+0000 7fec16a07740 1 -- start start 2024-02-21T22:53:07.365 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.366+0000 7fec16a07740 1 Processor -- start 2024-02-21T22:53:07.365 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.367+0000 7fec16a07740 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x556c24b3cbf0 0x556c24b69450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:07.365 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.367+0000 7fec16a07740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556c24b69070 0x556c24b62f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:07.365 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.367+0000 7fec16a07740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556c24b5e9d0 0x556c24b63490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:07.365 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.367+0000 7fec16a07740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c24b3dda0 con 0x556c24b5e9d0 2024-02-21T22:53:07.365 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.367+0000 7fec16a07740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c24a5ef10 con 0x556c24b69070 2024-02-21T22:53:07.365 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.367+0000 7fec16a07740 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x556c24b3d190 con 0x556c24b3cbf0 2024-02-21T22:53:07.365 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.367+0000 7fec16a07740 10 client.0 _ll_register_callbacks cb 0x556c24a52d10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T22:53:07.365 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.367+0000 7fec121ca640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556c24b5e9d0 0x556c24b63490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:07.365 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.367+0000 7fec111c8640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556c24b69070 0x556c24b62f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:07.365 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.367+0000 7fec119c9640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x556c24b3cbf0 0x556c24b69450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:07.365 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.367+0000 7fec121ca640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556c24b5e9d0 0x556c24b63490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:45412/0 (socket says 172.21.15.116:45412) 2024-02-21T22:53:07.365 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.367+0000 7fec121ca640 1 -- 172.21.15.116:0/3242970628 learned_addr learned my addr 172.21.15.116:0/3242970628 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:07.365 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.367+0000 7fec111c8640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556c24b69070 0x556c24b62f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.116:38952/0 (socket says 172.21.15.116:38952) 2024-02-21T22:53:07.365 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.367+0000 7fec121ca640 1 -- 172.21.15.116:0/3242970628 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x556c24b3cbf0 msgr2=0x556c24b69450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:53:07.366 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.367+0000 7fec121ca640 1 --2- 172.21.15.116:0/3242970628 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x556c24b3cbf0 0x556c24b69450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:07.366 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.367+0000 7fec121ca640 1 -- 172.21.15.116:0/3242970628 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556c24b69070 msgr2=0x556c24b62f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:53:07.366 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.367+0000 7fec121ca640 1 --2- 172.21.15.116:0/3242970628 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556c24b69070 0x556c24b62f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:07.366 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.367+0000 7fec121ca640 1 -- 172.21.15.116:0/3242970628 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556c247b72d0 con 0x556c24b5e9d0 2024-02-21T22:53:07.366 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.367+0000 7fec119c9640 1 --2- 172.21.15.116:0/3242970628 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x556c24b3cbf0 0x556c24b69450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T22:53:07.366 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.367+0000 7fec121ca640 1 --2- 172.21.15.116:0/3242970628 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556c24b5e9d0 0x556c24b63490 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fec08009930 tx=0x7fec08004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8a0d02fe9082c92 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:07.366 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.367+0000 7febecff9640 10 client.0 ms_handle_connect on v2:172.21.15.116:3300/0 2024-02-21T22:53:07.366 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.368+0000 7febecff9640 1 -- 172.21.15.116:0/3242970628 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec08034040 con 0x556c24b5e9d0 2024-02-21T22:53:07.366 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.368+0000 7febecff9640 1 -- 172.21.15.116:0/3242970628 <== mon.0 v2:172.21.15.116:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fec08043890 con 0x556c24b5e9d0 2024-02-21T22:53:07.366 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.368+0000 7fec16a07740 1 -- 172.21.15.116:0/3242970628 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fec0405d160 con 0x556c24b5e9d0 2024-02-21T22:53:07.366 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.368+0000 7febecff9640 1 -- 172.21.15.116:0/3242970628 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) v2 ==== 24+0+0 (secure 0 0 0) 0x7fec08051050 con 0x556c24b5e9d0 2024-02-21T22:53:07.366 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.368+0000 7fec16a07740 10 client.4680 fetch_fsmap learned FSMap version 6 2024-02-21T22:53:07.366 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.368+0000 7fec16a07740 1 -- 172.21.15.116:0/3242970628 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) v3 -- 0x556c248816b0 con 0x556c24b5e9d0 2024-02-21T22:53:07.366 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.368+0000 7febecff9640 1 -- 172.21.15.116:0/3242970628 <== mon.0 v2:172.21.15.116:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec0405d160 con 0x556c24b5e9d0 2024-02-21T22:53:07.366 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.368+0000 7febecff9640 1 -- 172.21.15.116:0/3242970628 <== mon.0 v2:172.21.15.116:3300/0 5 ==== fsmap(e 6) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fec08054020 con 0x556c24b5e9d0 2024-02-21T22:53:07.367 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.368+0000 7fec16a07740 10 client.4680 fetch_fsmap finished waiting for FSMap version 6 2024-02-21T22:53:07.367 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.368+0000 7fec16a07740 10 client.4680 resolve_mds: resolved name 'd' to daemon mds.d 2024-02-21T22:53:07.367 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.368+0000 7fec16a07740 20 client.4680 populate_metadata read hostname 'smithi116' 2024-02-21T22:53:07.367 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.368+0000 7fec16a07740 1 --2- 172.21.15.116:0/3242970628 >> [v2:172.21.15.142:6835/939436511,v1:172.21.15.142:6836/939436511] conn(0x556c24b61130 0x556c24b61510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:07.367 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.368+0000 7fec16a07740 4 client.4680 mds_command: new command op to 4290 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T22:53:07.367 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.368+0000 7fec16a07740 1 -- 172.21.15.116:0/3242970628 --> [v2:172.21.15.142:6835/939436511,v1:172.21.15.142:6836/939436511] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556c24b00480 con 0x556c24b61130 2024-02-21T22:53:07.367 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.368+0000 7fec119c9640 1 --2- 172.21.15.116:0/3242970628 >> [v2:172.21.15.142:6835/939436511,v1:172.21.15.142:6836/939436511] conn(0x556c24b61130 0x556c24b61510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:07.367 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.369+0000 7fec119c9640 1 --2- 172.21.15.116:0/3242970628 >> [v2:172.21.15.142:6835/939436511,v1:172.21.15.142:6836/939436511] conn(0x556c24b61130 0x556c24b61510 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1f6c341973f07dc1 server_cookie=d1120f56ad151972 in_seq=0 out_seq=0 2024-02-21T22:53:07.367 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.369+0000 7febecff9640 10 client.4680 ms_handle_connect on v2:172.21.15.142:6835/939436511 2024-02-21T22:53:07.367 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.369+0000 7febecff9640 1 -- 172.21.15.116:0/3242970628 <== mds.0 v2:172.21.15.142:6835/939436511 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x556c24b00480 con 0x556c24b61130 2024-02-21T22:53:07.367 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.369+0000 7febecff9640 10 client.4680 handle_command_reply: tid=0 2024-02-21T22:53:07.367 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.369+0000 7fec16a07740 1 client.4680 shutdown 2024-02-21T22:53:07.367 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.369+0000 7fec16a07740 1 -- 172.21.15.116:0/3242970628 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556c24b5e9d0 msgr2=0x556c24b63490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:07.367 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.369+0000 7fec16a07740 1 --2- 172.21.15.116:0/3242970628 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556c24b5e9d0 0x556c24b63490 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fec08009930 tx=0x7fec08004730 comp rx=0 tx=0).stop 2024-02-21T22:53:07.368 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.369+0000 7fec16a07740 1 -- 172.21.15.116:0/3242970628 shutdown_connections 2024-02-21T22:53:07.368 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.369+0000 7fec16a07740 1 --2- 172.21.15.116:0/3242970628 >> [v2:172.21.15.142:6835/939436511,v1:172.21.15.142:6836/939436511] conn(0x556c24b61130 0x556c24b61510 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:07.368 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.369+0000 7fec16a07740 1 --2- 172.21.15.116:0/3242970628 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556c24b5e9d0 0x556c24b63490 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:07.368 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.369+0000 7fec16a07740 1 --2- 172.21.15.116:0/3242970628 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556c24b69070 0x556c24b62f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:07.368 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.369+0000 7fec16a07740 1 --2- 172.21.15.116:0/3242970628 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x556c24b3cbf0 0x556c24b69450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:07.368 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.369+0000 7febecff9640 0 client.4680 ms_handle_reset on v2:172.21.15.142:6835/939436511 2024-02-21T22:53:07.368 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.369+0000 7fec16a07740 1 -- 172.21.15.116:0/3242970628 >> 172.21.15.116:0/3242970628 conn(0x556c24b39090 msgr2=0x556c24b3df20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:07.368 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.369+0000 7fec16a07740 1 -- 172.21.15.116:0/3242970628 shutdown_connections 2024-02-21T22:53:07.368 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.370+0000 7fec16a07740 1 -- 172.21.15.116:0/3242970628 wait complete. 2024-02-21T22:53:07.368 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.370+0000 7fec16a07740 20 client.4680 trim_cache size 0 max 16384 2024-02-21T22:53:07.377 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.386+0000 7fec16a07740 1 Processor -- start 2024-02-21T22:53:07.377 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.386+0000 7fec16a07740 1 -- start start 2024-02-21T22:53:07.379 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.387+0000 7fec16a07740 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x556c24b3cbf0 0x556c24b69450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:07.379 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.387+0000 7fec16a07740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556c24b5e9d0 0x556c24b65d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:07.379 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.387+0000 7fec16a07740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556c24b69070 0x556c24b662d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:07.379 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.387+0000 7fec16a07740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec0c1fe020 con 0x556c24b5e9d0 2024-02-21T22:53:07.379 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.387+0000 7fec16a07740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec0c1fd2c0 con 0x556c24b69070 2024-02-21T22:53:07.380 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.387+0000 7fec16a07740 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec0c1f52c0 con 0x556c24b3cbf0 2024-02-21T22:53:07.380 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.387+0000 7fec111c8640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556c24b5e9d0 0x556c24b65d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:07.380 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.387+0000 7fec111c8640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556c24b5e9d0 0x556c24b65d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:45422/0 (socket says 172.21.15.116:45422) 2024-02-21T22:53:07.380 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.387+0000 7fec111c8640 1 -- 172.21.15.116:0/2351839619 learned_addr learned my addr 172.21.15.116:0/2351839619 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:07.380 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.387+0000 7fec121ca640 1 --2- 172.21.15.116:0/2351839619 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556c24b69070 0x556c24b662d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:07.380 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.387+0000 7fec119c9640 1 --2- 172.21.15.116:0/2351839619 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x556c24b3cbf0 0x556c24b69450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:07.380 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.387+0000 7fec111c8640 1 -- 172.21.15.116:0/2351839619 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x556c24b3cbf0 msgr2=0x556c24b69450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:53:07.380 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.387+0000 7fec111c8640 1 --2- 172.21.15.116:0/2351839619 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x556c24b3cbf0 0x556c24b69450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:07.380 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.387+0000 7fec111c8640 1 -- 172.21.15.116:0/2351839619 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556c24b69070 msgr2=0x556c24b662d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:53:07.380 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.387+0000 7fec111c8640 1 --2- 172.21.15.116:0/2351839619 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556c24b69070 0x556c24b662d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:07.380 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.387+0000 7fec111c8640 1 -- 172.21.15.116:0/2351839619 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556c24b83ac0 con 0x556c24b5e9d0 2024-02-21T22:53:07.380 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.387+0000 7fec111c8640 1 --2- 172.21.15.116:0/2351839619 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556c24b5e9d0 0x556c24b65d90 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7febfc011b30 tx=0x7febfc014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=478826aa59257b1c server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:07.380 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.387+0000 7febeeffd640 1 -- 172.21.15.116:0/2351839619 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febfc003a60 con 0x556c24b5e9d0 2024-02-21T22:53:07.380 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.387+0000 7febeeffd640 1 -- 172.21.15.116:0/2351839619 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febfc028030 con 0x556c24b5e9d0 2024-02-21T22:53:07.380 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.387+0000 7febeeffd640 1 -- 172.21.15.116:0/2351839619 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febfc003e00 con 0x556c24b5e9d0 2024-02-21T22:53:07.381 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.388+0000 7fec16a07740 1 -- 172.21.15.116:0/2351839619 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556c24b5e9d0 msgr2=0x556c24b65d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:07.381 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.388+0000 7fec16a07740 1 --2- 172.21.15.116:0/2351839619 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556c24b5e9d0 0x556c24b65d90 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7febfc011b30 tx=0x7febfc014000 comp rx=0 tx=0).stop 2024-02-21T22:53:07.381 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.388+0000 7fec16a07740 1 -- 172.21.15.116:0/2351839619 shutdown_connections 2024-02-21T22:53:07.381 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.388+0000 7fec16a07740 1 --2- 172.21.15.116:0/2351839619 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556c24b69070 0x556c24b662d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:07.381 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.388+0000 7fec16a07740 1 --2- 172.21.15.116:0/2351839619 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556c24b5e9d0 0x556c24b65d90 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:07.381 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.388+0000 7fec16a07740 1 --2- 172.21.15.116:0/2351839619 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x556c24b3cbf0 0x556c24b69450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:07.381 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.388+0000 7fec16a07740 1 -- 172.21.15.116:0/2351839619 >> 172.21.15.116:0/2351839619 conn(0x556c24b39090 msgr2=0x556c24b843b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:07.381 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.388+0000 7fec16a07740 1 -- 172.21.15.116:0/2351839619 shutdown_connections 2024-02-21T22:53:07.381 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.388+0000 7fec16a07740 1 -- 172.21.15.116:0/2351839619 wait complete. 2024-02-21T22:53:07.381 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.388+0000 7fec16a07740 1 -- start start 2024-02-21T22:53:07.381 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.389+0000 7fec16a07740 1 Processor -- start 2024-02-21T22:53:07.385 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.389+0000 7fec16a07740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556c24b3cbf0 0x556c24bf2e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:07.385 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.389+0000 7fec16a07740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556c24b5e9d0 0x556c24b86420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:07.386 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.389+0000 7fec16a07740 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x556c24b69070 0x556c24b925a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:07.386 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.389+0000 7fec16a07740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c24b5f350 con 0x556c24b5e9d0 2024-02-21T22:53:07.386 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.389+0000 7fec16a07740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec0c1f58c0 con 0x556c24b3cbf0 2024-02-21T22:53:07.386 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.389+0000 7fec16a07740 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x556c24b5fbf0 con 0x556c24b69070 2024-02-21T22:53:07.386 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.389+0000 7fec16a07740 10 client.0 _ll_register_callbacks cb 0x7fec080096f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T22:53:07.386 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.390+0000 7fec111c8640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556c24b5e9d0 0x556c24b86420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:07.386 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.390+0000 7fec111c8640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556c24b5e9d0 0x556c24b86420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:45432/0 (socket says 172.21.15.116:45432) 2024-02-21T22:53:07.386 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.390+0000 7fec111c8640 1 -- 172.21.15.116:0/92594994 learned_addr learned my addr 172.21.15.116:0/92594994 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:07.386 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.390+0000 7fec119c9640 1 --2- 172.21.15.116:0/92594994 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556c24b3cbf0 0x556c24bf2e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:07.386 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.390+0000 7fec121ca640 1 --2- 172.21.15.116:0/92594994 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x556c24b69070 0x556c24b925a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:07.386 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.390+0000 7fec111c8640 1 -- 172.21.15.116:0/92594994 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x556c24b69070 msgr2=0x556c24b925a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:53:07.386 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.390+0000 7fec111c8640 1 --2- 172.21.15.116:0/92594994 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x556c24b69070 0x556c24b925a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:07.386 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.390+0000 7fec111c8640 1 -- 172.21.15.116:0/92594994 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556c24b3cbf0 msgr2=0x556c24bf2e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:53:07.386 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.390+0000 7fec111c8640 1 --2- 172.21.15.116:0/92594994 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556c24b3cbf0 0x556c24bf2e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:07.387 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.390+0000 7fec111c8640 1 -- 172.21.15.116:0/92594994 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556c24b86960 con 0x556c24b5e9d0 2024-02-21T22:53:07.387 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.390+0000 7fec119c9640 1 --2- 172.21.15.116:0/92594994 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556c24b3cbf0 0x556c24bf2e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T22:53:07.387 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.390+0000 7fec111c8640 1 --2- 172.21.15.116:0/92594994 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556c24b5e9d0 0x556c24b86420 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7febfc011b00 tx=0x7febfc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9afe4b766e21de48 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:07.387 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.390+0000 7febecff9640 10 client.0 ms_handle_connect on v2:172.21.15.116:3300/0 2024-02-21T22:53:07.387 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.390+0000 7febecff9640 1 -- 172.21.15.116:0/92594994 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febfc004420 con 0x556c24b5e9d0 2024-02-21T22:53:07.387 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.390+0000 7febecff9640 1 -- 172.21.15.116:0/92594994 <== mon.0 v2:172.21.15.116:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7febfc039ad0 con 0x556c24b5e9d0 2024-02-21T22:53:07.387 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.390+0000 7fec16a07740 1 -- 172.21.15.116:0/92594994 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7febfc028030 con 0x556c24b5e9d0 2024-02-21T22:53:07.387 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.390+0000 7febecff9640 1 -- 172.21.15.116:0/92594994 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) v2 ==== 24+0+0 (secure 0 0 0) 0x7febfc039cd0 con 0x556c24b5e9d0 2024-02-21T22:53:07.387 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.390+0000 7fec16a07740 10 client.4686 fetch_fsmap learned FSMap version 6 2024-02-21T22:53:07.387 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.390+0000 7fec16a07740 1 -- 172.21.15.116:0/92594994 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) v3 -- 0x556c24b92fc0 con 0x556c24b5e9d0 2024-02-21T22:53:07.387 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.390+0000 7febecff9640 1 -- 172.21.15.116:0/92594994 <== mon.0 v2:172.21.15.116:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febfc028030 con 0x556c24b5e9d0 2024-02-21T22:53:07.387 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.390+0000 7febecff9640 1 -- 172.21.15.116:0/92594994 <== mon.0 v2:172.21.15.116:3300/0 5 ==== fsmap(e 6) v1 ==== 3294+0+0 (secure 0 0 0) 0x7febfc014650 con 0x556c24b5e9d0 2024-02-21T22:53:07.387 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.390+0000 7fec16a07740 10 client.4686 fetch_fsmap finished waiting for FSMap version 6 2024-02-21T22:53:07.387 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.390+0000 7fec16a07740 10 client.4686 resolve_mds: resolved name 'd' to daemon mds.d 2024-02-21T22:53:07.387 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.390+0000 7fec16a07740 20 client.4686 populate_metadata read hostname 'smithi116' 2024-02-21T22:53:07.388 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.390+0000 7fec16a07740 1 --2- 172.21.15.116:0/92594994 >> [v2:172.21.15.142:6835/939436511,v1:172.21.15.142:6836/939436511] conn(0x556c24b5d400 0x556c24b62170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:07.388 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.390+0000 7fec16a07740 4 client.4686 mds_command: new command op to 4290 tid=0 multi_id=0 [{"prefix": "status"}] 2024-02-21T22:53:07.388 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.390+0000 7fec16a07740 1 -- 172.21.15.116:0/92594994 --> [v2:172.21.15.142:6835/939436511,v1:172.21.15.142:6836/939436511] -- command(tid 0: {"prefix": "status"}) v1 -- 0x556c24b39890 con 0x556c24b5d400 2024-02-21T22:53:07.388 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.391+0000 7fec119c9640 1 --2- 172.21.15.116:0/92594994 >> [v2:172.21.15.142:6835/939436511,v1:172.21.15.142:6836/939436511] conn(0x556c24b5d400 0x556c24b62170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:07.388 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.391+0000 7fec119c9640 1 --2- 172.21.15.116:0/92594994 >> [v2:172.21.15.142:6835/939436511,v1:172.21.15.142:6836/939436511] conn(0x556c24b5d400 0x556c24b62170 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e7c788cf9ab37a5d server_cookie=43028c37ac7e39e0 in_seq=0 out_seq=0 2024-02-21T22:53:07.388 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.391+0000 7febecff9640 10 client.4686 ms_handle_connect on v2:172.21.15.142:6835/939436511 2024-02-21T22:53:07.388 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.391+0000 7febecff9640 1 -- 172.21.15.116:0/92594994 <== mds.0 v2:172.21.15.142:6835/939436511 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x556c24b39890 con 0x556c24b5d400 2024-02-21T22:53:07.388 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.391+0000 7febecff9640 10 client.4686 handle_command_reply: tid=0 2024-02-21T22:53:07.388 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.391+0000 7fec16a07740 1 client.4686 shutdown 2024-02-21T22:53:07.388 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.391+0000 7fec16a07740 1 -- 172.21.15.116:0/92594994 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556c24b5e9d0 msgr2=0x556c24b86420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:07.388 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.391+0000 7fec16a07740 1 --2- 172.21.15.116:0/92594994 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556c24b5e9d0 0x556c24b86420 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7febfc011b00 tx=0x7febfc004730 comp rx=0 tx=0).stop 2024-02-21T22:53:07.388 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.391+0000 7fec16a07740 1 -- 172.21.15.116:0/92594994 shutdown_connections 2024-02-21T22:53:07.388 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.391+0000 7fec16a07740 1 --2- 172.21.15.116:0/92594994 >> [v2:172.21.15.142:6835/939436511,v1:172.21.15.142:6836/939436511] conn(0x556c24b5d400 0x556c24b62170 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:07.388 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.391+0000 7fec16a07740 1 --2- 172.21.15.116:0/92594994 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x556c24b69070 0x556c24b925a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:07.389 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.391+0000 7fec16a07740 1 --2- 172.21.15.116:0/92594994 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556c24b5e9d0 0x556c24b86420 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:07.389 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.391+0000 7fec16a07740 1 --2- 172.21.15.116:0/92594994 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556c24b3cbf0 0x556c24bf2e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:07.389 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.391+0000 7febecff9640 0 client.4686 ms_handle_reset on v2:172.21.15.142:6835/939436511 2024-02-21T22:53:07.392 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.391+0000 7fec16a07740 1 -- 172.21.15.116:0/92594994 >> 172.21.15.116:0/92594994 conn(0x556c24b39090 msgr2=0x556c24b65ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:07.392 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.391+0000 7fec16a07740 1 -- 172.21.15.116:0/92594994 shutdown_connections 2024-02-21T22:53:07.393 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.391+0000 7fec16a07740 1 -- 172.21.15.116:0/92594994 wait complete. 2024-02-21T22:53:07.393 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.391+0000 7fec16a07740 20 client.4686 trim_cache size 0 max 16384 2024-02-21T22:53:07.393 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-02-21T22:53:07.393 INFO:teuthology.orchestra.run.smithi116.stdout: "cluster_fsid": "7c298660-5f63-4b5c-a800-58c5be9a8445", 2024-02-21T22:53:07.393 INFO:teuthology.orchestra.run.smithi116.stdout: "whoami": 0, 2024-02-21T22:53:07.393 INFO:teuthology.orchestra.run.smithi116.stdout: "id": 4290, 2024-02-21T22:53:07.393 INFO:teuthology.orchestra.run.smithi116.stdout: "want_state": "up:active", 2024-02-21T22:53:07.393 INFO:teuthology.orchestra.run.smithi116.stdout: "state": "up:active", 2024-02-21T22:53:07.394 INFO:teuthology.orchestra.run.smithi116.stdout: "fs_name": "cephfs", 2024-02-21T22:53:07.394 INFO:teuthology.orchestra.run.smithi116.stdout: "rank_uptime": 16.604347966999999, 2024-02-21T22:53:07.394 INFO:teuthology.orchestra.run.smithi116.stdout: "mdsmap_epoch": 6, 2024-02-21T22:53:07.394 INFO:teuthology.orchestra.run.smithi116.stdout: "osdmap_epoch": 20, 2024-02-21T22:53:07.394 INFO:teuthology.orchestra.run.smithi116.stdout: "osdmap_epoch_barrier": 20, 2024-02-21T22:53:07.394 INFO:teuthology.orchestra.run.smithi116.stdout: "uptime": 23.638440868 2024-02-21T22:53:07.394 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-02-21T22:53:07.396 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.392+0000 7fec13c2d640 1 -- 172.21.15.116:0/1289058859 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7febf006b4d0 msgr2=0x7febf006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:07.396 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.392+0000 7fec13c2d640 1 --2- 172.21.15.116:0/1289058859 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7febf006b4d0 0x7febf006d990 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fec0c15c720 tx=0x7febfc009190 comp rx=0 tx=0).stop 2024-02-21T22:53:07.396 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.392+0000 7fec13c2d640 1 -- 172.21.15.116:0/1289058859 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fec0c070b70 msgr2=0x7fec0c1497a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:07.396 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.392+0000 7fec13c2d640 1 --2- 172.21.15.116:0/1289058859 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fec0c070b70 0x7fec0c1497a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fec04009d10 tx=0x7fec0400c490 comp rx=0 tx=0).stop 2024-02-21T22:53:07.396 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.392+0000 7fec13c2d640 1 -- 172.21.15.116:0/1289058859 shutdown_connections 2024-02-21T22:53:07.396 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.392+0000 7fec13c2d640 1 --2- 172.21.15.116:0/1289058859 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7febf006b4d0 0x7febf006d990 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:07.396 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.392+0000 7fec13c2d640 1 --2- 172.21.15.116:0/1289058859 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fec0c15afb0 0x7fec0c0ccde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:07.396 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.392+0000 7fec13c2d640 1 --2- 172.21.15.116:0/1289058859 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fec0c071ac0 0x7fec0c15c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:07.396 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.392+0000 7fec13c2d640 1 --2- 172.21.15.116:0/1289058859 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fec0c070b70 0x7fec0c1497a0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:07.396 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.392+0000 7fec13c2d640 1 -- 172.21.15.116:0/1289058859 >> 172.21.15.116:0/1289058859 conn(0x7fec0c0b18e0 msgr2=0x7fec0c0af740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:07.396 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.392+0000 7fec13c2d640 1 -- 172.21.15.116:0/1289058859 shutdown_connections 2024-02-21T22:53:07.396 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.392+0000 7fec13c2d640 1 -- 172.21.15.116:0/1289058859 wait complete. 2024-02-21T22:53:07.397 INFO:teuthology.run_tasks:Running task kclient... 2024-02-21T22:53:07.421 INFO:tasks.kclient:Mounting kernel clients... 2024-02-21T22:53:07.422 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-02-21T22:53:07.422 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T22:53:07.422 DEBUG:teuthology.orchestra.run.smithi116:> ip netns list 2024-02-21T22:53:07.438 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T22:53:07.438 DEBUG:teuthology.orchestra.run.smithi116:> sudo ip link delete ceph-brx 2024-02-21T22:53:07.506 INFO:teuthology.orchestra.run.smithi116.stderr:Cannot find device "ceph-brx" 2024-02-21T22:53:07.507 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-21T22:53:07.508 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T22:53:07.508 DEBUG:teuthology.orchestra.run.smithi116:> ip netns list 2024-02-21T22:53:07.563 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T22:53:07.563 DEBUG:teuthology.orchestra.run.smithi116:> sudo ip link delete ceph-brx 2024-02-21T22:53:07.631 INFO:teuthology.orchestra.run.smithi116.stderr:Cannot find device "ceph-brx" 2024-02-21T22:53:07.632 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-21T22:53:07.633 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T22:53:07.633 DEBUG:teuthology.orchestra.run.smithi142:> ip netns list 2024-02-21T22:53:07.649 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T22:53:07.649 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link delete ceph-brx 2024-02-21T22:53:07.717 INFO:teuthology.orchestra.run.smithi142.stderr:Cannot find device "ceph-brx" 2024-02-21T22:53:07.718 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-21T22:53:07.719 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T22:53:07.719 DEBUG:teuthology.orchestra.run.smithi142:> ip netns list 2024-02-21T22:53:07.775 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T22:53:07.775 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link delete ceph-brx 2024-02-21T22:53:07.842 INFO:teuthology.orchestra.run.smithi142.stderr:Cannot find device "ceph-brx" 2024-02-21T22:53:07.843 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-21T22:53:07.844 INFO:tasks.kclient:client.0 config is {'syntax': 'v2'} 2024-02-21T22:53:07.844 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-02-21T22:53:07.844 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-02-21T22:53:07.844 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-02-21T22:53:07.945 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.954+0000 7f9776c2d640 1 Processor -- start 2024-02-21T22:53:07.945 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.954+0000 7f9776c2d640 1 -- start start 2024-02-21T22:53:07.948 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.955+0000 7f9776c2d640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f97700d06f0 0x7f977006ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:07.948 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.955+0000 7f9776c2d640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f977006b380 0x7f977015c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:07.948 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.955+0000 7f9776c2d640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97700b0770 con 0x7f977015cb10 2024-02-21T22:53:07.948 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.955+0000 7f9776c2d640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f977015d340 con 0x7f97700d06f0 2024-02-21T22:53:07.948 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.955+0000 7f9776c2d640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97700af710 con 0x7f977006b380 2024-02-21T22:53:07.948 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.955+0000 7f97749c9640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f97700d06f0 0x7f977006ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:07.949 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.955+0000 7f97751ca640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f977015cb10 0x7f977015f920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:46750/0 (socket says 172.21.15.116:46750) 2024-02-21T22:53:07.949 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.955+0000 7f97751ca640 1 -- 172.21.15.116:0/734774144 learned_addr learned my addr 172.21.15.116:0/734774144 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-02-21T22:53:07.949 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.955+0000 7f976ffff640 1 --2- 172.21.15.116:0/734774144 >> v2:172.21.15.142:3300/0 conn(0x7f977006b380 0x7f977015c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:07.949 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.955+0000 7f97749c9640 1 -- 172.21.15.116:0/734774144 >> v2:172.21.15.142:3300/0 conn(0x7f977006b380 msgr2=0x7f977015c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:53:07.949 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.955+0000 7f97749c9640 1 --2- 172.21.15.116:0/734774144 >> v2:172.21.15.142:3300/0 conn(0x7f977006b380 0x7f977015c5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:07.949 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.955+0000 7f97749c9640 1 -- 172.21.15.116:0/734774144 >> v1:172.21.15.116:6789/0 conn(0x7f977015cb10 legacy=0x7f977015f920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:07.949 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.955+0000 7f97749c9640 1 -- 172.21.15.116:0/734774144 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9770072c90 con 0x7f97700d06f0 2024-02-21T22:53:07.949 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.955+0000 7f976f7fe640 1 -- 172.21.15.116:0/734774144 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1103178910 0 0) 0x7f97700b0770 con 0x7f977015cb10 2024-02-21T22:53:07.949 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.956+0000 7f97749c9640 1 --2- 172.21.15.116:0/734774144 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f97700d06f0 0x7f977006ae40 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f977006d0d0 tx=0x7f976802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90a382d07b36e1ad server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:07.949 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.956+0000 7f976f7fe640 1 -- 172.21.15.116:0/734774144 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9768039070 con 0x7f97700d06f0 2024-02-21T22:53:07.949 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.956+0000 7f976f7fe640 1 -- 172.21.15.116:0/734774144 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f976802cc80 con 0x7f97700d06f0 2024-02-21T22:53:07.949 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.956+0000 7f976f7fe640 1 -- 172.21.15.116:0/734774144 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9768034660 con 0x7f97700d06f0 2024-02-21T22:53:07.949 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.957+0000 7f9776c2d640 1 -- 172.21.15.116:0/734774144 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f97700d06f0 msgr2=0x7f977006ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:07.950 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.957+0000 7f9776c2d640 1 --2- 172.21.15.116:0/734774144 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f97700d06f0 0x7f977006ae40 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f977006d0d0 tx=0x7f976802bed0 comp rx=0 tx=0).stop 2024-02-21T22:53:07.950 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.957+0000 7f9776c2d640 1 -- 172.21.15.116:0/734774144 shutdown_connections 2024-02-21T22:53:07.950 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.957+0000 7f9776c2d640 1 --2- 172.21.15.116:0/734774144 >> v2:172.21.15.142:3300/0 conn(0x7f977006b380 0x7f977015c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:07.950 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.957+0000 7f9776c2d640 1 --2- 172.21.15.116:0/734774144 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f97700d06f0 0x7f977006ae40 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:07.950 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.957+0000 7f9776c2d640 1 -- 172.21.15.116:0/734774144 >> 172.21.15.116:0/734774144 conn(0x7f97700b29f0 msgr2=0x7f97700b2e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:07.950 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.957+0000 7f9776c2d640 1 -- 172.21.15.116:0/734774144 shutdown_connections 2024-02-21T22:53:07.950 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.957+0000 7f9776c2d640 1 -- 172.21.15.116:0/734774144 wait complete. 2024-02-21T22:53:07.950 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.958+0000 7f9776c2d640 1 Processor -- start 2024-02-21T22:53:07.950 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.958+0000 7f9776c2d640 1 -- start start 2024-02-21T22:53:07.953 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.959+0000 7f9776c2d640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f977006b380 0x7f97700b1c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:07.954 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.959+0000 7f9776c2d640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f97700d06f0 0x7f9770148380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:07.954 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.959+0000 7f9776c2d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f977015cb10 0x7f97701488c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:07.954 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.959+0000 7f9776c2d640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97700afc90 con 0x7f97700d06f0 2024-02-21T22:53:07.954 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.959+0000 7f9776c2d640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97700af9b0 con 0x7f977006b380 2024-02-21T22:53:07.954 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.959+0000 7f9776c2d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97700aff70 con 0x7f977015cb10 2024-02-21T22:53:07.954 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.959+0000 7f976ffff640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f97700d06f0 0x7f9770148380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:07.954 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.959+0000 7f976ffff640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f97700d06f0 0x7f9770148380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:45464/0 (socket says 172.21.15.116:45464) 2024-02-21T22:53:07.954 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.959+0000 7f976ffff640 1 -- 172.21.15.116:0/3487874201 learned_addr learned my addr 172.21.15.116:0/3487874201 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:07.954 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.959+0000 7f97751ca640 1 --2- 172.21.15.116:0/3487874201 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f977015cb10 0x7f97701488c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:07.954 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.959+0000 7f97749c9640 1 --2- 172.21.15.116:0/3487874201 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f977006b380 0x7f97700b1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:07.954 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.959+0000 7f976ffff640 1 -- 172.21.15.116:0/3487874201 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f977015cb10 msgr2=0x7f97701488c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:07.954 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.959+0000 7f976ffff640 1 --2- 172.21.15.116:0/3487874201 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f977015cb10 0x7f97701488c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:07.954 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.959+0000 7f976ffff640 1 -- 172.21.15.116:0/3487874201 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f977006b380 msgr2=0x7f97700b1c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:07.955 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.959+0000 7f976ffff640 1 --2- 172.21.15.116:0/3487874201 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f977006b380 0x7f97700b1c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:07.955 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.959+0000 7f976ffff640 1 -- 172.21.15.116:0/3487874201 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f977009d5d0 con 0x7f97700d06f0 2024-02-21T22:53:07.955 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.959+0000 7f976ffff640 1 --2- 172.21.15.116:0/3487874201 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f97700d06f0 0x7f9770148380 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f976400e9e0 tx=0x7f976400eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:07.955 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.959+0000 7f976d7fa640 1 -- 172.21.15.116:0/3487874201 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9764017070 con 0x7f97700d06f0 2024-02-21T22:53:07.955 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.959+0000 7f976d7fa640 1 -- 172.21.15.116:0/3487874201 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f976400c9d0 con 0x7f97700d06f0 2024-02-21T22:53:07.955 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.959+0000 7f9776c2d640 1 -- 172.21.15.116:0/3487874201 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f977009d8b0 con 0x7f97700d06f0 2024-02-21T22:53:07.955 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.959+0000 7f976d7fa640 1 -- 172.21.15.116:0/3487874201 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f976400cdc0 con 0x7f97700d06f0 2024-02-21T22:53:07.955 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.959+0000 7f9776c2d640 1 -- 172.21.15.116:0/3487874201 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9770158b30 con 0x7f97700d06f0 2024-02-21T22:53:07.955 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.961+0000 7f9776c2d640 1 -- 172.21.15.116:0/3487874201 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f977009da80 con 0x7f97700d06f0 2024-02-21T22:53:07.955 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.961+0000 7f976d7fa640 1 -- 172.21.15.116:0/3487874201 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f976401a070 con 0x7f97700d06f0 2024-02-21T22:53:07.955 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.961+0000 7f976d7fa640 1 --2- 172.21.15.116:0/3487874201 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f975c06b4d0 0x7f975c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:07.955 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.961+0000 7f976d7fa640 1 -- 172.21.15.116:0/3487874201 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f976408a590 con 0x7f97700d06f0 2024-02-21T22:53:07.955 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.961+0000 7f97749c9640 1 --2- 172.21.15.116:0/3487874201 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f975c06b4d0 0x7f975c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:07.955 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.962+0000 7f97749c9640 1 --2- 172.21.15.116:0/3487874201 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f975c06b4d0 0x7f975c06d990 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f9768036000 tx=0x7f9768030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:07.956 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:07.965+0000 7f976d7fa640 1 -- 172.21.15.116:0/3487874201 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f9764058dc0 con 0x7f97700d06f0 2024-02-21T22:53:08.164 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:08.173+0000 7f9776c2d640 1 -- 172.21.15.116:0/3487874201 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f97700752f0 con 0x7f97700d06f0 2024-02-21T22:53:08.164 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:08.174+0000 7f976d7fa640 1 -- 172.21.15.116:0/3487874201 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) v1 ==== 53+0+73 (secure 0 0 0) 0x7f976405ce60 con 0x7f97700d06f0 2024-02-21T22:53:08.165 INFO:teuthology.orchestra.run.smithi116.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-02-21T22:53:08.167 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:08.176+0000 7f9776c2d640 1 -- 172.21.15.116:0/3487874201 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f975c06b4d0 msgr2=0x7f975c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:08.167 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:08.176+0000 7f9776c2d640 1 --2- 172.21.15.116:0/3487874201 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f975c06b4d0 0x7f975c06d990 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f9768036000 tx=0x7f9768030000 comp rx=0 tx=0).stop 2024-02-21T22:53:08.167 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:08.176+0000 7f9776c2d640 1 -- 172.21.15.116:0/3487874201 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f97700d06f0 msgr2=0x7f9770148380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:08.167 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:08.176+0000 7f9776c2d640 1 --2- 172.21.15.116:0/3487874201 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f97700d06f0 0x7f9770148380 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f976400e9e0 tx=0x7f976400eea0 comp rx=0 tx=0).stop 2024-02-21T22:53:08.167 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:08.176+0000 7f9776c2d640 1 -- 172.21.15.116:0/3487874201 shutdown_connections 2024-02-21T22:53:08.167 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:08.176+0000 7f9776c2d640 1 --2- 172.21.15.116:0/3487874201 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f975c06b4d0 0x7f975c06d990 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:08.167 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:08.176+0000 7f9776c2d640 1 --2- 172.21.15.116:0/3487874201 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f977015cb10 0x7f97701488c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:08.167 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:08.176+0000 7f9776c2d640 1 --2- 172.21.15.116:0/3487874201 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f97700d06f0 0x7f9770148380 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:08.167 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:08.176+0000 7f9776c2d640 1 --2- 172.21.15.116:0/3487874201 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f977006b380 0x7f97700b1c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:08.167 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:08.176+0000 7f9776c2d640 1 -- 172.21.15.116:0/3487874201 >> 172.21.15.116:0/3487874201 conn(0x7f97700b29f0 msgr2=0x7f97700b5450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:08.167 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:08.176+0000 7f9776c2d640 1 -- 172.21.15.116:0/3487874201 shutdown_connections 2024-02-21T22:53:08.168 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:08.176+0000 7f9776c2d640 1 -- 172.21.15.116:0/3487874201 wait complete. 2024-02-21T22:53:08.177 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-02-21T22:53:08.178 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-02-21T22:53:08.178 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi116.front.sepia.ceph.com 2024-02-21T22:53:08.178 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-02-21T22:53:08.178 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-02-21T22:53:08.178 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-02-21T22:53:08.178 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-02-21T22:53:08.178 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-02-21T22:53:08.178 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-02-21T22:53:08.178 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T22:53:08.178 DEBUG:teuthology.orchestra.run.smithi116:> ip addr 2024-02-21T22:53:08.193 INFO:teuthology.orchestra.run.smithi116.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-02-21T22:53:08.193 INFO:teuthology.orchestra.run.smithi116.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-02-21T22:53:08.193 INFO:teuthology.orchestra.run.smithi116.stdout: inet 127.0.0.1/8 scope host lo 2024-02-21T22:53:08.193 INFO:teuthology.orchestra.run.smithi116.stdout: valid_lft forever preferred_lft forever 2024-02-21T22:53:08.194 INFO:teuthology.orchestra.run.smithi116.stdout: inet6 ::1/128 scope host 2024-02-21T22:53:08.194 INFO:teuthology.orchestra.run.smithi116.stdout: valid_lft forever preferred_lft forever 2024-02-21T22:53:08.194 INFO:teuthology.orchestra.run.smithi116.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-21T22:53:08.194 INFO:teuthology.orchestra.run.smithi116.stdout: link/ether 0c:c4:7a:d8:cb:90 brd ff:ff:ff:ff:ff:ff 2024-02-21T22:53:08.194 INFO:teuthology.orchestra.run.smithi116.stdout: altname enp7s0f0 2024-02-21T22:53:08.194 INFO:teuthology.orchestra.run.smithi116.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-21T22:53:08.194 INFO:teuthology.orchestra.run.smithi116.stdout: link/ether 0c:c4:7a:d8:cb:91 brd ff:ff:ff:ff:ff:ff 2024-02-21T22:53:08.194 INFO:teuthology.orchestra.run.smithi116.stdout: altname enp7s0f1 2024-02-21T22:53:08.194 INFO:teuthology.orchestra.run.smithi116.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-21T22:53:08.194 INFO:teuthology.orchestra.run.smithi116.stdout: link/ether 0c:c4:7a:8f:3f:66 brd ff:ff:ff:ff:ff:ff 2024-02-21T22:53:08.194 INFO:teuthology.orchestra.run.smithi116.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-02-21T22:53:08.194 INFO:teuthology.orchestra.run.smithi116.stdout: link/ether 0c:c4:7a:8f:3f:67 brd ff:ff:ff:ff:ff:ff 2024-02-21T22:53:08.194 INFO:teuthology.orchestra.run.smithi116.stdout: inet 172.21.15.116/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-02-21T22:53:08.194 INFO:teuthology.orchestra.run.smithi116.stdout: valid_lft 42525sec preferred_lft 42525sec 2024-02-21T22:53:08.194 INFO:teuthology.orchestra.run.smithi116.stdout: inet6 fe80::ec4:7aff:fe8f:3f67/64 scope link 2024-02-21T22:53:08.195 INFO:teuthology.orchestra.run.smithi116.stdout: valid_lft forever preferred_lft forever 2024-02-21T22:53:08.195 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-02-21T22:53:08.195 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T22:53:08.195 DEBUG:teuthology.orchestra.run.smithi116:> (cd / && exec bash -c ' 2024-02-21T22:53:08.196 DEBUG:teuthology.orchestra.run.smithi116:> set -e 2024-02-21T22:53:08.196 DEBUG:teuthology.orchestra.run.smithi116:> sudo ip link add name ceph-brx type bridge 2024-02-21T22:53:08.196 DEBUG:teuthology.orchestra.run.smithi116:> sudo ip addr flush dev ceph-brx 2024-02-21T22:53:08.196 DEBUG:teuthology.orchestra.run.smithi116:> sudo ip link set ceph-brx up 2024-02-21T22:53:08.196 DEBUG:teuthology.orchestra.run.smithi116:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-02-21T22:53:08.196 DEBUG:teuthology.orchestra.run.smithi116:> ') 2024-02-21T22:53:08.364 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T22:53:08.364 DEBUG:teuthology.orchestra.run.smithi116:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-02-21T22:53:08.391 INFO:teuthology.orchestra.run.smithi116.stdout:1 2024-02-21T22:53:08.393 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T22:53:08.393 DEBUG:teuthology.orchestra.run.smithi116:> route 2024-02-21T22:53:08.462 INFO:teuthology.orchestra.run.smithi116.stdout:Kernel IP routing table 2024-02-21T22:53:08.462 INFO:teuthology.orchestra.run.smithi116.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-02-21T22:53:08.462 INFO:teuthology.orchestra.run.smithi116.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-02-21T22:53:08.462 INFO:teuthology.orchestra.run.smithi116.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-02-21T22:53:08.462 INFO:teuthology.orchestra.run.smithi116.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-02-21T22:53:08.463 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T22:53:08.463 DEBUG:teuthology.orchestra.run.smithi116:> (cd / && exec bash -c ' 2024-02-21T22:53:08.463 DEBUG:teuthology.orchestra.run.smithi116:> set -e 2024-02-21T22:53:08.463 DEBUG:teuthology.orchestra.run.smithi116:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-02-21T22:53:08.463 DEBUG:teuthology.orchestra.run.smithi116:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-02-21T22:53:08.463 DEBUG:teuthology.orchestra.run.smithi116:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-02-21T22:53:08.463 DEBUG:teuthology.orchestra.run.smithi116:> ') 2024-02-21T22:53:08.709 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T22:53:08.709 DEBUG:teuthology.orchestra.run.smithi116:> ip netns list 2024-02-21T22:53:08.724 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T22:53:08.724 DEBUG:teuthology.orchestra.run.smithi116:> ip netns list-id 2024-02-21T22:53:08.780 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T22:53:08.781 DEBUG:teuthology.orchestra.run.smithi116:> (cd / && exec bash -c ' 2024-02-21T22:53:08.781 DEBUG:teuthology.orchestra.run.smithi116:> set -e 2024-02-21T22:53:08.781 DEBUG:teuthology.orchestra.run.smithi116:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-02-21T22:53:08.781 DEBUG:teuthology.orchestra.run.smithi116:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-02-21T22:53:08.781 DEBUG:teuthology.orchestra.run.smithi116:> ') 2024-02-21T22:53:08.866 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-02-21T22:53:08.867 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T22:53:08.867 DEBUG:teuthology.orchestra.run.smithi116:> (cd / && exec bash -c ' 2024-02-21T22:53:08.867 DEBUG:teuthology.orchestra.run.smithi116:> set -e 2024-02-21T22:53:08.867 DEBUG:teuthology.orchestra.run.smithi116:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-02-21T22:53:08.867 DEBUG:teuthology.orchestra.run.smithi116:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-02-21T22:53:08.867 DEBUG:teuthology.orchestra.run.smithi116:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-02-21T22:53:08.867 DEBUG:teuthology.orchestra.run.smithi116:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-02-21T22:53:08.867 DEBUG:teuthology.orchestra.run.smithi116:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-02-21T22:53:08.867 DEBUG:teuthology.orchestra.run.smithi116:> ') 2024-02-21T22:53:09.014 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T22:53:09.014 DEBUG:teuthology.orchestra.run.smithi116:> (cd / && exec bash -c ' 2024-02-21T22:53:09.014 DEBUG:teuthology.orchestra.run.smithi116:> set -e 2024-02-21T22:53:09.014 DEBUG:teuthology.orchestra.run.smithi116:> sudo ip link set brx.0 up 2024-02-21T22:53:09.014 DEBUG:teuthology.orchestra.run.smithi116:> sudo ip link set dev brx.0 master ceph-brx 2024-02-21T22:53:09.014 DEBUG:teuthology.orchestra.run.smithi116:> ') 2024-02-21T22:53:09.055 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-02-21T22:53:09.055 DEBUG:teuthology.orchestra.run.smithi116:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-02-21T22:53:09.110 INFO:teuthology.orchestra.run.smithi116.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-02-21T22:53:09.110 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-02-21T22:53:09.110 DEBUG:teuthology.orchestra.run.smithi116:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-02-21T22:53:09.164 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-02-21T22:53:09.165 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T22:53:09.165 DEBUG:teuthology.orchestra.run.smithi116:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-02-21T22:53:09.252 INFO:teuthology.orchestra.run.smithi116.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-02-21T22:53:09.253 INFO:teuthology.orchestra.run.smithi116.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-02-21T22:53:09.359 INFO:teuthology.orchestra.run.smithi116.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-02-21T22:53:09.359 INFO:teuthology.orchestra.run.smithi116.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-02-21T22:53:09.360 INFO:teuthology.orchestra.run.smithi116.stdout:mount.ceph: resolved to: "172.21.15.116:3300,172.21.15.142:3300,172.21.15.142:3301" 2024-02-21T22:53:09.360 INFO:teuthology.orchestra.run.smithi116.stdout:mount.ceph: trying mount with new device syntax: 0@7c298660-5f63-4b5c-a800-58c5be9a8445.cephfs=/ 2024-02-21T22:53:09.360 INFO:teuthology.orchestra.run.smithi116.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.116:3300/172.21.15.142:3300/172.21.15.142:3301" will pass to kernel 2024-02-21T22:53:09.360 INFO:teuthology.orchestra.run.smithi116.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-02-21T22:53:09.360 INFO:teuthology.orchestra.run.smithi116.stdout: You just mounted a file system that supports labels which does not 2024-02-21T22:53:09.360 INFO:teuthology.orchestra.run.smithi116.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-02-21T22:53:09.360 INFO:teuthology.orchestra.run.smithi116.stdout: applications will generate AVC messages and not be allowed access to 2024-02-21T22:53:09.360 INFO:teuthology.orchestra.run.smithi116.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-02-21T22:53:09.362 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-02-21T22:53:09.362 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T22:53:09.362 DEBUG:teuthology.orchestra.run.smithi116:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-02-21T22:53:09.390 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T22:53:09.391 DEBUG:teuthology.orchestra.run.smithi116:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-02-21T22:53:09.452 INFO:teuthology.orchestra.run.smithi116.stdout:client4698 2024-02-21T22:53:09.452 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-02-21T22:53:09.453 DEBUG:teuthology.orchestra.run.smithi116:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-21T22:53:09.508 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T22:53:09.508 DEBUG:teuthology.orchestra.run.smithi116:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-02-21T22:53:09.570 INFO:teuthology.orchestra.run.smithi116.stdout:client4698 2024-02-21T22:53:09.571 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T22:53:09.571 DEBUG:teuthology.orchestra.run.smithi116:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-02-21T22:53:09.630 INFO:teuthology.orchestra.run.smithi116.stdout:client4698 2024-02-21T22:53:09.631 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T22:53:09.632 DEBUG:teuthology.orchestra.run.smithi116:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/7c298660-5f63-4b5c-a800-58c5be9a8445.client4698/status') 2024-02-21T22:53:09.701 INFO:teuthology.orchestra.run.smithi116.stdout:instance: client.4698 (3)192.168.0.1:0/2833336521 2024-02-21T22:53:09.701 INFO:teuthology.orchestra.run.smithi116.stdout:blocklisted: false 2024-02-21T22:53:09.701 INFO:teuthology.orchestra.run.smithi116.stderr:0+1 records in 2024-02-21T22:53:09.701 INFO:teuthology.orchestra.run.smithi116.stderr:0+1 records out 2024-02-21T22:53:09.701 INFO:teuthology.orchestra.run.smithi116.stderr:69 bytes copied, 2.1961e-05 s, 3.1 MB/s 2024-02-21T22:53:09.702 INFO:tasks.kclient:client.2 config is {'syntax': 'v2'} 2024-02-21T22:53:09.703 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-02-21T22:53:09.703 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-02-21T22:53:09.703 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-02-21T22:53:09.843 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:09.852+0000 7f2e003c8640 1 Processor -- start 2024-02-21T22:53:09.843 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:09.852+0000 7f2e003c8640 1 -- start start 2024-02-21T22:53:09.845 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:09.853+0000 7f2e003c8640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f2df80cc990 0x7f2df80cfcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:09.845 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:09.853+0000 7f2e003c8640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2df80b26d0 con 0x7f2df8160530 2024-02-21T22:53:09.845 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:09.853+0000 7f2e003c8640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2df80b29b0 con 0x7f2df815c190 2024-02-21T22:53:09.845 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:09.853+0000 7f2e003c8640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2df80b2d50 con 0x7f2df80cc990 2024-02-21T22:53:09.845 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:09.854+0000 7f2dfe965640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f2df80cc990 0x7f2df80cfcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:09.845 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:09.854+0000 7f2dfe965640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f2df80cc990 0x7f2df80cfcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:45472/0 (socket says 172.21.15.116:45472) 2024-02-21T22:53:09.845 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:09.854+0000 7f2dfd963640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f2df8160530 0x7f2df80ce520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:46756/0 (socket says 172.21.15.116:46756) 2024-02-21T22:53:09.845 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:09.854+0000 7f2dfe965640 1 -- 172.21.15.116:0/2668861586 learned_addr learned my addr 172.21.15.116:0/2668861586 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:09.845 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:09.854+0000 7f2dfe965640 1 -- 172.21.15.116:0/2668861586 >> v1:172.21.15.142:6789/0 conn(0x7f2df815c190 legacy=0x7f2df815fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:09.845 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:09.854+0000 7f2dfe965640 1 -- 172.21.15.116:0/2668861586 >> v1:172.21.15.116:6789/0 conn(0x7f2df8160530 legacy=0x7f2df80ce520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:09.845 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:09.854+0000 7f2dfe965640 1 -- 172.21.15.116:0/2668861586 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2df80b2fa0 con 0x7f2df80cc990 2024-02-21T22:53:09.846 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:09.854+0000 7f2dfd162640 1 -- 172.21.15.116:0/2668861586 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3437140833 0 0) 0x7f2df80b26d0 con 0x7f2df8160530 2024-02-21T22:53:09.846 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:09.855+0000 7f2dfe965640 1 --2- 172.21.15.116:0/2668861586 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2df80cc990 0x7f2df80cfcf0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f2df0009870 tx=0x7f2df002ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73862a7b0c86f74c server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:09.846 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:09.855+0000 7f2dfd162640 1 -- 172.21.15.116:0/2668861586 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2df002f840 con 0x7f2df80cc990 2024-02-21T22:53:09.846 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:09.855+0000 7f2dfd162640 1 -- 172.21.15.116:0/2668861586 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2df002f9e0 con 0x7f2df80cc990 2024-02-21T22:53:09.846 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:09.855+0000 7f2dfd162640 1 -- 172.21.15.116:0/2668861586 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2df002fdb0 con 0x7f2df80cc990 2024-02-21T22:53:09.847 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:09.855+0000 7f2e003c8640 1 -- 172.21.15.116:0/2668861586 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2df80cc990 msgr2=0x7f2df80cfcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:09.847 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:09.855+0000 7f2e003c8640 1 --2- 172.21.15.116:0/2668861586 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2df80cc990 0x7f2df80cfcf0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f2df0009870 tx=0x7f2df002ba20 comp rx=0 tx=0).stop 2024-02-21T22:53:09.847 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:09.855+0000 7f2e003c8640 1 -- 172.21.15.116:0/2668861586 shutdown_connections 2024-02-21T22:53:09.847 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:09.855+0000 7f2e003c8640 1 --2- 172.21.15.116:0/2668861586 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2df80cc990 0x7f2df80cfcf0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:09.847 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:09.855+0000 7f2e003c8640 1 -- 172.21.15.116:0/2668861586 >> 172.21.15.116:0/2668861586 conn(0x7f2df80d1be0 msgr2=0x7f2df80d1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:09.847 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:09.855+0000 7f2e003c8640 1 -- 172.21.15.116:0/2668861586 shutdown_connections 2024-02-21T22:53:09.847 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:09.855+0000 7f2e003c8640 1 -- 172.21.15.116:0/2668861586 wait complete. 2024-02-21T22:53:09.847 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:09.856+0000 7f2e003c8640 1 Processor -- start 2024-02-21T22:53:09.847 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:09.857+0000 7f2e003c8640 1 -- start start 2024-02-21T22:53:09.850 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:09.857+0000 7f2e003c8640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2df80cc990 0x7f2df815d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:09.850 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:09.857+0000 7f2e003c8640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2df815c190 0x7f2df80c80f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:09.850 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:09.857+0000 7f2e003c8640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2df8160530 0x7f2df80c69c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:09.850 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:09.857+0000 7f2e003c8640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2df80d0230 con 0x7f2df80cc990 2024-02-21T22:53:09.850 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:09.857+0000 7f2e003c8640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2df80b3310 con 0x7f2df8160530 2024-02-21T22:53:09.850 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:09.857+0000 7f2e003c8640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2df80d28d0 con 0x7f2df815c190 2024-02-21T22:53:09.850 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:09.857+0000 7f2dfe164640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2df80cc990 0x7f2df815d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:09.850 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:09.857+0000 7f2dfe164640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2df80cc990 0x7f2df815d190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:45488/0 (socket says 172.21.15.116:45488) 2024-02-21T22:53:09.850 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:09.857+0000 7f2dfe164640 1 -- 172.21.15.116:0/2779359515 learned_addr learned my addr 172.21.15.116:0/2779359515 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:09.850 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:09.857+0000 7f2dfd963640 1 --2- 172.21.15.116:0/2779359515 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2df815c190 0x7f2df80c80f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:09.850 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:09.857+0000 7f2dfe965640 1 --2- 172.21.15.116:0/2779359515 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2df8160530 0x7f2df80c69c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:09.850 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:09.858+0000 7f2dfe164640 1 -- 172.21.15.116:0/2779359515 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2df815c190 msgr2=0x7f2df80c80f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:09.850 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:09.858+0000 7f2dfe164640 1 --2- 172.21.15.116:0/2779359515 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2df815c190 0x7f2df80c80f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:09.851 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:09.858+0000 7f2dfe164640 1 -- 172.21.15.116:0/2779359515 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2df8160530 msgr2=0x7f2df80c69c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:09.851 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:09.858+0000 7f2dfe164640 1 --2- 172.21.15.116:0/2779359515 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2df8160530 0x7f2df80c69c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:09.851 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:09.858+0000 7f2dfe164640 1 -- 172.21.15.116:0/2779359515 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2df815d820 con 0x7f2df80cc990 2024-02-21T22:53:09.851 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:09.858+0000 7f2dfe164640 1 --2- 172.21.15.116:0/2779359515 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2df80cc990 0x7f2df815d190 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f2df400c8a0 tx=0x7f2df400cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:09.851 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:09.858+0000 7f2deeffd640 1 -- 172.21.15.116:0/2779359515 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2df4003b70 con 0x7f2df80cc990 2024-02-21T22:53:09.851 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:09.858+0000 7f2deeffd640 1 -- 172.21.15.116:0/2779359515 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2df4003d30 con 0x7f2df80cc990 2024-02-21T22:53:09.851 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:09.858+0000 7f2deeffd640 1 -- 172.21.15.116:0/2779359515 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2df400aa90 con 0x7f2df80cc990 2024-02-21T22:53:09.851 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:09.858+0000 7f2e003c8640 1 -- 172.21.15.116:0/2779359515 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2df8159d70 con 0x7f2df80cc990 2024-02-21T22:53:09.851 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:09.858+0000 7f2e003c8640 1 -- 172.21.15.116:0/2779359515 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2df815a330 con 0x7f2df80cc990 2024-02-21T22:53:09.851 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:09.859+0000 7f2e003c8640 1 -- 172.21.15.116:0/2779359515 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2df815a530 con 0x7f2df80cc990 2024-02-21T22:53:09.851 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:09.859+0000 7f2deeffd640 1 -- 172.21.15.116:0/2779359515 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f2df400ac30 con 0x7f2df80cc990 2024-02-21T22:53:09.852 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:09.860+0000 7f2deeffd640 1 --2- 172.21.15.116:0/2779359515 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f2ddc06b4d0 0x7f2ddc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:09.852 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:09.860+0000 7f2deeffd640 1 -- 172.21.15.116:0/2779359515 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2df4089f90 con 0x7f2df80cc990 2024-02-21T22:53:09.852 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:09.860+0000 7f2dfd963640 1 --2- 172.21.15.116:0/2779359515 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f2ddc06b4d0 0x7f2ddc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:09.852 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:09.860+0000 7f2dfd963640 1 --2- 172.21.15.116:0/2779359515 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f2ddc06b4d0 0x7f2ddc06d990 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f2df80b77b0 tx=0x7f2de8007e40 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:09.854 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:09.864+0000 7f2deeffd640 1 -- 172.21.15.116:0/2779359515 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f2df815a530 con 0x7f2df80cc990 2024-02-21T22:53:10.071 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:10.073+0000 7f2e003c8640 1 -- 172.21.15.116:0/2779359515 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f2df80752f0 con 0x7f2df80cc990 2024-02-21T22:53:10.071 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:10.074+0000 7f2deeffd640 1 -- 172.21.15.116:0/2779359515 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) v1 ==== 53+0+73 (secure 0 0 0) 0x7f2df4058850 con 0x7f2df80cc990 2024-02-21T22:53:10.071 INFO:teuthology.orchestra.run.smithi116.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-02-21T22:53:10.072 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:10.076+0000 7f2e003c8640 1 -- 172.21.15.116:0/2779359515 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f2ddc06b4d0 msgr2=0x7f2ddc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:10.072 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:10.076+0000 7f2e003c8640 1 --2- 172.21.15.116:0/2779359515 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f2ddc06b4d0 0x7f2ddc06d990 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f2df80b77b0 tx=0x7f2de8007e40 comp rx=0 tx=0).stop 2024-02-21T22:53:10.072 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:10.076+0000 7f2e003c8640 1 -- 172.21.15.116:0/2779359515 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2df80cc990 msgr2=0x7f2df815d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:10.072 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:10.076+0000 7f2e003c8640 1 --2- 172.21.15.116:0/2779359515 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2df80cc990 0x7f2df815d190 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f2df400c8a0 tx=0x7f2df400cd60 comp rx=0 tx=0).stop 2024-02-21T22:53:10.072 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:10.076+0000 7f2e003c8640 1 -- 172.21.15.116:0/2779359515 shutdown_connections 2024-02-21T22:53:10.072 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:10.076+0000 7f2e003c8640 1 --2- 172.21.15.116:0/2779359515 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2df8160530 0x7f2df80c69c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:10.072 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:10.076+0000 7f2e003c8640 1 --2- 172.21.15.116:0/2779359515 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f2ddc06b4d0 0x7f2ddc06d990 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:10.073 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:10.076+0000 7f2e003c8640 1 --2- 172.21.15.116:0/2779359515 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2df815c190 0x7f2df80c80f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:10.073 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:10.076+0000 7f2e003c8640 1 --2- 172.21.15.116:0/2779359515 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2df80cc990 0x7f2df815d190 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:10.073 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:10.076+0000 7f2e003c8640 1 -- 172.21.15.116:0/2779359515 >> 172.21.15.116:0/2779359515 conn(0x7f2df80d1be0 msgr2=0x7f2df806fd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:10.073 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:10.076+0000 7f2e003c8640 1 -- 172.21.15.116:0/2779359515 shutdown_connections 2024-02-21T22:53:10.073 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:10.076+0000 7f2e003c8640 1 -- 172.21.15.116:0/2779359515 wait complete. 2024-02-21T22:53:10.077 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-02-21T22:53:10.077 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-02-21T22:53:10.077 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi116.front.sepia.ceph.com 2024-02-21T22:53:10.077 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-02-21T22:53:10.077 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-02-21T22:53:10.077 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-02-21T22:53:10.077 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-02-21T22:53:10.077 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-02-21T22:53:10.077 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-02-21T22:53:10.077 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T22:53:10.078 DEBUG:teuthology.orchestra.run.smithi116:> ip addr 2024-02-21T22:53:10.093 INFO:teuthology.orchestra.run.smithi116.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-02-21T22:53:10.093 INFO:teuthology.orchestra.run.smithi116.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-02-21T22:53:10.093 INFO:teuthology.orchestra.run.smithi116.stdout: inet 127.0.0.1/8 scope host lo 2024-02-21T22:53:10.093 INFO:teuthology.orchestra.run.smithi116.stdout: valid_lft forever preferred_lft forever 2024-02-21T22:53:10.093 INFO:teuthology.orchestra.run.smithi116.stdout: inet6 ::1/128 scope host 2024-02-21T22:53:10.093 INFO:teuthology.orchestra.run.smithi116.stdout: valid_lft forever preferred_lft forever 2024-02-21T22:53:10.093 INFO:teuthology.orchestra.run.smithi116.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-21T22:53:10.093 INFO:teuthology.orchestra.run.smithi116.stdout: link/ether 0c:c4:7a:d8:cb:90 brd ff:ff:ff:ff:ff:ff 2024-02-21T22:53:10.093 INFO:teuthology.orchestra.run.smithi116.stdout: altname enp7s0f0 2024-02-21T22:53:10.094 INFO:teuthology.orchestra.run.smithi116.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-21T22:53:10.094 INFO:teuthology.orchestra.run.smithi116.stdout: link/ether 0c:c4:7a:d8:cb:91 brd ff:ff:ff:ff:ff:ff 2024-02-21T22:53:10.094 INFO:teuthology.orchestra.run.smithi116.stdout: altname enp7s0f1 2024-02-21T22:53:10.094 INFO:teuthology.orchestra.run.smithi116.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-21T22:53:10.094 INFO:teuthology.orchestra.run.smithi116.stdout: link/ether 0c:c4:7a:8f:3f:66 brd ff:ff:ff:ff:ff:ff 2024-02-21T22:53:10.094 INFO:teuthology.orchestra.run.smithi116.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-02-21T22:53:10.094 INFO:teuthology.orchestra.run.smithi116.stdout: link/ether 0c:c4:7a:8f:3f:67 brd ff:ff:ff:ff:ff:ff 2024-02-21T22:53:10.094 INFO:teuthology.orchestra.run.smithi116.stdout: inet 172.21.15.116/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-02-21T22:53:10.094 INFO:teuthology.orchestra.run.smithi116.stdout: valid_lft 42523sec preferred_lft 42523sec 2024-02-21T22:53:10.094 INFO:teuthology.orchestra.run.smithi116.stdout: inet6 fe80::ec4:7aff:fe8f:3f67/64 scope link 2024-02-21T22:53:10.094 INFO:teuthology.orchestra.run.smithi116.stdout: valid_lft forever preferred_lft forever 2024-02-21T22:53:10.094 INFO:teuthology.orchestra.run.smithi116.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-02-21T22:53:10.094 INFO:teuthology.orchestra.run.smithi116.stdout: link/ether de:81:e7:70:c4:02 brd ff:ff:ff:ff:ff:ff 2024-02-21T22:53:10.094 INFO:teuthology.orchestra.run.smithi116.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-02-21T22:53:10.095 INFO:teuthology.orchestra.run.smithi116.stdout: valid_lft forever preferred_lft forever 2024-02-21T22:53:10.095 INFO:teuthology.orchestra.run.smithi116.stdout: inet6 fe80::f4cc:18ff:febe:37e0/64 scope link 2024-02-21T22:53:10.095 INFO:teuthology.orchestra.run.smithi116.stdout: valid_lft forever preferred_lft forever 2024-02-21T22:53:10.095 INFO:teuthology.orchestra.run.smithi116.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-02-21T22:53:10.095 INFO:teuthology.orchestra.run.smithi116.stdout: link/ether de:81:e7:70:c4:02 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-02-21T22:53:10.095 INFO:teuthology.orchestra.run.smithi116.stdout: inet6 fe80::dc81:e7ff:fe70:c402/64 scope link tentative 2024-02-21T22:53:10.095 INFO:teuthology.orchestra.run.smithi116.stdout: valid_lft forever preferred_lft forever 2024-02-21T22:53:10.095 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T22:53:10.095 DEBUG:teuthology.orchestra.run.smithi116:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-02-21T22:53:10.159 INFO:teuthology.orchestra.run.smithi116.stdout:1 2024-02-21T22:53:10.160 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T22:53:10.160 DEBUG:teuthology.orchestra.run.smithi116:> route 2024-02-21T22:53:10.216 INFO:teuthology.orchestra.run.smithi116.stdout:Kernel IP routing table 2024-02-21T22:53:10.216 INFO:teuthology.orchestra.run.smithi116.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-02-21T22:53:10.216 INFO:teuthology.orchestra.run.smithi116.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-02-21T22:53:10.216 INFO:teuthology.orchestra.run.smithi116.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-02-21T22:53:10.216 INFO:teuthology.orchestra.run.smithi116.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-02-21T22:53:10.217 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T22:53:10.217 DEBUG:teuthology.orchestra.run.smithi116:> (cd / && exec bash -c ' 2024-02-21T22:53:10.217 DEBUG:teuthology.orchestra.run.smithi116:> set -e 2024-02-21T22:53:10.217 DEBUG:teuthology.orchestra.run.smithi116:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-02-21T22:53:10.217 DEBUG:teuthology.orchestra.run.smithi116:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-02-21T22:53:10.217 DEBUG:teuthology.orchestra.run.smithi116:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-02-21T22:53:10.217 DEBUG:teuthology.orchestra.run.smithi116:> ') 2024-02-21T22:53:10.314 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T22:53:10.314 DEBUG:teuthology.orchestra.run.smithi116:> ip netns list 2024-02-21T22:53:10.329 INFO:teuthology.orchestra.run.smithi116.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-02-21T22:53:10.329 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T22:53:10.329 DEBUG:teuthology.orchestra.run.smithi116:> ip netns list-id 2024-02-21T22:53:10.384 INFO:teuthology.orchestra.run.smithi116.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-02-21T22:53:10.384 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T22:53:10.384 DEBUG:teuthology.orchestra.run.smithi116:> (cd / && exec bash -c ' 2024-02-21T22:53:10.384 DEBUG:teuthology.orchestra.run.smithi116:> set -e 2024-02-21T22:53:10.385 DEBUG:teuthology.orchestra.run.smithi116:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-02-21T22:53:10.385 DEBUG:teuthology.orchestra.run.smithi116:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-02-21T22:53:10.385 DEBUG:teuthology.orchestra.run.smithi116:> ') 2024-02-21T22:53:10.466 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T22:53:10.466 DEBUG:teuthology.orchestra.run.smithi116:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-02-21T22:53:10.533 INFO:teuthology.orchestra.run.smithi116.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-02-21T22:53:10.533 INFO:teuthology.orchestra.run.smithi116.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-02-21T22:53:10.533 INFO:teuthology.orchestra.run.smithi116.stdout: inet 127.0.0.1/8 scope host lo 2024-02-21T22:53:10.533 INFO:teuthology.orchestra.run.smithi116.stdout: valid_lft forever preferred_lft forever 2024-02-21T22:53:10.533 INFO:teuthology.orchestra.run.smithi116.stdout: inet6 ::1/128 scope host 2024-02-21T22:53:10.533 INFO:teuthology.orchestra.run.smithi116.stdout: valid_lft forever preferred_lft forever 2024-02-21T22:53:10.533 INFO:teuthology.orchestra.run.smithi116.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-02-21T22:53:10.534 INFO:teuthology.orchestra.run.smithi116.stdout: link/ether 8e:e9:a9:78:e2:82 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-02-21T22:53:10.534 INFO:teuthology.orchestra.run.smithi116.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-02-21T22:53:10.534 INFO:teuthology.orchestra.run.smithi116.stdout: valid_lft forever preferred_lft forever 2024-02-21T22:53:10.534 INFO:teuthology.orchestra.run.smithi116.stdout: inet6 fe80::8ce9:a9ff:fe78:e282/64 scope link tentative 2024-02-21T22:53:10.534 INFO:teuthology.orchestra.run.smithi116.stdout: valid_lft forever preferred_lft forever 2024-02-21T22:53:10.535 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T22:53:10.535 DEBUG:teuthology.orchestra.run.smithi116:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-02-21T22:53:10.602 INFO:teuthology.orchestra.run.smithi116.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-02-21T22:53:10.602 INFO:teuthology.orchestra.run.smithi116.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-02-21T22:53:10.602 INFO:teuthology.orchestra.run.smithi116.stdout: inet 127.0.0.1/8 scope host lo 2024-02-21T22:53:10.602 INFO:teuthology.orchestra.run.smithi116.stdout: valid_lft forever preferred_lft forever 2024-02-21T22:53:10.602 INFO:teuthology.orchestra.run.smithi116.stdout: inet6 ::1/128 scope host 2024-02-21T22:53:10.602 INFO:teuthology.orchestra.run.smithi116.stdout: valid_lft forever preferred_lft forever 2024-02-21T22:53:10.602 INFO:teuthology.orchestra.run.smithi116.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-02-21T22:53:10.603 INFO:teuthology.orchestra.run.smithi116.stdout: link/ether 8e:e9:a9:78:e2:82 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-02-21T22:53:10.603 INFO:teuthology.orchestra.run.smithi116.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-02-21T22:53:10.603 INFO:teuthology.orchestra.run.smithi116.stdout: valid_lft forever preferred_lft forever 2024-02-21T22:53:10.603 INFO:teuthology.orchestra.run.smithi116.stdout: inet6 fe80::8ce9:a9ff:fe78:e282/64 scope link tentative 2024-02-21T22:53:10.603 INFO:teuthology.orchestra.run.smithi116.stdout: valid_lft forever preferred_lft forever 2024-02-21T22:53:10.604 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-02-21T22:53:10.604 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T22:53:10.604 DEBUG:teuthology.orchestra.run.smithi116:> (cd / && exec bash -c ' 2024-02-21T22:53:10.604 DEBUG:teuthology.orchestra.run.smithi116:> set -e 2024-02-21T22:53:10.605 DEBUG:teuthology.orchestra.run.smithi116:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-02-21T22:53:10.605 DEBUG:teuthology.orchestra.run.smithi116:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-02-21T22:53:10.605 DEBUG:teuthology.orchestra.run.smithi116:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-02-21T22:53:10.605 DEBUG:teuthology.orchestra.run.smithi116:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-02-21T22:53:10.605 DEBUG:teuthology.orchestra.run.smithi116:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-02-21T22:53:10.605 DEBUG:teuthology.orchestra.run.smithi116:> ') 2024-02-21T22:53:10.729 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T22:53:10.729 DEBUG:teuthology.orchestra.run.smithi116:> (cd / && exec bash -c ' 2024-02-21T22:53:10.729 DEBUG:teuthology.orchestra.run.smithi116:> set -e 2024-02-21T22:53:10.729 DEBUG:teuthology.orchestra.run.smithi116:> sudo ip link set brx.1 up 2024-02-21T22:53:10.729 DEBUG:teuthology.orchestra.run.smithi116:> sudo ip link set dev brx.1 master ceph-brx 2024-02-21T22:53:10.729 DEBUG:teuthology.orchestra.run.smithi116:> ') 2024-02-21T22:53:10.771 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-02-21T22:53:10.771 DEBUG:teuthology.orchestra.run.smithi116:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-02-21T22:53:10.826 INFO:teuthology.orchestra.run.smithi116.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-02-21T22:53:10.827 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-02-21T22:53:10.827 DEBUG:teuthology.orchestra.run.smithi116:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-02-21T22:53:10.882 INFO:tasks.cephfs.kernel_mount:mounting using device: 2@.cephfs=/ 2024-02-21T22:53:10.882 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T22:53:10.883 DEBUG:teuthology.orchestra.run.smithi116:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 2@.cephfs=/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-02-21T22:53:10.966 INFO:teuthology.orchestra.run.smithi116.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-02-21T22:53:10.966 INFO:teuthology.orchestra.run.smithi116.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-02-21T22:53:10.973 INFO:teuthology.orchestra.run.smithi116.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-02-21T22:53:10.973 INFO:teuthology.orchestra.run.smithi116.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-02-21T22:53:10.973 INFO:teuthology.orchestra.run.smithi116.stdout:mount.ceph: resolved to: "172.21.15.116:3300,172.21.15.142:3300,172.21.15.142:3301" 2024-02-21T22:53:10.973 INFO:teuthology.orchestra.run.smithi116.stdout:mount.ceph: trying mount with new device syntax: 2@7c298660-5f63-4b5c-a800-58c5be9a8445.cephfs=/ 2024-02-21T22:53:10.973 INFO:teuthology.orchestra.run.smithi116.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,ms_mode=prefer-crc,key=2,mon_addr=172.21.15.116:3300/172.21.15.142:3300/172.21.15.142:3301" will pass to kernel 2024-02-21T22:53:10.973 INFO:teuthology.orchestra.run.smithi116.stdout:mount: /home/ubuntu/cephtest/mnt.2 does not contain SELinux labels. 2024-02-21T22:53:10.974 INFO:teuthology.orchestra.run.smithi116.stdout: You just mounted a file system that supports labels which does not 2024-02-21T22:53:10.974 INFO:teuthology.orchestra.run.smithi116.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-02-21T22:53:10.974 INFO:teuthology.orchestra.run.smithi116.stdout: applications will generate AVC messages and not be allowed access to 2024-02-21T22:53:10.974 INFO:teuthology.orchestra.run.smithi116.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-02-21T22:53:10.975 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-02-21T22:53:10.975 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T22:53:10.975 DEBUG:teuthology.orchestra.run.smithi116:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-02-21T22:53:11.043 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T22:53:11.043 DEBUG:teuthology.orchestra.run.smithi116:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-02-21T22:53:11.099 INFO:teuthology.orchestra.run.smithi116.stdout:client4687 2024-02-21T22:53:11.100 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-02-21T22:53:11.100 DEBUG:teuthology.orchestra.run.smithi116:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-21T22:53:11.156 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T22:53:11.156 DEBUG:teuthology.orchestra.run.smithi116:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-02-21T22:53:11.212 INFO:teuthology.orchestra.run.smithi116.stdout:client4687 2024-02-21T22:53:11.213 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T22:53:11.213 DEBUG:teuthology.orchestra.run.smithi116:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-02-21T22:53:11.268 INFO:teuthology.orchestra.run.smithi116.stdout:client4687 2024-02-21T22:53:11.268 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T22:53:11.268 DEBUG:teuthology.orchestra.run.smithi116:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/7c298660-5f63-4b5c-a800-58c5be9a8445.client4687/status') 2024-02-21T22:53:11.335 INFO:teuthology.orchestra.run.smithi116.stdout:instance: client.4687 (3)172.21.15.116:0/3983372581 2024-02-21T22:53:11.335 INFO:teuthology.orchestra.run.smithi116.stdout:blocklisted: false 2024-02-21T22:53:11.336 INFO:teuthology.orchestra.run.smithi116.stderr:0+1 records in 2024-02-21T22:53:11.336 INFO:teuthology.orchestra.run.smithi116.stderr:0+1 records out 2024-02-21T22:53:11.336 INFO:teuthology.orchestra.run.smithi116.stderr:71 bytes copied, 2.1331e-05 s, 3.3 MB/s 2024-02-21T22:53:11.337 INFO:tasks.kclient:client.1 config is {'syntax': 'v2'} 2024-02-21T22:53:11.337 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-02-21T22:53:11.337 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-02-21T22:53:11.337 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-02-21T22:53:11.476 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:11.485+0000 7efd45b08640 1 Processor -- start 2024-02-21T22:53:11.476 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:11.485+0000 7efd45b08640 1 -- start start 2024-02-21T22:53:11.478 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:11.486+0000 7efd45b08640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efd400d1c30 0x7efd400d2430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:11.478 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:11.486+0000 7efd45b08640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7efd400cb930 0x7efd400cbdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:11.478 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:11.486+0000 7efd45b08640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd400cfa50 con 0x7efd400d0510 2024-02-21T22:53:11.478 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:11.486+0000 7efd45b08640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd400d1450 con 0x7efd400cb930 2024-02-21T22:53:11.478 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:11.486+0000 7efd45b08640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd400cfcc0 con 0x7efd400d1c30 2024-02-21T22:53:11.478 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:11.486+0000 7efd3f7fe640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7efd400d0510 0x7efd400d08f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.116:37000/0 (socket says 172.21.15.116:37000) 2024-02-21T22:53:11.479 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:11.486+0000 7efd3f7fe640 1 -- 172.21.15.116:0/1789347609 learned_addr learned my addr 172.21.15.116:0/1789347609 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-02-21T22:53:11.479 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:11.486+0000 7efd3ffff640 1 --2- 172.21.15.116:0/1789347609 >> v2:172.21.15.142:3300/0 conn(0x7efd400cb930 0x7efd400cbdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:11.479 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:11.487+0000 7efd36ffd640 1 --2- 172.21.15.116:0/1789347609 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efd400d1c30 0x7efd400d2430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:11.479 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:11.487+0000 7efd3effd640 1 -- 172.21.15.116:0/1789347609 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 535120568 0 0) 0x7efd400cfa50 con 0x7efd400d0510 2024-02-21T22:53:11.479 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:11.487+0000 7efd3effd640 1 -- 172.21.15.116:0/1789347609 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efd2c003520 con 0x7efd400d0510 2024-02-21T22:53:11.479 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:11.487+0000 7efd36ffd640 1 -- 172.21.15.116:0/1789347609 >> v2:172.21.15.142:3300/0 conn(0x7efd400cb930 msgr2=0x7efd400cbdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:53:11.479 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:11.487+0000 7efd36ffd640 1 --2- 172.21.15.116:0/1789347609 >> v2:172.21.15.142:3300/0 conn(0x7efd400cb930 0x7efd400cbdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:11.479 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:11.487+0000 7efd36ffd640 1 -- 172.21.15.116:0/1789347609 >> v1:172.21.15.142:6789/0 conn(0x7efd400d0510 legacy=0x7efd400d08f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:11.479 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:11.487+0000 7efd36ffd640 1 -- 172.21.15.116:0/1789347609 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd400cffa0 con 0x7efd400d1c30 2024-02-21T22:53:11.479 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:11.487+0000 7efd3ffff640 1 --2- 172.21.15.116:0/1789347609 >> v2:172.21.15.142:3300/0 conn(0x7efd400cb930 0x7efd400cbdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T22:53:11.479 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:11.488+0000 7efd36ffd640 1 --2- 172.21.15.116:0/1789347609 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efd400d1c30 0x7efd400d2430 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7efd280097a0 tx=0x7efd2802b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c3352f12a4796b92 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:11.479 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:11.488+0000 7efd3effd640 1 -- 172.21.15.116:0/1789347609 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd280315a0 con 0x7efd400d1c30 2024-02-21T22:53:11.479 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:11.488+0000 7efd3effd640 1 -- 172.21.15.116:0/1789347609 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd28037070 con 0x7efd400d1c30 2024-02-21T22:53:11.479 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:11.488+0000 7efd3effd640 1 -- 172.21.15.116:0/1789347609 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd28031960 con 0x7efd400d1c30 2024-02-21T22:53:11.482 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:11.488+0000 7efd45b08640 1 -- 172.21.15.116:0/1789347609 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efd400d1c30 msgr2=0x7efd400d2430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:11.482 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:11.488+0000 7efd45b08640 1 --2- 172.21.15.116:0/1789347609 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efd400d1c30 0x7efd400d2430 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7efd280097a0 tx=0x7efd2802b840 comp rx=0 tx=0).stop 2024-02-21T22:53:11.482 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:11.488+0000 7efd45b08640 1 -- 172.21.15.116:0/1789347609 shutdown_connections 2024-02-21T22:53:11.482 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:11.488+0000 7efd45b08640 1 --2- 172.21.15.116:0/1789347609 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efd400d1c30 0x7efd400d2430 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:11.482 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:11.488+0000 7efd45b08640 1 --2- 172.21.15.116:0/1789347609 >> v2:172.21.15.142:3300/0 conn(0x7efd400cb930 0x7efd400cbdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:11.482 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:11.488+0000 7efd45b08640 1 -- 172.21.15.116:0/1789347609 >> 172.21.15.116:0/1789347609 conn(0x7efd400d3e50 msgr2=0x7efd400d4260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:11.482 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:11.488+0000 7efd45b08640 1 -- 172.21.15.116:0/1789347609 shutdown_connections 2024-02-21T22:53:11.482 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:11.488+0000 7efd45b08640 1 -- 172.21.15.116:0/1789347609 wait complete. 2024-02-21T22:53:11.483 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:11.489+0000 7efd45b08640 1 Processor -- start 2024-02-21T22:53:11.483 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:11.490+0000 7efd45b08640 1 -- start start 2024-02-21T22:53:11.483 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:11.490+0000 7efd45b08640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efd400cb930 0x7efd40156170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:11.483 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:11.490+0000 7efd45b08640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efd400d0510 0x7efd400c9b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:11.483 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:11.490+0000 7efd45b08640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efd400d1c30 0x7efd401f42a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:11.483 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:11.490+0000 7efd45b08640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd400d2970 con 0x7efd400cb930 2024-02-21T22:53:11.483 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:11.490+0000 7efd45b08640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd4015e640 con 0x7efd400d1c30 2024-02-21T22:53:11.483 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:11.490+0000 7efd45b08640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd400d2af0 con 0x7efd400d0510 2024-02-21T22:53:11.483 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:11.490+0000 7efd3f7fe640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efd400cb930 0x7efd40156170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:11.483 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:11.490+0000 7efd3f7fe640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efd400cb930 0x7efd40156170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:45498/0 (socket says 172.21.15.116:45498) 2024-02-21T22:53:11.483 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:11.490+0000 7efd3f7fe640 1 -- 172.21.15.116:0/2755817458 learned_addr learned my addr 172.21.15.116:0/2755817458 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:11.484 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:11.490+0000 7efd3ffff640 1 --2- 172.21.15.116:0/2755817458 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efd400d1c30 0x7efd401f42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:11.484 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:11.490+0000 7efd36ffd640 1 --2- 172.21.15.116:0/2755817458 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efd400d0510 0x7efd400c9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:11.484 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:11.491+0000 7efd3f7fe640 1 -- 172.21.15.116:0/2755817458 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efd400d0510 msgr2=0x7efd400c9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:11.484 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:11.491+0000 7efd3f7fe640 1 --2- 172.21.15.116:0/2755817458 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efd400d0510 0x7efd400c9b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:11.484 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:11.491+0000 7efd3f7fe640 1 -- 172.21.15.116:0/2755817458 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efd400d1c30 msgr2=0x7efd401f42a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:11.484 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:11.491+0000 7efd3f7fe640 1 --2- 172.21.15.116:0/2755817458 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efd400d1c30 0x7efd401f42a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:11.484 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:11.491+0000 7efd3f7fe640 1 -- 172.21.15.116:0/2755817458 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd401f4cd0 con 0x7efd400cb930 2024-02-21T22:53:11.484 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:11.491+0000 7efd3f7fe640 1 --2- 172.21.15.116:0/2755817458 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efd400cb930 0x7efd40156170 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7efd3000c430 tx=0x7efd3000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:11.484 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:11.491+0000 7efd3cff9640 1 -- 172.21.15.116:0/2755817458 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd30017070 con 0x7efd400cb930 2024-02-21T22:53:11.484 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:11.491+0000 7efd3cff9640 1 -- 172.21.15.116:0/2755817458 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd30005ce0 con 0x7efd400cb930 2024-02-21T22:53:11.485 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:11.491+0000 7efd3cff9640 1 -- 172.21.15.116:0/2755817458 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd300072f0 con 0x7efd400cb930 2024-02-21T22:53:11.485 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:11.491+0000 7efd45b08640 1 -- 172.21.15.116:0/2755817458 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd401f4fb0 con 0x7efd400cb930 2024-02-21T22:53:11.485 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:11.491+0000 7efd45b08640 1 -- 172.21.15.116:0/2755817458 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd401566b0 con 0x7efd400cb930 2024-02-21T22:53:11.487 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:11.492+0000 7efd45b08640 1 -- 172.21.15.116:0/2755817458 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd400752f0 con 0x7efd400cb930 2024-02-21T22:53:11.487 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:11.492+0000 7efd3cff9640 1 -- 172.21.15.116:0/2755817458 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7efd3001a070 con 0x7efd400cb930 2024-02-21T22:53:11.487 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:11.493+0000 7efd3cff9640 1 --2- 172.21.15.116:0/2755817458 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7efd2006b4d0 0x7efd2006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:11.487 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:11.493+0000 7efd3cff9640 1 -- 172.21.15.116:0/2755817458 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efd300894b0 con 0x7efd400cb930 2024-02-21T22:53:11.487 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:11.493+0000 7efd36ffd640 1 --2- 172.21.15.116:0/2755817458 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7efd2006b4d0 0x7efd2006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:11.487 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:11.493+0000 7efd36ffd640 1 --2- 172.21.15.116:0/2755817458 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7efd2006b4d0 0x7efd2006d990 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7efd28036000 tx=0x7efd2803d040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:11.487 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:11.497+0000 7efd3cff9640 1 -- 172.21.15.116:0/2755817458 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7efd30057d70 con 0x7efd400cb930 2024-02-21T22:53:11.698 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:11.708+0000 7efd45b08640 1 -- 172.21.15.116:0/2755817458 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7efd400d2210 con 0x7efd400cb930 2024-02-21T22:53:11.698 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:11.708+0000 7efd3cff9640 1 -- 172.21.15.116:0/2755817458 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) v1 ==== 53+0+73 (secure 0 0 0) 0x7efd3005be10 con 0x7efd400cb930 2024-02-21T22:53:11.699 INFO:teuthology.orchestra.run.smithi116.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-02-21T22:53:11.701 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:11.710+0000 7efd45b08640 1 -- 172.21.15.116:0/2755817458 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7efd2006b4d0 msgr2=0x7efd2006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:11.701 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:11.710+0000 7efd45b08640 1 --2- 172.21.15.116:0/2755817458 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7efd2006b4d0 0x7efd2006d990 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7efd28036000 tx=0x7efd2803d040 comp rx=0 tx=0).stop 2024-02-21T22:53:11.701 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:11.710+0000 7efd45b08640 1 -- 172.21.15.116:0/2755817458 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efd400cb930 msgr2=0x7efd40156170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:11.701 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:11.710+0000 7efd45b08640 1 --2- 172.21.15.116:0/2755817458 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efd400cb930 0x7efd40156170 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7efd3000c430 tx=0x7efd3000c830 comp rx=0 tx=0).stop 2024-02-21T22:53:11.701 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:11.710+0000 7efd45b08640 1 -- 172.21.15.116:0/2755817458 shutdown_connections 2024-02-21T22:53:11.701 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:11.710+0000 7efd45b08640 1 --2- 172.21.15.116:0/2755817458 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efd400d1c30 0x7efd401f42a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:11.701 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:11.710+0000 7efd45b08640 1 --2- 172.21.15.116:0/2755817458 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7efd2006b4d0 0x7efd2006d990 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:11.701 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:11.710+0000 7efd45b08640 1 --2- 172.21.15.116:0/2755817458 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efd400d0510 0x7efd400c9b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:11.701 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:11.710+0000 7efd45b08640 1 --2- 172.21.15.116:0/2755817458 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efd400cb930 0x7efd40156170 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:11.701 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:11.710+0000 7efd45b08640 1 -- 172.21.15.116:0/2755817458 >> 172.21.15.116:0/2755817458 conn(0x7efd400d3e50 msgr2=0x7efd400cb190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:11.701 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:11.710+0000 7efd45b08640 1 -- 172.21.15.116:0/2755817458 shutdown_connections 2024-02-21T22:53:11.701 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:11.710+0000 7efd45b08640 1 -- 172.21.15.116:0/2755817458 wait complete. 2024-02-21T22:53:11.711 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-02-21T22:53:11.711 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-02-21T22:53:11.711 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi142.front.sepia.ceph.com 2024-02-21T22:53:11.712 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-02-21T22:53:11.712 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-02-21T22:53:11.712 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-02-21T22:53:11.712 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-02-21T22:53:11.712 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-02-21T22:53:11.712 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-02-21T22:53:11.712 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T22:53:11.712 DEBUG:teuthology.orchestra.run.smithi142:> ip addr 2024-02-21T22:53:11.727 INFO:teuthology.orchestra.run.smithi142.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-02-21T22:53:11.727 INFO:teuthology.orchestra.run.smithi142.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-02-21T22:53:11.728 INFO:teuthology.orchestra.run.smithi142.stdout: inet 127.0.0.1/8 scope host lo 2024-02-21T22:53:11.728 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2024-02-21T22:53:11.728 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 ::1/128 scope host 2024-02-21T22:53:11.728 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2024-02-21T22:53:11.728 INFO:teuthology.orchestra.run.smithi142.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-21T22:53:11.728 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:d9:36:3c brd ff:ff:ff:ff:ff:ff 2024-02-21T22:53:11.728 INFO:teuthology.orchestra.run.smithi142.stdout: altname enp7s0f0 2024-02-21T22:53:11.728 INFO:teuthology.orchestra.run.smithi142.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-21T22:53:11.728 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:d9:36:3d brd ff:ff:ff:ff:ff:ff 2024-02-21T22:53:11.728 INFO:teuthology.orchestra.run.smithi142.stdout: altname enp7s0f1 2024-02-21T22:53:11.728 INFO:teuthology.orchestra.run.smithi142.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-21T22:53:11.728 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:88:6e:0c brd ff:ff:ff:ff:ff:ff 2024-02-21T22:53:11.728 INFO:teuthology.orchestra.run.smithi142.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-02-21T22:53:11.728 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:88:6e:0d brd ff:ff:ff:ff:ff:ff 2024-02-21T22:53:11.729 INFO:teuthology.orchestra.run.smithi142.stdout: inet 172.21.15.142/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-02-21T22:53:11.729 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft 42523sec preferred_lft 42523sec 2024-02-21T22:53:11.729 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::ec4:7aff:fe88:6e0d/64 scope link 2024-02-21T22:53:11.729 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2024-02-21T22:53:11.729 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-02-21T22:53:11.729 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T22:53:11.729 DEBUG:teuthology.orchestra.run.smithi142:> (cd / && exec bash -c ' 2024-02-21T22:53:11.729 DEBUG:teuthology.orchestra.run.smithi142:> set -e 2024-02-21T22:53:11.729 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link add name ceph-brx type bridge 2024-02-21T22:53:11.729 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip addr flush dev ceph-brx 2024-02-21T22:53:11.730 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link set ceph-brx up 2024-02-21T22:53:11.730 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-02-21T22:53:11.730 DEBUG:teuthology.orchestra.run.smithi142:> ') 2024-02-21T22:53:11.978 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T22:53:11.978 DEBUG:teuthology.orchestra.run.smithi142:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-02-21T22:53:12.004 INFO:teuthology.orchestra.run.smithi142.stdout:1 2024-02-21T22:53:12.006 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T22:53:12.006 DEBUG:teuthology.orchestra.run.smithi142:> route 2024-02-21T22:53:12.071 INFO:teuthology.orchestra.run.smithi142.stdout:Kernel IP routing table 2024-02-21T22:53:12.071 INFO:teuthology.orchestra.run.smithi142.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-02-21T22:53:12.072 INFO:teuthology.orchestra.run.smithi142.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-02-21T22:53:12.072 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-02-21T22:53:12.072 INFO:teuthology.orchestra.run.smithi142.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-02-21T22:53:12.072 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T22:53:12.073 DEBUG:teuthology.orchestra.run.smithi142:> (cd / && exec bash -c ' 2024-02-21T22:53:12.073 DEBUG:teuthology.orchestra.run.smithi142:> set -e 2024-02-21T22:53:12.073 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-02-21T22:53:12.073 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-02-21T22:53:12.073 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-02-21T22:53:12.073 DEBUG:teuthology.orchestra.run.smithi142:> ') 2024-02-21T22:53:12.329 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T22:53:12.330 DEBUG:teuthology.orchestra.run.smithi142:> ip netns list 2024-02-21T22:53:12.344 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T22:53:12.344 DEBUG:teuthology.orchestra.run.smithi142:> ip netns list-id 2024-02-21T22:53:12.399 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T22:53:12.399 DEBUG:teuthology.orchestra.run.smithi142:> (cd / && exec bash -c ' 2024-02-21T22:53:12.399 DEBUG:teuthology.orchestra.run.smithi142:> set -e 2024-02-21T22:53:12.400 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-02-21T22:53:12.400 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-02-21T22:53:12.400 DEBUG:teuthology.orchestra.run.smithi142:> ') 2024-02-21T22:53:12.484 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-02-21T22:53:12.484 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T22:53:12.484 DEBUG:teuthology.orchestra.run.smithi142:> (cd / && exec bash -c ' 2024-02-21T22:53:12.484 DEBUG:teuthology.orchestra.run.smithi142:> set -e 2024-02-21T22:53:12.484 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-02-21T22:53:12.484 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-02-21T22:53:12.484 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-02-21T22:53:12.484 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-02-21T22:53:12.485 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-02-21T22:53:12.485 DEBUG:teuthology.orchestra.run.smithi142:> ') 2024-02-21T22:53:12.632 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T22:53:12.632 DEBUG:teuthology.orchestra.run.smithi142:> (cd / && exec bash -c ' 2024-02-21T22:53:12.632 DEBUG:teuthology.orchestra.run.smithi142:> set -e 2024-02-21T22:53:12.632 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link set brx.0 up 2024-02-21T22:53:12.632 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link set dev brx.0 master ceph-brx 2024-02-21T22:53:12.633 DEBUG:teuthology.orchestra.run.smithi142:> ') 2024-02-21T22:53:12.682 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-02-21T22:53:12.682 DEBUG:teuthology.orchestra.run.smithi142:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-02-21T22:53:12.696 INFO:teuthology.orchestra.run.smithi142.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-02-21T22:53:12.697 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-02-21T22:53:12.697 DEBUG:teuthology.orchestra.run.smithi142:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-02-21T22:53:12.751 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-02-21T22:53:12.751 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T22:53:12.751 DEBUG:teuthology.orchestra.run.smithi142:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-02-21T22:53:12.841 INFO:teuthology.orchestra.run.smithi142.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-02-21T22:53:12.841 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-02-21T22:53:12.970 INFO:teuthology.orchestra.run.smithi142.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-02-21T22:53:12.970 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-02-21T22:53:12.970 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: resolved to: "172.21.15.116:3300,172.21.15.142:3300,172.21.15.142:3301" 2024-02-21T22:53:12.970 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: trying mount with new device syntax: 1@7c298660-5f63-4b5c-a800-58c5be9a8445.cephfs=/ 2024-02-21T22:53:12.970 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.116:3300/172.21.15.142:3300/172.21.15.142:3301" will pass to kernel 2024-02-21T22:53:12.971 INFO:teuthology.orchestra.run.smithi142.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-02-21T22:53:12.971 INFO:teuthology.orchestra.run.smithi142.stdout: You just mounted a file system that supports labels which does not 2024-02-21T22:53:12.971 INFO:teuthology.orchestra.run.smithi142.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-02-21T22:53:12.971 INFO:teuthology.orchestra.run.smithi142.stdout: applications will generate AVC messages and not be allowed access to 2024-02-21T22:53:12.971 INFO:teuthology.orchestra.run.smithi142.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-02-21T22:53:12.973 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-02-21T22:53:12.973 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T22:53:12.973 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-02-21T22:53:13.000 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T22:53:13.000 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-02-21T22:53:13.056 INFO:teuthology.orchestra.run.smithi142.stdout:client4713 2024-02-21T22:53:13.057 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-02-21T22:53:13.057 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-21T22:53:13.112 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T22:53:13.115 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-02-21T22:53:13.168 INFO:teuthology.orchestra.run.smithi142.stdout:client4713 2024-02-21T22:53:13.168 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T22:53:13.168 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-02-21T22:53:13.225 INFO:teuthology.orchestra.run.smithi142.stdout:client4713 2024-02-21T22:53:13.225 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T22:53:13.225 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/7c298660-5f63-4b5c-a800-58c5be9a8445.client4713/status') 2024-02-21T22:53:13.294 INFO:teuthology.orchestra.run.smithi142.stdout:instance: client.4713 (3)172.21.15.142:0/1615726362 2024-02-21T22:53:13.294 INFO:teuthology.orchestra.run.smithi142.stdout:blocklisted: false 2024-02-21T22:53:13.295 INFO:teuthology.orchestra.run.smithi142.stderr:0+1 records in 2024-02-21T22:53:13.295 INFO:teuthology.orchestra.run.smithi142.stderr:0+1 records out 2024-02-21T22:53:13.295 INFO:teuthology.orchestra.run.smithi142.stderr:71 bytes copied, 3.1045e-05 s, 2.3 MB/s 2024-02-21T22:53:13.296 INFO:tasks.kclient:client.3 config is {'syntax': 'v2'} 2024-02-21T22:53:13.296 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-02-21T22:53:13.296 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-02-21T22:53:13.296 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-02-21T22:53:13.407 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:13.416+0000 7fba03fc8640 1 Processor -- start 2024-02-21T22:53:13.407 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:13.416+0000 7fba03fc8640 1 -- start start 2024-02-21T22:53:13.408 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:13.417+0000 7fba03fc8640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fb9fc15afb0 0x7fb9fc0af080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:13.409 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:13.417+0000 7fba03fc8640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb9fc071c90 0x7fb9fc0b3860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:13.409 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:13.417+0000 7fba03fc8640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9fc0710e0 con 0x7fb9fc070b70 2024-02-21T22:53:13.409 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:13.417+0000 7fba03fc8640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9fc15b390 con 0x7fb9fc15afb0 2024-02-21T22:53:13.409 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:13.417+0000 7fba03fc8640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9fc0713c0 con 0x7fb9fc071c90 2024-02-21T22:53:13.409 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:13.417+0000 7fba01d64640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fb9fc15afb0 0x7fb9fc0af080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:13.409 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:13.417+0000 7fba01563640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7fb9fc070b70 0x7fb9fc071580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:46766/0 (socket says 172.21.15.116:46766) 2024-02-21T22:53:13.409 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:13.417+0000 7fba01563640 1 -- 172.21.15.116:0/1314781489 learned_addr learned my addr 172.21.15.116:0/1314781489 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-02-21T22:53:13.409 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:13.418+0000 7fba02565640 1 --2- 172.21.15.116:0/1314781489 >> v2:172.21.15.142:3300/0 conn(0x7fb9fc071c90 0x7fb9fc0b3860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:13.409 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:13.418+0000 7fba01d64640 1 -- 172.21.15.116:0/1314781489 >> v2:172.21.15.142:3300/0 conn(0x7fb9fc071c90 msgr2=0x7fb9fc0b3860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:53:13.409 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:13.418+0000 7fba01d64640 1 --2- 172.21.15.116:0/1314781489 >> v2:172.21.15.142:3300/0 conn(0x7fb9fc071c90 0x7fb9fc0b3860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:13.409 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:13.418+0000 7fba01d64640 1 -- 172.21.15.116:0/1314781489 >> v1:172.21.15.116:6789/0 conn(0x7fb9fc070b70 legacy=0x7fb9fc071580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:13.409 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:13.418+0000 7fba00d62640 1 -- 172.21.15.116:0/1314781489 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2743816575 0 0) 0x7fb9fc0710e0 con 0x7fb9fc070b70 2024-02-21T22:53:13.409 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:13.418+0000 7fba01d64640 1 -- 172.21.15.116:0/1314781489 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9fc0b2d80 con 0x7fb9fc15afb0 2024-02-21T22:53:13.409 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:13.418+0000 7fba01d64640 1 --2- 172.21.15.116:0/1314781489 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb9fc15afb0 0x7fb9fc0af080 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fb9f80097a0 tx=0x7fb9f802b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=402d53a93eeaf247 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:13.411 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:13.419+0000 7fba00d62640 1 -- 172.21.15.116:0/1314781489 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9f8034070 con 0x7fb9fc15afb0 2024-02-21T22:53:13.411 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:13.419+0000 7fba00d62640 1 -- 172.21.15.116:0/1314781489 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9f8030610 con 0x7fb9fc15afb0 2024-02-21T22:53:13.411 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:13.419+0000 7fba00d62640 1 -- 172.21.15.116:0/1314781489 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9f80309e0 con 0x7fb9fc15afb0 2024-02-21T22:53:13.411 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:13.419+0000 7fba03fc8640 1 -- 172.21.15.116:0/1314781489 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb9fc15afb0 msgr2=0x7fb9fc0af080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:13.411 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:13.419+0000 7fba03fc8640 1 --2- 172.21.15.116:0/1314781489 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb9fc15afb0 0x7fb9fc0af080 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fb9f80097a0 tx=0x7fb9f802b960 comp rx=0 tx=0).stop 2024-02-21T22:53:13.411 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:13.419+0000 7fba03fc8640 1 -- 172.21.15.116:0/1314781489 shutdown_connections 2024-02-21T22:53:13.411 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:13.419+0000 7fba03fc8640 1 --2- 172.21.15.116:0/1314781489 >> v2:172.21.15.142:3300/0 conn(0x7fb9fc071c90 0x7fb9fc0b3860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:13.411 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:13.419+0000 7fba03fc8640 1 --2- 172.21.15.116:0/1314781489 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb9fc15afb0 0x7fb9fc0af080 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:13.411 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:13.419+0000 7fba03fc8640 1 -- 172.21.15.116:0/1314781489 >> 172.21.15.116:0/1314781489 conn(0x7fb9fc0b18e0 msgr2=0x7fb9fc0b1cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:13.411 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:13.419+0000 7fba03fc8640 1 -- 172.21.15.116:0/1314781489 shutdown_connections 2024-02-21T22:53:13.412 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:13.419+0000 7fba03fc8640 1 -- 172.21.15.116:0/1314781489 wait complete. 2024-02-21T22:53:13.412 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:13.420+0000 7fba03fc8640 1 Processor -- start 2024-02-21T22:53:13.412 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:13.420+0000 7fba03fc8640 1 -- start start 2024-02-21T22:53:13.414 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:13.421+0000 7fba03fc8640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb9fc070b70 0x7fb9fc0ce3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:13.414 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:13.421+0000 7fba03fc8640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb9fc071c90 0x7fb9fc0c5560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:13.414 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:13.421+0000 7fba03fc8640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb9fc15afb0 0x7fb9fc0b0790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:13.414 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:13.421+0000 7fba03fc8640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9fc0af5c0 con 0x7fb9fc070b70 2024-02-21T22:53:13.415 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:13.421+0000 7fba03fc8640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9fc0b3340 con 0x7fb9fc15afb0 2024-02-21T22:53:13.415 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:13.421+0000 7fba03fc8640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9fc0b3da0 con 0x7fb9fc071c90 2024-02-21T22:53:13.415 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:13.421+0000 7fba01d64640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb9fc070b70 0x7fb9fc0ce3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:13.415 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:13.421+0000 7fba01d64640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb9fc070b70 0x7fb9fc0ce3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:45508/0 (socket says 172.21.15.116:45508) 2024-02-21T22:53:13.415 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:13.421+0000 7fba01d64640 1 -- 172.21.15.116:0/2315585671 learned_addr learned my addr 172.21.15.116:0/2315585671 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:13.415 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:13.421+0000 7fba02565640 1 --2- 172.21.15.116:0/2315585671 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb9fc15afb0 0x7fb9fc0b0790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:13.415 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:13.421+0000 7fba01563640 1 --2- 172.21.15.116:0/2315585671 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb9fc071c90 0x7fb9fc0c5560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:13.415 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:13.422+0000 7fba01d64640 1 -- 172.21.15.116:0/2315585671 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb9fc071c90 msgr2=0x7fb9fc0c5560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:13.415 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:13.422+0000 7fba01d64640 1 --2- 172.21.15.116:0/2315585671 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb9fc071c90 0x7fb9fc0c5560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:13.415 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:13.422+0000 7fba01d64640 1 -- 172.21.15.116:0/2315585671 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb9fc15afb0 msgr2=0x7fb9fc0b0790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:13.415 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:13.422+0000 7fba01d64640 1 --2- 172.21.15.116:0/2315585671 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb9fc15afb0 0x7fb9fc0b0790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:13.415 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:13.422+0000 7fba01d64640 1 -- 172.21.15.116:0/2315585671 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9fc0c5cb0 con 0x7fb9fc070b70 2024-02-21T22:53:13.415 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:13.422+0000 7fba01d64640 1 --2- 172.21.15.116:0/2315585671 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb9fc070b70 0x7fb9fc0ce3b0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fb9f80098c0 tx=0x7fb9f80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:13.415 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:13.422+0000 7fb9f27fc640 1 -- 172.21.15.116:0/2315585671 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9f8047070 con 0x7fb9fc070b70 2024-02-21T22:53:13.416 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:13.422+0000 7fb9f27fc640 1 -- 172.21.15.116:0/2315585671 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9f8030410 con 0x7fb9fc070b70 2024-02-21T22:53:13.416 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:13.422+0000 7fba03fc8640 1 -- 172.21.15.116:0/2315585671 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9fc0c5f90 con 0x7fb9fc070b70 2024-02-21T22:53:13.416 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:13.422+0000 7fb9f27fc640 1 -- 172.21.15.116:0/2315585671 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9f8034040 con 0x7fb9fc070b70 2024-02-21T22:53:13.416 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:13.422+0000 7fba03fc8640 1 -- 172.21.15.116:0/2315585671 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9fc0c6550 con 0x7fb9fc070b70 2024-02-21T22:53:13.416 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:13.423+0000 7fba03fc8640 1 -- 172.21.15.116:0/2315585671 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9fc0752f0 con 0x7fb9fc070b70 2024-02-21T22:53:13.416 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:13.423+0000 7fb9f27fc640 1 -- 172.21.15.116:0/2315585671 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fb9f804a070 con 0x7fb9fc070b70 2024-02-21T22:53:13.416 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:13.424+0000 7fb9f27fc640 1 --2- 172.21.15.116:0/2315585671 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fb9e006b4d0 0x7fb9e006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:13.416 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:13.424+0000 7fb9f27fc640 1 -- 172.21.15.116:0/2315585671 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb9f80aba70 con 0x7fb9fc070b70 2024-02-21T22:53:13.416 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:13.424+0000 7fba01563640 1 --2- 172.21.15.116:0/2315585671 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fb9e006b4d0 0x7fb9e006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:13.417 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:13.424+0000 7fba01563640 1 --2- 172.21.15.116:0/2315585671 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fb9e006b4d0 0x7fb9e006d990 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fb9fc150fb0 tx=0x7fb9ec007d50 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:13.418 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:13.428+0000 7fb9f27fc640 1 -- 172.21.15.116:0/2315585671 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7fb9f80305e0 con 0x7fb9fc070b70 2024-02-21T22:53:13.625 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:13.635+0000 7fba03fc8640 1 -- 172.21.15.116:0/2315585671 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fb9fc0b14b0 con 0x7fb9fc070b70 2024-02-21T22:53:13.625 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:13.635+0000 7fb9f27fc640 1 -- 172.21.15.116:0/2315585671 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) v1 ==== 53+0+73 (secure 0 0 0) 0x7fb9f807a210 con 0x7fb9fc070b70 2024-02-21T22:53:13.626 INFO:teuthology.orchestra.run.smithi116.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-02-21T22:53:13.628 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:13.637+0000 7fba03fc8640 1 -- 172.21.15.116:0/2315585671 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fb9e006b4d0 msgr2=0x7fb9e006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:13.628 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:13.637+0000 7fba03fc8640 1 --2- 172.21.15.116:0/2315585671 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fb9e006b4d0 0x7fb9e006d990 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fb9fc150fb0 tx=0x7fb9ec007d50 comp rx=0 tx=0).stop 2024-02-21T22:53:13.628 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:13.637+0000 7fba03fc8640 1 -- 172.21.15.116:0/2315585671 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb9fc070b70 msgr2=0x7fb9fc0ce3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:13.628 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:13.637+0000 7fba03fc8640 1 --2- 172.21.15.116:0/2315585671 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb9fc070b70 0x7fb9fc0ce3b0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fb9f80098c0 tx=0x7fb9f80046c0 comp rx=0 tx=0).stop 2024-02-21T22:53:13.628 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:13.637+0000 7fba03fc8640 1 -- 172.21.15.116:0/2315585671 shutdown_connections 2024-02-21T22:53:13.628 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:13.637+0000 7fba03fc8640 1 --2- 172.21.15.116:0/2315585671 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb9fc15afb0 0x7fb9fc0b0790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:13.628 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:13.637+0000 7fba03fc8640 1 --2- 172.21.15.116:0/2315585671 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fb9e006b4d0 0x7fb9e006d990 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:13.628 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:13.637+0000 7fba03fc8640 1 --2- 172.21.15.116:0/2315585671 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb9fc071c90 0x7fb9fc0c5560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:13.628 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:13.637+0000 7fba03fc8640 1 --2- 172.21.15.116:0/2315585671 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb9fc070b70 0x7fb9fc0ce3b0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:13.628 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:13.637+0000 7fba03fc8640 1 -- 172.21.15.116:0/2315585671 >> 172.21.15.116:0/2315585671 conn(0x7fb9fc0b18e0 msgr2=0x7fb9fc0b1cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:13.628 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:13.637+0000 7fba03fc8640 1 -- 172.21.15.116:0/2315585671 shutdown_connections 2024-02-21T22:53:13.628 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:13.637+0000 7fba03fc8640 1 -- 172.21.15.116:0/2315585671 wait complete. 2024-02-21T22:53:13.638 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-02-21T22:53:13.638 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-02-21T22:53:13.638 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi142.front.sepia.ceph.com 2024-02-21T22:53:13.638 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-02-21T22:53:13.638 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-02-21T22:53:13.638 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-02-21T22:53:13.639 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-02-21T22:53:13.639 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-02-21T22:53:13.639 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-02-21T22:53:13.639 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T22:53:13.639 DEBUG:teuthology.orchestra.run.smithi142:> ip addr 2024-02-21T22:53:13.654 INFO:teuthology.orchestra.run.smithi142.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-02-21T22:53:13.655 INFO:teuthology.orchestra.run.smithi142.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-02-21T22:53:13.655 INFO:teuthology.orchestra.run.smithi142.stdout: inet 127.0.0.1/8 scope host lo 2024-02-21T22:53:13.655 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2024-02-21T22:53:13.655 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 ::1/128 scope host 2024-02-21T22:53:13.655 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2024-02-21T22:53:13.655 INFO:teuthology.orchestra.run.smithi142.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-21T22:53:13.655 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:d9:36:3c brd ff:ff:ff:ff:ff:ff 2024-02-21T22:53:13.655 INFO:teuthology.orchestra.run.smithi142.stdout: altname enp7s0f0 2024-02-21T22:53:13.655 INFO:teuthology.orchestra.run.smithi142.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-21T22:53:13.655 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:d9:36:3d brd ff:ff:ff:ff:ff:ff 2024-02-21T22:53:13.655 INFO:teuthology.orchestra.run.smithi142.stdout: altname enp7s0f1 2024-02-21T22:53:13.655 INFO:teuthology.orchestra.run.smithi142.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-21T22:53:13.655 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:88:6e:0c brd ff:ff:ff:ff:ff:ff 2024-02-21T22:53:13.656 INFO:teuthology.orchestra.run.smithi142.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-02-21T22:53:13.656 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:88:6e:0d brd ff:ff:ff:ff:ff:ff 2024-02-21T22:53:13.656 INFO:teuthology.orchestra.run.smithi142.stdout: inet 172.21.15.142/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-02-21T22:53:13.656 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft 42521sec preferred_lft 42521sec 2024-02-21T22:53:13.656 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::ec4:7aff:fe88:6e0d/64 scope link 2024-02-21T22:53:13.656 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2024-02-21T22:53:13.656 INFO:teuthology.orchestra.run.smithi142.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-02-21T22:53:13.656 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 32:2d:6c:e1:02:0f brd ff:ff:ff:ff:ff:ff 2024-02-21T22:53:13.656 INFO:teuthology.orchestra.run.smithi142.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-02-21T22:53:13.656 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2024-02-21T22:53:13.656 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::e86d:f5ff:fe24:61e1/64 scope link tentative 2024-02-21T22:53:13.656 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2024-02-21T22:53:13.656 INFO:teuthology.orchestra.run.smithi142.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-02-21T22:53:13.656 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 32:2d:6c:e1:02:0f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-02-21T22:53:13.657 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::302d:6cff:fee1:20f/64 scope link tentative 2024-02-21T22:53:13.657 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2024-02-21T22:53:13.657 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T22:53:13.657 DEBUG:teuthology.orchestra.run.smithi142:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-02-21T22:53:13.722 INFO:teuthology.orchestra.run.smithi142.stdout:1 2024-02-21T22:53:13.724 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T22:53:13.724 DEBUG:teuthology.orchestra.run.smithi142:> route 2024-02-21T22:53:13.780 INFO:teuthology.orchestra.run.smithi142.stdout:Kernel IP routing table 2024-02-21T22:53:13.781 INFO:teuthology.orchestra.run.smithi142.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-02-21T22:53:13.781 INFO:teuthology.orchestra.run.smithi142.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-02-21T22:53:13.781 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-02-21T22:53:13.781 INFO:teuthology.orchestra.run.smithi142.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-02-21T22:53:13.781 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T22:53:13.781 DEBUG:teuthology.orchestra.run.smithi142:> (cd / && exec bash -c ' 2024-02-21T22:53:13.781 DEBUG:teuthology.orchestra.run.smithi142:> set -e 2024-02-21T22:53:13.781 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-02-21T22:53:13.781 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-02-21T22:53:13.782 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-02-21T22:53:13.782 DEBUG:teuthology.orchestra.run.smithi142:> ') 2024-02-21T22:53:13.877 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T22:53:13.877 DEBUG:teuthology.orchestra.run.smithi142:> ip netns list 2024-02-21T22:53:13.892 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-02-21T22:53:13.892 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T22:53:13.893 DEBUG:teuthology.orchestra.run.smithi142:> ip netns list-id 2024-02-21T22:53:13.948 INFO:teuthology.orchestra.run.smithi142.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-02-21T22:53:13.948 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T22:53:13.948 DEBUG:teuthology.orchestra.run.smithi142:> (cd / && exec bash -c ' 2024-02-21T22:53:13.948 DEBUG:teuthology.orchestra.run.smithi142:> set -e 2024-02-21T22:53:13.948 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-02-21T22:53:13.948 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-02-21T22:53:13.948 DEBUG:teuthology.orchestra.run.smithi142:> ') 2024-02-21T22:53:14.032 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T22:53:14.032 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-02-21T22:53:14.059 INFO:teuthology.orchestra.run.smithi142.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-02-21T22:53:14.059 INFO:teuthology.orchestra.run.smithi142.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-02-21T22:53:14.059 INFO:teuthology.orchestra.run.smithi142.stdout: inet 127.0.0.1/8 scope host lo 2024-02-21T22:53:14.059 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2024-02-21T22:53:14.059 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 ::1/128 scope host 2024-02-21T22:53:14.059 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2024-02-21T22:53:14.059 INFO:teuthology.orchestra.run.smithi142.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-02-21T22:53:14.059 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 96:8c:04:e4:07:df brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-02-21T22:53:14.060 INFO:teuthology.orchestra.run.smithi142.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-02-21T22:53:14.060 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2024-02-21T22:53:14.060 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::948c:4ff:fee4:7df/64 scope link tentative 2024-02-21T22:53:14.060 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2024-02-21T22:53:14.061 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T22:53:14.061 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-02-21T22:53:14.130 INFO:teuthology.orchestra.run.smithi142.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-02-21T22:53:14.130 INFO:teuthology.orchestra.run.smithi142.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-02-21T22:53:14.131 INFO:teuthology.orchestra.run.smithi142.stdout: inet 127.0.0.1/8 scope host lo 2024-02-21T22:53:14.131 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2024-02-21T22:53:14.131 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 ::1/128 scope host 2024-02-21T22:53:14.131 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2024-02-21T22:53:14.131 INFO:teuthology.orchestra.run.smithi142.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-02-21T22:53:14.131 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 96:8c:04:e4:07:df brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-02-21T22:53:14.131 INFO:teuthology.orchestra.run.smithi142.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-02-21T22:53:14.131 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2024-02-21T22:53:14.131 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::948c:4ff:fee4:7df/64 scope link tentative 2024-02-21T22:53:14.131 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2024-02-21T22:53:14.132 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-02-21T22:53:14.132 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T22:53:14.133 DEBUG:teuthology.orchestra.run.smithi142:> (cd / && exec bash -c ' 2024-02-21T22:53:14.133 DEBUG:teuthology.orchestra.run.smithi142:> set -e 2024-02-21T22:53:14.133 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-02-21T22:53:14.133 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-02-21T22:53:14.133 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-02-21T22:53:14.133 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-02-21T22:53:14.133 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-02-21T22:53:14.133 DEBUG:teuthology.orchestra.run.smithi142:> ') 2024-02-21T22:53:14.256 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T22:53:14.256 DEBUG:teuthology.orchestra.run.smithi142:> (cd / && exec bash -c ' 2024-02-21T22:53:14.257 DEBUG:teuthology.orchestra.run.smithi142:> set -e 2024-02-21T22:53:14.257 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link set brx.1 up 2024-02-21T22:53:14.257 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link set dev brx.1 master ceph-brx 2024-02-21T22:53:14.257 DEBUG:teuthology.orchestra.run.smithi142:> ') 2024-02-21T22:53:14.300 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-02-21T22:53:14.300 DEBUG:teuthology.orchestra.run.smithi142:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-02-21T22:53:14.355 INFO:teuthology.orchestra.run.smithi142.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-02-21T22:53:14.355 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-02-21T22:53:14.355 DEBUG:teuthology.orchestra.run.smithi142:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-02-21T22:53:14.409 INFO:tasks.cephfs.kernel_mount:mounting using device: 3@.cephfs=/ 2024-02-21T22:53:14.409 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T22:53:14.409 DEBUG:teuthology.orchestra.run.smithi142:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 3@.cephfs=/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-02-21T22:53:14.494 INFO:teuthology.orchestra.run.smithi142.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-02-21T22:53:14.494 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-02-21T22:53:14.501 INFO:teuthology.orchestra.run.smithi142.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-02-21T22:53:14.501 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-02-21T22:53:14.501 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: resolved to: "172.21.15.116:3300,172.21.15.142:3300,172.21.15.142:3301" 2024-02-21T22:53:14.501 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: trying mount with new device syntax: 3@7c298660-5f63-4b5c-a800-58c5be9a8445.cephfs=/ 2024-02-21T22:53:14.501 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,ms_mode=prefer-crc,key=3,mon_addr=172.21.15.116:3300/172.21.15.142:3300/172.21.15.142:3301" will pass to kernel 2024-02-21T22:53:14.502 INFO:teuthology.orchestra.run.smithi142.stdout:mount: /home/ubuntu/cephtest/mnt.3 does not contain SELinux labels. 2024-02-21T22:53:14.502 INFO:teuthology.orchestra.run.smithi142.stdout: You just mounted a file system that supports labels which does not 2024-02-21T22:53:14.502 INFO:teuthology.orchestra.run.smithi142.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-02-21T22:53:14.502 INFO:teuthology.orchestra.run.smithi142.stdout: applications will generate AVC messages and not be allowed access to 2024-02-21T22:53:14.502 INFO:teuthology.orchestra.run.smithi142.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-02-21T22:53:14.505 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-02-21T22:53:14.505 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T22:53:14.505 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-02-21T22:53:14.535 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T22:53:14.535 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-02-21T22:53:14.592 INFO:teuthology.orchestra.run.smithi142.stdout:client4520 2024-02-21T22:53:14.592 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-02-21T22:53:14.592 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-21T22:53:14.647 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T22:53:14.647 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-02-21T22:53:14.702 INFO:teuthology.orchestra.run.smithi142.stdout:client4520 2024-02-21T22:53:14.702 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T22:53:14.703 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-02-21T22:53:14.759 INFO:teuthology.orchestra.run.smithi142.stdout:client4520 2024-02-21T22:53:14.759 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T22:53:14.759 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/7c298660-5f63-4b5c-a800-58c5be9a8445.client4520/status') 2024-02-21T22:53:14.769 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T22:53:14.772 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T22:53:14.825 INFO:teuthology.orchestra.run.smithi142.stdout:instance: client.4520 (3)192.168.0.2:0/3436408150 2024-02-21T22:53:14.826 INFO:teuthology.orchestra.run.smithi142.stdout:blocklisted: false 2024-02-21T22:53:14.826 INFO:teuthology.orchestra.run.smithi142.stderr:0+1 records in 2024-02-21T22:53:14.826 INFO:teuthology.orchestra.run.smithi142.stderr:0+1 records out 2024-02-21T22:53:14.826 INFO:teuthology.orchestra.run.smithi142.stderr:69 bytes copied, 2.052e-05 s, 3.4 MB/s 2024-02-21T22:53:14.827 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-02-21T22:53:14.843 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-21T22:53:14.954 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:14.960+0000 7f8d819bb640 1 Processor -- start 2024-02-21T22:53:14.954 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:14.960+0000 7f8d819bb640 1 -- start start 2024-02-21T22:53:14.954 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:14.960+0000 7f8d819bb640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8d7c0d1c30 0x7f8d7c0d2430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:14.954 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:14.960+0000 7f8d819bb640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f8d7c0cb930 0x7f8d7c0cbdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:14.954 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:14.960+0000 7f8d819bb640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d7c0cfa50 con 0x7f8d7c0d0510 2024-02-21T22:53:14.954 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:14.960+0000 7f8d819bb640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d7c0d1450 con 0x7f8d7c0cb930 2024-02-21T22:53:14.955 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:14.960+0000 7f8d819bb640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d7c0cfcc0 con 0x7f8d7c0d1c30 2024-02-21T22:53:14.955 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:14.961+0000 7f8d7affd640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f8d7c0d0510 0x7f8d7c0d08f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:46768/0 (socket says 172.21.15.116:46768) 2024-02-21T22:53:14.955 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:14.961+0000 7f8d7affd640 1 -- 172.21.15.116:0/1091195563 learned_addr learned my addr 172.21.15.116:0/1091195563 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-02-21T22:53:14.955 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:14.961+0000 7f8d7a7fc640 1 --2- 172.21.15.116:0/1091195563 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8d7c0d1c30 0x7f8d7c0d2430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:14.955 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:14.961+0000 7f8d7b7fe640 1 --2- 172.21.15.116:0/1091195563 >> v2:172.21.15.142:3300/0 conn(0x7f8d7c0cb930 0x7f8d7c0cbdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:14.955 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:14.961+0000 7f8d79ffb640 1 -- 172.21.15.116:0/1091195563 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2607020915 0 0) 0x7f8d7c0cfa50 con 0x7f8d7c0d0510 2024-02-21T22:53:14.955 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:14.961+0000 7f8d79ffb640 1 -- 172.21.15.116:0/1091195563 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d64003520 con 0x7f8d7c0d0510 2024-02-21T22:53:14.955 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:14.961+0000 7f8d7b7fe640 1 -- 172.21.15.116:0/1091195563 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8d7c0d1c30 msgr2=0x7f8d7c0d2430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:53:14.955 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:14.961+0000 7f8d7b7fe640 1 --2- 172.21.15.116:0/1091195563 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8d7c0d1c30 0x7f8d7c0d2430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:14.955 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:14.961+0000 7f8d7b7fe640 1 -- 172.21.15.116:0/1091195563 >> v1:172.21.15.116:6789/0 conn(0x7f8d7c0d0510 legacy=0x7f8d7c0d08f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:14.955 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:14.961+0000 7f8d7b7fe640 1 -- 172.21.15.116:0/1091195563 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d7c0cffa0 con 0x7f8d7c0cb930 2024-02-21T22:53:14.955 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:14.961+0000 7f8d7a7fc640 1 --2- 172.21.15.116:0/1091195563 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8d7c0d1c30 0x7f8d7c0d2430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T22:53:14.955 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:14.962+0000 7f8d7b7fe640 1 --2- 172.21.15.116:0/1091195563 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8d7c0cb930 0x7f8d7c0cbdc0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f8d6c0097a0 tx=0x7f8d6c02b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f89eba71174d88d2 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:14.955 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:14.962+0000 7f8d79ffb640 1 -- 172.21.15.116:0/1091195563 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d6c0315a0 con 0x7f8d7c0cb930 2024-02-21T22:53:14.955 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:14.962+0000 7f8d79ffb640 1 -- 172.21.15.116:0/1091195563 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d6c037070 con 0x7f8d7c0cb930 2024-02-21T22:53:14.956 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:14.962+0000 7f8d79ffb640 1 -- 172.21.15.116:0/1091195563 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d6c031960 con 0x7f8d7c0cb930 2024-02-21T22:53:14.956 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:14.962+0000 7f8d819bb640 1 -- 172.21.15.116:0/1091195563 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8d7c0cb930 msgr2=0x7f8d7c0cbdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:14.956 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:14.962+0000 7f8d819bb640 1 --2- 172.21.15.116:0/1091195563 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8d7c0cb930 0x7f8d7c0cbdc0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f8d6c0097a0 tx=0x7f8d6c02b840 comp rx=0 tx=0).stop 2024-02-21T22:53:14.956 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:14.962+0000 7f8d819bb640 1 -- 172.21.15.116:0/1091195563 shutdown_connections 2024-02-21T22:53:14.956 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:14.962+0000 7f8d819bb640 1 --2- 172.21.15.116:0/1091195563 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8d7c0cb930 0x7f8d7c0cbdc0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:14.956 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:14.962+0000 7f8d819bb640 1 --2- 172.21.15.116:0/1091195563 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8d7c0d1c30 0x7f8d7c0d2430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:14.956 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:14.962+0000 7f8d819bb640 1 -- 172.21.15.116:0/1091195563 >> 172.21.15.116:0/1091195563 conn(0x7f8d7c0d3e50 msgr2=0x7f8d7c0d4260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:14.956 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:14.963+0000 7f8d819bb640 1 -- 172.21.15.116:0/1091195563 shutdown_connections 2024-02-21T22:53:14.956 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:14.963+0000 7f8d819bb640 1 -- 172.21.15.116:0/1091195563 wait complete. 2024-02-21T22:53:14.956 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:14.964+0000 7f8d819bb640 1 Processor -- start 2024-02-21T22:53:14.956 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:14.964+0000 7f8d819bb640 1 -- start start 2024-02-21T22:53:14.959 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:14.965+0000 7f8d819bb640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8d7c0cb930 0x7f8d7c154da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:14.959 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:14.965+0000 7f8d819bb640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8d7c0d0510 0x7f8d7c160220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:14.959 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:14.965+0000 7f8d819bb640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8d7c0d1c30 0x7f8d7c155540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:14.959 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:14.965+0000 7f8d819bb640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d7c0d2970 con 0x7f8d7c0cb930 2024-02-21T22:53:14.959 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:14.965+0000 7f8d819bb640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d7c15e640 con 0x7f8d7c0d0510 2024-02-21T22:53:14.959 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:14.965+0000 7f8d819bb640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d7c0d2af0 con 0x7f8d7c0d1c30 2024-02-21T22:53:14.959 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:14.965+0000 7f8d7affd640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8d7c0cb930 0x7f8d7c154da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:14.959 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:14.965+0000 7f8d7affd640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8d7c0cb930 0x7f8d7c154da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:45522/0 (socket says 172.21.15.116:45522) 2024-02-21T22:53:14.959 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:14.965+0000 7f8d7affd640 1 -- 172.21.15.116:0/3543246164 learned_addr learned my addr 172.21.15.116:0/3543246164 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:14.959 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:14.965+0000 7f8d7a7fc640 1 --2- 172.21.15.116:0/3543246164 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8d7c0d0510 0x7f8d7c160220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:14.959 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:14.965+0000 7f8d7b7fe640 1 --2- 172.21.15.116:0/3543246164 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8d7c0d1c30 0x7f8d7c155540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:14.959 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:14.965+0000 7f8d7affd640 1 -- 172.21.15.116:0/3543246164 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8d7c0d1c30 msgr2=0x7f8d7c155540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:14.960 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:14.965+0000 7f8d7affd640 1 --2- 172.21.15.116:0/3543246164 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8d7c0d1c30 0x7f8d7c155540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:14.960 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:14.965+0000 7f8d7affd640 1 -- 172.21.15.116:0/3543246164 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8d7c0d0510 msgr2=0x7f8d7c160220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:14.960 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:14.965+0000 7f8d7affd640 1 --2- 172.21.15.116:0/3543246164 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8d7c0d0510 0x7f8d7c160220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:14.960 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:14.965+0000 7f8d7affd640 1 -- 172.21.15.116:0/3543246164 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d7c160970 con 0x7f8d7c0cb930 2024-02-21T22:53:14.960 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:14.965+0000 7f8d7affd640 1 --2- 172.21.15.116:0/3543246164 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8d7c0cb930 0x7f8d7c154da0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f8d7400c430 tx=0x7f8d7400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:14.960 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:14.965+0000 7f8d63fff640 1 -- 172.21.15.116:0/3543246164 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d74017070 con 0x7f8d7c0cb930 2024-02-21T22:53:14.960 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:14.965+0000 7f8d63fff640 1 -- 172.21.15.116:0/3543246164 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d74005ce0 con 0x7f8d7c0cb930 2024-02-21T22:53:14.960 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:14.965+0000 7f8d819bb640 1 -- 172.21.15.116:0/3543246164 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d7c160c50 con 0x7f8d7c0cb930 2024-02-21T22:53:14.960 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:14.965+0000 7f8d63fff640 1 -- 172.21.15.116:0/3543246164 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d740072f0 con 0x7f8d7c0cb930 2024-02-21T22:53:14.960 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:14.965+0000 7f8d819bb640 1 -- 172.21.15.116:0/3543246164 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d7c152df0 con 0x7f8d7c0cb930 2024-02-21T22:53:14.960 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:14.966+0000 7f8d819bb640 1 -- 172.21.15.116:0/3543246164 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d7c161170 con 0x7f8d7c0cb930 2024-02-21T22:53:14.960 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:14.967+0000 7f8d63fff640 1 -- 172.21.15.116:0/3543246164 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f8d7401a070 con 0x7f8d7c0cb930 2024-02-21T22:53:14.960 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:14.967+0000 7f8d63fff640 1 --2- 172.21.15.116:0/3543246164 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f8d6806b4d0 0x7f8d6806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:14.960 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:14.967+0000 7f8d63fff640 1 -- 172.21.15.116:0/3543246164 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8d74089620 con 0x7f8d7c0cb930 2024-02-21T22:53:14.960 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:14.967+0000 7f8d7a7fc640 1 --2- 172.21.15.116:0/3543246164 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f8d6806b4d0 0x7f8d6806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:14.961 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:14.968+0000 7f8d7a7fc640 1 --2- 172.21.15.116:0/3543246164 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f8d6806b4d0 0x7f8d6806d990 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f8d70009bd0 tx=0x7f8d7000b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:14.962 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:14.972+0000 7f8d63fff640 1 -- 172.21.15.116:0/3543246164 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f8d7c161170 con 0x7f8d7c0cb930 2024-02-21T22:53:15.133 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.143+0000 7f8d819bb640 1 -- 172.21.15.116:0/3543246164 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8d7c0752f0 con 0x7f8d7c0cb930 2024-02-21T22:53:15.135 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.144+0000 7f8d63fff640 1 -- 172.21.15.116:0/3543246164 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16653 (secure 0 0 0) 0x7f8d7405ce20 con 0x7f8d7c0cb930 2024-02-21T22:53:15.135 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-02-21T22:53:15.135 INFO:teuthology.orchestra.run.smithi116.stdout:{"epoch":20,"fsid":"7c298660-5f63-4b5c-a800-58c5be9a8445","created":"2024-02-21T22:52:25.994613+0000","modified":"2024-02-21T22:52:51.786454+0000","last_up_change":"2024-02-21T22:52:37.313595+0000","last_in_change":"2024-02-21T22:52:28.176031+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-21T22:52:38.328796+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-21T22:52:48.145152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-21T22:52:49.096955+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4f09126b-b5e4-4876-8b08-f5cbb967388a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":1613202231},{"type":"v1","addr":"172.21.15.116:6809","nonce":1613202231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":1613202231},{"type":"v1","addr":"172.21.15.116:6811","nonce":1613202231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":1613202231},{"type":"v1","addr":"172.21.15.116:6815","nonce":1613202231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":1613202231},{"type":"v1","addr":"172.21.15.116:6813","nonce":1613202231}]},"public_addr":"172.21.15.116:6809/1613202231","cluster_addr":"172.21.15.116:6811/1613202231","heartbeat_back_addr":"172.21.15.116:6815/1613202231","heartbeat_front_addr":"172.21.15.116:6813/1613202231","state":["exists","up"]},{"osd":1,"uuid":"7272c51d-51f9-4536-931d-33ad7a4b377e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6816","nonce":172614746},{"type":"v1","addr":"172.21.15.116:6817","nonce":172614746}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":172614746},{"type":"v1","addr":"172.21.15.116:6819","nonce":172614746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":172614746},{"type":"v1","addr":"172.21.15.116:6823","nonce":172614746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":172614746},{"type":"v1","addr":"172.21.15.116:6821","nonce":172614746}]},"public_addr":"172.21.15.116:6817/172614746","cluster_addr":"172.21.15.116:6819/172614746","heartbeat_back_addr":"172.21.15.116:6823/172614746","heartbeat_front_addr":"172.21.15.116:6821/172614746","state":["exists","up"]},{"osd":2,"uuid":"2589616c-adf1-4187-aac3-735256cf624b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":1029280577},{"type":"v1","addr":"172.21.15.116:6825","nonce":1029280577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":1029280577},{"type":"v1","addr":"172.21.15.116:6827","nonce":1029280577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":1029280577},{"type":"v1","addr":"172.21.15.116:6831","nonce":1029280577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":1029280577},{"type":"v1","addr":"172.21.15.116:6829","nonce":1029280577}]},"public_addr":"172.21.15.116:6825/1029280577","cluster_addr":"172.21.15.116:6827/1029280577","heartbeat_back_addr":"172.21.15.116:6831/1029280577","heartbeat_front_addr":"172.21.15.116:6829/1029280577","state":["exists","up"]},{"osd":3,"uuid":"0fd2e563-7c5b-46f6-82c2-b60c86072c93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":3106627557},{"type":"v1","addr":"172.21.15.116:6801","nonce":3106627557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":3106627557},{"type":"v1","addr":"172.21.15.116:6803","nonce":3106627557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":3106627557},{"type":"v1","addr":"172.21.15.116:6807","nonce":3106627557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":3106627557},{"type":"v1","addr":"172.21.15.116:6805","nonce":3106627557}]},"public_addr":"172.21.15.116:6801/3106627557","cluster_addr":"172.21.15.116:6803/3106627557","heartbeat_back_addr":"172.21.15.116:6807/3106627557","heartbeat_front_addr":"172.21.15.116:6805/3106627557","state":["exists","up"]},{"osd":4,"uuid":"79ae35b7-dda8-4ab8-96ce-47515afde082","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":3231407772},{"type":"v1","addr":"172.21.15.142:6825","nonce":3231407772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":3231407772},{"type":"v1","addr":"172.21.15.142:6827","nonce":3231407772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":3231407772},{"type":"v1","addr":"172.21.15.142:6831","nonce":3231407772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":3231407772},{"type":"v1","addr":"172.21.15.142:6829","nonce":3231407772}]},"public_addr":"172.21.15.142:6825/3231407772","cluster_addr":"172.21.15.142:6827/3231407772","heartbeat_back_addr":"172.21.15.142:6831/3231407772","heartbeat_front_addr":"172.21.15.142:6829/3231407772","state":["exists","up"]},{"osd":5,"uuid":"3166eb2c-3fcf-41c8-9362-45bafaabaa39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":1184158716},{"type":"v1","addr":"172.21.15.142:6817","nonce":1184158716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":1184158716},{"type":"v1","addr":"172.21.15.142:6819","nonce":1184158716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":1184158716},{"type":"v1","addr":"172.21.15.142:6823","nonce":1184158716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":1184158716},{"type":"v1","addr":"172.21.15.142:6821","nonce":1184158716}]},"public_addr":"172.21.15.142:6817/1184158716","cluster_addr":"172.21.15.142:6819/1184158716","heartbeat_back_addr":"172.21.15.142:6823/1184158716","heartbeat_front_addr":"172.21.15.142:6821/1184158716","state":["exists","up"]},{"osd":6,"uuid":"f9aa9672-7527-43e2-963e-b61868e5e63f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":1987868911},{"type":"v1","addr":"172.21.15.142:6801","nonce":1987868911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":1987868911},{"type":"v1","addr":"172.21.15.142:6803","nonce":1987868911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":1987868911},{"type":"v1","addr":"172.21.15.142:6807","nonce":1987868911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":1987868911},{"type":"v1","addr":"172.21.15.142:6805","nonce":1987868911}]},"public_addr":"172.21.15.142:6801/1987868911","cluster_addr":"172.21.15.142:6803/1987868911","heartbeat_back_addr":"172.21.15.142:6807/1987868911","heartbeat_front_addr":"172.21.15.142:6805/1987868911","state":["exists","up"]},{"osd":7,"uuid":"7ed29226-fc42-4382-a91a-fa50f7ec5426","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":1272081937},{"type":"v1","addr":"172.21.15.142:6809","nonce":1272081937}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":1272081937},{"type":"v1","addr":"172.21.15.142:6811","nonce":1272081937}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":1272081937},{"type":"v1","addr":"172.21.15.142:6815","nonce":1272081937}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":1272081937},{"type":"v1","addr":"172.21.15.142:6813","nonce":1272081937}]},"public_addr":"172.21.15.142:6809/1272081937","cluster_addr":"172.21.15.142:6811/1272081937","heartbeat_back_addr":"172.21.15.142:6815/1272081937","heartbeat_front_addr":"172.21.15.142:6813/1272081937","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.350998+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.307201+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.289112+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.243888+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.312091+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.370472+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.275659+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.289297+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-21T22:53:15.137 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.146+0000 7f8d819bb640 1 -- 172.21.15.116:0/3543246164 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f8d6806b4d0 msgr2=0x7f8d6806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:15.137 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.146+0000 7f8d819bb640 1 --2- 172.21.15.116:0/3543246164 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f8d6806b4d0 0x7f8d6806d990 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f8d70009bd0 tx=0x7f8d7000b040 comp rx=0 tx=0).stop 2024-02-21T22:53:15.137 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.146+0000 7f8d819bb640 1 -- 172.21.15.116:0/3543246164 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8d7c0cb930 msgr2=0x7f8d7c154da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:15.137 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.146+0000 7f8d819bb640 1 --2- 172.21.15.116:0/3543246164 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8d7c0cb930 0x7f8d7c154da0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f8d7400c430 tx=0x7f8d7400c8f0 comp rx=0 tx=0).stop 2024-02-21T22:53:15.137 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.146+0000 7f8d819bb640 1 -- 172.21.15.116:0/3543246164 shutdown_connections 2024-02-21T22:53:15.137 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.146+0000 7f8d819bb640 1 --2- 172.21.15.116:0/3543246164 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f8d6806b4d0 0x7f8d6806d990 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:15.137 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.146+0000 7f8d819bb640 1 --2- 172.21.15.116:0/3543246164 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8d7c0d1c30 0x7f8d7c155540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:15.137 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.146+0000 7f8d819bb640 1 --2- 172.21.15.116:0/3543246164 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8d7c0d0510 0x7f8d7c160220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:15.137 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.146+0000 7f8d819bb640 1 --2- 172.21.15.116:0/3543246164 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8d7c0cb930 0x7f8d7c154da0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:15.138 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.146+0000 7f8d819bb640 1 -- 172.21.15.116:0/3543246164 >> 172.21.15.116:0/3543246164 conn(0x7f8d7c0d3e50 msgr2=0x7f8d7c0cb0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:15.138 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.146+0000 7f8d819bb640 1 -- 172.21.15.116:0/3543246164 shutdown_connections 2024-02-21T22:53:15.138 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.146+0000 7f8d819bb640 1 -- 172.21.15.116:0/3543246164 wait complete. 2024-02-21T22:53:15.149 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-21T22:52:38.328796+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-02-21T22:52:48.145152+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-02-21T22:52:49.096955+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-21T22:53:15.149 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-21T22:53:15.252 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.261+0000 7f6f2ac0f640 1 Processor -- start 2024-02-21T22:53:15.252 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.261+0000 7f6f2ac0f640 1 -- start start 2024-02-21T22:53:15.253 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.262+0000 7f6f2ac0f640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f6f241456c0 0x7f6f240b2260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:15.253 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.262+0000 7f6f2ac0f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6f241604a0 0x7f6f2406d030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:15.253 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.262+0000 7f6f2ac0f640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f240b3c30 con 0x7f6f2415f920 2024-02-21T22:53:15.253 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.262+0000 7f6f2ac0f640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f240b3f10 con 0x7f6f241456c0 2024-02-21T22:53:15.254 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.262+0000 7f6f2ac0f640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f240b41f0 con 0x7f6f241604a0 2024-02-21T22:53:15.254 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.262+0000 7f6f291ac640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6f241604a0 0x7f6f2406d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:15.254 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.262+0000 7f6f289ab640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f6f241456c0 0x7f6f240b2260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:15.254 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.262+0000 7f6f291ac640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6f241604a0 0x7f6f2406d030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.116:57152/0 (socket says 172.21.15.116:57152) 2024-02-21T22:53:15.254 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.262+0000 7f6f23fff640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f6f2415f920 0x7f6f2415fd90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.116:37002/0 (socket says 172.21.15.116:37002) 2024-02-21T22:53:15.254 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.262+0000 7f6f289ab640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f6f241456c0 0x7f6f240b2260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.116:39032/0 (socket says 172.21.15.116:39032) 2024-02-21T22:53:15.254 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.262+0000 7f6f291ac640 1 -- 172.21.15.116:0/3896185638 learned_addr learned my addr 172.21.15.116:0/3896185638 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:15.254 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.263+0000 7f6f289ab640 1 -- 172.21.15.116:0/3896185638 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6f241604a0 msgr2=0x7f6f2406d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:53:15.254 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.263+0000 7f6f289ab640 1 --2- 172.21.15.116:0/3896185638 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6f241604a0 0x7f6f2406d030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:15.254 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.263+0000 7f6f289ab640 1 -- 172.21.15.116:0/3896185638 >> v1:172.21.15.142:6789/0 conn(0x7f6f2415f920 legacy=0x7f6f2415fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:15.254 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.263+0000 7f6f289ab640 1 -- 172.21.15.116:0/3896185638 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f2406cb10 con 0x7f6f241456c0 2024-02-21T22:53:15.254 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.263+0000 7f6f237fe640 1 -- 172.21.15.116:0/3896185638 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2203033450 0 0) 0x7f6f240b3c30 con 0x7f6f2415f920 2024-02-21T22:53:15.256 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.263+0000 7f6f289ab640 1 --2- 172.21.15.116:0/3896185638 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f241456c0 0x7f6f240b2260 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f6f140097a0 tx=0x7f6f1402b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=edab84e9f89bef91 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:15.256 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.264+0000 7f6f237fe640 1 -- 172.21.15.116:0/3896185638 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f140315a0 con 0x7f6f241456c0 2024-02-21T22:53:15.256 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.264+0000 7f6f237fe640 1 -- 172.21.15.116:0/3896185638 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f14037070 con 0x7f6f241456c0 2024-02-21T22:53:15.256 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.264+0000 7f6f237fe640 1 -- 172.21.15.116:0/3896185638 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f14031960 con 0x7f6f241456c0 2024-02-21T22:53:15.256 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.264+0000 7f6f2ac0f640 1 -- 172.21.15.116:0/3896185638 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f241456c0 msgr2=0x7f6f240b2260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:15.256 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.264+0000 7f6f2ac0f640 1 --2- 172.21.15.116:0/3896185638 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f241456c0 0x7f6f240b2260 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f6f140097a0 tx=0x7f6f1402b840 comp rx=0 tx=0).stop 2024-02-21T22:53:15.256 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.264+0000 7f6f2ac0f640 1 -- 172.21.15.116:0/3896185638 shutdown_connections 2024-02-21T22:53:15.256 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.264+0000 7f6f2ac0f640 1 --2- 172.21.15.116:0/3896185638 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6f241604a0 0x7f6f2406d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:15.257 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.264+0000 7f6f2ac0f640 1 --2- 172.21.15.116:0/3896185638 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f241456c0 0x7f6f240b2260 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:15.257 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.264+0000 7f6f2ac0f640 1 -- 172.21.15.116:0/3896185638 >> 172.21.15.116:0/3896185638 conn(0x7f6f240b1740 msgr2=0x7f6f240b1b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:15.257 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.264+0000 7f6f2ac0f640 1 -- 172.21.15.116:0/3896185638 shutdown_connections 2024-02-21T22:53:15.257 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.264+0000 7f6f2ac0f640 1 -- 172.21.15.116:0/3896185638 wait complete. 2024-02-21T22:53:15.257 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.265+0000 7f6f2ac0f640 1 Processor -- start 2024-02-21T22:53:15.257 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.265+0000 7f6f2ac0f640 1 -- start start 2024-02-21T22:53:15.259 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.266+0000 7f6f2ac0f640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6f241456c0 0x7f6f2415e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:15.259 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.266+0000 7f6f2ac0f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6f2415f920 0x7f6f2413af60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:15.260 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.266+0000 7f6f2ac0f640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f241604a0 0x7f6f2413b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:15.260 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.266+0000 7f6f2ac0f640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f2406d6f0 con 0x7f6f241456c0 2024-02-21T22:53:15.260 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.266+0000 7f6f2ac0f640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f2406d570 con 0x7f6f241604a0 2024-02-21T22:53:15.260 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.266+0000 7f6f2ac0f640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f2406d870 con 0x7f6f2415f920 2024-02-21T22:53:15.260 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.266+0000 7f6f289ab640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6f241456c0 0x7f6f2415e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:15.260 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.266+0000 7f6f289ab640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6f241456c0 0x7f6f2415e280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:45524/0 (socket says 172.21.15.116:45524) 2024-02-21T22:53:15.260 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.266+0000 7f6f289ab640 1 -- 172.21.15.116:0/2717398383 learned_addr learned my addr 172.21.15.116:0/2717398383 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:15.260 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.266+0000 7f6f23fff640 1 --2- 172.21.15.116:0/2717398383 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6f2415f920 0x7f6f2413af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:15.260 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.266+0000 7f6f291ac640 1 --2- 172.21.15.116:0/2717398383 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f241604a0 0x7f6f2413b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:15.260 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.267+0000 7f6f289ab640 1 -- 172.21.15.116:0/2717398383 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6f2415f920 msgr2=0x7f6f2413af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:15.260 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.267+0000 7f6f289ab640 1 --2- 172.21.15.116:0/2717398383 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6f2415f920 0x7f6f2413af60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:15.260 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.267+0000 7f6f289ab640 1 -- 172.21.15.116:0/2717398383 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f241604a0 msgr2=0x7f6f2413b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:15.261 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.267+0000 7f6f289ab640 1 --2- 172.21.15.116:0/2717398383 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f241604a0 0x7f6f2413b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:15.261 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.267+0000 7f6f289ab640 1 -- 172.21.15.116:0/2717398383 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f24071650 con 0x7f6f241456c0 2024-02-21T22:53:15.261 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.267+0000 7f6f289ab640 1 --2- 172.21.15.116:0/2717398383 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6f241456c0 0x7f6f2415e280 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f6f140098c0 tx=0x7f6f140046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:15.261 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.267+0000 7f6f217fa640 1 -- 172.21.15.116:0/2717398383 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f14032630 con 0x7f6f241456c0 2024-02-21T22:53:15.261 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.267+0000 7f6f217fa640 1 -- 172.21.15.116:0/2717398383 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f140327f0 con 0x7f6f241456c0 2024-02-21T22:53:15.261 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.267+0000 7f6f2ac0f640 1 -- 172.21.15.116:0/2717398383 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f24071930 con 0x7f6f241456c0 2024-02-21T22:53:15.262 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.267+0000 7f6f217fa640 1 -- 172.21.15.116:0/2717398383 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f14032be0 con 0x7f6f241456c0 2024-02-21T22:53:15.262 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.267+0000 7f6f2ac0f640 1 -- 172.21.15.116:0/2717398383 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f24071ef0 con 0x7f6f241456c0 2024-02-21T22:53:15.262 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.268+0000 7f6f2ac0f640 1 -- 172.21.15.116:0/2717398383 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f240752f0 con 0x7f6f241456c0 2024-02-21T22:53:15.262 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.268+0000 7f6f217fa640 1 -- 172.21.15.116:0/2717398383 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f6f1404e430 con 0x7f6f241456c0 2024-02-21T22:53:15.262 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.269+0000 7f6f217fa640 1 --2- 172.21.15.116:0/2717398383 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f6f1006b4d0 0x7f6f1006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:15.262 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.269+0000 7f6f217fa640 1 -- 172.21.15.116:0/2717398383 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6f1402f030 con 0x7f6f241456c0 2024-02-21T22:53:15.262 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.269+0000 7f6f23fff640 1 --2- 172.21.15.116:0/2717398383 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f6f1006b4d0 0x7f6f1006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:15.262 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.269+0000 7f6f23fff640 1 --2- 172.21.15.116:0/2717398383 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f6f1006b4d0 0x7f6f1006d990 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f6f2415dfa0 tx=0x7f6f18007d50 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:15.263 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.273+0000 7f6f217fa640 1 -- 172.21.15.116:0/2717398383 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f6f14040070 con 0x7f6f241456c0 2024-02-21T22:53:15.433 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.442+0000 7f6f2ac0f640 1 -- 172.21.15.116:0/2717398383 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6f240cef90 con 0x7f6f241456c0 2024-02-21T22:53:15.433 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.442+0000 7f6f217fa640 1 -- 172.21.15.116:0/2717398383 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6f1407a790 con 0x7f6f241456c0 2024-02-21T22:53:15.433 INFO:teuthology.orchestra.run.smithi116.stdout:pg_num: 1 2024-02-21T22:53:15.435 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.445+0000 7f6f2ac0f640 1 -- 172.21.15.116:0/2717398383 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f6f1006b4d0 msgr2=0x7f6f1006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:15.435 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.445+0000 7f6f2ac0f640 1 --2- 172.21.15.116:0/2717398383 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f6f1006b4d0 0x7f6f1006d990 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f6f2415dfa0 tx=0x7f6f18007d50 comp rx=0 tx=0).stop 2024-02-21T22:53:15.435 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.445+0000 7f6f2ac0f640 1 -- 172.21.15.116:0/2717398383 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6f241456c0 msgr2=0x7f6f2415e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:15.435 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.445+0000 7f6f2ac0f640 1 --2- 172.21.15.116:0/2717398383 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6f241456c0 0x7f6f2415e280 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f6f140098c0 tx=0x7f6f140046c0 comp rx=0 tx=0).stop 2024-02-21T22:53:15.435 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.445+0000 7f6f2ac0f640 1 -- 172.21.15.116:0/2717398383 shutdown_connections 2024-02-21T22:53:15.435 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.445+0000 7f6f2ac0f640 1 --2- 172.21.15.116:0/2717398383 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f241604a0 0x7f6f2413b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:15.436 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.445+0000 7f6f2ac0f640 1 --2- 172.21.15.116:0/2717398383 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f6f1006b4d0 0x7f6f1006d990 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:15.436 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.445+0000 7f6f2ac0f640 1 --2- 172.21.15.116:0/2717398383 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6f2415f920 0x7f6f2413af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:15.436 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.445+0000 7f6f2ac0f640 1 --2- 172.21.15.116:0/2717398383 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6f241456c0 0x7f6f2415e280 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:15.436 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.445+0000 7f6f2ac0f640 1 -- 172.21.15.116:0/2717398383 >> 172.21.15.116:0/2717398383 conn(0x7f6f240b1740 msgr2=0x7f6f240b3010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:15.436 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.445+0000 7f6f2ac0f640 1 -- 172.21.15.116:0/2717398383 shutdown_connections 2024-02-21T22:53:15.436 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.445+0000 7f6f2ac0f640 1 -- 172.21.15.116:0/2717398383 wait complete. 2024-02-21T22:53:15.446 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-02-21T22:53:15.549 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.558+0000 7fa44db74640 1 Processor -- start 2024-02-21T22:53:15.549 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.558+0000 7fa44db74640 1 -- start start 2024-02-21T22:53:15.551 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.559+0000 7fa44db74640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa44806ae40 0x7fa44806b220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:15.552 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.559+0000 7fa44db74640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fa448066f20 0x7fa4480b0c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:15.552 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.559+0000 7fa44db74640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa44806b760 con 0x7fa4480cfef0 2024-02-21T22:53:15.552 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.559+0000 7fa44db74640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4480b1450 con 0x7fa448066f20 2024-02-21T22:53:15.552 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.559+0000 7fa44db74640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4480ad270 con 0x7fa44806ae40 2024-02-21T22:53:15.552 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.559+0000 7fa446ffd640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fa448066f20 0x7fa4480b0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:15.552 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.559+0000 7fa447fff640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7fa4480cfef0 0x7fa4480d0380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:54800/0 (socket says 172.21.15.116:54800) 2024-02-21T22:53:15.552 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.559+0000 7fa447fff640 1 -- 172.21.15.116:0/3933511444 learned_addr learned my addr 172.21.15.116:0/3933511444 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-02-21T22:53:15.552 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.559+0000 7fa4477fe640 1 --2- 172.21.15.116:0/3933511444 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa44806ae40 0x7fa44806b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:15.552 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.559+0000 7fa446ffd640 1 -- 172.21.15.116:0/3933511444 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa44806ae40 msgr2=0x7fa44806b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:53:15.552 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.559+0000 7fa446ffd640 1 --2- 172.21.15.116:0/3933511444 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa44806ae40 0x7fa44806b220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:15.552 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.559+0000 7fa446ffd640 1 -- 172.21.15.116:0/3933511444 >> v1:172.21.15.116:6789/0 conn(0x7fa4480cfef0 legacy=0x7fa4480d0380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:15.552 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.559+0000 7fa446ffd640 1 -- 172.21.15.116:0/3933511444 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4480ad550 con 0x7fa448066f20 2024-02-21T22:53:15.552 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.560+0000 7fa446ffd640 1 --2- 172.21.15.116:0/3933511444 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa448066f20 0x7fa4480b0c00 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fa43c0097a0 tx=0x7fa43c02b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d7da0108f3ac0e2 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:15.553 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.560+0000 7fa4467fc640 1 -- 172.21.15.116:0/3933511444 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa43c034070 con 0x7fa448066f20 2024-02-21T22:53:15.553 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.560+0000 7fa4467fc640 1 -- 172.21.15.116:0/3933511444 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa43c030610 con 0x7fa448066f20 2024-02-21T22:53:15.553 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.560+0000 7fa4467fc640 1 -- 172.21.15.116:0/3933511444 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa43c0309e0 con 0x7fa448066f20 2024-02-21T22:53:15.553 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.561+0000 7fa44db74640 1 -- 172.21.15.116:0/3933511444 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa448066f20 msgr2=0x7fa4480b0c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:15.553 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.561+0000 7fa44db74640 1 --2- 172.21.15.116:0/3933511444 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa448066f20 0x7fa4480b0c00 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fa43c0097a0 tx=0x7fa43c02b960 comp rx=0 tx=0).stop 2024-02-21T22:53:15.553 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.561+0000 7fa44db74640 1 -- 172.21.15.116:0/3933511444 shutdown_connections 2024-02-21T22:53:15.553 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.561+0000 7fa44db74640 1 --2- 172.21.15.116:0/3933511444 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa448066f20 0x7fa4480b0c00 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:15.553 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.561+0000 7fa44db74640 1 --2- 172.21.15.116:0/3933511444 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa44806ae40 0x7fa44806b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:15.553 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.561+0000 7fa44db74640 1 -- 172.21.15.116:0/3933511444 >> 172.21.15.116:0/3933511444 conn(0x7fa4480b3250 msgr2=0x7fa4480b3660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:15.553 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.561+0000 7fa44db74640 1 -- 172.21.15.116:0/3933511444 shutdown_connections 2024-02-21T22:53:15.553 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.561+0000 7fa44db74640 1 -- 172.21.15.116:0/3933511444 wait complete. 2024-02-21T22:53:15.555 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.562+0000 7fa44db74640 1 Processor -- start 2024-02-21T22:53:15.555 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.562+0000 7fa44db74640 1 -- start start 2024-02-21T22:53:15.556 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.563+0000 7fa44db74640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa448066f20 0x7fa448157ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:15.556 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.563+0000 7fa44db74640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa44806ae40 0x7fa4480c3ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:15.556 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.563+0000 7fa44db74640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa4480cfef0 0x7fa4480c43e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:15.556 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.563+0000 7fa44db74640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4480d0a90 con 0x7fa448066f20 2024-02-21T22:53:15.556 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.563+0000 7fa44db74640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4480b1140 con 0x7fa4480cfef0 2024-02-21T22:53:15.556 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.563+0000 7fa44db74640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4480d0c10 con 0x7fa44806ae40 2024-02-21T22:53:15.556 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.563+0000 7fa4477fe640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa448066f20 0x7fa448157ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:15.556 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.563+0000 7fa4477fe640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa448066f20 0x7fa448157ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:38266/0 (socket says 172.21.15.116:38266) 2024-02-21T22:53:15.556 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.563+0000 7fa4477fe640 1 -- 172.21.15.116:0/3725142030 learned_addr learned my addr 172.21.15.116:0/3725142030 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:15.557 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.563+0000 7fa446ffd640 1 --2- 172.21.15.116:0/3725142030 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa44806ae40 0x7fa4480c3ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:15.557 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.563+0000 7fa447fff640 1 --2- 172.21.15.116:0/3725142030 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa4480cfef0 0x7fa4480c43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:15.557 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.564+0000 7fa4477fe640 1 -- 172.21.15.116:0/3725142030 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa44806ae40 msgr2=0x7fa4480c3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:15.557 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.564+0000 7fa4477fe640 1 --2- 172.21.15.116:0/3725142030 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa44806ae40 0x7fa4480c3ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:15.557 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.564+0000 7fa4477fe640 1 -- 172.21.15.116:0/3725142030 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa4480cfef0 msgr2=0x7fa4480c43e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:15.557 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.564+0000 7fa4477fe640 1 --2- 172.21.15.116:0/3725142030 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa4480cfef0 0x7fa4480c43e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:15.557 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.564+0000 7fa4477fe640 1 -- 172.21.15.116:0/3725142030 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4480c7470 con 0x7fa448066f20 2024-02-21T22:53:15.557 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.564+0000 7fa4477fe640 1 --2- 172.21.15.116:0/3725142030 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa448066f20 0x7fa448157ac0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fa43800e9b0 tx=0x7fa43800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:15.557 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.564+0000 7fa42ffff640 1 -- 172.21.15.116:0/3725142030 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa438017070 con 0x7fa448066f20 2024-02-21T22:53:15.557 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.564+0000 7fa42ffff640 1 -- 172.21.15.116:0/3725142030 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa43800c9a0 con 0x7fa448066f20 2024-02-21T22:53:15.557 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.564+0000 7fa42ffff640 1 -- 172.21.15.116:0/3725142030 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa43800cd90 con 0x7fa448066f20 2024-02-21T22:53:15.557 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.564+0000 7fa44db74640 1 -- 172.21.15.116:0/3725142030 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4480c7750 con 0x7fa448066f20 2024-02-21T22:53:15.557 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.564+0000 7fa44db74640 1 -- 172.21.15.116:0/3725142030 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4480c7d10 con 0x7fa448066f20 2024-02-21T22:53:15.557 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.565+0000 7fa44db74640 1 -- 172.21.15.116:0/3725142030 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4480752f0 con 0x7fa448066f20 2024-02-21T22:53:15.557 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.565+0000 7fa42ffff640 1 -- 172.21.15.116:0/3725142030 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fa43801a070 con 0x7fa448066f20 2024-02-21T22:53:15.558 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.566+0000 7fa42ffff640 1 --2- 172.21.15.116:0/3725142030 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fa43406b4d0 0x7fa43406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:15.558 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.566+0000 7fa42ffff640 1 -- 172.21.15.116:0/3725142030 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa43808a4a0 con 0x7fa448066f20 2024-02-21T22:53:15.558 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.566+0000 7fa446ffd640 1 --2- 172.21.15.116:0/3725142030 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fa43406b4d0 0x7fa43406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:15.558 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.566+0000 7fa446ffd640 1 --2- 172.21.15.116:0/3725142030 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fa43406b4d0 0x7fa43406d990 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fa43c036000 tx=0x7fa43c03c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:15.560 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.571+0000 7fa42ffff640 1 -- 172.21.15.116:0/3725142030 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7fa438058d60 con 0x7fa448066f20 2024-02-21T22:53:15.731 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.740+0000 7fa44db74640 1 -- 172.21.15.116:0/3725142030 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa44806d340 con 0x7fa448066f20 2024-02-21T22:53:15.732 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.741+0000 7fa42ffff640 1 -- 172.21.15.116:0/3725142030 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa43805ce00 con 0x7fa448066f20 2024-02-21T22:53:15.732 INFO:teuthology.orchestra.run.smithi116.stdout:pg_num: 32 2024-02-21T22:53:15.734 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.744+0000 7fa44db74640 1 -- 172.21.15.116:0/3725142030 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fa43406b4d0 msgr2=0x7fa43406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:15.734 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.744+0000 7fa44db74640 1 --2- 172.21.15.116:0/3725142030 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fa43406b4d0 0x7fa43406d990 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fa43c036000 tx=0x7fa43c03c040 comp rx=0 tx=0).stop 2024-02-21T22:53:15.734 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.744+0000 7fa44db74640 1 -- 172.21.15.116:0/3725142030 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa448066f20 msgr2=0x7fa448157ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:15.734 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.744+0000 7fa44db74640 1 --2- 172.21.15.116:0/3725142030 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa448066f20 0x7fa448157ac0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fa43800e9b0 tx=0x7fa43800ee70 comp rx=0 tx=0).stop 2024-02-21T22:53:15.734 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.744+0000 7fa44db74640 1 -- 172.21.15.116:0/3725142030 shutdown_connections 2024-02-21T22:53:15.734 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.744+0000 7fa44db74640 1 --2- 172.21.15.116:0/3725142030 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa4480cfef0 0x7fa4480c43e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:15.734 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.744+0000 7fa44db74640 1 --2- 172.21.15.116:0/3725142030 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fa43406b4d0 0x7fa43406d990 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:15.734 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.744+0000 7fa44db74640 1 --2- 172.21.15.116:0/3725142030 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa44806ae40 0x7fa4480c3ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:15.734 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.744+0000 7fa44db74640 1 --2- 172.21.15.116:0/3725142030 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa448066f20 0x7fa448157ac0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:15.734 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.744+0000 7fa44db74640 1 -- 172.21.15.116:0/3725142030 >> 172.21.15.116:0/3725142030 conn(0x7fa4480b3250 msgr2=0x7fa4480b0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:15.734 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.744+0000 7fa44db74640 1 -- 172.21.15.116:0/3725142030 shutdown_connections 2024-02-21T22:53:15.734 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.744+0000 7fa44db74640 1 -- 172.21.15.116:0/3725142030 wait complete. 2024-02-21T22:53:15.744 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-02-21T22:53:15.847 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.856+0000 7f388e436640 1 Processor -- start 2024-02-21T22:53:15.847 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.856+0000 7f388e436640 1 -- start start 2024-02-21T22:53:15.848 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.857+0000 7f388e436640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f38880d2b10 0x7f38880d4940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:15.848 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.857+0000 7f388e436640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f388815da70 0x7f388815df20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:15.848 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.857+0000 7f388e436640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38880ceea0 con 0x7f38880d0ca0 2024-02-21T22:53:15.849 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.857+0000 7f388e436640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38880cf180 con 0x7f38880d2b10 2024-02-21T22:53:15.849 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.857+0000 7f388e436640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38880cf460 con 0x7f388815da70 2024-02-21T22:53:15.849 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.857+0000 7f38877fe640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f38880d2b10 0x7f38880d4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:15.849 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.857+0000 7f388c9d3640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f388815da70 0x7f388815df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:15.849 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.857+0000 7f3887fff640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f38880d0ca0 0x7f38880d2400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.116:59388/0 (socket says 172.21.15.116:59388) 2024-02-21T22:53:15.849 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.857+0000 7f3887fff640 1 -- 172.21.15.116:0/333053248 learned_addr learned my addr 172.21.15.116:0/333053248 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-02-21T22:53:15.849 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.858+0000 7f38877fe640 1 -- 172.21.15.116:0/333053248 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f388815da70 msgr2=0x7f388815df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:53:15.849 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.858+0000 7f38877fe640 1 --2- 172.21.15.116:0/333053248 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f388815da70 0x7f388815df20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:15.849 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.858+0000 7f38877fe640 1 -- 172.21.15.116:0/333053248 >> v1:172.21.15.142:6789/0 conn(0x7f38880d0ca0 legacy=0x7f38880d2400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:15.849 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.858+0000 7f38877fe640 1 -- 172.21.15.116:0/333053248 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38880cf740 con 0x7f38880d2b10 2024-02-21T22:53:15.849 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.858+0000 7f3886ffd640 1 -- 172.21.15.116:0/333053248 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 40713254 0 0) 0x7f38880ceea0 con 0x7f38880d0ca0 2024-02-21T22:53:15.849 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.858+0000 7f388c9d3640 1 --2- 172.21.15.116:0/333053248 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f388815da70 0x7f388815df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T22:53:15.851 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.858+0000 7f38877fe640 1 --2- 172.21.15.116:0/333053248 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f38880d2b10 0x7f38880d4940 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f387c0097a0 tx=0x7f387c02b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=34e57bcf38b1b20a server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:15.851 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.859+0000 7f3886ffd640 1 -- 172.21.15.116:0/333053248 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f387c034070 con 0x7f38880d2b10 2024-02-21T22:53:15.851 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.859+0000 7f3886ffd640 1 -- 172.21.15.116:0/333053248 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f387c030610 con 0x7f38880d2b10 2024-02-21T22:53:15.851 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.859+0000 7f3886ffd640 1 -- 172.21.15.116:0/333053248 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f387c0309e0 con 0x7f38880d2b10 2024-02-21T22:53:15.851 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.859+0000 7f388e436640 1 -- 172.21.15.116:0/333053248 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f38880d2b10 msgr2=0x7f38880d4940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:15.851 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.859+0000 7f388e436640 1 --2- 172.21.15.116:0/333053248 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f38880d2b10 0x7f38880d4940 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f387c0097a0 tx=0x7f387c02b960 comp rx=0 tx=0).stop 2024-02-21T22:53:15.851 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.859+0000 7f388e436640 1 -- 172.21.15.116:0/333053248 shutdown_connections 2024-02-21T22:53:15.851 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.859+0000 7f388e436640 1 --2- 172.21.15.116:0/333053248 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f388815da70 0x7f388815df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:15.851 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.859+0000 7f388e436640 1 --2- 172.21.15.116:0/333053248 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f38880d2b10 0x7f38880d4940 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:15.851 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.859+0000 7f388e436640 1 -- 172.21.15.116:0/333053248 >> 172.21.15.116:0/333053248 conn(0x7f38880d3e20 msgr2=0x7f38880d4230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:15.851 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.859+0000 7f388e436640 1 -- 172.21.15.116:0/333053248 shutdown_connections 2024-02-21T22:53:15.851 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.859+0000 7f388e436640 1 -- 172.21.15.116:0/333053248 wait complete. 2024-02-21T22:53:15.852 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.860+0000 7f388e436640 1 Processor -- start 2024-02-21T22:53:15.852 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.860+0000 7f388e436640 1 -- start start 2024-02-21T22:53:15.853 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.861+0000 7f388e436640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f38880d0ca0 0x7f38880c9aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:15.854 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.861+0000 7f388e436640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f38880d2b10 0x7f38880ccd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:15.854 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.861+0000 7f388e436640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f388815da70 0x7f388806c410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:15.854 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.861+0000 7f388e436640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38880d1200 con 0x7f388815da70 2024-02-21T22:53:15.854 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.861+0000 7f388e436640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38880d1080 con 0x7f38880d2b10 2024-02-21T22:53:15.854 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.861+0000 7f388e436640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38880ceaa0 con 0x7f38880d0ca0 2024-02-21T22:53:15.854 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.861+0000 7f388c9d3640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f388815da70 0x7f388806c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:15.854 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.861+0000 7f3887fff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f38880d0ca0 0x7f38880c9aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:15.854 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.861+0000 7f388c9d3640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f388815da70 0x7f388806c410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:38276/0 (socket says 172.21.15.116:38276) 2024-02-21T22:53:15.854 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.861+0000 7f388c9d3640 1 -- 172.21.15.116:0/2640353433 learned_addr learned my addr 172.21.15.116:0/2640353433 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:15.854 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.861+0000 7f38877fe640 1 --2- 172.21.15.116:0/2640353433 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f38880d2b10 0x7f38880ccd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:15.854 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.862+0000 7f3887fff640 1 -- 172.21.15.116:0/2640353433 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f38880d2b10 msgr2=0x7f38880ccd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:15.854 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.862+0000 7f3887fff640 1 --2- 172.21.15.116:0/2640353433 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f38880d2b10 0x7f38880ccd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:15.854 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.862+0000 7f3887fff640 1 -- 172.21.15.116:0/2640353433 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f388815da70 msgr2=0x7f388806c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:15.854 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.862+0000 7f3887fff640 1 --2- 172.21.15.116:0/2640353433 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f388815da70 0x7f388806c410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:15.855 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.862+0000 7f3887fff640 1 -- 172.21.15.116:0/2640353433 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38880cd7e0 con 0x7f38880d0ca0 2024-02-21T22:53:15.855 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.862+0000 7f388c9d3640 1 --2- 172.21.15.116:0/2640353433 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f388815da70 0x7f388806c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T22:53:15.855 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.862+0000 7f3887fff640 1 --2- 172.21.15.116:0/2640353433 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f38880d0ca0 0x7f38880c9aa0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f387800c450 tx=0x7f387800c910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:15.855 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.862+0000 7f3884ff9640 1 -- 172.21.15.116:0/2640353433 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3878018070 con 0x7f38880d0ca0 2024-02-21T22:53:15.855 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.862+0000 7f3884ff9640 1 -- 172.21.15.116:0/2640353433 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38780074e0 con 0x7f38880d0ca0 2024-02-21T22:53:15.855 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.862+0000 7f3884ff9640 1 -- 172.21.15.116:0/2640353433 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3878004a20 con 0x7f38880d0ca0 2024-02-21T22:53:15.855 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.862+0000 7f388e436640 1 -- 172.21.15.116:0/2640353433 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38880b6ae0 con 0x7f38880d0ca0 2024-02-21T22:53:15.855 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.862+0000 7f388e436640 1 -- 172.21.15.116:0/2640353433 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38880b70a0 con 0x7f38880d0ca0 2024-02-21T22:53:15.855 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.863+0000 7f388e436640 1 -- 172.21.15.116:0/2640353433 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38880752f0 con 0x7f38880d0ca0 2024-02-21T22:53:15.855 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.863+0000 7f3884ff9640 1 -- 172.21.15.116:0/2640353433 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f387801b070 con 0x7f38880d0ca0 2024-02-21T22:53:15.856 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.864+0000 7f3884ff9640 1 --2- 172.21.15.116:0/2640353433 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f387406b4d0 0x7f387406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:15.856 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.864+0000 7f3884ff9640 1 -- 172.21.15.116:0/2640353433 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f38780893f0 con 0x7f38880d0ca0 2024-02-21T22:53:15.856 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.864+0000 7f38877fe640 1 --2- 172.21.15.116:0/2640353433 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f387406b4d0 0x7f387406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:15.856 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.864+0000 7f38877fe640 1 --2- 172.21.15.116:0/2640353433 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f387406b4d0 0x7f387406d990 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f387c036000 tx=0x7f387c03b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:15.859 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:15.869+0000 7f3884ff9640 1 -- 172.21.15.116:0/2640353433 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f3878057c20 con 0x7f38880d0ca0 2024-02-21T22:53:16.031 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.040+0000 7f388e436640 1 -- 172.21.15.116:0/2640353433 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3888161980 con 0x7f38880d0ca0 2024-02-21T22:53:16.047 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.040+0000 7f3884ff9640 1 -- 172.21.15.116:0/2640353433 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f387805bcc0 con 0x7f38880d0ca0 2024-02-21T22:53:16.047 INFO:teuthology.orchestra.run.smithi116.stdout:pg_num: 64 2024-02-21T22:53:16.049 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.042+0000 7f388e436640 1 -- 172.21.15.116:0/2640353433 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f387406b4d0 msgr2=0x7f387406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:16.049 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.042+0000 7f388e436640 1 --2- 172.21.15.116:0/2640353433 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f387406b4d0 0x7f387406d990 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f387c036000 tx=0x7f387c03b040 comp rx=0 tx=0).stop 2024-02-21T22:53:16.049 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.042+0000 7f388e436640 1 -- 172.21.15.116:0/2640353433 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f38880d0ca0 msgr2=0x7f38880c9aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:16.049 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.042+0000 7f388e436640 1 --2- 172.21.15.116:0/2640353433 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f38880d0ca0 0x7f38880c9aa0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f387800c450 tx=0x7f387800c910 comp rx=0 tx=0).stop 2024-02-21T22:53:16.049 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.042+0000 7f388e436640 1 -- 172.21.15.116:0/2640353433 shutdown_connections 2024-02-21T22:53:16.049 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.042+0000 7f388e436640 1 --2- 172.21.15.116:0/2640353433 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f388815da70 0x7f388806c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:16.049 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.042+0000 7f388e436640 1 --2- 172.21.15.116:0/2640353433 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f38880d2b10 0x7f38880ccd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:16.050 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.042+0000 7f388e436640 1 --2- 172.21.15.116:0/2640353433 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f387406b4d0 0x7f387406d990 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:16.050 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.042+0000 7f388e436640 1 --2- 172.21.15.116:0/2640353433 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f38880d0ca0 0x7f38880c9aa0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:16.050 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.042+0000 7f388e436640 1 -- 172.21.15.116:0/2640353433 >> 172.21.15.116:0/2640353433 conn(0x7f38880d3e20 msgr2=0x7f38880b0ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:16.050 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.042+0000 7f388e436640 1 -- 172.21.15.116:0/2640353433 shutdown_connections 2024-02-21T22:53:16.050 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.042+0000 7f388e436640 1 -- 172.21.15.116:0/2640353433 wait complete. 2024-02-21T22:53:16.050 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-21T22:53:16.150 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.160+0000 7f38ce0de640 1 Processor -- start 2024-02-21T22:53:16.150 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.160+0000 7f38ce0de640 1 -- start start 2024-02-21T22:53:16.152 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.160+0000 7f38ce0de640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f38c806d070 0x7f38c815f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:16.152 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.160+0000 7f38ce0de640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f38c806c160 0x7f38c80ce280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:16.152 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.160+0000 7f38ce0de640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38c80cf520 con 0x7f38c815bd00 2024-02-21T22:53:16.152 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.160+0000 7f38ce0de640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38c815c0e0 con 0x7f38c806c160 2024-02-21T22:53:16.152 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.160+0000 7f38ce0de640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38c80d0b80 con 0x7f38c806d070 2024-02-21T22:53:16.152 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.161+0000 7f38c7fff640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f38c806c160 0x7f38c80ce280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:16.153 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.161+0000 7f38c77fe640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f38c815bd00 0x7f38c806c960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:54802/0 (socket says 172.21.15.116:54802) 2024-02-21T22:53:16.153 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.161+0000 7f38c77fe640 1 -- 172.21.15.116:0/2324987373 learned_addr learned my addr 172.21.15.116:0/2324987373 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-02-21T22:53:16.153 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.161+0000 7f38bffff640 1 --2- 172.21.15.116:0/2324987373 >> v2:172.21.15.142:3300/0 conn(0x7f38c806d070 0x7f38c815f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:16.153 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.161+0000 7f38c7fff640 1 -- 172.21.15.116:0/2324987373 >> v2:172.21.15.142:3300/0 conn(0x7f38c806d070 msgr2=0x7f38c815f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:53:16.153 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.161+0000 7f38c7fff640 1 --2- 172.21.15.116:0/2324987373 >> v2:172.21.15.142:3300/0 conn(0x7f38c806d070 0x7f38c815f0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:16.153 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.161+0000 7f38c7fff640 1 -- 172.21.15.116:0/2324987373 >> v1:172.21.15.116:6789/0 conn(0x7f38c815bd00 legacy=0x7f38c806c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:16.153 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.161+0000 7f38c7fff640 1 -- 172.21.15.116:0/2324987373 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38c80d0250 con 0x7f38c806c160 2024-02-21T22:53:16.153 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.161+0000 7f38c6ffd640 1 -- 172.21.15.116:0/2324987373 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3884031502 0 0) 0x7f38c80cf520 con 0x7f38c815bd00 2024-02-21T22:53:16.153 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.162+0000 7f38c7fff640 1 --2- 172.21.15.116:0/2324987373 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f38c806c160 0x7f38c80ce280 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f38c8071d70 tx=0x7f38c002be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0310f56e90b6a9a server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:16.153 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.162+0000 7f38c6ffd640 1 -- 172.21.15.116:0/2324987373 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38c0039070 con 0x7f38c806c160 2024-02-21T22:53:16.153 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.162+0000 7f38c6ffd640 1 -- 172.21.15.116:0/2324987373 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38c002cbf0 con 0x7f38c806c160 2024-02-21T22:53:16.153 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.162+0000 7f38c6ffd640 1 -- 172.21.15.116:0/2324987373 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38c0034440 con 0x7f38c806c160 2024-02-21T22:53:16.156 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.162+0000 7f38ce0de640 1 -- 172.21.15.116:0/2324987373 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f38c806c160 msgr2=0x7f38c80ce280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:16.156 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.162+0000 7f38ce0de640 1 --2- 172.21.15.116:0/2324987373 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f38c806c160 0x7f38c80ce280 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f38c8071d70 tx=0x7f38c002be40 comp rx=0 tx=0).stop 2024-02-21T22:53:16.156 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.162+0000 7f38ce0de640 1 -- 172.21.15.116:0/2324987373 shutdown_connections 2024-02-21T22:53:16.156 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.162+0000 7f38ce0de640 1 --2- 172.21.15.116:0/2324987373 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f38c806c160 0x7f38c80ce280 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:16.156 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.162+0000 7f38ce0de640 1 --2- 172.21.15.116:0/2324987373 >> v2:172.21.15.142:3300/0 conn(0x7f38c806d070 0x7f38c815f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:16.156 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.162+0000 7f38ce0de640 1 -- 172.21.15.116:0/2324987373 >> 172.21.15.116:0/2324987373 conn(0x7f38c80d1c10 msgr2=0x7f38c80d2020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:16.156 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.162+0000 7f38ce0de640 1 -- 172.21.15.116:0/2324987373 shutdown_connections 2024-02-21T22:53:16.157 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.162+0000 7f38ce0de640 1 -- 172.21.15.116:0/2324987373 wait complete. 2024-02-21T22:53:16.157 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.164+0000 7f38ce0de640 1 Processor -- start 2024-02-21T22:53:16.157 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.164+0000 7f38ce0de640 1 -- start start 2024-02-21T22:53:16.157 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.164+0000 7f38ce0de640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f38c806c160 0x7f38c80b7520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:16.157 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.164+0000 7f38ce0de640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f38c806d070 0x7f38c8149740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:16.157 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.164+0000 7f38ce0de640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f38c815bd00 0x7f38c815ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:16.157 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.164+0000 7f38ce0de640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38c80cff40 con 0x7f38c806d070 2024-02-21T22:53:16.157 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.164+0000 7f38ce0de640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38c80d0810 con 0x7f38c806c160 2024-02-21T22:53:16.157 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.164+0000 7f38ce0de640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38c80d1010 con 0x7f38c815bd00 2024-02-21T22:53:16.157 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.164+0000 7f38bffff640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f38c806d070 0x7f38c8149740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:16.157 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.164+0000 7f38bffff640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f38c806d070 0x7f38c8149740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:38304/0 (socket says 172.21.15.116:38304) 2024-02-21T22:53:16.157 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.164+0000 7f38bffff640 1 -- 172.21.15.116:0/3262018386 learned_addr learned my addr 172.21.15.116:0/3262018386 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:16.157 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.164+0000 7f38c77fe640 1 --2- 172.21.15.116:0/3262018386 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f38c806c160 0x7f38c80b7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:16.157 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.164+0000 7f38c7fff640 1 --2- 172.21.15.116:0/3262018386 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f38c815bd00 0x7f38c815ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:16.157 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.165+0000 7f38bffff640 1 -- 172.21.15.116:0/3262018386 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f38c815bd00 msgr2=0x7f38c815ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:16.158 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.165+0000 7f38bffff640 1 --2- 172.21.15.116:0/3262018386 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f38c815bd00 0x7f38c815ce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:16.158 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.165+0000 7f38bffff640 1 -- 172.21.15.116:0/3262018386 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f38c806c160 msgr2=0x7f38c80b7520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:16.158 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.165+0000 7f38bffff640 1 --2- 172.21.15.116:0/3262018386 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f38c806c160 0x7f38c80b7520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:16.158 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.165+0000 7f38bffff640 1 -- 172.21.15.116:0/3262018386 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38c809d2d0 con 0x7f38c806d070 2024-02-21T22:53:16.158 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.165+0000 7f38c7fff640 1 --2- 172.21.15.116:0/3262018386 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f38c815bd00 0x7f38c815ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T22:53:16.158 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.165+0000 7f38bffff640 1 --2- 172.21.15.116:0/3262018386 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f38c806d070 0x7f38c8149740 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f38b000e980 tx=0x7f38b000ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:16.158 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.165+0000 7f38c4ff9640 1 -- 172.21.15.116:0/3262018386 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38b0017070 con 0x7f38c806d070 2024-02-21T22:53:16.158 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.165+0000 7f38c4ff9640 1 -- 172.21.15.116:0/3262018386 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38b000ca00 con 0x7f38c806d070 2024-02-21T22:53:16.158 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.165+0000 7f38ce0de640 1 -- 172.21.15.116:0/3262018386 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38c80b7a60 con 0x7f38c806d070 2024-02-21T22:53:16.158 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.165+0000 7f38c4ff9640 1 -- 172.21.15.116:0/3262018386 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38b000cdd0 con 0x7f38c806d070 2024-02-21T22:53:16.158 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.165+0000 7f38ce0de640 1 -- 172.21.15.116:0/3262018386 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38c814cc40 con 0x7f38c806d070 2024-02-21T22:53:16.158 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.166+0000 7f38ce0de640 1 -- 172.21.15.116:0/3262018386 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38c814cf50 con 0x7f38c806d070 2024-02-21T22:53:16.159 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.166+0000 7f38c4ff9640 1 -- 172.21.15.116:0/3262018386 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f38b001a070 con 0x7f38c806d070 2024-02-21T22:53:16.159 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.167+0000 7f38c4ff9640 1 --2- 172.21.15.116:0/3262018386 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f38a806b4d0 0x7f38a806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:16.159 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.167+0000 7f38c4ff9640 1 -- 172.21.15.116:0/3262018386 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f38b008a0f0 con 0x7f38c806d070 2024-02-21T22:53:16.159 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.167+0000 7f38c77fe640 1 --2- 172.21.15.116:0/3262018386 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f38a806b4d0 0x7f38a806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:16.160 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.167+0000 7f38c77fe640 1 --2- 172.21.15.116:0/3262018386 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f38a806b4d0 0x7f38a806d990 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f38b8007fd0 tx=0x7f38b8007de0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:16.161 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.171+0000 7f38c4ff9640 1 -- 172.21.15.116:0/3262018386 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f38c814cf50 con 0x7f38c806d070 2024-02-21T22:53:16.333 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.342+0000 7f38ce0de640 1 -- 172.21.15.116:0/3262018386 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f38c80752f0 con 0x7f38c806d070 2024-02-21T22:53:16.334 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.343+0000 7f38c4ff9640 1 -- 172.21.15.116:0/3262018386 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16653 (secure 0 0 0) 0x7f38c80b7a60 con 0x7f38c806d070 2024-02-21T22:53:16.334 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-02-21T22:53:16.334 INFO:teuthology.orchestra.run.smithi116.stdout:{"epoch":20,"fsid":"7c298660-5f63-4b5c-a800-58c5be9a8445","created":"2024-02-21T22:52:25.994613+0000","modified":"2024-02-21T22:52:51.786454+0000","last_up_change":"2024-02-21T22:52:37.313595+0000","last_in_change":"2024-02-21T22:52:28.176031+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-21T22:52:38.328796+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-21T22:52:48.145152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-21T22:52:49.096955+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4f09126b-b5e4-4876-8b08-f5cbb967388a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":1613202231},{"type":"v1","addr":"172.21.15.116:6809","nonce":1613202231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":1613202231},{"type":"v1","addr":"172.21.15.116:6811","nonce":1613202231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":1613202231},{"type":"v1","addr":"172.21.15.116:6815","nonce":1613202231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":1613202231},{"type":"v1","addr":"172.21.15.116:6813","nonce":1613202231}]},"public_addr":"172.21.15.116:6809/1613202231","cluster_addr":"172.21.15.116:6811/1613202231","heartbeat_back_addr":"172.21.15.116:6815/1613202231","heartbeat_front_addr":"172.21.15.116:6813/1613202231","state":["exists","up"]},{"osd":1,"uuid":"7272c51d-51f9-4536-931d-33ad7a4b377e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6816","nonce":172614746},{"type":"v1","addr":"172.21.15.116:6817","nonce":172614746}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":172614746},{"type":"v1","addr":"172.21.15.116:6819","nonce":172614746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":172614746},{"type":"v1","addr":"172.21.15.116:6823","nonce":172614746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":172614746},{"type":"v1","addr":"172.21.15.116:6821","nonce":172614746}]},"public_addr":"172.21.15.116:6817/172614746","cluster_addr":"172.21.15.116:6819/172614746","heartbeat_back_addr":"172.21.15.116:6823/172614746","heartbeat_front_addr":"172.21.15.116:6821/172614746","state":["exists","up"]},{"osd":2,"uuid":"2589616c-adf1-4187-aac3-735256cf624b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":1029280577},{"type":"v1","addr":"172.21.15.116:6825","nonce":1029280577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":1029280577},{"type":"v1","addr":"172.21.15.116:6827","nonce":1029280577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":1029280577},{"type":"v1","addr":"172.21.15.116:6831","nonce":1029280577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":1029280577},{"type":"v1","addr":"172.21.15.116:6829","nonce":1029280577}]},"public_addr":"172.21.15.116:6825/1029280577","cluster_addr":"172.21.15.116:6827/1029280577","heartbeat_back_addr":"172.21.15.116:6831/1029280577","heartbeat_front_addr":"172.21.15.116:6829/1029280577","state":["exists","up"]},{"osd":3,"uuid":"0fd2e563-7c5b-46f6-82c2-b60c86072c93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":3106627557},{"type":"v1","addr":"172.21.15.116:6801","nonce":3106627557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":3106627557},{"type":"v1","addr":"172.21.15.116:6803","nonce":3106627557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":3106627557},{"type":"v1","addr":"172.21.15.116:6807","nonce":3106627557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":3106627557},{"type":"v1","addr":"172.21.15.116:6805","nonce":3106627557}]},"public_addr":"172.21.15.116:6801/3106627557","cluster_addr":"172.21.15.116:6803/3106627557","heartbeat_back_addr":"172.21.15.116:6807/3106627557","heartbeat_front_addr":"172.21.15.116:6805/3106627557","state":["exists","up"]},{"osd":4,"uuid":"79ae35b7-dda8-4ab8-96ce-47515afde082","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":3231407772},{"type":"v1","addr":"172.21.15.142:6825","nonce":3231407772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":3231407772},{"type":"v1","addr":"172.21.15.142:6827","nonce":3231407772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":3231407772},{"type":"v1","addr":"172.21.15.142:6831","nonce":3231407772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":3231407772},{"type":"v1","addr":"172.21.15.142:6829","nonce":3231407772}]},"public_addr":"172.21.15.142:6825/3231407772","cluster_addr":"172.21.15.142:6827/3231407772","heartbeat_back_addr":"172.21.15.142:6831/3231407772","heartbeat_front_addr":"172.21.15.142:6829/3231407772","state":["exists","up"]},{"osd":5,"uuid":"3166eb2c-3fcf-41c8-9362-45bafaabaa39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":1184158716},{"type":"v1","addr":"172.21.15.142:6817","nonce":1184158716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":1184158716},{"type":"v1","addr":"172.21.15.142:6819","nonce":1184158716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":1184158716},{"type":"v1","addr":"172.21.15.142:6823","nonce":1184158716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":1184158716},{"type":"v1","addr":"172.21.15.142:6821","nonce":1184158716}]},"public_addr":"172.21.15.142:6817/1184158716","cluster_addr":"172.21.15.142:6819/1184158716","heartbeat_back_addr":"172.21.15.142:6823/1184158716","heartbeat_front_addr":"172.21.15.142:6821/1184158716","state":["exists","up"]},{"osd":6,"uuid":"f9aa9672-7527-43e2-963e-b61868e5e63f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":1987868911},{"type":"v1","addr":"172.21.15.142:6801","nonce":1987868911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":1987868911},{"type":"v1","addr":"172.21.15.142:6803","nonce":1987868911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":1987868911},{"type":"v1","addr":"172.21.15.142:6807","nonce":1987868911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":1987868911},{"type":"v1","addr":"172.21.15.142:6805","nonce":1987868911}]},"public_addr":"172.21.15.142:6801/1987868911","cluster_addr":"172.21.15.142:6803/1987868911","heartbeat_back_addr":"172.21.15.142:6807/1987868911","heartbeat_front_addr":"172.21.15.142:6805/1987868911","state":["exists","up"]},{"osd":7,"uuid":"7ed29226-fc42-4382-a91a-fa50f7ec5426","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":1272081937},{"type":"v1","addr":"172.21.15.142:6809","nonce":1272081937}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":1272081937},{"type":"v1","addr":"172.21.15.142:6811","nonce":1272081937}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":1272081937},{"type":"v1","addr":"172.21.15.142:6815","nonce":1272081937}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":1272081937},{"type":"v1","addr":"172.21.15.142:6813","nonce":1272081937}]},"public_addr":"172.21.15.142:6809/1272081937","cluster_addr":"172.21.15.142:6811/1272081937","heartbeat_back_addr":"172.21.15.142:6815/1272081937","heartbeat_front_addr":"172.21.15.142:6813/1272081937","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.350998+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.307201+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.289112+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.243888+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.312091+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.370472+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.275659+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.289297+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-21T22:53:16.336 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.345+0000 7f38ce0de640 1 -- 172.21.15.116:0/3262018386 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f38a806b4d0 msgr2=0x7f38a806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:16.336 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.345+0000 7f38ce0de640 1 --2- 172.21.15.116:0/3262018386 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f38a806b4d0 0x7f38a806d990 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f38b8007fd0 tx=0x7f38b8007de0 comp rx=0 tx=0).stop 2024-02-21T22:53:16.336 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.345+0000 7f38ce0de640 1 -- 172.21.15.116:0/3262018386 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f38c806d070 msgr2=0x7f38c8149740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:16.336 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.345+0000 7f38ce0de640 1 --2- 172.21.15.116:0/3262018386 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f38c806d070 0x7f38c8149740 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f38b000e980 tx=0x7f38b000ee40 comp rx=0 tx=0).stop 2024-02-21T22:53:16.336 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.345+0000 7f38ce0de640 1 -- 172.21.15.116:0/3262018386 shutdown_connections 2024-02-21T22:53:16.336 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.345+0000 7f38ce0de640 1 --2- 172.21.15.116:0/3262018386 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f38a806b4d0 0x7f38a806d990 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:16.336 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.345+0000 7f38ce0de640 1 --2- 172.21.15.116:0/3262018386 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f38c815bd00 0x7f38c815ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:16.336 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.345+0000 7f38ce0de640 1 --2- 172.21.15.116:0/3262018386 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f38c806d070 0x7f38c8149740 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:16.337 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.345+0000 7f38ce0de640 1 --2- 172.21.15.116:0/3262018386 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f38c806c160 0x7f38c80b7520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:16.337 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.345+0000 7f38ce0de640 1 -- 172.21.15.116:0/3262018386 >> 172.21.15.116:0/3262018386 conn(0x7f38c80d1c10 msgr2=0x7f38c8159c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:16.337 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.345+0000 7f38ce0de640 1 -- 172.21.15.116:0/3262018386 shutdown_connections 2024-02-21T22:53:16.337 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.345+0000 7f38ce0de640 1 -- 172.21.15.116:0/3262018386 wait complete. 2024-02-21T22:53:16.347 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-21T22:52:38.328796+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-02-21T22:52:48.145152+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-02-21T22:52:49.096955+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-21T22:53:16.347 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-21T22:53:16.451 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.460+0000 7f4bd91f7640 1 Processor -- start 2024-02-21T22:53:16.451 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.460+0000 7f4bd91f7640 1 -- start start 2024-02-21T22:53:16.452 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.461+0000 7f4bd91f7640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4bd40cf720 0x7f4bd40cd350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:16.453 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.461+0000 7f4bd91f7640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bd4161a10 con 0x7f4bd40cd890 2024-02-21T22:53:16.453 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.461+0000 7f4bd91f7640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bd40cdd20 con 0x7f4bd4161630 2024-02-21T22:53:16.453 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.461+0000 7f4bd91f7640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bd40cfb80 con 0x7f4bd40cf720 2024-02-21T22:53:16.453 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.461+0000 7f4bd359e640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f4bd40cd890 0x7f4bd40ce4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:54816/0 (socket says 172.21.15.116:54816) 2024-02-21T22:53:16.453 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.461+0000 7f4bd359e640 1 -- 172.21.15.116:0/1448578097 learned_addr learned my addr 172.21.15.116:0/1448578097 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-02-21T22:53:16.453 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.461+0000 7f4bd259c640 1 --2- 172.21.15.116:0/1448578097 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4bd40cf720 0x7f4bd40cd350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:16.453 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.461+0000 7f4bd1d9b640 1 -- 172.21.15.116:0/1448578097 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1874626801 0 0) 0x7f4bcc001490 con 0x7f4bd40cd890 2024-02-21T22:53:16.453 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.461+0000 7f4bd1d9b640 1 -- 172.21.15.116:0/1448578097 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4bbc003520 con 0x7f4bd40cd890 2024-02-21T22:53:16.453 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.461+0000 7f4bd1d9b640 1 -- 172.21.15.116:0/1448578097 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2252588221 0 0) 0x7f4bd40cdd20 con 0x7f4bd4161630 2024-02-21T22:53:16.453 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.461+0000 7f4bd1d9b640 1 -- 172.21.15.116:0/1448578097 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4bcc001490 con 0x7f4bd4161630 2024-02-21T22:53:16.453 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.461+0000 7f4bd259c640 1 -- 172.21.15.116:0/1448578097 >> v1:172.21.15.142:6789/0 conn(0x7f4bd4161630 legacy=0x7f4bd40b14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:16.453 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.461+0000 7f4bd259c640 1 -- 172.21.15.116:0/1448578097 >> v1:172.21.15.116:6789/0 conn(0x7f4bd40cd890 legacy=0x7f4bd40ce4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:16.453 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.461+0000 7f4bd259c640 1 -- 172.21.15.116:0/1448578097 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bd40d07f0 con 0x7f4bd40cf720 2024-02-21T22:53:16.453 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.462+0000 7f4bd259c640 1 --2- 172.21.15.116:0/1448578097 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4bd40cf720 0x7f4bd40cd350 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f4bc80097d0 tx=0x7f4bc802b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=37bc138b5a5ec54b server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:16.454 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.462+0000 7f4bd1d9b640 1 -- 172.21.15.116:0/1448578097 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bc8035020 con 0x7f4bd40cf720 2024-02-21T22:53:16.454 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.462+0000 7f4bd1d9b640 1 -- 172.21.15.116:0/1448578097 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bc8031890 con 0x7f4bd40cf720 2024-02-21T22:53:16.454 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.462+0000 7f4bd1d9b640 1 -- 172.21.15.116:0/1448578097 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bc8031c40 con 0x7f4bd40cf720 2024-02-21T22:53:16.455 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.463+0000 7f4bd91f7640 1 -- 172.21.15.116:0/1448578097 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4bd40cf720 msgr2=0x7f4bd40cd350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:16.455 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.463+0000 7f4bd91f7640 1 --2- 172.21.15.116:0/1448578097 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4bd40cf720 0x7f4bd40cd350 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f4bc80097d0 tx=0x7f4bc802b930 comp rx=0 tx=0).stop 2024-02-21T22:53:16.455 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.463+0000 7f4bd91f7640 1 -- 172.21.15.116:0/1448578097 shutdown_connections 2024-02-21T22:53:16.455 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.463+0000 7f4bd91f7640 1 --2- 172.21.15.116:0/1448578097 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4bd40cf720 0x7f4bd40cd350 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:16.455 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.463+0000 7f4bd91f7640 1 -- 172.21.15.116:0/1448578097 >> 172.21.15.116:0/1448578097 conn(0x7f4bd40d1b50 msgr2=0x7f4bd40d1f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:16.455 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.463+0000 7f4bd91f7640 1 -- 172.21.15.116:0/1448578097 shutdown_connections 2024-02-21T22:53:16.455 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.463+0000 7f4bd91f7640 1 -- 172.21.15.116:0/1448578097 wait complete. 2024-02-21T22:53:16.455 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.464+0000 7f4bd91f7640 1 Processor -- start 2024-02-21T22:53:16.455 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.464+0000 7f4bd91f7640 1 -- start start 2024-02-21T22:53:16.459 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.465+0000 7f4bd91f7640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4bd40cd890 0x7f4bd4150f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:16.459 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.465+0000 7f4bd91f7640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4bd40cf720 0x7f4bd40c9e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:16.459 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.465+0000 7f4bd91f7640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4bd4161630 0x7f4bd415dc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:16.459 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.465+0000 7f4bd91f7640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bd40ccb50 con 0x7f4bd4161630 2024-02-21T22:53:16.459 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.465+0000 7f4bd91f7640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bd40ccec0 con 0x7f4bd40cf720 2024-02-21T22:53:16.459 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.465+0000 7f4bd91f7640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bd40b11a0 con 0x7f4bd40cd890 2024-02-21T22:53:16.459 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.465+0000 7f4bd359e640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4bd4161630 0x7f4bd415dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:16.459 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.465+0000 7f4bd2d9d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4bd40cd890 0x7f4bd4150f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:16.459 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.465+0000 7f4bd359e640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4bd4161630 0x7f4bd415dc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:38310/0 (socket says 172.21.15.116:38310) 2024-02-21T22:53:16.459 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.465+0000 7f4bd359e640 1 -- 172.21.15.116:0/851895068 learned_addr learned my addr 172.21.15.116:0/851895068 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:16.459 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.465+0000 7f4bd2d9d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4bd40cd890 0x7f4bd4150f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.116:41338/0 (socket says 172.21.15.116:41338) 2024-02-21T22:53:16.459 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.465+0000 7f4bd259c640 1 --2- 172.21.15.116:0/851895068 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4bd40cf720 0x7f4bd40c9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:16.459 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.465+0000 7f4bd359e640 1 -- 172.21.15.116:0/851895068 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4bd40cd890 msgr2=0x7f4bd4150f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:16.460 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.465+0000 7f4bd359e640 1 --2- 172.21.15.116:0/851895068 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4bd40cd890 0x7f4bd4150f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:16.460 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.465+0000 7f4bd359e640 1 -- 172.21.15.116:0/851895068 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4bd40cf720 msgr2=0x7f4bd40c9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:16.460 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.465+0000 7f4bd359e640 1 --2- 172.21.15.116:0/851895068 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4bd40cf720 0x7f4bd40c9e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:16.460 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.465+0000 7f4bd359e640 1 -- 172.21.15.116:0/851895068 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bd415b210 con 0x7f4bd4161630 2024-02-21T22:53:16.460 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.465+0000 7f4bd2d9d640 1 --2- 172.21.15.116:0/851895068 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4bd40cd890 0x7f4bd4150f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T22:53:16.460 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.465+0000 7f4bd259c640 1 --2- 172.21.15.116:0/851895068 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4bd40cf720 0x7f4bd40c9e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T22:53:16.460 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.466+0000 7f4bd359e640 1 --2- 172.21.15.116:0/851895068 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4bd4161630 0x7f4bd415dc60 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f4bcc001ed0 tx=0x7f4bcc00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:16.460 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.466+0000 7f4bbb7fe640 1 -- 172.21.15.116:0/851895068 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bcc017070 con 0x7f4bd4161630 2024-02-21T22:53:16.460 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.466+0000 7f4bbb7fe640 1 -- 172.21.15.116:0/851895068 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bcc012400 con 0x7f4bd4161630 2024-02-21T22:53:16.460 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.466+0000 7f4bbb7fe640 1 -- 172.21.15.116:0/851895068 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bcc012830 con 0x7f4bd4161630 2024-02-21T22:53:16.460 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.466+0000 7f4bd91f7640 1 -- 172.21.15.116:0/851895068 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bd40c8dc0 con 0x7f4bd4161630 2024-02-21T22:53:16.460 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.466+0000 7f4bd91f7640 1 -- 172.21.15.116:0/851895068 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bd40c9380 con 0x7f4bd4161630 2024-02-21T22:53:16.460 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.467+0000 7f4bd91f7640 1 -- 172.21.15.116:0/851895068 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bd40752f0 con 0x7f4bd4161630 2024-02-21T22:53:16.460 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.467+0000 7f4bbb7fe640 1 -- 172.21.15.116:0/851895068 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f4bcc01a070 con 0x7f4bd4161630 2024-02-21T22:53:16.460 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.468+0000 7f4bbb7fe640 1 --2- 172.21.15.116:0/851895068 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f4bc006b4d0 0x7f4bc006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:16.461 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.468+0000 7f4bbb7fe640 1 -- 172.21.15.116:0/851895068 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4bcc08a100 con 0x7f4bd4161630 2024-02-21T22:53:16.461 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.468+0000 7f4bd2d9d640 1 --2- 172.21.15.116:0/851895068 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f4bc006b4d0 0x7f4bc006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:16.461 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.468+0000 7f4bd2d9d640 1 --2- 172.21.15.116:0/851895068 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f4bc006b4d0 0x7f4bc006d990 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f4bc4007fd0 tx=0x7f4bc4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:16.462 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.473+0000 7f4bbb7fe640 1 -- 172.21.15.116:0/851895068 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f4bd4161a10 con 0x7f4bd4161630 2024-02-21T22:53:16.633 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.643+0000 7f4bd91f7640 1 -- 172.21.15.116:0/851895068 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4bd415c680 con 0x7f4bd4161630 2024-02-21T22:53:16.634 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.643+0000 7f4bbb7fe640 1 -- 172.21.15.116:0/851895068 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4bcc058930 con 0x7f4bd4161630 2024-02-21T22:53:16.634 INFO:teuthology.orchestra.run.smithi116.stdout:pg_num: 1 2024-02-21T22:53:16.636 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.645+0000 7f4bd91f7640 1 -- 172.21.15.116:0/851895068 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f4bc006b4d0 msgr2=0x7f4bc006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:16.636 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.645+0000 7f4bd91f7640 1 --2- 172.21.15.116:0/851895068 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f4bc006b4d0 0x7f4bc006d990 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f4bc4007fd0 tx=0x7f4bc4009040 comp rx=0 tx=0).stop 2024-02-21T22:53:16.636 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.645+0000 7f4bd91f7640 1 -- 172.21.15.116:0/851895068 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4bd4161630 msgr2=0x7f4bd415dc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:16.636 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.645+0000 7f4bd91f7640 1 --2- 172.21.15.116:0/851895068 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4bd4161630 0x7f4bd415dc60 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f4bcc001ed0 tx=0x7f4bcc00a430 comp rx=0 tx=0).stop 2024-02-21T22:53:16.636 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.645+0000 7f4bd91f7640 1 -- 172.21.15.116:0/851895068 shutdown_connections 2024-02-21T22:53:16.636 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.645+0000 7f4bd91f7640 1 --2- 172.21.15.116:0/851895068 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4bd4161630 0x7f4bd415dc60 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:16.636 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.645+0000 7f4bd91f7640 1 --2- 172.21.15.116:0/851895068 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4bd40cf720 0x7f4bd40c9e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:16.636 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.645+0000 7f4bd91f7640 1 --2- 172.21.15.116:0/851895068 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f4bc006b4d0 0x7f4bc006d990 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:16.637 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.645+0000 7f4bd91f7640 1 --2- 172.21.15.116:0/851895068 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4bd40cd890 0x7f4bd4150f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:16.637 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.645+0000 7f4bd91f7640 1 -- 172.21.15.116:0/851895068 >> 172.21.15.116:0/851895068 conn(0x7f4bd40d1b50 msgr2=0x7f4bd415bbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:16.637 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.645+0000 7f4bd91f7640 1 -- 172.21.15.116:0/851895068 shutdown_connections 2024-02-21T22:53:16.637 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.645+0000 7f4bd91f7640 1 -- 172.21.15.116:0/851895068 wait complete. 2024-02-21T22:53:16.646 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-02-21T22:53:16.749 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.759+0000 7fb6711cf640 1 Processor -- start 2024-02-21T22:53:16.749 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.759+0000 7fb6711cf640 1 -- start start 2024-02-21T22:53:16.750 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.759+0000 7fb6711cf640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb66c15dff0 0x7fb66c0affe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:16.751 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.759+0000 7fb6711cf640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb66c06b550 0x7fb66c06e110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:16.751 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.759+0000 7fb6711cf640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb66c0ae760 con 0x7fb66c06ffe0 2024-02-21T22:53:16.751 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.759+0000 7fb6711cf640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb66c15e3d0 con 0x7fb66c15dff0 2024-02-21T22:53:16.751 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.759+0000 7fb6711cf640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb66c0ae9e0 con 0x7fb66c06b550 2024-02-21T22:53:16.751 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.759+0000 7fb663fff640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7fb66c06ffe0 0x7fb66c06ae40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:54820/0 (socket says 172.21.15.116:54820) 2024-02-21T22:53:16.751 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.759+0000 7fb663fff640 1 -- 172.21.15.116:0/3219072749 learned_addr learned my addr 172.21.15.116:0/3219072749 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-02-21T22:53:16.751 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.760+0000 7fb66b59e640 1 --2- 172.21.15.116:0/3219072749 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb66c06b550 0x7fb66c06e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:16.751 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.760+0000 7fb66ad9d640 1 --2- 172.21.15.116:0/3219072749 >> v2:172.21.15.142:3300/0 conn(0x7fb66c15dff0 0x7fb66c0affe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:16.751 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.760+0000 7fb66a59c640 1 -- 172.21.15.116:0/3219072749 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1342049323 0 0) 0x7fb654001110 con 0x7fb66c06ffe0 2024-02-21T22:53:16.751 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.760+0000 7fb66a59c640 1 -- 172.21.15.116:0/3219072749 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb658003520 con 0x7fb66c06ffe0 2024-02-21T22:53:16.751 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.760+0000 7fb66b59e640 1 -- 172.21.15.116:0/3219072749 >> v2:172.21.15.142:3300/0 conn(0x7fb66c15dff0 msgr2=0x7fb66c0affe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:53:16.751 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.760+0000 7fb66b59e640 1 --2- 172.21.15.116:0/3219072749 >> v2:172.21.15.142:3300/0 conn(0x7fb66c15dff0 0x7fb66c0affe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:16.751 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.760+0000 7fb66b59e640 1 -- 172.21.15.116:0/3219072749 >> v1:172.21.15.116:6789/0 conn(0x7fb66c06ffe0 legacy=0x7fb66c06ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:16.751 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.760+0000 7fb66b59e640 1 -- 172.21.15.116:0/3219072749 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb66c06d630 con 0x7fb66c06b550 2024-02-21T22:53:16.753 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.761+0000 7fb66b59e640 1 --2- 172.21.15.116:0/3219072749 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb66c06b550 0x7fb66c06e110 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fb664009d90 tx=0x7fb66402be10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8c163b2c5eb73b9a server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:16.753 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.761+0000 7fb66a59c640 1 -- 172.21.15.116:0/3219072749 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb664039070 con 0x7fb66c06b550 2024-02-21T22:53:16.753 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.761+0000 7fb66a59c640 1 -- 172.21.15.116:0/3219072749 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb66402cbc0 con 0x7fb66c06b550 2024-02-21T22:53:16.753 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.761+0000 7fb66a59c640 1 -- 172.21.15.116:0/3219072749 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb664034440 con 0x7fb66c06b550 2024-02-21T22:53:16.753 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.761+0000 7fb6711cf640 1 -- 172.21.15.116:0/3219072749 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb66c06b550 msgr2=0x7fb66c06e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:16.753 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.761+0000 7fb6711cf640 1 --2- 172.21.15.116:0/3219072749 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb66c06b550 0x7fb66c06e110 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fb664009d90 tx=0x7fb66402be10 comp rx=0 tx=0).stop 2024-02-21T22:53:16.753 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.761+0000 7fb6711cf640 1 -- 172.21.15.116:0/3219072749 shutdown_connections 2024-02-21T22:53:16.753 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.761+0000 7fb6711cf640 1 --2- 172.21.15.116:0/3219072749 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb66c06b550 0x7fb66c06e110 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:16.753 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.761+0000 7fb6711cf640 1 --2- 172.21.15.116:0/3219072749 >> v2:172.21.15.142:3300/0 conn(0x7fb66c15dff0 0x7fb66c0affe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:16.754 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.761+0000 7fb6711cf640 1 -- 172.21.15.116:0/3219072749 >> 172.21.15.116:0/3219072749 conn(0x7fb66c0d0b00 msgr2=0x7fb66c0d0f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:16.754 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.761+0000 7fb6711cf640 1 -- 172.21.15.116:0/3219072749 shutdown_connections 2024-02-21T22:53:16.754 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.761+0000 7fb6711cf640 1 -- 172.21.15.116:0/3219072749 wait complete. 2024-02-21T22:53:16.754 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.763+0000 7fb6711cf640 1 Processor -- start 2024-02-21T22:53:16.754 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.763+0000 7fb6711cf640 1 -- start start 2024-02-21T22:53:16.756 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.763+0000 7fb6711cf640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb66c06b550 0x7fb66c158a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:16.756 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.763+0000 7fb6711cf640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb66c06ffe0 0x7fb66c155520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:16.756 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.763+0000 7fb6711cf640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb66c15dff0 0x7fb66c161280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:16.756 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.763+0000 7fb6711cf640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb66c0ad870 con 0x7fb66c06b550 2024-02-21T22:53:16.756 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.763+0000 7fb6711cf640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb66c06dbf0 con 0x7fb66c06ffe0 2024-02-21T22:53:16.756 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.763+0000 7fb6711cf640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb66c0ad9f0 con 0x7fb66c15dff0 2024-02-21T22:53:16.756 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.764+0000 7fb66ad9d640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb66c06b550 0x7fb66c158a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:16.756 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.764+0000 7fb66ad9d640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb66c06b550 0x7fb66c158a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:38326/0 (socket says 172.21.15.116:38326) 2024-02-21T22:53:16.756 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.764+0000 7fb66ad9d640 1 -- 172.21.15.116:0/3268510193 learned_addr learned my addr 172.21.15.116:0/3268510193 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:16.756 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.764+0000 7fb663fff640 1 --2- 172.21.15.116:0/3268510193 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb66c06ffe0 0x7fb66c155520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:16.757 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.764+0000 7fb66b59e640 1 --2- 172.21.15.116:0/3268510193 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb66c15dff0 0x7fb66c161280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:16.757 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.764+0000 7fb66ad9d640 1 -- 172.21.15.116:0/3268510193 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb66c15dff0 msgr2=0x7fb66c161280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:16.757 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.764+0000 7fb66ad9d640 1 --2- 172.21.15.116:0/3268510193 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb66c15dff0 0x7fb66c161280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:16.757 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.764+0000 7fb66ad9d640 1 -- 172.21.15.116:0/3268510193 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb66c06ffe0 msgr2=0x7fb66c155520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:16.757 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.764+0000 7fb66ad9d640 1 --2- 172.21.15.116:0/3268510193 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb66c06ffe0 0x7fb66c155520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:16.757 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.764+0000 7fb66ad9d640 1 -- 172.21.15.116:0/3268510193 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb66c1606a0 con 0x7fb66c06b550 2024-02-21T22:53:16.757 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.764+0000 7fb66ad9d640 1 --2- 172.21.15.116:0/3268510193 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb66c06b550 0x7fb66c158a70 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fb65c00e9b0 tx=0x7fb65c00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:16.757 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.764+0000 7fb6637fe640 1 -- 172.21.15.116:0/3268510193 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb65c017070 con 0x7fb66c06b550 2024-02-21T22:53:16.757 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.764+0000 7fb6637fe640 1 -- 172.21.15.116:0/3268510193 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb65c00c9a0 con 0x7fb66c06b550 2024-02-21T22:53:16.757 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.764+0000 7fb6637fe640 1 -- 172.21.15.116:0/3268510193 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb65c00cd90 con 0x7fb66c06b550 2024-02-21T22:53:16.757 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.764+0000 7fb6711cf640 1 -- 172.21.15.116:0/3268510193 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb66c159150 con 0x7fb66c06b550 2024-02-21T22:53:16.757 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.764+0000 7fb6711cf640 1 -- 172.21.15.116:0/3268510193 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb66c159710 con 0x7fb66c06b550 2024-02-21T22:53:16.757 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.765+0000 7fb6711cf640 1 -- 172.21.15.116:0/3268510193 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb66c1f4150 con 0x7fb66c06b550 2024-02-21T22:53:16.757 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.766+0000 7fb6637fe640 1 -- 172.21.15.116:0/3268510193 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fb65c01a070 con 0x7fb66c06b550 2024-02-21T22:53:16.758 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.766+0000 7fb6637fe640 1 --2- 172.21.15.116:0/3268510193 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fb64c06b500 0x7fb64c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:16.758 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.766+0000 7fb6637fe640 1 -- 172.21.15.116:0/3268510193 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb65c08a090 con 0x7fb66c06b550 2024-02-21T22:53:16.758 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.766+0000 7fb663fff640 1 --2- 172.21.15.116:0/3268510193 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fb64c06b500 0x7fb64c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:16.758 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.767+0000 7fb663fff640 1 --2- 172.21.15.116:0/3268510193 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fb64c06b500 0x7fb64c06d9c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fb66c1f7320 tx=0x7fb654009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:16.761 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.771+0000 7fb6637fe640 1 -- 172.21.15.116:0/3268510193 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7fb65c0588c0 con 0x7fb66c06b550 2024-02-21T22:53:16.934 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.944+0000 7fb6711cf640 1 -- 172.21.15.116:0/3268510193 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb66c0752f0 con 0x7fb66c06b550 2024-02-21T22:53:16.935 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.944+0000 7fb6637fe640 1 -- 172.21.15.116:0/3268510193 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb65c05c960 con 0x7fb66c06b550 2024-02-21T22:53:16.935 INFO:teuthology.orchestra.run.smithi116.stdout:pg_num: 32 2024-02-21T22:53:16.937 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.946+0000 7fb6711cf640 1 -- 172.21.15.116:0/3268510193 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fb64c06b500 msgr2=0x7fb64c06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:16.937 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.946+0000 7fb6711cf640 1 --2- 172.21.15.116:0/3268510193 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fb64c06b500 0x7fb64c06d9c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fb66c1f7320 tx=0x7fb654009040 comp rx=0 tx=0).stop 2024-02-21T22:53:16.937 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.946+0000 7fb6711cf640 1 -- 172.21.15.116:0/3268510193 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb66c06b550 msgr2=0x7fb66c158a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:16.937 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.946+0000 7fb6711cf640 1 --2- 172.21.15.116:0/3268510193 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb66c06b550 0x7fb66c158a70 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fb65c00e9b0 tx=0x7fb65c00ee70 comp rx=0 tx=0).stop 2024-02-21T22:53:16.937 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.946+0000 7fb6711cf640 1 -- 172.21.15.116:0/3268510193 shutdown_connections 2024-02-21T22:53:16.937 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.946+0000 7fb6711cf640 1 --2- 172.21.15.116:0/3268510193 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fb64c06b500 0x7fb64c06d9c0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:16.938 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.946+0000 7fb6711cf640 1 --2- 172.21.15.116:0/3268510193 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb66c15dff0 0x7fb66c161280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:16.938 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.946+0000 7fb6711cf640 1 --2- 172.21.15.116:0/3268510193 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb66c06ffe0 0x7fb66c155520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:16.938 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.946+0000 7fb6711cf640 1 --2- 172.21.15.116:0/3268510193 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb66c06b550 0x7fb66c158a70 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:16.938 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.946+0000 7fb6711cf640 1 -- 172.21.15.116:0/3268510193 >> 172.21.15.116:0/3268510193 conn(0x7fb66c0d0b00 msgr2=0x7fb66c06e8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:16.938 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.946+0000 7fb6711cf640 1 -- 172.21.15.116:0/3268510193 shutdown_connections 2024-02-21T22:53:16.938 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:16.946+0000 7fb6711cf640 1 -- 172.21.15.116:0/3268510193 wait complete. 2024-02-21T22:53:16.947 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-02-21T22:53:17.051 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.061+0000 7f59a595e640 1 Processor -- start 2024-02-21T22:53:17.051 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.061+0000 7f59a595e640 1 -- start start 2024-02-21T22:53:17.052 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.062+0000 7f59a595e640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f59a00d0ca0 0x7f59a00d4940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:17.052 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.062+0000 7f59a595e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f59a00d2870 0x7f59a015e180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:17.053 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.062+0000 7f59a595e640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59a00d2d00 con 0x7f59a00d2400 2024-02-21T22:53:17.053 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.062+0000 7f59a595e640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59a00ceea0 con 0x7f59a00d0ca0 2024-02-21T22:53:17.053 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.062+0000 7f59a595e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59a00cf180 con 0x7f59a00d2870 2024-02-21T22:53:17.053 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.062+0000 7f599effd640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f59a00d0ca0 0x7f59a00d4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:17.053 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.062+0000 7f599e7fc640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f59a00d2400 0x7f59a015da70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:54830/0 (socket says 172.21.15.116:54830) 2024-02-21T22:53:17.053 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.062+0000 7f599e7fc640 1 -- 172.21.15.116:0/1424314693 learned_addr learned my addr 172.21.15.116:0/1424314693 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-02-21T22:53:17.053 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.062+0000 7f599f7fe640 1 --2- 172.21.15.116:0/1424314693 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f59a00d2870 0x7f59a015e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:17.053 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.062+0000 7f599effd640 1 -- 172.21.15.116:0/1424314693 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f59a00d2870 msgr2=0x7f59a015e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:53:17.053 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.062+0000 7f599effd640 1 --2- 172.21.15.116:0/1424314693 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f59a00d2870 0x7f59a015e180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:17.053 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.062+0000 7f599effd640 1 -- 172.21.15.116:0/1424314693 >> v1:172.21.15.116:6789/0 conn(0x7f59a00d2400 legacy=0x7f59a015da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:17.053 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.062+0000 7f599dffb640 1 -- 172.21.15.116:0/1424314693 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1453841066 0 0) 0x7f59a00d2d00 con 0x7f59a00d2400 2024-02-21T22:53:17.053 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.062+0000 7f599effd640 1 -- 172.21.15.116:0/1424314693 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59a00cf460 con 0x7f59a00d0ca0 2024-02-21T22:53:17.053 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.063+0000 7f599effd640 1 --2- 172.21.15.116:0/1424314693 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f59a00d0ca0 0x7f59a00d4940 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f59900097a0 tx=0x7f599002b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb8adf242656eb4 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:17.053 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.063+0000 7f599dffb640 1 -- 172.21.15.116:0/1424314693 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5990034070 con 0x7f59a00d0ca0 2024-02-21T22:53:17.054 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.063+0000 7f599dffb640 1 -- 172.21.15.116:0/1424314693 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5990030610 con 0x7f59a00d0ca0 2024-02-21T22:53:17.054 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.063+0000 7f599dffb640 1 -- 172.21.15.116:0/1424314693 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59900309e0 con 0x7f59a00d0ca0 2024-02-21T22:53:17.057 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.064+0000 7f59a595e640 1 -- 172.21.15.116:0/1424314693 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f59a00d0ca0 msgr2=0x7f59a00d4940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:17.057 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.064+0000 7f59a595e640 1 --2- 172.21.15.116:0/1424314693 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f59a00d0ca0 0x7f59a00d4940 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f59900097a0 tx=0x7f599002b960 comp rx=0 tx=0).stop 2024-02-21T22:53:17.057 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.064+0000 7f59a595e640 1 -- 172.21.15.116:0/1424314693 shutdown_connections 2024-02-21T22:53:17.057 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.064+0000 7f59a595e640 1 --2- 172.21.15.116:0/1424314693 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f59a00d2870 0x7f59a015e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:17.057 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.064+0000 7f59a595e640 1 --2- 172.21.15.116:0/1424314693 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f59a00d0ca0 0x7f59a00d4940 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:17.057 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.064+0000 7f59a595e640 1 -- 172.21.15.116:0/1424314693 >> 172.21.15.116:0/1424314693 conn(0x7f59a00d3e20 msgr2=0x7f59a00d4230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:17.057 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.064+0000 7f59a595e640 1 -- 172.21.15.116:0/1424314693 shutdown_connections 2024-02-21T22:53:17.057 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.064+0000 7f59a595e640 1 -- 172.21.15.116:0/1424314693 wait complete. 2024-02-21T22:53:17.057 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.065+0000 7f59a595e640 1 Processor -- start 2024-02-21T22:53:17.058 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.065+0000 7f59a595e640 1 -- start start 2024-02-21T22:53:17.058 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.065+0000 7f59a595e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f59a00d0ca0 0x7f59a015b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:17.058 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.065+0000 7f59a595e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f59a00d2400 0x7f59a015fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:17.058 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.065+0000 7f59a595e640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f59a00d2870 0x7f59a00b3d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:17.058 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.065+0000 7f59a595e640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59a015e6c0 con 0x7f59a00d2870 2024-02-21T22:53:17.058 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.065+0000 7f59a595e640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59a00cfa20 con 0x7f59a00d2400 2024-02-21T22:53:17.058 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.065+0000 7f59a595e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59a00d1080 con 0x7f59a00d0ca0 2024-02-21T22:53:17.058 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.065+0000 7f599f7fe640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f59a00d2870 0x7f59a00b3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:17.058 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.065+0000 7f599f7fe640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f59a00d2870 0x7f59a00b3d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:38350/0 (socket says 172.21.15.116:38350) 2024-02-21T22:53:17.058 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.065+0000 7f599f7fe640 1 -- 172.21.15.116:0/4247192023 learned_addr learned my addr 172.21.15.116:0/4247192023 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:17.058 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.065+0000 7f599e7fc640 1 --2- 172.21.15.116:0/4247192023 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f59a00d2400 0x7f59a015fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:17.058 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.065+0000 7f599effd640 1 --2- 172.21.15.116:0/4247192023 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f59a00d0ca0 0x7f59a015b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:17.059 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.065+0000 7f599f7fe640 1 -- 172.21.15.116:0/4247192023 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f59a00d0ca0 msgr2=0x7f59a015b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:17.059 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.065+0000 7f599f7fe640 1 --2- 172.21.15.116:0/4247192023 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f59a00d0ca0 0x7f59a015b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:17.059 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.065+0000 7f599f7fe640 1 -- 172.21.15.116:0/4247192023 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f59a00d2400 msgr2=0x7f59a015fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:17.059 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.065+0000 7f599f7fe640 1 --2- 172.21.15.116:0/4247192023 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f59a00d2400 0x7f59a015fb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:17.059 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.065+0000 7f599f7fe640 1 -- 172.21.15.116:0/4247192023 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59a00cb7e0 con 0x7f59a00d2870 2024-02-21T22:53:17.059 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.065+0000 7f599f7fe640 1 --2- 172.21.15.116:0/4247192023 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f59a00d2870 0x7f59a00b3d20 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f599800efc0 tx=0x7f599800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:17.059 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.065+0000 7f5987fff640 1 -- 172.21.15.116:0/4247192023 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5998018020 con 0x7f59a00d2870 2024-02-21T22:53:17.059 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.065+0000 7f5987fff640 1 -- 172.21.15.116:0/4247192023 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5998014480 con 0x7f59a00d2870 2024-02-21T22:53:17.059 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.065+0000 7f5987fff640 1 -- 172.21.15.116:0/4247192023 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5998014870 con 0x7f59a00d2870 2024-02-21T22:53:17.059 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.065+0000 7f59a595e640 1 -- 172.21.15.116:0/4247192023 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59a00cbac0 con 0x7f59a00d2870 2024-02-21T22:53:17.059 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.065+0000 7f59a595e640 1 -- 172.21.15.116:0/4247192023 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59a00cc080 con 0x7f59a00d2870 2024-02-21T22:53:17.060 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.066+0000 7f59a595e640 1 -- 172.21.15.116:0/4247192023 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59a00752f0 con 0x7f59a00d2870 2024-02-21T22:53:17.060 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.068+0000 7f5987fff640 1 -- 172.21.15.116:0/4247192023 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f5998005d10 con 0x7f59a00d2870 2024-02-21T22:53:17.060 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.068+0000 7f5987fff640 1 --2- 172.21.15.116:0/4247192023 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f598c06b4d0 0x7f598c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:17.060 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.068+0000 7f5987fff640 1 -- 172.21.15.116:0/4247192023 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f599808ac70 con 0x7f59a00d2870 2024-02-21T22:53:17.061 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.068+0000 7f599effd640 1 --2- 172.21.15.116:0/4247192023 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f598c06b4d0 0x7f598c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:17.061 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.069+0000 7f599effd640 1 --2- 172.21.15.116:0/4247192023 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f598c06b4d0 0x7f598c06d990 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f5990036000 tx=0x7f599003b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:17.062 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.072+0000 7f5987fff640 1 -- 172.21.15.116:0/4247192023 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f5998022070 con 0x7f59a00d2870 2024-02-21T22:53:17.233 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.244+0000 7f59a595e640 1 -- 172.21.15.116:0/4247192023 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f59a00d21e0 con 0x7f59a00d2870 2024-02-21T22:53:17.234 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.244+0000 7f5987fff640 1 -- 172.21.15.116:0/4247192023 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5998010040 con 0x7f59a00d2870 2024-02-21T22:53:17.234 INFO:teuthology.orchestra.run.smithi116.stdout:pg_num: 64 2024-02-21T22:53:17.236 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.246+0000 7f59a595e640 1 -- 172.21.15.116:0/4247192023 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f598c06b4d0 msgr2=0x7f598c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:17.236 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.246+0000 7f59a595e640 1 --2- 172.21.15.116:0/4247192023 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f598c06b4d0 0x7f598c06d990 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f5990036000 tx=0x7f599003b040 comp rx=0 tx=0).stop 2024-02-21T22:53:17.236 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.246+0000 7f59a595e640 1 -- 172.21.15.116:0/4247192023 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f59a00d2870 msgr2=0x7f59a00b3d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:17.236 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.246+0000 7f59a595e640 1 --2- 172.21.15.116:0/4247192023 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f59a00d2870 0x7f59a00b3d20 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f599800efc0 tx=0x7f599800c490 comp rx=0 tx=0).stop 2024-02-21T22:53:17.236 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.246+0000 7f59a595e640 1 -- 172.21.15.116:0/4247192023 shutdown_connections 2024-02-21T22:53:17.236 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.246+0000 7f59a595e640 1 --2- 172.21.15.116:0/4247192023 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f59a00d2870 0x7f59a00b3d20 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:17.236 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.246+0000 7f59a595e640 1 --2- 172.21.15.116:0/4247192023 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f59a00d2400 0x7f59a015fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:17.236 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.246+0000 7f59a595e640 1 --2- 172.21.15.116:0/4247192023 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f598c06b4d0 0x7f598c06d990 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:17.237 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.246+0000 7f59a595e640 1 --2- 172.21.15.116:0/4247192023 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f59a00d0ca0 0x7f59a015b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:17.237 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.246+0000 7f59a595e640 1 -- 172.21.15.116:0/4247192023 >> 172.21.15.116:0/4247192023 conn(0x7f59a00d3e20 msgr2=0x7f59a006cc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:17.237 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.246+0000 7f59a595e640 1 -- 172.21.15.116:0/4247192023 shutdown_connections 2024-02-21T22:53:17.237 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.246+0000 7f59a595e640 1 -- 172.21.15.116:0/4247192023 wait complete. 2024-02-21T22:53:17.247 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-21T22:53:17.347 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.358+0000 7fdcf8b99640 1 Processor -- start 2024-02-21T22:53:17.348 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.358+0000 7fdcf8b99640 1 -- start start 2024-02-21T22:53:17.349 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.359+0000 7fdcf8b99640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdcf40b4670 0x7fdcf4070e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:17.349 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.359+0000 7fdcf8b99640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcf4072e30 con 0x7fdcf406da10 2024-02-21T22:53:17.349 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.359+0000 7fdcf8b99640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcf40b4030 con 0x7fdcf415e0e0 2024-02-21T22:53:17.349 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.359+0000 7fdcf8b99640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcf40b4310 con 0x7fdcf40b4670 2024-02-21T22:53:17.350 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.359+0000 7fdcf2d9d640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7fdcf406da10 0x7fdcf4161b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:54834/0 (socket says 172.21.15.116:54834) 2024-02-21T22:53:17.350 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.359+0000 7fdcf2d9d640 1 -- 172.21.15.116:0/2780581811 learned_addr learned my addr 172.21.15.116:0/2780581811 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-02-21T22:53:17.350 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.359+0000 7fdcebfff640 1 --2- 172.21.15.116:0/2780581811 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdcf40b4670 0x7fdcf4070e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:17.350 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.359+0000 7fdcf1d9b640 1 -- 172.21.15.116:0/2780581811 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2044785943 0 0) 0x7fdcf4072e30 con 0x7fdcf406da10 2024-02-21T22:53:17.350 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.359+0000 7fdcf1d9b640 1 -- 172.21.15.116:0/2780581811 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdce0003520 con 0x7fdcf406da10 2024-02-21T22:53:17.350 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.359+0000 7fdcebfff640 1 -- 172.21.15.116:0/2780581811 >> v1:172.21.15.142:6789/0 conn(0x7fdcf415e0e0 legacy=0x7fdcf406d300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:17.350 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.359+0000 7fdcf1d9b640 1 -- 172.21.15.116:0/2780581811 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1478855903 0 0) 0x7fdcf40b4030 con 0x7fdcf415e0e0 2024-02-21T22:53:17.350 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.359+0000 7fdcebfff640 1 -- 172.21.15.116:0/2780581811 >> v1:172.21.15.116:6789/0 conn(0x7fdcf406da10 legacy=0x7fdcf4161b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:17.350 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.359+0000 7fdcebfff640 1 -- 172.21.15.116:0/2780581811 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcf4072b50 con 0x7fdcf40b4670 2024-02-21T22:53:17.350 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.360+0000 7fdcebfff640 1 --2- 172.21.15.116:0/2780581811 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdcf40b4670 0x7fdcf4070e50 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fdcdc0097d0 tx=0x7fdcdc02b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c62640dcda42f0fa server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:17.350 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.360+0000 7fdcf1d9b640 1 -- 172.21.15.116:0/2780581811 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcdc035020 con 0x7fdcf40b4670 2024-02-21T22:53:17.350 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.360+0000 7fdcf1d9b640 1 -- 172.21.15.116:0/2780581811 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcdc031800 con 0x7fdcf40b4670 2024-02-21T22:53:17.350 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.360+0000 7fdcf1d9b640 1 -- 172.21.15.116:0/2780581811 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcdc031bd0 con 0x7fdcf40b4670 2024-02-21T22:53:17.351 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.360+0000 7fdcf8b99640 1 -- 172.21.15.116:0/2780581811 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdcf40b4670 msgr2=0x7fdcf4070e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:17.352 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.360+0000 7fdcf8b99640 1 --2- 172.21.15.116:0/2780581811 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdcf40b4670 0x7fdcf4070e50 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fdcdc0097d0 tx=0x7fdcdc02b8a0 comp rx=0 tx=0).stop 2024-02-21T22:53:17.352 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.361+0000 7fdcf8b99640 1 -- 172.21.15.116:0/2780581811 shutdown_connections 2024-02-21T22:53:17.352 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.361+0000 7fdcf8b99640 1 --2- 172.21.15.116:0/2780581811 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdcf40b4670 0x7fdcf4070e50 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:17.352 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.361+0000 7fdcf8b99640 1 -- 172.21.15.116:0/2780581811 >> 172.21.15.116:0/2780581811 conn(0x7fdcf40b18e0 msgr2=0x7fdcf40b1cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:17.352 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.361+0000 7fdcf8b99640 1 -- 172.21.15.116:0/2780581811 shutdown_connections 2024-02-21T22:53:17.352 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.361+0000 7fdcf8b99640 1 -- 172.21.15.116:0/2780581811 wait complete. 2024-02-21T22:53:17.352 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.362+0000 7fdcf8b99640 1 Processor -- start 2024-02-21T22:53:17.352 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.362+0000 7fdcf8b99640 1 -- start start 2024-02-21T22:53:17.354 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.363+0000 7fdcf8b99640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdcf406da10 0x7fdcf415a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:17.354 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.363+0000 7fdcf8b99640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdcf40b4670 0x7fdcf414c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:17.354 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.363+0000 7fdcf8b99640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdcf415e0e0 0x7fdcf40c8f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:17.354 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.363+0000 7fdcf8b99640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcf40728f0 con 0x7fdcf40b4670 2024-02-21T22:53:17.354 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.363+0000 7fdcf8b99640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcf4072770 con 0x7fdcf406da10 2024-02-21T22:53:17.354 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.363+0000 7fdcf8b99640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcf406dea0 con 0x7fdcf415e0e0 2024-02-21T22:53:17.355 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.363+0000 7fdcebfff640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdcf40b4670 0x7fdcf414c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:17.355 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.363+0000 7fdcebfff640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdcf40b4670 0x7fdcf414c740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:38364/0 (socket says 172.21.15.116:38364) 2024-02-21T22:53:17.355 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.363+0000 7fdcebfff640 1 -- 172.21.15.116:0/1866610185 learned_addr learned my addr 172.21.15.116:0/1866610185 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:17.355 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.363+0000 7fdcf259c640 1 --2- 172.21.15.116:0/1866610185 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdcf406da10 0x7fdcf415a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:17.355 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.363+0000 7fdcf2d9d640 1 --2- 172.21.15.116:0/1866610185 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdcf415e0e0 0x7fdcf40c8f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:17.355 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.363+0000 7fdcebfff640 1 -- 172.21.15.116:0/1866610185 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdcf415e0e0 msgr2=0x7fdcf40c8f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:17.355 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.363+0000 7fdcebfff640 1 --2- 172.21.15.116:0/1866610185 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdcf415e0e0 0x7fdcf40c8f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:17.355 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.363+0000 7fdcebfff640 1 -- 172.21.15.116:0/1866610185 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdcf406da10 msgr2=0x7fdcf415a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:17.355 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.363+0000 7fdcebfff640 1 --2- 172.21.15.116:0/1866610185 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdcf406da10 0x7fdcf415a300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:17.355 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.363+0000 7fdcebfff640 1 -- 172.21.15.116:0/1866610185 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcf4159260 con 0x7fdcf40b4670 2024-02-21T22:53:17.355 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.363+0000 7fdcebfff640 1 --2- 172.21.15.116:0/1866610185 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdcf40b4670 0x7fdcf414c740 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fdcdc0098f0 tx=0x7fdcdc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:17.355 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.363+0000 7fdceaffd640 1 -- 172.21.15.116:0/1866610185 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcdc041070 con 0x7fdcf40b4670 2024-02-21T22:53:17.355 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.363+0000 7fdceaffd640 1 -- 172.21.15.116:0/1866610185 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcdc03ad00 con 0x7fdcf40b4670 2024-02-21T22:53:17.355 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.363+0000 7fdceaffd640 1 -- 172.21.15.116:0/1866610185 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcdc035040 con 0x7fdcf40b4670 2024-02-21T22:53:17.356 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.363+0000 7fdcf8b99640 1 -- 172.21.15.116:0/1866610185 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcf4159540 con 0x7fdcf40b4670 2024-02-21T22:53:17.356 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.363+0000 7fdcf8b99640 1 -- 172.21.15.116:0/1866610185 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcf4159b00 con 0x7fdcf40b4670 2024-02-21T22:53:17.356 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.364+0000 7fdcf8b99640 1 -- 172.21.15.116:0/1866610185 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcf40752f0 con 0x7fdcf40b4670 2024-02-21T22:53:17.356 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.365+0000 7fdceaffd640 1 -- 172.21.15.116:0/1866610185 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fdcdc038020 con 0x7fdcf40b4670 2024-02-21T22:53:17.356 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.365+0000 7fdceaffd640 1 --2- 172.21.15.116:0/1866610185 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fdcd406b4d0 0x7fdcd406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:17.356 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.365+0000 7fdceaffd640 1 -- 172.21.15.116:0/1866610185 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdcdc0abc90 con 0x7fdcf40b4670 2024-02-21T22:53:17.357 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.365+0000 7fdcf259c640 1 --2- 172.21.15.116:0/1866610185 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fdcd406b4d0 0x7fdcd406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:17.357 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.366+0000 7fdcf259c640 1 --2- 172.21.15.116:0/1866610185 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fdcd406b4d0 0x7fdcd406d990 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fdce4000f60 tx=0x7fdce4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:17.359 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.370+0000 7fdceaffd640 1 -- 172.21.15.116:0/1866610185 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7fdcdc07a430 con 0x7fdcf40b4670 2024-02-21T22:53:17.531 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.541+0000 7fdcf8b99640 1 -- 172.21.15.116:0/1866610185 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdcf40b2e70 con 0x7fdcf40b4670 2024-02-21T22:53:17.532 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.543+0000 7fdceaffd640 1 -- 172.21.15.116:0/1866610185 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16653 (secure 0 0 0) 0x7fdcdc07e4d0 con 0x7fdcf40b4670 2024-02-21T22:53:17.532 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-02-21T22:53:17.533 INFO:teuthology.orchestra.run.smithi116.stdout:{"epoch":20,"fsid":"7c298660-5f63-4b5c-a800-58c5be9a8445","created":"2024-02-21T22:52:25.994613+0000","modified":"2024-02-21T22:52:51.786454+0000","last_up_change":"2024-02-21T22:52:37.313595+0000","last_in_change":"2024-02-21T22:52:28.176031+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-21T22:52:38.328796+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-21T22:52:48.145152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-21T22:52:49.096955+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4f09126b-b5e4-4876-8b08-f5cbb967388a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":1613202231},{"type":"v1","addr":"172.21.15.116:6809","nonce":1613202231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":1613202231},{"type":"v1","addr":"172.21.15.116:6811","nonce":1613202231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":1613202231},{"type":"v1","addr":"172.21.15.116:6815","nonce":1613202231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":1613202231},{"type":"v1","addr":"172.21.15.116:6813","nonce":1613202231}]},"public_addr":"172.21.15.116:6809/1613202231","cluster_addr":"172.21.15.116:6811/1613202231","heartbeat_back_addr":"172.21.15.116:6815/1613202231","heartbeat_front_addr":"172.21.15.116:6813/1613202231","state":["exists","up"]},{"osd":1,"uuid":"7272c51d-51f9-4536-931d-33ad7a4b377e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6816","nonce":172614746},{"type":"v1","addr":"172.21.15.116:6817","nonce":172614746}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":172614746},{"type":"v1","addr":"172.21.15.116:6819","nonce":172614746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":172614746},{"type":"v1","addr":"172.21.15.116:6823","nonce":172614746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":172614746},{"type":"v1","addr":"172.21.15.116:6821","nonce":172614746}]},"public_addr":"172.21.15.116:6817/172614746","cluster_addr":"172.21.15.116:6819/172614746","heartbeat_back_addr":"172.21.15.116:6823/172614746","heartbeat_front_addr":"172.21.15.116:6821/172614746","state":["exists","up"]},{"osd":2,"uuid":"2589616c-adf1-4187-aac3-735256cf624b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":1029280577},{"type":"v1","addr":"172.21.15.116:6825","nonce":1029280577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":1029280577},{"type":"v1","addr":"172.21.15.116:6827","nonce":1029280577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":1029280577},{"type":"v1","addr":"172.21.15.116:6831","nonce":1029280577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":1029280577},{"type":"v1","addr":"172.21.15.116:6829","nonce":1029280577}]},"public_addr":"172.21.15.116:6825/1029280577","cluster_addr":"172.21.15.116:6827/1029280577","heartbeat_back_addr":"172.21.15.116:6831/1029280577","heartbeat_front_addr":"172.21.15.116:6829/1029280577","state":["exists","up"]},{"osd":3,"uuid":"0fd2e563-7c5b-46f6-82c2-b60c86072c93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":3106627557},{"type":"v1","addr":"172.21.15.116:6801","nonce":3106627557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":3106627557},{"type":"v1","addr":"172.21.15.116:6803","nonce":3106627557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":3106627557},{"type":"v1","addr":"172.21.15.116:6807","nonce":3106627557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":3106627557},{"type":"v1","addr":"172.21.15.116:6805","nonce":3106627557}]},"public_addr":"172.21.15.116:6801/3106627557","cluster_addr":"172.21.15.116:6803/3106627557","heartbeat_back_addr":"172.21.15.116:6807/3106627557","heartbeat_front_addr":"172.21.15.116:6805/3106627557","state":["exists","up"]},{"osd":4,"uuid":"79ae35b7-dda8-4ab8-96ce-47515afde082","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":3231407772},{"type":"v1","addr":"172.21.15.142:6825","nonce":3231407772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":3231407772},{"type":"v1","addr":"172.21.15.142:6827","nonce":3231407772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":3231407772},{"type":"v1","addr":"172.21.15.142:6831","nonce":3231407772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":3231407772},{"type":"v1","addr":"172.21.15.142:6829","nonce":3231407772}]},"public_addr":"172.21.15.142:6825/3231407772","cluster_addr":"172.21.15.142:6827/3231407772","heartbeat_back_addr":"172.21.15.142:6831/3231407772","heartbeat_front_addr":"172.21.15.142:6829/3231407772","state":["exists","up"]},{"osd":5,"uuid":"3166eb2c-3fcf-41c8-9362-45bafaabaa39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":1184158716},{"type":"v1","addr":"172.21.15.142:6817","nonce":1184158716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":1184158716},{"type":"v1","addr":"172.21.15.142:6819","nonce":1184158716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":1184158716},{"type":"v1","addr":"172.21.15.142:6823","nonce":1184158716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":1184158716},{"type":"v1","addr":"172.21.15.142:6821","nonce":1184158716}]},"public_addr":"172.21.15.142:6817/1184158716","cluster_addr":"172.21.15.142:6819/1184158716","heartbeat_back_addr":"172.21.15.142:6823/1184158716","heartbeat_front_addr":"172.21.15.142:6821/1184158716","state":["exists","up"]},{"osd":6,"uuid":"f9aa9672-7527-43e2-963e-b61868e5e63f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":1987868911},{"type":"v1","addr":"172.21.15.142:6801","nonce":1987868911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":1987868911},{"type":"v1","addr":"172.21.15.142:6803","nonce":1987868911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":1987868911},{"type":"v1","addr":"172.21.15.142:6807","nonce":1987868911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":1987868911},{"type":"v1","addr":"172.21.15.142:6805","nonce":1987868911}]},"public_addr":"172.21.15.142:6801/1987868911","cluster_addr":"172.21.15.142:6803/1987868911","heartbeat_back_addr":"172.21.15.142:6807/1987868911","heartbeat_front_addr":"172.21.15.142:6805/1987868911","state":["exists","up"]},{"osd":7,"uuid":"7ed29226-fc42-4382-a91a-fa50f7ec5426","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":1272081937},{"type":"v1","addr":"172.21.15.142:6809","nonce":1272081937}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":1272081937},{"type":"v1","addr":"172.21.15.142:6811","nonce":1272081937}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":1272081937},{"type":"v1","addr":"172.21.15.142:6815","nonce":1272081937}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":1272081937},{"type":"v1","addr":"172.21.15.142:6813","nonce":1272081937}]},"public_addr":"172.21.15.142:6809/1272081937","cluster_addr":"172.21.15.142:6811/1272081937","heartbeat_back_addr":"172.21.15.142:6815/1272081937","heartbeat_front_addr":"172.21.15.142:6813/1272081937","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.350998+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.307201+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.289112+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.243888+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.312091+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.370472+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.275659+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.289297+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-21T22:53:17.534 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.544+0000 7fdcf8b99640 1 -- 172.21.15.116:0/1866610185 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fdcd406b4d0 msgr2=0x7fdcd406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:17.535 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.544+0000 7fdcf8b99640 1 --2- 172.21.15.116:0/1866610185 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fdcd406b4d0 0x7fdcd406d990 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fdce4000f60 tx=0x7fdce4009040 comp rx=0 tx=0).stop 2024-02-21T22:53:17.535 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.545+0000 7fdcf8b99640 1 -- 172.21.15.116:0/1866610185 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdcf40b4670 msgr2=0x7fdcf414c740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:17.535 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.545+0000 7fdcf8b99640 1 --2- 172.21.15.116:0/1866610185 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdcf40b4670 0x7fdcf414c740 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fdcdc0098f0 tx=0x7fdcdc0046c0 comp rx=0 tx=0).stop 2024-02-21T22:53:17.535 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.545+0000 7fdcf8b99640 1 -- 172.21.15.116:0/1866610185 shutdown_connections 2024-02-21T22:53:17.535 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.545+0000 7fdcf8b99640 1 --2- 172.21.15.116:0/1866610185 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fdcd406b4d0 0x7fdcd406d990 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:17.535 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.545+0000 7fdcf8b99640 1 --2- 172.21.15.116:0/1866610185 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdcf415e0e0 0x7fdcf40c8f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:17.535 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.545+0000 7fdcf8b99640 1 --2- 172.21.15.116:0/1866610185 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdcf40b4670 0x7fdcf414c740 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:17.535 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.545+0000 7fdcf8b99640 1 --2- 172.21.15.116:0/1866610185 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdcf406da10 0x7fdcf415a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:17.535 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.545+0000 7fdcf8b99640 1 -- 172.21.15.116:0/1866610185 >> 172.21.15.116:0/1866610185 conn(0x7fdcf40b18e0 msgr2=0x7fdcf40b3850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:17.535 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.545+0000 7fdcf8b99640 1 -- 172.21.15.116:0/1866610185 shutdown_connections 2024-02-21T22:53:17.535 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.545+0000 7fdcf8b99640 1 -- 172.21.15.116:0/1866610185 wait complete. 2024-02-21T22:53:17.545 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-21T22:52:38.328796+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-02-21T22:52:48.145152+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-02-21T22:52:49.096955+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-21T22:53:17.546 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-21T22:53:17.649 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.660+0000 7f8de79dc640 1 Processor -- start 2024-02-21T22:53:17.650 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.660+0000 7f8de79dc640 1 -- start start 2024-02-21T22:53:17.652 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.661+0000 7f8de79dc640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8de0066f20 0x7f8de00b0c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:17.653 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.661+0000 7f8de79dc640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f8de00cfef0 0x7f8de00d0380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:17.653 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.661+0000 7f8de79dc640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8de00b1450 con 0x7f8de006ae40 2024-02-21T22:53:17.653 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.661+0000 7f8de79dc640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8de00ad270 con 0x7f8de00cfef0 2024-02-21T22:53:17.653 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.661+0000 7f8de79dc640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8de00ad550 con 0x7f8de0066f20 2024-02-21T22:53:17.653 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.661+0000 7f8de5778640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f8de006ae40 0x7f8de006b220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:54844/0 (socket says 172.21.15.116:54844) 2024-02-21T22:53:17.653 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.661+0000 7f8de5778640 1 -- 172.21.15.116:0/1811543650 learned_addr learned my addr 172.21.15.116:0/1811543650 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-02-21T22:53:17.653 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.661+0000 7f8de5f79640 1 --2- 172.21.15.116:0/1811543650 >> v2:172.21.15.142:3300/0 conn(0x7f8de00cfef0 0x7f8de00d0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:17.653 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.661+0000 7f8de4f77640 1 --2- 172.21.15.116:0/1811543650 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8de0066f20 0x7f8de00b0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:17.653 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.661+0000 7f8dd7fff640 1 -- 172.21.15.116:0/1811543650 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1662263571 0 0) 0x7f8de00b1450 con 0x7f8de006ae40 2024-02-21T22:53:17.653 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.661+0000 7f8dd7fff640 1 -- 172.21.15.116:0/1811543650 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8dcc003520 con 0x7f8de006ae40 2024-02-21T22:53:17.653 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.661+0000 7f8de5f79640 1 -- 172.21.15.116:0/1811543650 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8de0066f20 msgr2=0x7f8de00b0c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:53:17.653 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.661+0000 7f8de5f79640 1 --2- 172.21.15.116:0/1811543650 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8de0066f20 0x7f8de00b0c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:17.653 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.661+0000 7f8de5f79640 1 -- 172.21.15.116:0/1811543650 >> v1:172.21.15.116:6789/0 conn(0x7f8de006ae40 legacy=0x7f8de006b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:17.654 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.661+0000 7f8de5f79640 1 -- 172.21.15.116:0/1811543650 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8de00ad830 con 0x7f8de00cfef0 2024-02-21T22:53:17.654 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.661+0000 7f8de4f77640 1 --2- 172.21.15.116:0/1811543650 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8de0066f20 0x7f8de00b0c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T22:53:17.654 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.662+0000 7f8de5f79640 1 --2- 172.21.15.116:0/1811543650 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8de00cfef0 0x7f8de00d0380 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f8dd8009d90 tx=0x7f8dd802bf30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=68566346ddc77925 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:17.654 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.662+0000 7f8dd7fff640 1 -- 172.21.15.116:0/1811543650 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dd8039070 con 0x7f8de00cfef0 2024-02-21T22:53:17.654 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.662+0000 7f8dd7fff640 1 -- 172.21.15.116:0/1811543650 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dd802cce0 con 0x7f8de00cfef0 2024-02-21T22:53:17.654 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.662+0000 7f8dd7fff640 1 -- 172.21.15.116:0/1811543650 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dd8034640 con 0x7f8de00cfef0 2024-02-21T22:53:17.654 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.663+0000 7f8de79dc640 1 -- 172.21.15.116:0/1811543650 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8de00cfef0 msgr2=0x7f8de00d0380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:17.654 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.663+0000 7f8de79dc640 1 --2- 172.21.15.116:0/1811543650 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8de00cfef0 0x7f8de00d0380 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f8dd8009d90 tx=0x7f8dd802bf30 comp rx=0 tx=0).stop 2024-02-21T22:53:17.654 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.663+0000 7f8de79dc640 1 -- 172.21.15.116:0/1811543650 shutdown_connections 2024-02-21T22:53:17.654 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.663+0000 7f8de79dc640 1 --2- 172.21.15.116:0/1811543650 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8de00cfef0 0x7f8de00d0380 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:17.654 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.663+0000 7f8de79dc640 1 --2- 172.21.15.116:0/1811543650 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8de0066f20 0x7f8de00b0c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:17.654 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.663+0000 7f8de79dc640 1 -- 172.21.15.116:0/1811543650 >> 172.21.15.116:0/1811543650 conn(0x7f8de00b3250 msgr2=0x7f8de00b3660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:17.654 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.663+0000 7f8de79dc640 1 -- 172.21.15.116:0/1811543650 shutdown_connections 2024-02-21T22:53:17.654 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.663+0000 7f8de79dc640 1 -- 172.21.15.116:0/1811543650 wait complete. 2024-02-21T22:53:17.657 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.664+0000 7f8de79dc640 1 Processor -- start 2024-02-21T22:53:17.657 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.664+0000 7f8de79dc640 1 -- start start 2024-02-21T22:53:17.658 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.664+0000 7f8de79dc640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8de0066f20 0x7f8de00c8f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:17.658 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.665+0000 7f8de79dc640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8de006ae40 0x7f8de01f7350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:17.658 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.665+0000 7f8de79dc640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8de00cfef0 0x7f8de006de20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:17.658 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.665+0000 7f8de79dc640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8de00d0a40 con 0x7f8de006ae40 2024-02-21T22:53:17.658 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.665+0000 7f8de79dc640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8de00d08c0 con 0x7f8de00cfef0 2024-02-21T22:53:17.658 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.665+0000 7f8de79dc640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8de00d0bc0 con 0x7f8de0066f20 2024-02-21T22:53:17.658 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.665+0000 7f8de4f77640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8de006ae40 0x7f8de01f7350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:17.658 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.665+0000 7f8de4f77640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8de006ae40 0x7f8de01f7350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:38370/0 (socket says 172.21.15.116:38370) 2024-02-21T22:53:17.658 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.665+0000 7f8de4f77640 1 -- 172.21.15.116:0/2232049951 learned_addr learned my addr 172.21.15.116:0/2232049951 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:17.658 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.665+0000 7f8de5778640 1 --2- 172.21.15.116:0/2232049951 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8de0066f20 0x7f8de00c8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:17.658 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.665+0000 7f8de5f79640 1 --2- 172.21.15.116:0/2232049951 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8de00cfef0 0x7f8de006de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:17.658 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.665+0000 7f8de4f77640 1 -- 172.21.15.116:0/2232049951 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8de0066f20 msgr2=0x7f8de00c8f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:17.658 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.665+0000 7f8de4f77640 1 --2- 172.21.15.116:0/2232049951 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8de0066f20 0x7f8de00c8f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:17.658 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.665+0000 7f8de4f77640 1 -- 172.21.15.116:0/2232049951 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8de00cfef0 msgr2=0x7f8de006de20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:17.658 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.665+0000 7f8de4f77640 1 --2- 172.21.15.116:0/2232049951 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8de00cfef0 0x7f8de006de20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:17.659 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.665+0000 7f8de4f77640 1 -- 172.21.15.116:0/2232049951 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8de01f3d60 con 0x7f8de006ae40 2024-02-21T22:53:17.659 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.665+0000 7f8de4f77640 1 --2- 172.21.15.116:0/2232049951 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8de006ae40 0x7f8de01f7350 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f8dd000e960 tx=0x7f8dd000ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:17.659 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.665+0000 7f8dd5ffb640 1 -- 172.21.15.116:0/2232049951 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dd0017070 con 0x7f8de006ae40 2024-02-21T22:53:17.659 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.665+0000 7f8de79dc640 1 -- 172.21.15.116:0/2232049951 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8de01f7890 con 0x7f8de006ae40 2024-02-21T22:53:17.659 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.665+0000 7f8dd5ffb640 1 -- 172.21.15.116:0/2232049951 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dd000ca00 con 0x7f8de006ae40 2024-02-21T22:53:17.659 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.665+0000 7f8dd5ffb640 1 -- 172.21.15.116:0/2232049951 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dd000cdd0 con 0x7f8de006ae40 2024-02-21T22:53:17.659 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.665+0000 7f8de79dc640 1 -- 172.21.15.116:0/2232049951 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8de01f7df0 con 0x7f8de006ae40 2024-02-21T22:53:17.659 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.667+0000 7f8de79dc640 1 -- 172.21.15.116:0/2232049951 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8de00752f0 con 0x7f8de006ae40 2024-02-21T22:53:17.659 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.667+0000 7f8dd5ffb640 1 -- 172.21.15.116:0/2232049951 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f8dd001a070 con 0x7f8de006ae40 2024-02-21T22:53:17.659 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.667+0000 7f8dd5ffb640 1 --2- 172.21.15.116:0/2232049951 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f8dc406b4d0 0x7f8dc406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:17.659 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.667+0000 7f8dd5ffb640 1 -- 172.21.15.116:0/2232049951 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8dd008a090 con 0x7f8de006ae40 2024-02-21T22:53:17.659 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.667+0000 7f8de5778640 1 --2- 172.21.15.116:0/2232049951 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f8dc406b4d0 0x7f8dc406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:17.659 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.668+0000 7f8de5778640 1 --2- 172.21.15.116:0/2232049951 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f8dc406b4d0 0x7f8dc406d990 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f8ddc005880 tx=0x7f8ddc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:17.661 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.672+0000 7f8dd5ffb640 1 -- 172.21.15.116:0/2232049951 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f8de01f7890 con 0x7f8de006ae40 2024-02-21T22:53:17.831 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.841+0000 7f8de79dc640 1 -- 172.21.15.116:0/2232049951 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8de006d990 con 0x7f8de006ae40 2024-02-21T22:53:17.831 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.842+0000 7f8dd5ffb640 1 -- 172.21.15.116:0/2232049951 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8de01f3d60 con 0x7f8de006ae40 2024-02-21T22:53:17.831 INFO:teuthology.orchestra.run.smithi116.stdout:pg_num: 1 2024-02-21T22:53:17.833 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.844+0000 7f8de79dc640 1 -- 172.21.15.116:0/2232049951 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f8dc406b4d0 msgr2=0x7f8dc406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:17.833 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.844+0000 7f8de79dc640 1 --2- 172.21.15.116:0/2232049951 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f8dc406b4d0 0x7f8dc406d990 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f8ddc005880 tx=0x7f8ddc009040 comp rx=0 tx=0).stop 2024-02-21T22:53:17.833 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.844+0000 7f8de79dc640 1 -- 172.21.15.116:0/2232049951 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8de006ae40 msgr2=0x7f8de01f7350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:17.834 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.844+0000 7f8de79dc640 1 --2- 172.21.15.116:0/2232049951 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8de006ae40 0x7f8de01f7350 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f8dd000e960 tx=0x7f8dd000ee20 comp rx=0 tx=0).stop 2024-02-21T22:53:17.834 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.844+0000 7f8de79dc640 1 -- 172.21.15.116:0/2232049951 shutdown_connections 2024-02-21T22:53:17.834 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.844+0000 7f8de79dc640 1 --2- 172.21.15.116:0/2232049951 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8de00cfef0 0x7f8de006de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:17.834 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.844+0000 7f8de79dc640 1 --2- 172.21.15.116:0/2232049951 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8de006ae40 0x7f8de01f7350 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:17.834 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.844+0000 7f8de79dc640 1 --2- 172.21.15.116:0/2232049951 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f8dc406b4d0 0x7f8dc406d990 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:17.834 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.844+0000 7f8de79dc640 1 --2- 172.21.15.116:0/2232049951 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8de0066f20 0x7f8de00c8f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:17.834 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.844+0000 7f8de79dc640 1 -- 172.21.15.116:0/2232049951 >> 172.21.15.116:0/2232049951 conn(0x7f8de00b3250 msgr2=0x7f8de00b3630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:17.834 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.844+0000 7f8de79dc640 1 -- 172.21.15.116:0/2232049951 shutdown_connections 2024-02-21T22:53:17.834 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.844+0000 7f8de79dc640 1 -- 172.21.15.116:0/2232049951 wait complete. 2024-02-21T22:53:17.844 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-02-21T22:53:17.947 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.958+0000 7f81833dc640 1 Processor -- start 2024-02-21T22:53:17.947 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.958+0000 7f81833dc640 1 -- start start 2024-02-21T22:53:17.948 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.958+0000 7f81833dc640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f817c15e3d0 0x7f817c0d24e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:17.949 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.958+0000 7f81833dc640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f817c0b2200 0x7f817c0d2a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:17.949 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.958+0000 7f81833dc640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f817c0d1e80 con 0x7f817c0b2e70 2024-02-21T22:53:17.949 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.958+0000 7f81833dc640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f817c15e7b0 con 0x7f817c0b2200 2024-02-21T22:53:17.949 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.958+0000 7f81833dc640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f817c0d2120 con 0x7f817c15e3d0 2024-02-21T22:53:17.949 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.959+0000 7f8181979640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f817c0b2200 0x7f817c0d2a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:17.949 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.959+0000 7f8181979640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f817c0b2200 0x7f817c0d2a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:38380/0 (socket says 172.21.15.116:38380) 2024-02-21T22:53:17.949 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.959+0000 7f8181979640 1 -- 172.21.15.116:0/3431033748 learned_addr learned my addr 172.21.15.116:0/3431033748 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:17.949 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.959+0000 7f8181178640 1 --2- 172.21.15.116:0/3431033748 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f817c15e3d0 0x7f817c0d24e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:17.949 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.959+0000 7f8181979640 1 -- 172.21.15.116:0/3431033748 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f817c15e3d0 msgr2=0x7f817c0d24e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:53:17.949 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.959+0000 7f8181979640 1 --2- 172.21.15.116:0/3431033748 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f817c15e3d0 0x7f817c0d24e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:17.949 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.959+0000 7f8181979640 1 -- 172.21.15.116:0/3431033748 >> v1:172.21.15.142:6789/0 conn(0x7f817c0b2e70 legacy=0x7f817c0ceaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:17.950 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.959+0000 7f8181979640 1 -- 172.21.15.116:0/3431033748 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f817c0cfde0 con 0x7f817c0b2200 2024-02-21T22:53:17.953 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.960+0000 7f8181979640 1 --2- 172.21.15.116:0/3431033748 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f817c0b2200 0x7f817c0d2a20 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f8174009e50 tx=0x7f817402bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=605708d1e2ad6c1f server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:17.954 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.960+0000 7f816ffff640 1 -- 172.21.15.116:0/3431033748 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f817402cb00 con 0x7f817c0b2200 2024-02-21T22:53:17.954 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.960+0000 7f816ffff640 1 -- 172.21.15.116:0/3431033748 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f817402cca0 con 0x7f817c0b2200 2024-02-21T22:53:17.954 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.960+0000 7f816ffff640 1 -- 172.21.15.116:0/3431033748 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8174034610 con 0x7f817c0b2200 2024-02-21T22:53:17.954 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.960+0000 7f81833dc640 1 -- 172.21.15.116:0/3431033748 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f817c0b2200 msgr2=0x7f817c0d2a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:17.954 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.960+0000 7f81833dc640 1 --2- 172.21.15.116:0/3431033748 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f817c0b2200 0x7f817c0d2a20 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f8174009e50 tx=0x7f817402bf60 comp rx=0 tx=0).stop 2024-02-21T22:53:17.954 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.960+0000 7f81833dc640 1 -- 172.21.15.116:0/3431033748 shutdown_connections 2024-02-21T22:53:17.954 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.960+0000 7f81833dc640 1 --2- 172.21.15.116:0/3431033748 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f817c0b2200 0x7f817c0d2a20 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:17.954 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.960+0000 7f81833dc640 1 --2- 172.21.15.116:0/3431033748 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f817c15e3d0 0x7f817c0d24e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:17.954 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.960+0000 7f81833dc640 1 -- 172.21.15.116:0/3431033748 >> 172.21.15.116:0/3431033748 conn(0x7f817c0d3f00 msgr2=0x7f817c0d4310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:17.954 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.960+0000 7f81833dc640 1 -- 172.21.15.116:0/3431033748 shutdown_connections 2024-02-21T22:53:17.954 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.960+0000 7f81833dc640 1 -- 172.21.15.116:0/3431033748 wait complete. 2024-02-21T22:53:17.954 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.961+0000 7f81833dc640 1 Processor -- start 2024-02-21T22:53:17.954 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.962+0000 7f81833dc640 1 -- start start 2024-02-21T22:53:17.955 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.962+0000 7f81833dc640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f817c0b2200 0x7f817c0cc9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:17.955 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.962+0000 7f81833dc640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f817c0b2e70 0x7f817c0a1250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:17.955 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.962+0000 7f81833dc640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f817c15e3d0 0x7f817c1f7980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:17.955 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.962+0000 7f81833dc640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f817c0d0fa0 con 0x7f817c0b2e70 2024-02-21T22:53:17.955 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.962+0000 7f81833dc640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f817c0b0cd0 con 0x7f817c0b2200 2024-02-21T22:53:17.955 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.962+0000 7f81833dc640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f817c0d1120 con 0x7f817c15e3d0 2024-02-21T22:53:17.955 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.962+0000 7f8180977640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f817c0b2e70 0x7f817c0a1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:17.955 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.962+0000 7f8180977640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f817c0b2e70 0x7f817c0a1250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:38386/0 (socket says 172.21.15.116:38386) 2024-02-21T22:53:17.955 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.962+0000 7f8180977640 1 -- 172.21.15.116:0/3381706632 learned_addr learned my addr 172.21.15.116:0/3381706632 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:17.955 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.962+0000 7f8181178640 1 --2- 172.21.15.116:0/3381706632 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f817c0b2200 0x7f817c0cc9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:17.955 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.962+0000 7f8181979640 1 --2- 172.21.15.116:0/3381706632 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f817c15e3d0 0x7f817c1f7980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:17.955 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.963+0000 7f8180977640 1 -- 172.21.15.116:0/3381706632 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f817c15e3d0 msgr2=0x7f817c1f7980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:17.956 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.963+0000 7f8180977640 1 --2- 172.21.15.116:0/3381706632 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f817c15e3d0 0x7f817c1f7980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:17.956 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.963+0000 7f8180977640 1 -- 172.21.15.116:0/3381706632 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f817c0b2200 msgr2=0x7f817c0cc9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:17.956 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.963+0000 7f8180977640 1 --2- 172.21.15.116:0/3381706632 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f817c0b2200 0x7f817c0cc9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:17.956 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.963+0000 7f8180977640 1 -- 172.21.15.116:0/3381706632 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f817c0ccf30 con 0x7f817c0b2e70 2024-02-21T22:53:17.956 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.963+0000 7f8181178640 1 --2- 172.21.15.116:0/3381706632 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f817c0b2200 0x7f817c0cc9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T22:53:17.956 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.963+0000 7f8180977640 1 --2- 172.21.15.116:0/3381706632 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f817c0b2e70 0x7f817c0a1250 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f817000c3c0 tx=0x7f817000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:17.956 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.963+0000 7f816dffb640 1 -- 172.21.15.116:0/3381706632 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81700052d0 con 0x7f817c0b2e70 2024-02-21T22:53:17.956 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.963+0000 7f816dffb640 1 -- 172.21.15.116:0/3381706632 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8170005490 con 0x7f817c0b2e70 2024-02-21T22:53:17.956 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.963+0000 7f81833dc640 1 -- 172.21.15.116:0/3381706632 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f817c15eea0 con 0x7f817c0b2e70 2024-02-21T22:53:17.957 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.963+0000 7f816dffb640 1 -- 172.21.15.116:0/3381706632 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8170007260 con 0x7f817c0b2e70 2024-02-21T22:53:17.957 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.963+0000 7f81833dc640 1 -- 172.21.15.116:0/3381706632 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f817c15f460 con 0x7f817c0b2e70 2024-02-21T22:53:17.957 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.964+0000 7f81833dc640 1 -- 172.21.15.116:0/3381706632 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f817c0752f0 con 0x7f817c0b2e70 2024-02-21T22:53:17.957 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.964+0000 7f816dffb640 1 -- 172.21.15.116:0/3381706632 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f8170007400 con 0x7f817c0b2e70 2024-02-21T22:53:17.958 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.965+0000 7f816dffb640 1 --2- 172.21.15.116:0/3381706632 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f816006b4d0 0x7f816006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:17.958 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.965+0000 7f816dffb640 1 -- 172.21.15.116:0/3381706632 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8170089680 con 0x7f817c0b2e70 2024-02-21T22:53:17.958 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.965+0000 7f8181178640 1 --2- 172.21.15.116:0/3381706632 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f816006b4d0 0x7f816006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:17.958 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.965+0000 7f8181178640 1 --2- 172.21.15.116:0/3381706632 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f816006b4d0 0x7f816006d990 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f8178009b90 tx=0x7f8178008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:17.958 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:17.969+0000 7f816dffb640 1 -- 172.21.15.116:0/3381706632 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f817c0ccf30 con 0x7f817c0b2e70 2024-02-21T22:53:18.127 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.138+0000 7f81833dc640 1 -- 172.21.15.116:0/3381706632 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f817c0b9a70 con 0x7f817c0b2e70 2024-02-21T22:53:18.128 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.138+0000 7f816dffb640 1 -- 172.21.15.116:0/3381706632 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8170057e20 con 0x7f817c0b2e70 2024-02-21T22:53:18.128 INFO:teuthology.orchestra.run.smithi116.stdout:pg_num: 32 2024-02-21T22:53:18.130 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.140+0000 7f81833dc640 1 -- 172.21.15.116:0/3381706632 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f816006b4d0 msgr2=0x7f816006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:18.130 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.140+0000 7f81833dc640 1 --2- 172.21.15.116:0/3381706632 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f816006b4d0 0x7f816006d990 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f8178009b90 tx=0x7f8178008040 comp rx=0 tx=0).stop 2024-02-21T22:53:18.130 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.140+0000 7f81833dc640 1 -- 172.21.15.116:0/3381706632 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f817c0b2e70 msgr2=0x7f817c0a1250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:18.131 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.140+0000 7f81833dc640 1 --2- 172.21.15.116:0/3381706632 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f817c0b2e70 0x7f817c0a1250 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f817000c3c0 tx=0x7f817000c880 comp rx=0 tx=0).stop 2024-02-21T22:53:18.131 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.140+0000 7f81833dc640 1 -- 172.21.15.116:0/3381706632 shutdown_connections 2024-02-21T22:53:18.131 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.140+0000 7f81833dc640 1 --2- 172.21.15.116:0/3381706632 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f816006b4d0 0x7f816006d990 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:18.131 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.140+0000 7f81833dc640 1 --2- 172.21.15.116:0/3381706632 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f817c15e3d0 0x7f817c1f7980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:18.131 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.140+0000 7f81833dc640 1 --2- 172.21.15.116:0/3381706632 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f817c0b2e70 0x7f817c0a1250 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:18.131 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.140+0000 7f81833dc640 1 --2- 172.21.15.116:0/3381706632 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f817c0b2200 0x7f817c0cc9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:18.131 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.140+0000 7f81833dc640 1 -- 172.21.15.116:0/3381706632 >> 172.21.15.116:0/3381706632 conn(0x7f817c0d3f00 msgr2=0x7f817c06cc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:18.131 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.140+0000 7f81833dc640 1 -- 172.21.15.116:0/3381706632 shutdown_connections 2024-02-21T22:53:18.131 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.140+0000 7f81833dc640 1 -- 172.21.15.116:0/3381706632 wait complete. 2024-02-21T22:53:18.141 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-02-21T22:53:18.244 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.254+0000 7f436be1c640 1 Processor -- start 2024-02-21T22:53:18.244 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.254+0000 7f436be1c640 1 -- start start 2024-02-21T22:53:18.245 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.255+0000 7f436be1c640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f436415ae80 0x7f43640b2dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:18.245 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.255+0000 7f436be1c640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4364071d90 con 0x7f436406e310 2024-02-21T22:53:18.245 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.255+0000 7f436be1c640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4364072070 con 0x7f43640ce100 2024-02-21T22:53:18.245 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.255+0000 7f436be1c640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4364072350 con 0x7f436415ae80 2024-02-21T22:53:18.245 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.255+0000 7f4369bb8640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f436415ae80 0x7f43640b2dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:18.245 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.255+0000 7f43693b7640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f436406e310 0x7f4364070910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:54856/0 (socket says 172.21.15.116:54856) 2024-02-21T22:53:18.245 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.255+0000 7f43693b7640 1 -- 172.21.15.116:0/576357650 learned_addr learned my addr 172.21.15.116:0/576357650 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-02-21T22:53:18.245 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.255+0000 7f4369bb8640 1 -- 172.21.15.116:0/576357650 >> v1:172.21.15.142:6789/0 conn(0x7f43640ce100 legacy=0x7f4364071020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:18.246 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.255+0000 7f4369bb8640 1 -- 172.21.15.116:0/576357650 >> v1:172.21.15.116:6789/0 conn(0x7f436406e310 legacy=0x7f4364070910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:18.246 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.255+0000 7f4368bb6640 1 -- 172.21.15.116:0/576357650 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2496591504 0 0) 0x7f4364071d90 con 0x7f436406e310 2024-02-21T22:53:18.246 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.255+0000 7f4369bb8640 1 -- 172.21.15.116:0/576357650 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4364072630 con 0x7f436415ae80 2024-02-21T22:53:18.247 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.256+0000 7f4369bb8640 1 --2- 172.21.15.116:0/576357650 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f436415ae80 0x7f43640b2dc0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f4360009d90 tx=0x7f436002bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9082e052bedefac server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:18.247 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.256+0000 7f4368bb6640 1 -- 172.21.15.116:0/576357650 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4360039070 con 0x7f436415ae80 2024-02-21T22:53:18.247 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.256+0000 7f4368bb6640 1 -- 172.21.15.116:0/576357650 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f436002cd00 con 0x7f436415ae80 2024-02-21T22:53:18.247 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.256+0000 7f4368bb6640 1 -- 172.21.15.116:0/576357650 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4360034660 con 0x7f436415ae80 2024-02-21T22:53:18.247 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.257+0000 7f436be1c640 1 -- 172.21.15.116:0/576357650 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f436415ae80 msgr2=0x7f43640b2dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:18.247 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.257+0000 7f436be1c640 1 --2- 172.21.15.116:0/576357650 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f436415ae80 0x7f43640b2dc0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f4360009d90 tx=0x7f436002bf50 comp rx=0 tx=0).stop 2024-02-21T22:53:18.247 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.257+0000 7f436be1c640 1 -- 172.21.15.116:0/576357650 shutdown_connections 2024-02-21T22:53:18.247 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.257+0000 7f436be1c640 1 --2- 172.21.15.116:0/576357650 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f436415ae80 0x7f43640b2dc0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:18.247 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.257+0000 7f436be1c640 1 -- 172.21.15.116:0/576357650 >> 172.21.15.116:0/576357650 conn(0x7f43640b1740 msgr2=0x7f43640b1b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:18.248 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.257+0000 7f436be1c640 1 -- 172.21.15.116:0/576357650 shutdown_connections 2024-02-21T22:53:18.248 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.257+0000 7f436be1c640 1 -- 172.21.15.116:0/576357650 wait complete. 2024-02-21T22:53:18.251 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.258+0000 7f436be1c640 1 Processor -- start 2024-02-21T22:53:18.251 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.258+0000 7f436be1c640 1 -- start start 2024-02-21T22:53:18.251 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.259+0000 7f436be1c640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f436406e310 0x7f436414ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:18.251 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.259+0000 7f436be1c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f43640ce100 0x7f43640cf910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:18.252 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.259+0000 7f436be1c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f43640cfe50 0x7f43641416a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:18.252 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.259+0000 7f436be1c640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43640b4610 con 0x7f436406e310 2024-02-21T22:53:18.252 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.259+0000 7f436be1c640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43640b4490 con 0x7f43640ce100 2024-02-21T22:53:18.252 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.259+0000 7f436be1c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43640b4790 con 0x7f43640cfe50 2024-02-21T22:53:18.252 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.259+0000 7f4369bb8640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f436406e310 0x7f436414ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:18.252 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.259+0000 7f4369bb8640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f436406e310 0x7f436414ebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:38410/0 (socket says 172.21.15.116:38410) 2024-02-21T22:53:18.252 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.259+0000 7f4369bb8640 1 -- 172.21.15.116:0/58785855 learned_addr learned my addr 172.21.15.116:0/58785855 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:18.252 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.259+0000 7f43693b7640 1 --2- 172.21.15.116:0/58785855 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f43640ce100 0x7f43640cf910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:18.252 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.259+0000 7f436a3b9640 1 --2- 172.21.15.116:0/58785855 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f43640cfe50 0x7f43641416a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:18.252 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.259+0000 7f4369bb8640 1 -- 172.21.15.116:0/58785855 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f43640cfe50 msgr2=0x7f43641416a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:18.252 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.259+0000 7f4369bb8640 1 --2- 172.21.15.116:0/58785855 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f43640cfe50 0x7f43641416a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:18.252 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.259+0000 7f4369bb8640 1 -- 172.21.15.116:0/58785855 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f43640ce100 msgr2=0x7f43640cf910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:18.252 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.259+0000 7f4369bb8640 1 --2- 172.21.15.116:0/58785855 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f43640ce100 0x7f43640cf910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:18.252 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.259+0000 7f4369bb8640 1 -- 172.21.15.116:0/58785855 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4364142310 con 0x7f436406e310 2024-02-21T22:53:18.253 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.259+0000 7f436a3b9640 1 --2- 172.21.15.116:0/58785855 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f43640cfe50 0x7f43641416a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T22:53:18.253 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.259+0000 7f4369bb8640 1 --2- 172.21.15.116:0/58785855 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f436406e310 0x7f436414ebd0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f4360037040 tx=0x7f4360004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:18.253 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.259+0000 7f435a7fc640 1 -- 172.21.15.116:0/58785855 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4360039050 con 0x7f436406e310 2024-02-21T22:53:18.253 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.259+0000 7f435a7fc640 1 -- 172.21.15.116:0/58785855 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f436003a040 con 0x7f436406e310 2024-02-21T22:53:18.253 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.259+0000 7f435a7fc640 1 -- 172.21.15.116:0/58785855 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4360003bd0 con 0x7f436406e310 2024-02-21T22:53:18.253 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.259+0000 7f436be1c640 1 -- 172.21.15.116:0/58785855 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43641425f0 con 0x7f436406e310 2024-02-21T22:53:18.253 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.260+0000 7f436be1c640 1 -- 172.21.15.116:0/58785855 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4364141be0 con 0x7f436406e310 2024-02-21T22:53:18.253 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.260+0000 7f436be1c640 1 -- 172.21.15.116:0/58785855 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43640d0260 con 0x7f436406e310 2024-02-21T22:53:18.253 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.261+0000 7f435a7fc640 1 -- 172.21.15.116:0/58785855 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f4360047030 con 0x7f436406e310 2024-02-21T22:53:18.253 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.261+0000 7f435a7fc640 1 --2- 172.21.15.116:0/58785855 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f434806b500 0x7f434806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:18.253 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.261+0000 7f435a7fc640 1 -- 172.21.15.116:0/58785855 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f43600ac660 con 0x7f436406e310 2024-02-21T22:53:18.253 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.261+0000 7f43693b7640 1 --2- 172.21.15.116:0/58785855 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f434806b500 0x7f434806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:18.253 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.262+0000 7f43693b7640 1 --2- 172.21.15.116:0/58785855 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f434806b500 0x7f434806d9c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f43641529c0 tx=0x7f4354007e40 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:18.255 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.266+0000 7f435a7fc640 1 -- 172.21.15.116:0/58785855 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f43640d0260 con 0x7f436406e310 2024-02-21T22:53:18.428 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.438+0000 7f436be1c640 1 -- 172.21.15.116:0/58785855 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f43640752f0 con 0x7f436406e310 2024-02-21T22:53:18.428 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.439+0000 7f435a7fc640 1 -- 172.21.15.116:0/58785855 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f436004e020 con 0x7f436406e310 2024-02-21T22:53:18.429 INFO:teuthology.orchestra.run.smithi116.stdout:pg_num: 64 2024-02-21T22:53:18.430 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.441+0000 7f436be1c640 1 -- 172.21.15.116:0/58785855 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f434806b500 msgr2=0x7f434806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:18.431 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.441+0000 7f436be1c640 1 --2- 172.21.15.116:0/58785855 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f434806b500 0x7f434806d9c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f43641529c0 tx=0x7f4354007e40 comp rx=0 tx=0).stop 2024-02-21T22:53:18.431 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.441+0000 7f436be1c640 1 -- 172.21.15.116:0/58785855 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f436406e310 msgr2=0x7f436414ebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:18.431 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.441+0000 7f436be1c640 1 --2- 172.21.15.116:0/58785855 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f436406e310 0x7f436414ebd0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f4360037040 tx=0x7f4360004a40 comp rx=0 tx=0).stop 2024-02-21T22:53:18.431 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.441+0000 7f436be1c640 1 -- 172.21.15.116:0/58785855 shutdown_connections 2024-02-21T22:53:18.431 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.441+0000 7f436be1c640 1 --2- 172.21.15.116:0/58785855 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f434806b500 0x7f434806d9c0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:18.431 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.441+0000 7f436be1c640 1 --2- 172.21.15.116:0/58785855 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f43640cfe50 0x7f43641416a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:18.431 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.441+0000 7f436be1c640 1 --2- 172.21.15.116:0/58785855 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f43640ce100 0x7f43640cf910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:18.431 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.441+0000 7f436be1c640 1 --2- 172.21.15.116:0/58785855 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f436406e310 0x7f436414ebd0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:18.431 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.441+0000 7f436be1c640 1 -- 172.21.15.116:0/58785855 >> 172.21.15.116:0/58785855 conn(0x7f43640b1740 msgr2=0x7f43640b32d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:18.431 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.441+0000 7f436be1c640 1 -- 172.21.15.116:0/58785855 shutdown_connections 2024-02-21T22:53:18.431 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.441+0000 7f436be1c640 1 -- 172.21.15.116:0/58785855 wait complete. 2024-02-21T22:53:18.441 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-21T22:53:18.541 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.551+0000 7f4257836640 1 Processor -- start 2024-02-21T22:53:18.541 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.551+0000 7f4257836640 1 -- start start 2024-02-21T22:53:18.542 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.552+0000 7f4257836640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4250160530 0x7f42500cfcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:18.542 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.552+0000 7f4257836640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f42500cc990 0x7f42500ce520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:18.543 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.552+0000 7f4257836640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42500b26d0 con 0x7f425015c190 2024-02-21T22:53:18.543 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.552+0000 7f4257836640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42500b2d50 con 0x7f42500cc990 2024-02-21T22:53:18.543 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.552+0000 7f4257836640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42500b3310 con 0x7f4250160530 2024-02-21T22:53:18.543 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.552+0000 7f4255dd3640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f42500cc990 0x7f42500ce520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:18.543 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.552+0000 7f4255dd3640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f42500cc990 0x7f42500ce520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:38422/0 (socket says 172.21.15.116:38422) 2024-02-21T22:53:18.543 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.552+0000 7f4255dd3640 1 -- 172.21.15.116:0/282499982 learned_addr learned my addr 172.21.15.116:0/282499982 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:18.543 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.552+0000 7f4254dd1640 1 --2- 172.21.15.116:0/282499982 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4250160530 0x7f42500cfcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:18.543 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.553+0000 7f4255dd3640 1 -- 172.21.15.116:0/282499982 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4250160530 msgr2=0x7f42500cfcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:53:18.543 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.553+0000 7f4247fff640 1 -- 172.21.15.116:0/282499982 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 243654820 0 0) 0x7f42500b26d0 con 0x7f425015c190 2024-02-21T22:53:18.543 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.553+0000 7f4255dd3640 1 --2- 172.21.15.116:0/282499982 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4250160530 0x7f42500cfcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:18.543 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.553+0000 7f4255dd3640 1 -- 172.21.15.116:0/282499982 >> v1:172.21.15.142:6789/0 conn(0x7f425015c190 legacy=0x7f425015fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:18.543 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.553+0000 7f4255dd3640 1 -- 172.21.15.116:0/282499982 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42500b29b0 con 0x7f42500cc990 2024-02-21T22:53:18.545 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.553+0000 7f4255dd3640 1 --2- 172.21.15.116:0/282499982 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f42500cc990 0x7f42500ce520 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f4248009870 tx=0x7f424802b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d482ae844d16e56 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:18.545 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.554+0000 7f4247fff640 1 -- 172.21.15.116:0/282499982 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4248034070 con 0x7f42500cc990 2024-02-21T22:53:18.545 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.554+0000 7f4247fff640 1 -- 172.21.15.116:0/282499982 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4248030840 con 0x7f42500cc990 2024-02-21T22:53:18.545 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.554+0000 7f4247fff640 1 -- 172.21.15.116:0/282499982 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4248030c10 con 0x7f42500cc990 2024-02-21T22:53:18.545 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.554+0000 7f4257836640 1 -- 172.21.15.116:0/282499982 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f42500cc990 msgr2=0x7f42500ce520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:18.545 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.554+0000 7f4257836640 1 --2- 172.21.15.116:0/282499982 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f42500cc990 0x7f42500ce520 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f4248009870 tx=0x7f424802b980 comp rx=0 tx=0).stop 2024-02-21T22:53:18.546 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.554+0000 7f4257836640 1 -- 172.21.15.116:0/282499982 shutdown_connections 2024-02-21T22:53:18.546 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.554+0000 7f4257836640 1 --2- 172.21.15.116:0/282499982 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f42500cc990 0x7f42500ce520 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:18.546 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.554+0000 7f4257836640 1 --2- 172.21.15.116:0/282499982 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4250160530 0x7f42500cfcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:18.546 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.554+0000 7f4257836640 1 -- 172.21.15.116:0/282499982 >> 172.21.15.116:0/282499982 conn(0x7f42500d1be0 msgr2=0x7f42500d1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:18.546 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.554+0000 7f4257836640 1 -- 172.21.15.116:0/282499982 shutdown_connections 2024-02-21T22:53:18.546 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.554+0000 7f4257836640 1 -- 172.21.15.116:0/282499982 wait complete. 2024-02-21T22:53:18.546 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.555+0000 7f4257836640 1 Processor -- start 2024-02-21T22:53:18.546 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.555+0000 7f4257836640 1 -- start start 2024-02-21T22:53:18.549 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.556+0000 7f4257836640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f42500cc990 0x7f42500c83b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:18.549 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.556+0000 7f4257836640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f425015c190 0x7f425014d030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:18.549 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.556+0000 7f4257836640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4250160530 0x7f425015f060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:18.549 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.556+0000 7f4257836640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f425015c570 con 0x7f4250160530 2024-02-21T22:53:18.549 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.556+0000 7f4257836640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42500d0230 con 0x7f42500cc990 2024-02-21T22:53:18.549 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.556+0000 7f4257836640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f425015c6f0 con 0x7f425015c190 2024-02-21T22:53:18.549 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.556+0000 7f4255dd3640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4250160530 0x7f425015f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:18.550 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.556+0000 7f4255dd3640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4250160530 0x7f425015f060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:38434/0 (socket says 172.21.15.116:38434) 2024-02-21T22:53:18.550 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.556+0000 7f4255dd3640 1 -- 172.21.15.116:0/2498802883 learned_addr learned my addr 172.21.15.116:0/2498802883 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:18.550 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.556+0000 7f42555d2640 1 --2- 172.21.15.116:0/2498802883 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f42500cc990 0x7f42500c83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:18.550 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.556+0000 7f4254dd1640 1 --2- 172.21.15.116:0/2498802883 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f425015c190 0x7f425014d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:18.550 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.557+0000 7f4255dd3640 1 -- 172.21.15.116:0/2498802883 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f425015c190 msgr2=0x7f425014d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:18.550 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.557+0000 7f4255dd3640 1 --2- 172.21.15.116:0/2498802883 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f425015c190 0x7f425014d030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:18.550 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.557+0000 7f4255dd3640 1 -- 172.21.15.116:0/2498802883 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f42500cc990 msgr2=0x7f42500c83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:18.550 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.557+0000 7f4255dd3640 1 --2- 172.21.15.116:0/2498802883 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f42500cc990 0x7f42500c83b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:18.550 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.557+0000 7f4255dd3640 1 -- 172.21.15.116:0/2498802883 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f425015dfc0 con 0x7f4250160530 2024-02-21T22:53:18.551 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.557+0000 7f4255dd3640 1 --2- 172.21.15.116:0/2498802883 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4250160530 0x7f425015f060 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f4248009870 tx=0x7f4248004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:18.551 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.557+0000 7f4245ffb640 1 -- 172.21.15.116:0/2498802883 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4248048070 con 0x7f4250160530 2024-02-21T22:53:18.551 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.557+0000 7f4245ffb640 1 -- 172.21.15.116:0/2498802883 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4248030640 con 0x7f4250160530 2024-02-21T22:53:18.551 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.557+0000 7f4257836640 1 -- 172.21.15.116:0/2498802883 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f425015e2a0 con 0x7f4250160530 2024-02-21T22:53:18.551 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.557+0000 7f4245ffb640 1 -- 172.21.15.116:0/2498802883 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4248034040 con 0x7f4250160530 2024-02-21T22:53:18.551 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.557+0000 7f4257836640 1 -- 172.21.15.116:0/2498802883 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f425015e860 con 0x7f4250160530 2024-02-21T22:53:18.551 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.558+0000 7f4257836640 1 -- 172.21.15.116:0/2498802883 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42500752f0 con 0x7f4250160530 2024-02-21T22:53:18.551 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.558+0000 7f4245ffb640 1 -- 172.21.15.116:0/2498802883 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f424804b070 con 0x7f4250160530 2024-02-21T22:53:18.551 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.559+0000 7f4245ffb640 1 --2- 172.21.15.116:0/2498802883 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f423406b4d0 0x7f423406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:18.551 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.559+0000 7f4245ffb640 1 -- 172.21.15.116:0/2498802883 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f42480ac130 con 0x7f4250160530 2024-02-21T22:53:18.551 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.559+0000 7f42555d2640 1 --2- 172.21.15.116:0/2498802883 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f423406b4d0 0x7f423406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:18.552 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.559+0000 7f42555d2640 1 --2- 172.21.15.116:0/2498802883 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f423406b4d0 0x7f423406d990 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f424c0012e0 tx=0x7f424c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:18.553 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.563+0000 7f4245ffb640 1 -- 172.21.15.116:0/2498802883 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f424807aa80 con 0x7f4250160530 2024-02-21T22:53:18.723 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.733+0000 7f4257836640 1 -- 172.21.15.116:0/2498802883 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f425015abe0 con 0x7f4250160530 2024-02-21T22:53:18.724 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.734+0000 7f4245ffb640 1 -- 172.21.15.116:0/2498802883 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16653 (secure 0 0 0) 0x7f424807eb20 con 0x7f4250160530 2024-02-21T22:53:18.724 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-02-21T22:53:18.724 INFO:teuthology.orchestra.run.smithi116.stdout:{"epoch":20,"fsid":"7c298660-5f63-4b5c-a800-58c5be9a8445","created":"2024-02-21T22:52:25.994613+0000","modified":"2024-02-21T22:52:51.786454+0000","last_up_change":"2024-02-21T22:52:37.313595+0000","last_in_change":"2024-02-21T22:52:28.176031+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-21T22:52:38.328796+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-21T22:52:48.145152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-21T22:52:49.096955+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4f09126b-b5e4-4876-8b08-f5cbb967388a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":1613202231},{"type":"v1","addr":"172.21.15.116:6809","nonce":1613202231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":1613202231},{"type":"v1","addr":"172.21.15.116:6811","nonce":1613202231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":1613202231},{"type":"v1","addr":"172.21.15.116:6815","nonce":1613202231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":1613202231},{"type":"v1","addr":"172.21.15.116:6813","nonce":1613202231}]},"public_addr":"172.21.15.116:6809/1613202231","cluster_addr":"172.21.15.116:6811/1613202231","heartbeat_back_addr":"172.21.15.116:6815/1613202231","heartbeat_front_addr":"172.21.15.116:6813/1613202231","state":["exists","up"]},{"osd":1,"uuid":"7272c51d-51f9-4536-931d-33ad7a4b377e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6816","nonce":172614746},{"type":"v1","addr":"172.21.15.116:6817","nonce":172614746}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":172614746},{"type":"v1","addr":"172.21.15.116:6819","nonce":172614746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":172614746},{"type":"v1","addr":"172.21.15.116:6823","nonce":172614746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":172614746},{"type":"v1","addr":"172.21.15.116:6821","nonce":172614746}]},"public_addr":"172.21.15.116:6817/172614746","cluster_addr":"172.21.15.116:6819/172614746","heartbeat_back_addr":"172.21.15.116:6823/172614746","heartbeat_front_addr":"172.21.15.116:6821/172614746","state":["exists","up"]},{"osd":2,"uuid":"2589616c-adf1-4187-aac3-735256cf624b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":1029280577},{"type":"v1","addr":"172.21.15.116:6825","nonce":1029280577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":1029280577},{"type":"v1","addr":"172.21.15.116:6827","nonce":1029280577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":1029280577},{"type":"v1","addr":"172.21.15.116:6831","nonce":1029280577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":1029280577},{"type":"v1","addr":"172.21.15.116:6829","nonce":1029280577}]},"public_addr":"172.21.15.116:6825/1029280577","cluster_addr":"172.21.15.116:6827/1029280577","heartbeat_back_addr":"172.21.15.116:6831/1029280577","heartbeat_front_addr":"172.21.15.116:6829/1029280577","state":["exists","up"]},{"osd":3,"uuid":"0fd2e563-7c5b-46f6-82c2-b60c86072c93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":3106627557},{"type":"v1","addr":"172.21.15.116:6801","nonce":3106627557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":3106627557},{"type":"v1","addr":"172.21.15.116:6803","nonce":3106627557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":3106627557},{"type":"v1","addr":"172.21.15.116:6807","nonce":3106627557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":3106627557},{"type":"v1","addr":"172.21.15.116:6805","nonce":3106627557}]},"public_addr":"172.21.15.116:6801/3106627557","cluster_addr":"172.21.15.116:6803/3106627557","heartbeat_back_addr":"172.21.15.116:6807/3106627557","heartbeat_front_addr":"172.21.15.116:6805/3106627557","state":["exists","up"]},{"osd":4,"uuid":"79ae35b7-dda8-4ab8-96ce-47515afde082","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":3231407772},{"type":"v1","addr":"172.21.15.142:6825","nonce":3231407772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":3231407772},{"type":"v1","addr":"172.21.15.142:6827","nonce":3231407772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":3231407772},{"type":"v1","addr":"172.21.15.142:6831","nonce":3231407772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":3231407772},{"type":"v1","addr":"172.21.15.142:6829","nonce":3231407772}]},"public_addr":"172.21.15.142:6825/3231407772","cluster_addr":"172.21.15.142:6827/3231407772","heartbeat_back_addr":"172.21.15.142:6831/3231407772","heartbeat_front_addr":"172.21.15.142:6829/3231407772","state":["exists","up"]},{"osd":5,"uuid":"3166eb2c-3fcf-41c8-9362-45bafaabaa39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":1184158716},{"type":"v1","addr":"172.21.15.142:6817","nonce":1184158716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":1184158716},{"type":"v1","addr":"172.21.15.142:6819","nonce":1184158716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":1184158716},{"type":"v1","addr":"172.21.15.142:6823","nonce":1184158716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":1184158716},{"type":"v1","addr":"172.21.15.142:6821","nonce":1184158716}]},"public_addr":"172.21.15.142:6817/1184158716","cluster_addr":"172.21.15.142:6819/1184158716","heartbeat_back_addr":"172.21.15.142:6823/1184158716","heartbeat_front_addr":"172.21.15.142:6821/1184158716","state":["exists","up"]},{"osd":6,"uuid":"f9aa9672-7527-43e2-963e-b61868e5e63f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":1987868911},{"type":"v1","addr":"172.21.15.142:6801","nonce":1987868911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":1987868911},{"type":"v1","addr":"172.21.15.142:6803","nonce":1987868911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":1987868911},{"type":"v1","addr":"172.21.15.142:6807","nonce":1987868911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":1987868911},{"type":"v1","addr":"172.21.15.142:6805","nonce":1987868911}]},"public_addr":"172.21.15.142:6801/1987868911","cluster_addr":"172.21.15.142:6803/1987868911","heartbeat_back_addr":"172.21.15.142:6807/1987868911","heartbeat_front_addr":"172.21.15.142:6805/1987868911","state":["exists","up"]},{"osd":7,"uuid":"7ed29226-fc42-4382-a91a-fa50f7ec5426","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":1272081937},{"type":"v1","addr":"172.21.15.142:6809","nonce":1272081937}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":1272081937},{"type":"v1","addr":"172.21.15.142:6811","nonce":1272081937}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":1272081937},{"type":"v1","addr":"172.21.15.142:6815","nonce":1272081937}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":1272081937},{"type":"v1","addr":"172.21.15.142:6813","nonce":1272081937}]},"public_addr":"172.21.15.142:6809/1272081937","cluster_addr":"172.21.15.142:6811/1272081937","heartbeat_back_addr":"172.21.15.142:6815/1272081937","heartbeat_front_addr":"172.21.15.142:6813/1272081937","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.350998+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.307201+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.289112+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.243888+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.312091+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.370472+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.275659+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.289297+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-21T22:53:18.726 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.736+0000 7f4257836640 1 -- 172.21.15.116:0/2498802883 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f423406b4d0 msgr2=0x7f423406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:18.726 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.736+0000 7f4257836640 1 --2- 172.21.15.116:0/2498802883 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f423406b4d0 0x7f423406d990 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f424c0012e0 tx=0x7f424c009040 comp rx=0 tx=0).stop 2024-02-21T22:53:18.726 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.736+0000 7f4257836640 1 -- 172.21.15.116:0/2498802883 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4250160530 msgr2=0x7f425015f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:18.727 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.736+0000 7f4257836640 1 --2- 172.21.15.116:0/2498802883 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4250160530 0x7f425015f060 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f4248009870 tx=0x7f4248004730 comp rx=0 tx=0).stop 2024-02-21T22:53:18.727 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.736+0000 7f4257836640 1 -- 172.21.15.116:0/2498802883 shutdown_connections 2024-02-21T22:53:18.727 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.736+0000 7f4257836640 1 --2- 172.21.15.116:0/2498802883 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4250160530 0x7f425015f060 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:18.727 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.736+0000 7f4257836640 1 --2- 172.21.15.116:0/2498802883 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f423406b4d0 0x7f423406d990 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:18.727 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.736+0000 7f4257836640 1 --2- 172.21.15.116:0/2498802883 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f425015c190 0x7f425014d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:18.727 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.736+0000 7f4257836640 1 --2- 172.21.15.116:0/2498802883 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f42500cc990 0x7f42500c83b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:18.727 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.736+0000 7f4257836640 1 -- 172.21.15.116:0/2498802883 >> 172.21.15.116:0/2498802883 conn(0x7f42500d1be0 msgr2=0x7f42500d1fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:18.727 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.737+0000 7f4257836640 1 -- 172.21.15.116:0/2498802883 shutdown_connections 2024-02-21T22:53:18.727 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.737+0000 7f4257836640 1 -- 172.21.15.116:0/2498802883 wait complete. 2024-02-21T22:53:18.737 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-21T22:52:38.328796+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-02-21T22:52:48.145152+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-02-21T22:52:49.096955+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-21T22:53:18.738 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-21T22:53:18.841 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.851+0000 7f7ebb036640 1 Processor -- start 2024-02-21T22:53:18.841 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.851+0000 7f7ebb036640 1 -- start start 2024-02-21T22:53:18.843 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.852+0000 7f7ebb036640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f7eb40cd1d0 0x7f7eb40b41e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:18.843 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.852+0000 7f7ebb036640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f7eb415f990 0x7f7eb415fde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:18.843 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.852+0000 7f7ebb036640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7eb415c280 con 0x7f7eb415bea0 2024-02-21T22:53:18.843 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.852+0000 7f7ebb036640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7eb4160320 con 0x7f7eb415f990 2024-02-21T22:53:18.843 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.852+0000 7f7ebb036640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7eb40cda90 con 0x7f7eb40cd1d0 2024-02-21T22:53:18.843 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.852+0000 7f7eb95d3640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f7eb415f990 0x7f7eb415fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:18.843 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.852+0000 7f7eb8dd2640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f7eb415bea0 0x7f7eb40d0390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.116:59454/0 (socket says 172.21.15.116:59454) 2024-02-21T22:53:18.843 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.852+0000 7f7eb8dd2640 1 -- 172.21.15.116:0/3642291291 learned_addr learned my addr 172.21.15.116:0/3642291291 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-02-21T22:53:18.843 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.852+0000 7f7eb3fff640 1 --2- 172.21.15.116:0/3642291291 >> v2:172.21.15.142:3300/0 conn(0x7f7eb40cd1d0 0x7f7eb40b41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:18.844 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.853+0000 7f7eb95d3640 1 -- 172.21.15.116:0/3642291291 >> v2:172.21.15.142:3300/0 conn(0x7f7eb40cd1d0 msgr2=0x7f7eb40b41e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:53:18.844 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.853+0000 7f7eb95d3640 1 --2- 172.21.15.116:0/3642291291 >> v2:172.21.15.142:3300/0 conn(0x7f7eb40cd1d0 0x7f7eb40b41e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:18.844 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.853+0000 7f7eb95d3640 1 -- 172.21.15.116:0/3642291291 >> v1:172.21.15.142:6789/0 conn(0x7f7eb415bea0 legacy=0x7f7eb40d0390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:18.844 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.853+0000 7f7eb95d3640 1 -- 172.21.15.116:0/3642291291 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7eb41607c0 con 0x7f7eb415f990 2024-02-21T22:53:18.844 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.853+0000 7f7eb95d3640 1 --2- 172.21.15.116:0/3642291291 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7eb415f990 0x7f7eb415fde0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f7eb4071a10 tx=0x7f7eac02be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3114af7045c1fdaa server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:18.844 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.853+0000 7f7eb37fe640 1 -- 172.21.15.116:0/3642291291 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eac039070 con 0x7f7eb415f990 2024-02-21T22:53:18.844 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.853+0000 7f7eb37fe640 1 -- 172.21.15.116:0/3642291291 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7eac02cbf0 con 0x7f7eb415f990 2024-02-21T22:53:18.844 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.853+0000 7f7eb37fe640 1 -- 172.21.15.116:0/3642291291 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eac034440 con 0x7f7eb415f990 2024-02-21T22:53:18.849 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.854+0000 7f7ebb036640 1 -- 172.21.15.116:0/3642291291 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7eb415f990 msgr2=0x7f7eb415fde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:18.849 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.854+0000 7f7ebb036640 1 --2- 172.21.15.116:0/3642291291 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7eb415f990 0x7f7eb415fde0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f7eb4071a10 tx=0x7f7eac02be40 comp rx=0 tx=0).stop 2024-02-21T22:53:18.850 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.854+0000 7f7ebb036640 1 -- 172.21.15.116:0/3642291291 shutdown_connections 2024-02-21T22:53:18.850 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.854+0000 7f7ebb036640 1 --2- 172.21.15.116:0/3642291291 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7eb415f990 0x7f7eb415fde0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:18.850 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.854+0000 7f7ebb036640 1 --2- 172.21.15.116:0/3642291291 >> v2:172.21.15.142:3300/0 conn(0x7f7eb40cd1d0 0x7f7eb40b41e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:18.850 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.854+0000 7f7ebb036640 1 -- 172.21.15.116:0/3642291291 >> 172.21.15.116:0/3642291291 conn(0x7f7eb40b36c0 msgr2=0x7f7eb40b3ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:18.850 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.854+0000 7f7ebb036640 1 -- 172.21.15.116:0/3642291291 shutdown_connections 2024-02-21T22:53:18.850 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.854+0000 7f7ebb036640 1 -- 172.21.15.116:0/3642291291 wait complete. 2024-02-21T22:53:18.850 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.855+0000 7f7ebb036640 1 Processor -- start 2024-02-21T22:53:18.850 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.855+0000 7f7ebb036640 1 -- start start 2024-02-21T22:53:18.850 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.856+0000 7f7ebb036640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7eb40cd1d0 0x7f7eb40b5750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:18.850 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.856+0000 7f7ebb036640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7eb415bea0 0x7f7eb41580b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:18.850 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.856+0000 7f7ebb036640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7eb415f990 0x7f7eb415eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:18.850 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.856+0000 7f7ebb036640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7eb40cfb90 con 0x7f7eb415bea0 2024-02-21T22:53:18.850 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.856+0000 7f7ebb036640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7eb40cf8b0 con 0x7f7eb40cd1d0 2024-02-21T22:53:18.851 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.856+0000 7f7ebb036640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7eb40cfe70 con 0x7f7eb415f990 2024-02-21T22:53:18.851 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.856+0000 7f7eb3fff640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7eb415bea0 0x7f7eb41580b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:18.851 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.856+0000 7f7eb3fff640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7eb415bea0 0x7f7eb41580b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:38458/0 (socket says 172.21.15.116:38458) 2024-02-21T22:53:18.851 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.856+0000 7f7eb3fff640 1 -- 172.21.15.116:0/2475103722 learned_addr learned my addr 172.21.15.116:0/2475103722 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:18.851 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.856+0000 7f7eb8dd2640 1 --2- 172.21.15.116:0/2475103722 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7eb40cd1d0 0x7f7eb40b5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:18.851 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.856+0000 7f7eb95d3640 1 --2- 172.21.15.116:0/2475103722 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7eb415f990 0x7f7eb415eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:18.851 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.856+0000 7f7eb3fff640 1 -- 172.21.15.116:0/2475103722 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7eb415f990 msgr2=0x7f7eb415eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:18.851 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.856+0000 7f7eb3fff640 1 --2- 172.21.15.116:0/2475103722 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7eb415f990 0x7f7eb415eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:18.851 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.856+0000 7f7eb3fff640 1 -- 172.21.15.116:0/2475103722 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7eb40cd1d0 msgr2=0x7f7eb40b5750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:18.851 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.856+0000 7f7eb3fff640 1 --2- 172.21.15.116:0/2475103722 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7eb40cd1d0 0x7f7eb40b5750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:18.851 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.856+0000 7f7eb3fff640 1 -- 172.21.15.116:0/2475103722 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7eb40b5c90 con 0x7f7eb415bea0 2024-02-21T22:53:18.851 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.857+0000 7f7eb3fff640 1 --2- 172.21.15.116:0/2475103722 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7eb415bea0 0x7f7eb41580b0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f7ea800e9e0 tx=0x7f7ea800eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:18.851 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.857+0000 7f7eb17fa640 1 -- 172.21.15.116:0/2475103722 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ea8017070 con 0x7f7eb415bea0 2024-02-21T22:53:18.851 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.857+0000 7f7eb17fa640 1 -- 172.21.15.116:0/2475103722 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ea800c9d0 con 0x7f7eb415bea0 2024-02-21T22:53:18.852 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.857+0000 7f7ebb036640 1 -- 172.21.15.116:0/2475103722 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7eb40c8ed0 con 0x7f7eb415bea0 2024-02-21T22:53:18.852 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.857+0000 7f7eb17fa640 1 -- 172.21.15.116:0/2475103722 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ea800cdc0 con 0x7f7eb415bea0 2024-02-21T22:53:18.852 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.857+0000 7f7ebb036640 1 -- 172.21.15.116:0/2475103722 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7eb40c9490 con 0x7f7eb415bea0 2024-02-21T22:53:18.852 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.858+0000 7f7ebb036640 1 -- 172.21.15.116:0/2475103722 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7eb40c8c60 con 0x7f7eb415bea0 2024-02-21T22:53:18.852 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.858+0000 7f7eb17fa640 1 -- 172.21.15.116:0/2475103722 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f7ea801a070 con 0x7f7eb415bea0 2024-02-21T22:53:18.852 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.859+0000 7f7eb17fa640 1 --2- 172.21.15.116:0/2475103722 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f7ea006b500 0x7f7ea006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:18.852 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.859+0000 7f7eb17fa640 1 -- 172.21.15.116:0/2475103722 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7ea808a090 con 0x7f7eb415bea0 2024-02-21T22:53:18.853 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.859+0000 7f7eb8dd2640 1 --2- 172.21.15.116:0/2475103722 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f7ea006b500 0x7f7ea006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:18.853 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.859+0000 7f7eb8dd2640 1 --2- 172.21.15.116:0/2475103722 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f7ea006b500 0x7f7ea006d9c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f7ea4005880 tx=0x7f7ea4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:18.853 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:18.863+0000 7f7eb17fa640 1 -- 172.21.15.116:0/2475103722 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f7ea8058950 con 0x7f7eb415bea0 2024-02-21T22:53:19.026 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.036+0000 7f7ebb036640 1 -- 172.21.15.116:0/2475103722 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7eb40752f0 con 0x7f7eb415bea0 2024-02-21T22:53:19.026 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.036+0000 7f7eb17fa640 1 -- 172.21.15.116:0/2475103722 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7ea805c9f0 con 0x7f7eb415bea0 2024-02-21T22:53:19.026 INFO:teuthology.orchestra.run.smithi116.stdout:pg_num: 1 2024-02-21T22:53:19.028 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.038+0000 7f7ebb036640 1 -- 172.21.15.116:0/2475103722 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f7ea006b500 msgr2=0x7f7ea006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:19.028 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.038+0000 7f7ebb036640 1 --2- 172.21.15.116:0/2475103722 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f7ea006b500 0x7f7ea006d9c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f7ea4005880 tx=0x7f7ea4009040 comp rx=0 tx=0).stop 2024-02-21T22:53:19.029 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.038+0000 7f7ebb036640 1 -- 172.21.15.116:0/2475103722 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7eb415bea0 msgr2=0x7f7eb41580b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:19.029 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.038+0000 7f7ebb036640 1 --2- 172.21.15.116:0/2475103722 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7eb415bea0 0x7f7eb41580b0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f7ea800e9e0 tx=0x7f7ea800eea0 comp rx=0 tx=0).stop 2024-02-21T22:53:19.029 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.038+0000 7f7ebb036640 1 -- 172.21.15.116:0/2475103722 shutdown_connections 2024-02-21T22:53:19.029 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.038+0000 7f7ebb036640 1 --2- 172.21.15.116:0/2475103722 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f7ea006b500 0x7f7ea006d9c0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:19.029 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.038+0000 7f7ebb036640 1 --2- 172.21.15.116:0/2475103722 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7eb415f990 0x7f7eb415eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:19.029 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.038+0000 7f7ebb036640 1 --2- 172.21.15.116:0/2475103722 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7eb415bea0 0x7f7eb41580b0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:19.029 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.038+0000 7f7ebb036640 1 --2- 172.21.15.116:0/2475103722 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7eb40cd1d0 0x7f7eb40b5750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:19.029 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.038+0000 7f7ebb036640 1 -- 172.21.15.116:0/2475103722 >> 172.21.15.116:0/2475103722 conn(0x7f7eb40b36c0 msgr2=0x7f7eb40b18b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:19.029 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.039+0000 7f7ebb036640 1 -- 172.21.15.116:0/2475103722 shutdown_connections 2024-02-21T22:53:19.029 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.039+0000 7f7ebb036640 1 -- 172.21.15.116:0/2475103722 wait complete. 2024-02-21T22:53:19.039 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-02-21T22:53:19.142 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.152+0000 7f271b31e640 1 Processor -- start 2024-02-21T22:53:19.143 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.153+0000 7f271b31e640 1 -- start start 2024-02-21T22:53:19.145 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.153+0000 7f271b31e640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f271415c140 0x7f27140cd590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:19.146 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.153+0000 7f271b31e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f27140cf260 0x7f27140ce5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:19.146 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.153+0000 7f271b31e640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f27140ceb00 0x7f27140cfda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:19.146 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.153+0000 7f271b31e640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27140cdde0 con 0x7f271415c140 2024-02-21T22:53:19.146 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.153+0000 7f271b31e640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27140ce0c0 con 0x7f27140ceb00 2024-02-21T22:53:19.146 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.153+0000 7f271b31e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27140b4cf0 con 0x7f27140cf260 2024-02-21T22:53:19.146 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.154+0000 7f27190ba640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f271415c140 0x7f27140cd590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:19.146 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.154+0000 7f27190ba640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f271415c140 0x7f27140cd590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:38470/0 (socket says 172.21.15.116:38470) 2024-02-21T22:53:19.146 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.154+0000 7f27188b9640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f27140cf260 0x7f27140ce5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:19.146 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.154+0000 7f27198bb640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f27140ceb00 0x7f27140cfda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:19.146 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.154+0000 7f27190ba640 1 -- 172.21.15.116:0/4220671292 learned_addr learned my addr 172.21.15.116:0/4220671292 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:19.146 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.154+0000 7f27190ba640 1 -- 172.21.15.116:0/4220671292 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f27140cf260 msgr2=0x7f27140ce5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:53:19.146 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.154+0000 7f27190ba640 1 --2- 172.21.15.116:0/4220671292 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f27140cf260 0x7f27140ce5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:19.146 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.154+0000 7f27190ba640 1 -- 172.21.15.116:0/4220671292 >> v2:172.21.15.142:3300/0 conn(0x7f27140ceb00 msgr2=0x7f27140cfda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:53:19.146 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.154+0000 7f27190ba640 1 --2- 172.21.15.116:0/4220671292 >> v2:172.21.15.142:3300/0 conn(0x7f27140ceb00 0x7f27140cfda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:19.147 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.154+0000 7f27190ba640 1 -- 172.21.15.116:0/4220671292 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27140b4fd0 con 0x7f271415c140 2024-02-21T22:53:19.147 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.155+0000 7f27190ba640 1 --2- 172.21.15.116:0/4220671292 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f271415c140 0x7f27140cd590 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f27140d2d70 tx=0x7f271002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f36c8a4768265aff server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:19.147 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.155+0000 7f270bfff640 1 -- 172.21.15.116:0/4220671292 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2710035020 con 0x7f271415c140 2024-02-21T22:53:19.147 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.155+0000 7f270bfff640 1 -- 172.21.15.116:0/4220671292 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2710031870 con 0x7f271415c140 2024-02-21T22:53:19.147 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.155+0000 7f270bfff640 1 -- 172.21.15.116:0/4220671292 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2710031c40 con 0x7f271415c140 2024-02-21T22:53:19.147 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.155+0000 7f271b31e640 1 -- 172.21.15.116:0/4220671292 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f271415c140 msgr2=0x7f27140cd590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:19.147 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.155+0000 7f271b31e640 1 --2- 172.21.15.116:0/4220671292 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f271415c140 0x7f27140cd590 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f27140d2d70 tx=0x7f271002b910 comp rx=0 tx=0).stop 2024-02-21T22:53:19.147 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.155+0000 7f271b31e640 1 -- 172.21.15.116:0/4220671292 shutdown_connections 2024-02-21T22:53:19.147 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.155+0000 7f271b31e640 1 --2- 172.21.15.116:0/4220671292 >> v2:172.21.15.142:3300/0 conn(0x7f27140ceb00 0x7f27140cfda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:19.147 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.155+0000 7f271b31e640 1 --2- 172.21.15.116:0/4220671292 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f27140cf260 0x7f27140ce5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:19.147 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.155+0000 7f271b31e640 1 --2- 172.21.15.116:0/4220671292 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f271415c140 0x7f27140cd590 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:19.147 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.155+0000 7f271b31e640 1 -- 172.21.15.116:0/4220671292 >> 172.21.15.116:0/4220671292 conn(0x7f27140d1c90 msgr2=0x7f27140d20a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:19.147 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.155+0000 7f271b31e640 1 -- 172.21.15.116:0/4220671292 shutdown_connections 2024-02-21T22:53:19.147 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.155+0000 7f271b31e640 1 -- 172.21.15.116:0/4220671292 wait complete. 2024-02-21T22:53:19.150 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.157+0000 7f271b31e640 1 Processor -- start 2024-02-21T22:53:19.150 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.157+0000 7f271b31e640 1 -- start start 2024-02-21T22:53:19.150 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.157+0000 7f271b31e640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f27140ceb00 0x7f27140cb1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:19.150 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.157+0000 7f271b31e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f27140cf260 0x7f27140c5210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:19.150 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.157+0000 7f271b31e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f271415c140 0x7f27140c5750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:19.150 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.157+0000 7f271b31e640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27140d02e0 con 0x7f27140ceb00 2024-02-21T22:53:19.150 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.157+0000 7f271b31e640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f271415c520 con 0x7f271415c140 2024-02-21T22:53:19.150 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.157+0000 7f271b31e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27140d0460 con 0x7f27140cf260 2024-02-21T22:53:19.151 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.157+0000 7f27190ba640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f27140ceb00 0x7f27140cb1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:19.151 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.157+0000 7f27190ba640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f27140ceb00 0x7f27140cb1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:38482/0 (socket says 172.21.15.116:38482) 2024-02-21T22:53:19.151 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.157+0000 7f27190ba640 1 -- 172.21.15.116:0/866989188 learned_addr learned my addr 172.21.15.116:0/866989188 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:19.151 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.157+0000 7f27188b9640 1 --2- 172.21.15.116:0/866989188 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f27140cf260 0x7f27140c5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:19.151 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.157+0000 7f27198bb640 1 --2- 172.21.15.116:0/866989188 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f271415c140 0x7f27140c5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:19.151 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.158+0000 7f27190ba640 1 -- 172.21.15.116:0/866989188 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f27140cf260 msgr2=0x7f27140c5210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:19.151 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.158+0000 7f27190ba640 1 --2- 172.21.15.116:0/866989188 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f27140cf260 0x7f27140c5210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:19.151 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.158+0000 7f27190ba640 1 -- 172.21.15.116:0/866989188 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f271415c140 msgr2=0x7f27140c5750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:19.151 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.158+0000 7f27190ba640 1 --2- 172.21.15.116:0/866989188 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f271415c140 0x7f27140c5750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:19.151 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.158+0000 7f27190ba640 1 -- 172.21.15.116:0/866989188 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2714147c50 con 0x7f27140ceb00 2024-02-21T22:53:19.151 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.158+0000 7f27190ba640 1 --2- 172.21.15.116:0/866989188 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f27140ceb00 0x7f27140cb1b0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f2710000c00 tx=0x7f27100046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:19.151 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.158+0000 7f2709ffb640 1 -- 172.21.15.116:0/866989188 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2710031e10 con 0x7f27140ceb00 2024-02-21T22:53:19.151 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.158+0000 7f2709ffb640 1 -- 172.21.15.116:0/866989188 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f271003ad60 con 0x7f27140ceb00 2024-02-21T22:53:19.151 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.158+0000 7f2709ffb640 1 -- 172.21.15.116:0/866989188 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2710044630 con 0x7f27140ceb00 2024-02-21T22:53:19.152 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.158+0000 7f271b31e640 1 -- 172.21.15.116:0/866989188 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27140ca130 con 0x7f27140ceb00 2024-02-21T22:53:19.152 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.158+0000 7f271b31e640 1 -- 172.21.15.116:0/866989188 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27140ca6f0 con 0x7f27140ceb00 2024-02-21T22:53:19.152 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.159+0000 7f271b31e640 1 -- 172.21.15.116:0/866989188 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27140752f0 con 0x7f27140ceb00 2024-02-21T22:53:19.152 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.159+0000 7f2709ffb640 1 -- 172.21.15.116:0/866989188 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f271004b060 con 0x7f27140ceb00 2024-02-21T22:53:19.152 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.160+0000 7f2709ffb640 1 --2- 172.21.15.116:0/866989188 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f26f806b4d0 0x7f26f806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:19.152 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.160+0000 7f2709ffb640 1 -- 172.21.15.116:0/866989188 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f27100ac040 con 0x7f27140ceb00 2024-02-21T22:53:19.152 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.160+0000 7f27188b9640 1 --2- 172.21.15.116:0/866989188 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f26f806b4d0 0x7f26f806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:19.152 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.160+0000 7f27188b9640 1 --2- 172.21.15.116:0/866989188 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f26f806b4d0 0x7f26f806d990 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f27140d2970 tx=0x7f2704009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:19.153 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.164+0000 7f2709ffb640 1 -- 172.21.15.116:0/866989188 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f271003f070 con 0x7f27140ceb00 2024-02-21T22:53:19.324 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.335+0000 7f271b31e640 1 -- 172.21.15.116:0/866989188 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f271406ed90 con 0x7f27140ceb00 2024-02-21T22:53:19.325 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.335+0000 7f2709ffb640 1 -- 172.21.15.116:0/866989188 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f271007a870 con 0x7f27140ceb00 2024-02-21T22:53:19.325 INFO:teuthology.orchestra.run.smithi116.stdout:pg_num: 32 2024-02-21T22:53:19.326 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.337+0000 7f271b31e640 1 -- 172.21.15.116:0/866989188 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f26f806b4d0 msgr2=0x7f26f806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:19.327 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.337+0000 7f271b31e640 1 --2- 172.21.15.116:0/866989188 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f26f806b4d0 0x7f26f806d990 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f27140d2970 tx=0x7f2704009190 comp rx=0 tx=0).stop 2024-02-21T22:53:19.327 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.337+0000 7f271b31e640 1 -- 172.21.15.116:0/866989188 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f27140ceb00 msgr2=0x7f27140cb1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:19.327 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.337+0000 7f271b31e640 1 --2- 172.21.15.116:0/866989188 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f27140ceb00 0x7f27140cb1b0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f2710000c00 tx=0x7f27100046c0 comp rx=0 tx=0).stop 2024-02-21T22:53:19.327 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.337+0000 7f271b31e640 1 -- 172.21.15.116:0/866989188 shutdown_connections 2024-02-21T22:53:19.327 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.337+0000 7f271b31e640 1 --2- 172.21.15.116:0/866989188 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f271415c140 0x7f27140c5750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:19.327 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.337+0000 7f271b31e640 1 --2- 172.21.15.116:0/866989188 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f26f806b4d0 0x7f26f806d990 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:19.327 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.337+0000 7f271b31e640 1 --2- 172.21.15.116:0/866989188 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f27140cf260 0x7f27140c5210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:19.327 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.337+0000 7f271b31e640 1 --2- 172.21.15.116:0/866989188 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f27140ceb00 0x7f27140cb1b0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:19.327 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.337+0000 7f271b31e640 1 -- 172.21.15.116:0/866989188 >> 172.21.15.116:0/866989188 conn(0x7f27140d1c90 msgr2=0x7f27140d07b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:19.327 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.337+0000 7f271b31e640 1 -- 172.21.15.116:0/866989188 shutdown_connections 2024-02-21T22:53:19.327 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.337+0000 7f271b31e640 1 -- 172.21.15.116:0/866989188 wait complete. 2024-02-21T22:53:19.337 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-02-21T22:53:19.441 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.451+0000 7fa11555d640 1 Processor -- start 2024-02-21T22:53:19.441 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.451+0000 7fa11555d640 1 -- start start 2024-02-21T22:53:19.443 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.452+0000 7fa11555d640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fa1100d0ca0 0x7fa1100d4940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:19.443 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.452+0000 7fa11555d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa1100d2870 0x7fa11015e180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:19.443 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.452+0000 7fa11555d640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1100d2d00 con 0x7fa1100d2400 2024-02-21T22:53:19.444 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.452+0000 7fa11555d640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1100ceea0 con 0x7fa1100d0ca0 2024-02-21T22:53:19.444 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.452+0000 7fa11555d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1100cf180 con 0x7fa1100d2870 2024-02-21T22:53:19.444 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.452+0000 7fa10effd640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fa1100d0ca0 0x7fa1100d4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:19.444 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.452+0000 7fa10effd640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fa1100d0ca0 0x7fa1100d4940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:38496/0 (socket says 172.21.15.116:38496) 2024-02-21T22:53:19.444 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.452+0000 7fa10effd640 1 -- 172.21.15.116:0/3368917542 learned_addr learned my addr 172.21.15.116:0/3368917542 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:19.444 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.452+0000 7fa10e7fc640 1 --1- 172.21.15.116:0/3368917542 >> v1:172.21.15.142:6789/0 conn(0x7fa1100d2400 0x7fa11015da70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.116:59456/0 (socket says 172.21.15.116:59456) 2024-02-21T22:53:19.444 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.452+0000 7fa10f7fe640 1 --2- 172.21.15.116:0/3368917542 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa1100d2870 0x7fa11015e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:19.444 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.452+0000 7fa10effd640 1 -- 172.21.15.116:0/3368917542 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa1100d2870 msgr2=0x7fa11015e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:53:19.444 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.452+0000 7fa10dffb640 1 -- 172.21.15.116:0/3368917542 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1958274250 0 0) 0x7fa1100d2d00 con 0x7fa1100d2400 2024-02-21T22:53:19.444 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.452+0000 7fa10effd640 1 --2- 172.21.15.116:0/3368917542 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa1100d2870 0x7fa11015e180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:19.444 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.452+0000 7fa10effd640 1 -- 172.21.15.116:0/3368917542 >> v1:172.21.15.142:6789/0 conn(0x7fa1100d2400 legacy=0x7fa11015da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:19.444 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.452+0000 7fa10effd640 1 -- 172.21.15.116:0/3368917542 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1100cf460 con 0x7fa1100d0ca0 2024-02-21T22:53:19.444 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.452+0000 7fa10f7fe640 1 --2- 172.21.15.116:0/3368917542 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa1100d2870 0x7fa11015e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T22:53:19.444 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.453+0000 7fa10effd640 1 --2- 172.21.15.116:0/3368917542 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa1100d0ca0 0x7fa1100d4940 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fa100009e50 tx=0x7fa10002bff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1654b8084ea9e484 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:19.445 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.453+0000 7fa10dffb640 1 -- 172.21.15.116:0/3368917542 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa10002cb90 con 0x7fa1100d0ca0 2024-02-21T22:53:19.445 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.453+0000 7fa10dffb640 1 -- 172.21.15.116:0/3368917542 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa10002cd30 con 0x7fa1100d0ca0 2024-02-21T22:53:19.445 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.453+0000 7fa10dffb640 1 -- 172.21.15.116:0/3368917542 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa100034610 con 0x7fa1100d0ca0 2024-02-21T22:53:19.445 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.454+0000 7fa11555d640 1 -- 172.21.15.116:0/3368917542 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa1100d0ca0 msgr2=0x7fa1100d4940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:19.445 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.454+0000 7fa11555d640 1 --2- 172.21.15.116:0/3368917542 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa1100d0ca0 0x7fa1100d4940 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fa100009e50 tx=0x7fa10002bff0 comp rx=0 tx=0).stop 2024-02-21T22:53:19.445 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.454+0000 7fa11555d640 1 -- 172.21.15.116:0/3368917542 shutdown_connections 2024-02-21T22:53:19.445 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.454+0000 7fa11555d640 1 --2- 172.21.15.116:0/3368917542 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa1100d2870 0x7fa11015e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:19.445 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.454+0000 7fa11555d640 1 --2- 172.21.15.116:0/3368917542 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa1100d0ca0 0x7fa1100d4940 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:19.445 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.454+0000 7fa11555d640 1 -- 172.21.15.116:0/3368917542 >> 172.21.15.116:0/3368917542 conn(0x7fa1100d3e20 msgr2=0x7fa1100d4230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:19.445 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.454+0000 7fa11555d640 1 -- 172.21.15.116:0/3368917542 shutdown_connections 2024-02-21T22:53:19.445 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.454+0000 7fa11555d640 1 -- 172.21.15.116:0/3368917542 wait complete. 2024-02-21T22:53:19.451 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.455+0000 7fa11555d640 1 Processor -- start 2024-02-21T22:53:19.451 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.455+0000 7fa11555d640 1 -- start start 2024-02-21T22:53:19.451 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.456+0000 7fa11555d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa1100d0ca0 0x7fa11015faf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:19.451 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.456+0000 7fa11555d640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa1100d2400 0x7fa110160590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:19.451 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.456+0000 7fa11555d640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa1100d2870 0x7fa1100b2ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:19.452 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.456+0000 7fa11555d640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa11015e6c0 con 0x7fa1100d2870 2024-02-21T22:53:19.452 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.456+0000 7fa11555d640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1100cfa20 con 0x7fa1100d2400 2024-02-21T22:53:19.452 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.456+0000 7fa11555d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1100d1080 con 0x7fa1100d0ca0 2024-02-21T22:53:19.452 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.456+0000 7fa10f7fe640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa1100d2870 0x7fa1100b2ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:19.452 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.456+0000 7fa10f7fe640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa1100d2870 0x7fa1100b2ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:38504/0 (socket says 172.21.15.116:38504) 2024-02-21T22:53:19.452 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.456+0000 7fa10f7fe640 1 -- 172.21.15.116:0/414324492 learned_addr learned my addr 172.21.15.116:0/414324492 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:19.452 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.456+0000 7fa10effd640 1 --2- 172.21.15.116:0/414324492 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa1100d0ca0 0x7fa11015faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:19.452 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.456+0000 7fa10e7fc640 1 --2- 172.21.15.116:0/414324492 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa1100d2400 0x7fa110160590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:19.452 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.456+0000 7fa10f7fe640 1 -- 172.21.15.116:0/414324492 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa1100d0ca0 msgr2=0x7fa11015faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:19.452 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.456+0000 7fa10f7fe640 1 --2- 172.21.15.116:0/414324492 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa1100d0ca0 0x7fa11015faf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:19.452 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.456+0000 7fa10f7fe640 1 -- 172.21.15.116:0/414324492 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa1100d2400 msgr2=0x7fa110160590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:19.452 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.456+0000 7fa10f7fe640 1 --2- 172.21.15.116:0/414324492 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa1100d2400 0x7fa110160590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:19.452 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.456+0000 7fa10f7fe640 1 -- 172.21.15.116:0/414324492 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa110160cb0 con 0x7fa1100d2870 2024-02-21T22:53:19.452 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.456+0000 7fa10f7fe640 1 --2- 172.21.15.116:0/414324492 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa1100d2870 0x7fa1100b2ff0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fa10800e8b0 tx=0x7fa10800ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:19.453 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.456+0000 7fa0f77fe640 1 -- 172.21.15.116:0/414324492 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa108017070 con 0x7fa1100d2870 2024-02-21T22:53:19.453 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.456+0000 7fa0f77fe640 1 -- 172.21.15.116:0/414324492 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa108004020 con 0x7fa1100d2870 2024-02-21T22:53:19.453 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.456+0000 7fa11555d640 1 -- 172.21.15.116:0/414324492 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa110160f90 con 0x7fa1100d2870 2024-02-21T22:53:19.453 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.456+0000 7fa0f77fe640 1 -- 172.21.15.116:0/414324492 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1080043f0 con 0x7fa1100d2870 2024-02-21T22:53:19.453 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.456+0000 7fa11555d640 1 -- 172.21.15.116:0/414324492 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa110161270 con 0x7fa1100d2870 2024-02-21T22:53:19.453 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.457+0000 7fa11555d640 1 -- 172.21.15.116:0/414324492 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1100d0800 con 0x7fa1100d2870 2024-02-21T22:53:19.453 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.458+0000 7fa0f77fe640 1 -- 172.21.15.116:0/414324492 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fa10800c940 con 0x7fa1100d2870 2024-02-21T22:53:19.453 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.458+0000 7fa0f77fe640 1 --2- 172.21.15.116:0/414324492 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fa0fc06b4d0 0x7fa0fc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:19.453 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.458+0000 7fa0f77fe640 1 -- 172.21.15.116:0/414324492 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa10808a290 con 0x7fa1100d2870 2024-02-21T22:53:19.453 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.458+0000 7fa10effd640 1 --2- 172.21.15.116:0/414324492 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fa0fc06b4d0 0x7fa0fc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:19.453 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.459+0000 7fa10effd640 1 --2- 172.21.15.116:0/414324492 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fa0fc06b4d0 0x7fa0fc06d990 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fa100035000 tx=0x7fa100030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:19.454 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.462+0000 7fa0f77fe640 1 -- 172.21.15.116:0/414324492 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7fa1100d0800 con 0x7fa1100d2870 2024-02-21T22:53:19.621 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.631+0000 7fa11555d640 1 -- 172.21.15.116:0/414324492 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa1100752f0 con 0x7fa1100d2870 2024-02-21T22:53:19.621 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.632+0000 7fa0f77fe640 1 -- 172.21.15.116:0/414324492 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa108058b50 con 0x7fa1100d2870 2024-02-21T22:53:19.621 INFO:teuthology.orchestra.run.smithi116.stdout:pg_num: 64 2024-02-21T22:53:19.623 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.633+0000 7fa11555d640 1 -- 172.21.15.116:0/414324492 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fa0fc06b4d0 msgr2=0x7fa0fc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:19.624 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.633+0000 7fa11555d640 1 --2- 172.21.15.116:0/414324492 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fa0fc06b4d0 0x7fa0fc06d990 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fa100035000 tx=0x7fa100030000 comp rx=0 tx=0).stop 2024-02-21T22:53:19.624 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.633+0000 7fa11555d640 1 -- 172.21.15.116:0/414324492 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa1100d2870 msgr2=0x7fa1100b2ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:19.624 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.633+0000 7fa11555d640 1 --2- 172.21.15.116:0/414324492 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa1100d2870 0x7fa1100b2ff0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fa10800e8b0 tx=0x7fa10800ed70 comp rx=0 tx=0).stop 2024-02-21T22:53:19.624 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.633+0000 7fa11555d640 1 -- 172.21.15.116:0/414324492 shutdown_connections 2024-02-21T22:53:19.624 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.633+0000 7fa11555d640 1 --2- 172.21.15.116:0/414324492 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa1100d2870 0x7fa1100b2ff0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:19.624 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.633+0000 7fa11555d640 1 --2- 172.21.15.116:0/414324492 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa1100d2400 0x7fa110160590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:19.624 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.633+0000 7fa11555d640 1 --2- 172.21.15.116:0/414324492 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fa0fc06b4d0 0x7fa0fc06d990 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:19.624 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.633+0000 7fa11555d640 1 --2- 172.21.15.116:0/414324492 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa1100d0ca0 0x7fa11015faf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:19.624 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.633+0000 7fa11555d640 1 -- 172.21.15.116:0/414324492 >> 172.21.15.116:0/414324492 conn(0x7fa1100d3e20 msgr2=0x7fa11006b680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:19.625 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.633+0000 7fa11555d640 1 -- 172.21.15.116:0/414324492 shutdown_connections 2024-02-21T22:53:19.625 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.634+0000 7fa11555d640 1 -- 172.21.15.116:0/414324492 wait complete. 2024-02-21T22:53:19.644 INFO:tasks.cephfs_test_runner:Starting test: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2024-02-21T22:53:19.645 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-21T22:53:19.746 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.756+0000 7ffb2a860640 1 Processor -- start 2024-02-21T22:53:19.746 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.756+0000 7ffb2a860640 1 -- start start 2024-02-21T22:53:19.747 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.757+0000 7ffb2a860640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ffb2415be60 0x7ffb240cf7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:19.747 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.757+0000 7ffb2a860640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7ffb240cd800 0x7ffb240d01c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:19.747 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.757+0000 7ffb2a860640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb240cca40 con 0x7ffb240cf2c0 2024-02-21T22:53:19.747 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.757+0000 7ffb2a860640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb240ccd20 con 0x7ffb240cd800 2024-02-21T22:53:19.747 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.757+0000 7ffb2a860640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb240cd000 con 0x7ffb2415be60 2024-02-21T22:53:19.748 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.757+0000 7ffb237fe640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7ffb240cd800 0x7ffb240d01c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:19.748 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.757+0000 7ffb28dfd640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7ffb240cf2c0 0x7ffb2415fac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:54870/0 (socket says 172.21.15.116:54870) 2024-02-21T22:53:19.748 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.757+0000 7ffb28dfd640 1 -- 172.21.15.116:0/2675776804 learned_addr learned my addr 172.21.15.116:0/2675776804 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-02-21T22:53:19.748 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.757+0000 7ffb23fff640 1 --2- 172.21.15.116:0/2675776804 >> v2:172.21.15.142:3300/0 conn(0x7ffb2415be60 0x7ffb240cf7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:19.748 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.758+0000 7ffb237fe640 1 -- 172.21.15.116:0/2675776804 >> v2:172.21.15.142:3300/0 conn(0x7ffb2415be60 msgr2=0x7ffb240cf7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:53:19.748 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.758+0000 7ffb237fe640 1 --2- 172.21.15.116:0/2675776804 >> v2:172.21.15.142:3300/0 conn(0x7ffb2415be60 0x7ffb240cf7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:19.748 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.758+0000 7ffb237fe640 1 -- 172.21.15.116:0/2675776804 >> v1:172.21.15.116:6789/0 conn(0x7ffb240cf2c0 legacy=0x7ffb2415fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:19.748 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.758+0000 7ffb22ffd640 1 -- 172.21.15.116:0/2675776804 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1845948693 0 0) 0x7ffb240cca40 con 0x7ffb240cf2c0 2024-02-21T22:53:19.748 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.758+0000 7ffb237fe640 1 -- 172.21.15.116:0/2675776804 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb240cd2e0 con 0x7ffb240cd800 2024-02-21T22:53:19.748 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.758+0000 7ffb23fff640 1 --2- 172.21.15.116:0/2675776804 >> v2:172.21.15.142:3300/0 conn(0x7ffb2415be60 0x7ffb240cf7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T22:53:19.749 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.758+0000 7ffb237fe640 1 --2- 172.21.15.116:0/2675776804 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ffb240cd800 0x7ffb240d01c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7ffb24071930 tx=0x7ffb1802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b42034f28c90e48 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:19.750 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.758+0000 7ffb22ffd640 1 -- 172.21.15.116:0/2675776804 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb18035020 con 0x7ffb240cd800 2024-02-21T22:53:19.750 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.758+0000 7ffb22ffd640 1 -- 172.21.15.116:0/2675776804 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb18031830 con 0x7ffb240cd800 2024-02-21T22:53:19.750 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.758+0000 7ffb22ffd640 1 -- 172.21.15.116:0/2675776804 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb18031c00 con 0x7ffb240cd800 2024-02-21T22:53:19.750 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.759+0000 7ffb2a860640 1 -- 172.21.15.116:0/2675776804 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ffb240cd800 msgr2=0x7ffb240d01c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:19.750 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.759+0000 7ffb2a860640 1 --2- 172.21.15.116:0/2675776804 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ffb240cd800 0x7ffb240d01c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7ffb24071930 tx=0x7ffb1802b8d0 comp rx=0 tx=0).stop 2024-02-21T22:53:19.750 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.759+0000 7ffb2a860640 1 -- 172.21.15.116:0/2675776804 shutdown_connections 2024-02-21T22:53:19.750 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.759+0000 7ffb2a860640 1 --2- 172.21.15.116:0/2675776804 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ffb240cd800 0x7ffb240d01c0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:19.750 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.759+0000 7ffb2a860640 1 --2- 172.21.15.116:0/2675776804 >> v2:172.21.15.142:3300/0 conn(0x7ffb2415be60 0x7ffb240cf7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:19.750 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.759+0000 7ffb2a860640 1 -- 172.21.15.116:0/2675776804 >> 172.21.15.116:0/2675776804 conn(0x7ffb240b3730 msgr2=0x7ffb240b3b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:19.750 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.759+0000 7ffb2a860640 1 -- 172.21.15.116:0/2675776804 shutdown_connections 2024-02-21T22:53:19.750 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.759+0000 7ffb2a860640 1 -- 172.21.15.116:0/2675776804 wait complete. 2024-02-21T22:53:19.750 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.760+0000 7ffb2a860640 1 Processor -- start 2024-02-21T22:53:19.750 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.760+0000 7ffb2a860640 1 -- start start 2024-02-21T22:53:19.753 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.761+0000 7ffb2a860640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ffb240cd800 0x7ffb240c5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:19.753 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.761+0000 7ffb2a860640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffb240cf2c0 0x7ffb240b2d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:19.753 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.761+0000 7ffb2a860640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffb2415be60 0x7ffb240c8cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:19.753 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.761+0000 7ffb2a860640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb2415c3c0 con 0x7ffb240cd800 2024-02-21T22:53:19.753 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.761+0000 7ffb2a860640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb2415c240 con 0x7ffb2415be60 2024-02-21T22:53:19.753 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.761+0000 7ffb2a860640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb240cfcf0 con 0x7ffb240cf2c0 2024-02-21T22:53:19.753 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.761+0000 7ffb23fff640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ffb240cd800 0x7ffb240c5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:19.753 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.761+0000 7ffb23fff640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ffb240cd800 0x7ffb240c5710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:38534/0 (socket says 172.21.15.116:38534) 2024-02-21T22:53:19.753 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.761+0000 7ffb23fff640 1 -- 172.21.15.116:0/1138041274 learned_addr learned my addr 172.21.15.116:0/1138041274 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:19.753 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.761+0000 7ffb237fe640 1 --2- 172.21.15.116:0/1138041274 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffb240cf2c0 0x7ffb240b2d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:19.754 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.761+0000 7ffb28dfd640 1 --2- 172.21.15.116:0/1138041274 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffb2415be60 0x7ffb240c8cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:19.754 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.761+0000 7ffb23fff640 1 -- 172.21.15.116:0/1138041274 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffb240cf2c0 msgr2=0x7ffb240b2d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:19.754 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.761+0000 7ffb23fff640 1 --2- 172.21.15.116:0/1138041274 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffb240cf2c0 0x7ffb240b2d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:19.754 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.761+0000 7ffb23fff640 1 -- 172.21.15.116:0/1138041274 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffb2415be60 msgr2=0x7ffb240c8cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:19.754 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.761+0000 7ffb23fff640 1 --2- 172.21.15.116:0/1138041274 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffb2415be60 0x7ffb240c8cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:19.754 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.761+0000 7ffb23fff640 1 -- 172.21.15.116:0/1138041274 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb240c5f60 con 0x7ffb240cd800 2024-02-21T22:53:19.754 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.762+0000 7ffb23fff640 1 --2- 172.21.15.116:0/1138041274 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ffb240cd800 0x7ffb240c5710 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7ffb1400e960 tx=0x7ffb1400ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:19.754 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.762+0000 7ffb20ff9640 1 -- 172.21.15.116:0/1138041274 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb14017070 con 0x7ffb240cd800 2024-02-21T22:53:19.754 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.762+0000 7ffb20ff9640 1 -- 172.21.15.116:0/1138041274 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb1400ca00 con 0x7ffb240cd800 2024-02-21T22:53:19.754 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.762+0000 7ffb2a860640 1 -- 172.21.15.116:0/1138041274 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb240c6240 con 0x7ffb240cd800 2024-02-21T22:53:19.754 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.762+0000 7ffb20ff9640 1 -- 172.21.15.116:0/1138041274 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb1400cdd0 con 0x7ffb240cd800 2024-02-21T22:53:19.754 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.762+0000 7ffb2a860640 1 -- 172.21.15.116:0/1138041274 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb2406cff0 con 0x7ffb240cd800 2024-02-21T22:53:19.754 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.763+0000 7ffb2a860640 1 -- 172.21.15.116:0/1138041274 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb240752f0 con 0x7ffb240cd800 2024-02-21T22:53:19.754 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.763+0000 7ffb20ff9640 1 -- 172.21.15.116:0/1138041274 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ffb1401a070 con 0x7ffb240cd800 2024-02-21T22:53:19.754 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.763+0000 7ffb20ff9640 1 --2- 172.21.15.116:0/1138041274 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7ffb1006b4d0 0x7ffb1006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:19.755 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.764+0000 7ffb20ff9640 1 -- 172.21.15.116:0/1138041274 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ffb1408a3b0 con 0x7ffb240cd800 2024-02-21T22:53:19.755 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.764+0000 7ffb237fe640 1 --2- 172.21.15.116:0/1138041274 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7ffb1006b4d0 0x7ffb1006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:19.755 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.764+0000 7ffb237fe640 1 --2- 172.21.15.116:0/1138041274 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7ffb1006b4d0 0x7ffb1006d990 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7ffb18036000 tx=0x7ffb1803d040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:19.757 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.768+0000 7ffb20ff9640 1 -- 172.21.15.116:0/1138041274 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7ffb14058be0 con 0x7ffb240cd800 2024-02-21T22:53:19.928 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.937+0000 7ffb2a860640 1 -- 172.21.15.116:0/1138041274 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ffb240b7b60 con 0x7ffb240cd800 2024-02-21T22:53:19.929 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.938+0000 7ffb20ff9640 1 -- 172.21.15.116:0/1138041274 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16653 (secure 0 0 0) 0x7ffb1405cc80 con 0x7ffb240cd800 2024-02-21T22:53:19.929 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-02-21T22:53:19.929 INFO:teuthology.orchestra.run.smithi116.stdout:{"epoch":20,"fsid":"7c298660-5f63-4b5c-a800-58c5be9a8445","created":"2024-02-21T22:52:25.994613+0000","modified":"2024-02-21T22:52:51.786454+0000","last_up_change":"2024-02-21T22:52:37.313595+0000","last_in_change":"2024-02-21T22:52:28.176031+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-21T22:52:38.328796+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-21T22:52:48.145152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-21T22:52:49.096955+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4f09126b-b5e4-4876-8b08-f5cbb967388a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":1613202231},{"type":"v1","addr":"172.21.15.116:6809","nonce":1613202231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":1613202231},{"type":"v1","addr":"172.21.15.116:6811","nonce":1613202231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":1613202231},{"type":"v1","addr":"172.21.15.116:6815","nonce":1613202231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":1613202231},{"type":"v1","addr":"172.21.15.116:6813","nonce":1613202231}]},"public_addr":"172.21.15.116:6809/1613202231","cluster_addr":"172.21.15.116:6811/1613202231","heartbeat_back_addr":"172.21.15.116:6815/1613202231","heartbeat_front_addr":"172.21.15.116:6813/1613202231","state":["exists","up"]},{"osd":1,"uuid":"7272c51d-51f9-4536-931d-33ad7a4b377e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6816","nonce":172614746},{"type":"v1","addr":"172.21.15.116:6817","nonce":172614746}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":172614746},{"type":"v1","addr":"172.21.15.116:6819","nonce":172614746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":172614746},{"type":"v1","addr":"172.21.15.116:6823","nonce":172614746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":172614746},{"type":"v1","addr":"172.21.15.116:6821","nonce":172614746}]},"public_addr":"172.21.15.116:6817/172614746","cluster_addr":"172.21.15.116:6819/172614746","heartbeat_back_addr":"172.21.15.116:6823/172614746","heartbeat_front_addr":"172.21.15.116:6821/172614746","state":["exists","up"]},{"osd":2,"uuid":"2589616c-adf1-4187-aac3-735256cf624b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":1029280577},{"type":"v1","addr":"172.21.15.116:6825","nonce":1029280577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":1029280577},{"type":"v1","addr":"172.21.15.116:6827","nonce":1029280577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":1029280577},{"type":"v1","addr":"172.21.15.116:6831","nonce":1029280577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":1029280577},{"type":"v1","addr":"172.21.15.116:6829","nonce":1029280577}]},"public_addr":"172.21.15.116:6825/1029280577","cluster_addr":"172.21.15.116:6827/1029280577","heartbeat_back_addr":"172.21.15.116:6831/1029280577","heartbeat_front_addr":"172.21.15.116:6829/1029280577","state":["exists","up"]},{"osd":3,"uuid":"0fd2e563-7c5b-46f6-82c2-b60c86072c93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":3106627557},{"type":"v1","addr":"172.21.15.116:6801","nonce":3106627557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":3106627557},{"type":"v1","addr":"172.21.15.116:6803","nonce":3106627557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":3106627557},{"type":"v1","addr":"172.21.15.116:6807","nonce":3106627557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":3106627557},{"type":"v1","addr":"172.21.15.116:6805","nonce":3106627557}]},"public_addr":"172.21.15.116:6801/3106627557","cluster_addr":"172.21.15.116:6803/3106627557","heartbeat_back_addr":"172.21.15.116:6807/3106627557","heartbeat_front_addr":"172.21.15.116:6805/3106627557","state":["exists","up"]},{"osd":4,"uuid":"79ae35b7-dda8-4ab8-96ce-47515afde082","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":3231407772},{"type":"v1","addr":"172.21.15.142:6825","nonce":3231407772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":3231407772},{"type":"v1","addr":"172.21.15.142:6827","nonce":3231407772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":3231407772},{"type":"v1","addr":"172.21.15.142:6831","nonce":3231407772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":3231407772},{"type":"v1","addr":"172.21.15.142:6829","nonce":3231407772}]},"public_addr":"172.21.15.142:6825/3231407772","cluster_addr":"172.21.15.142:6827/3231407772","heartbeat_back_addr":"172.21.15.142:6831/3231407772","heartbeat_front_addr":"172.21.15.142:6829/3231407772","state":["exists","up"]},{"osd":5,"uuid":"3166eb2c-3fcf-41c8-9362-45bafaabaa39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":1184158716},{"type":"v1","addr":"172.21.15.142:6817","nonce":1184158716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":1184158716},{"type":"v1","addr":"172.21.15.142:6819","nonce":1184158716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":1184158716},{"type":"v1","addr":"172.21.15.142:6823","nonce":1184158716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":1184158716},{"type":"v1","addr":"172.21.15.142:6821","nonce":1184158716}]},"public_addr":"172.21.15.142:6817/1184158716","cluster_addr":"172.21.15.142:6819/1184158716","heartbeat_back_addr":"172.21.15.142:6823/1184158716","heartbeat_front_addr":"172.21.15.142:6821/1184158716","state":["exists","up"]},{"osd":6,"uuid":"f9aa9672-7527-43e2-963e-b61868e5e63f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":1987868911},{"type":"v1","addr":"172.21.15.142:6801","nonce":1987868911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":1987868911},{"type":"v1","addr":"172.21.15.142:6803","nonce":1987868911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":1987868911},{"type":"v1","addr":"172.21.15.142:6807","nonce":1987868911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":1987868911},{"type":"v1","addr":"172.21.15.142:6805","nonce":1987868911}]},"public_addr":"172.21.15.142:6801/1987868911","cluster_addr":"172.21.15.142:6803/1987868911","heartbeat_back_addr":"172.21.15.142:6807/1987868911","heartbeat_front_addr":"172.21.15.142:6805/1987868911","state":["exists","up"]},{"osd":7,"uuid":"7ed29226-fc42-4382-a91a-fa50f7ec5426","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":1272081937},{"type":"v1","addr":"172.21.15.142:6809","nonce":1272081937}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":1272081937},{"type":"v1","addr":"172.21.15.142:6811","nonce":1272081937}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":1272081937},{"type":"v1","addr":"172.21.15.142:6815","nonce":1272081937}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":1272081937},{"type":"v1","addr":"172.21.15.142:6813","nonce":1272081937}]},"public_addr":"172.21.15.142:6809/1272081937","cluster_addr":"172.21.15.142:6811/1272081937","heartbeat_back_addr":"172.21.15.142:6815/1272081937","heartbeat_front_addr":"172.21.15.142:6813/1272081937","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.350998+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.307201+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.289112+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.243888+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.312091+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.370472+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.275659+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.289297+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-21T22:53:19.931 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.940+0000 7ffb2a860640 1 -- 172.21.15.116:0/1138041274 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7ffb1006b4d0 msgr2=0x7ffb1006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:19.931 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.940+0000 7ffb2a860640 1 --2- 172.21.15.116:0/1138041274 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7ffb1006b4d0 0x7ffb1006d990 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7ffb18036000 tx=0x7ffb1803d040 comp rx=0 tx=0).stop 2024-02-21T22:53:19.931 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.940+0000 7ffb2a860640 1 -- 172.21.15.116:0/1138041274 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ffb240cd800 msgr2=0x7ffb240c5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:19.931 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.940+0000 7ffb2a860640 1 --2- 172.21.15.116:0/1138041274 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ffb240cd800 0x7ffb240c5710 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7ffb1400e960 tx=0x7ffb1400ee20 comp rx=0 tx=0).stop 2024-02-21T22:53:19.931 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.940+0000 7ffb2a860640 1 -- 172.21.15.116:0/1138041274 shutdown_connections 2024-02-21T22:53:19.931 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.940+0000 7ffb2a860640 1 --2- 172.21.15.116:0/1138041274 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffb2415be60 0x7ffb240c8cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:19.932 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.940+0000 7ffb2a860640 1 --2- 172.21.15.116:0/1138041274 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7ffb1006b4d0 0x7ffb1006d990 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:19.932 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.940+0000 7ffb2a860640 1 --2- 172.21.15.116:0/1138041274 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffb240cf2c0 0x7ffb240b2d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:19.932 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.940+0000 7ffb2a860640 1 --2- 172.21.15.116:0/1138041274 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ffb240cd800 0x7ffb240c5710 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:19.932 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.940+0000 7ffb2a860640 1 -- 172.21.15.116:0/1138041274 >> 172.21.15.116:0/1138041274 conn(0x7ffb240b3730 msgr2=0x7ffb24159bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:19.932 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.940+0000 7ffb2a860640 1 -- 172.21.15.116:0/1138041274 shutdown_connections 2024-02-21T22:53:19.932 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:19.940+0000 7ffb2a860640 1 -- 172.21.15.116:0/1138041274 wait complete. 2024-02-21T22:53:19.942 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-21T22:52:38.328796+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-02-21T22:52:48.145152+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-02-21T22:52:49.096955+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-21T22:53:19.942 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-21T22:53:20.046 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.055+0000 7f76375c8640 1 Processor -- start 2024-02-21T22:53:20.046 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.055+0000 7f76375c8640 1 -- start start 2024-02-21T22:53:20.047 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.056+0000 7f76375c8640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f763015dfe0 0x7f763006eb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:20.047 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.056+0000 7f76375c8640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f7630162840 0x7f763006f540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:20.048 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.056+0000 7f76375c8640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76300d0030 con 0x7f76300d0df0 2024-02-21T22:53:20.048 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.056+0000 7f76375c8640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76300d0310 con 0x7f7630162840 2024-02-21T22:53:20.048 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.056+0000 7f76375c8640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76300d05f0 con 0x7f763015dfe0 2024-02-21T22:53:20.048 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.056+0000 7f7635b65640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f76300d0df0 0x7f76300cc200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:54876/0 (socket says 172.21.15.116:54876) 2024-02-21T22:53:20.048 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.056+0000 7f7635b65640 1 -- 172.21.15.116:0/135405466 learned_addr learned my addr 172.21.15.116:0/135405466 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-02-21T22:53:20.048 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.056+0000 7f7634b63640 1 --2- 172.21.15.116:0/135405466 >> v2:172.21.15.142:3300/0 conn(0x7f7630162840 0x7f763006f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:20.048 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.056+0000 7f7635364640 1 --2- 172.21.15.116:0/135405466 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f763015dfe0 0x7f763006eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:20.048 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.057+0000 7f7627fff640 1 -- 172.21.15.116:0/135405466 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1559507875 0 0) 0x7f76300d0030 con 0x7f76300d0df0 2024-02-21T22:53:20.048 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.057+0000 7f7627fff640 1 -- 172.21.15.116:0/135405466 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f761c003520 con 0x7f76300d0df0 2024-02-21T22:53:20.048 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.057+0000 7f7634b63640 1 -- 172.21.15.116:0/135405466 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f763015dfe0 msgr2=0x7f763006eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:53:20.048 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.057+0000 7f7634b63640 1 --2- 172.21.15.116:0/135405466 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f763015dfe0 0x7f763006eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:20.048 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.057+0000 7f7634b63640 1 -- 172.21.15.116:0/135405466 >> v1:172.21.15.116:6789/0 conn(0x7f76300d0df0 legacy=0x7f76300cc200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:20.048 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.057+0000 7f7634b63640 1 -- 172.21.15.116:0/135405466 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76300d08d0 con 0x7f7630162840 2024-02-21T22:53:20.048 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.057+0000 7f7635364640 1 --2- 172.21.15.116:0/135405466 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f763015dfe0 0x7f763006eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T22:53:20.050 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.057+0000 7f7634b63640 1 --2- 172.21.15.116:0/135405466 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7630162840 0x7f763006f540 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f76200097a0 tx=0x7f762002b7a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bce9210de7508703 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:20.050 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.058+0000 7f7627fff640 1 -- 172.21.15.116:0/135405466 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7620038070 con 0x7f7630162840 2024-02-21T22:53:20.050 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.058+0000 7f7627fff640 1 -- 172.21.15.116:0/135405466 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7620031700 con 0x7f7630162840 2024-02-21T22:53:20.050 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.058+0000 7f7627fff640 1 -- 172.21.15.116:0/135405466 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7620031ad0 con 0x7f7630162840 2024-02-21T22:53:20.050 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.058+0000 7f76375c8640 1 -- 172.21.15.116:0/135405466 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7630162840 msgr2=0x7f763006f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:20.050 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.058+0000 7f76375c8640 1 --2- 172.21.15.116:0/135405466 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7630162840 0x7f763006f540 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f76200097a0 tx=0x7f762002b7a0 comp rx=0 tx=0).stop 2024-02-21T22:53:20.050 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.058+0000 7f76375c8640 1 -- 172.21.15.116:0/135405466 shutdown_connections 2024-02-21T22:53:20.050 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.058+0000 7f76375c8640 1 --2- 172.21.15.116:0/135405466 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7630162840 0x7f763006f540 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:20.050 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.058+0000 7f76375c8640 1 --2- 172.21.15.116:0/135405466 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f763015dfe0 0x7f763006eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:20.051 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.058+0000 7f76375c8640 1 -- 172.21.15.116:0/135405466 >> 172.21.15.116:0/135405466 conn(0x7f76300b36c0 msgr2=0x7f76300b3ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:20.051 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.058+0000 7f76375c8640 1 -- 172.21.15.116:0/135405466 shutdown_connections 2024-02-21T22:53:20.051 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.058+0000 7f76375c8640 1 -- 172.21.15.116:0/135405466 wait complete. 2024-02-21T22:53:20.051 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.059+0000 7f76375c8640 1 Processor -- start 2024-02-21T22:53:20.051 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.059+0000 7f76375c8640 1 -- start start 2024-02-21T22:53:20.053 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.060+0000 7f76375c8640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f76300d0df0 0x7f7630158940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:20.053 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.060+0000 7f76375c8640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f763015dfe0 0x7f7630158e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:20.053 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.060+0000 7f76375c8640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7630162840 0x7f76301e83a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:20.053 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.060+0000 7f76375c8640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f763006f090 con 0x7f76300d0df0 2024-02-21T22:53:20.053 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.060+0000 7f76375c8640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f763015e3c0 con 0x7f7630162840 2024-02-21T22:53:20.054 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.060+0000 7f76375c8640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f763006f210 con 0x7f763015dfe0 2024-02-21T22:53:20.054 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.060+0000 7f7635364640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f76300d0df0 0x7f7630158940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:20.054 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.060+0000 7f7635364640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f76300d0df0 0x7f7630158940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:38536/0 (socket says 172.21.15.116:38536) 2024-02-21T22:53:20.054 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.060+0000 7f7635364640 1 -- 172.21.15.116:0/2233769115 learned_addr learned my addr 172.21.15.116:0/2233769115 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:20.054 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.060+0000 7f7635b65640 1 --2- 172.21.15.116:0/2233769115 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7630162840 0x7f76301e83a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:20.054 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.060+0000 7f7634b63640 1 --2- 172.21.15.116:0/2233769115 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f763015dfe0 0x7f7630158e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:20.054 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.060+0000 7f7635364640 1 -- 172.21.15.116:0/2233769115 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f763015dfe0 msgr2=0x7f7630158e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:20.054 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.060+0000 7f7635364640 1 --2- 172.21.15.116:0/2233769115 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f763015dfe0 0x7f7630158e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:20.054 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.060+0000 7f7635364640 1 -- 172.21.15.116:0/2233769115 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7630162840 msgr2=0x7f76301e83a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:20.054 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.060+0000 7f7635364640 1 --2- 172.21.15.116:0/2233769115 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7630162840 0x7f76301e83a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:20.054 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.060+0000 7f7635364640 1 -- 172.21.15.116:0/2233769115 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76301e90d0 con 0x7f76300d0df0 2024-02-21T22:53:20.054 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.060+0000 7f7635b65640 1 --2- 172.21.15.116:0/2233769115 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7630162840 0x7f76301e83a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T22:53:20.054 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.060+0000 7f7634b63640 1 --2- 172.21.15.116:0/2233769115 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f763015dfe0 0x7f7630158e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T22:53:20.054 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.061+0000 7f7635364640 1 --2- 172.21.15.116:0/2233769115 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f76300d0df0 0x7f7630158940 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f762c009f60 tx=0x7f762c009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:20.054 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.061+0000 7f7625ffb640 1 -- 172.21.15.116:0/2233769115 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f762c018020 con 0x7f76300d0df0 2024-02-21T22:53:20.055 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.061+0000 7f7625ffb640 1 -- 172.21.15.116:0/2233769115 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f762c014680 con 0x7f76300d0df0 2024-02-21T22:53:20.055 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.061+0000 7f76375c8640 1 -- 172.21.15.116:0/2233769115 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76301e93b0 con 0x7f76300d0df0 2024-02-21T22:53:20.055 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.061+0000 7f7625ffb640 1 -- 172.21.15.116:0/2233769115 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f762c014a50 con 0x7f76300d0df0 2024-02-21T22:53:20.055 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.061+0000 7f76375c8640 1 -- 172.21.15.116:0/2233769115 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76301e9970 con 0x7f76300d0df0 2024-02-21T22:53:20.055 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.062+0000 7f76375c8640 1 -- 172.21.15.116:0/2233769115 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76300752f0 con 0x7f76300d0df0 2024-02-21T22:53:20.055 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.062+0000 7f7625ffb640 1 -- 172.21.15.116:0/2233769115 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f762c005d10 con 0x7f76300d0df0 2024-02-21T22:53:20.055 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.063+0000 7f7625ffb640 1 --2- 172.21.15.116:0/2233769115 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f761406b4d0 0x7f761406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:20.055 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.063+0000 7f7625ffb640 1 -- 172.21.15.116:0/2233769115 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f762c08b080 con 0x7f76300d0df0 2024-02-21T22:53:20.055 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.063+0000 7f7634b63640 1 --2- 172.21.15.116:0/2233769115 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f761406b4d0 0x7f761406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:20.055 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.063+0000 7f7634b63640 1 --2- 172.21.15.116:0/2233769115 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f761406b4d0 0x7f761406d990 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f7620035000 tx=0x7f7620008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:20.057 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.067+0000 7f7625ffb640 1 -- 172.21.15.116:0/2233769115 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f762c022030 con 0x7f76300d0df0 2024-02-21T22:53:20.231 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.240+0000 7f76375c8640 1 -- 172.21.15.116:0/2233769115 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f76300d1620 con 0x7f76300d0df0 2024-02-21T22:53:20.231 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.240+0000 7f7625ffb640 1 -- 172.21.15.116:0/2233769115 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f762c010040 con 0x7f76300d0df0 2024-02-21T22:53:20.231 INFO:teuthology.orchestra.run.smithi116.stdout:pg_num: 1 2024-02-21T22:53:20.233 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.242+0000 7f76375c8640 1 -- 172.21.15.116:0/2233769115 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f761406b4d0 msgr2=0x7f761406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:20.233 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.242+0000 7f76375c8640 1 --2- 172.21.15.116:0/2233769115 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f761406b4d0 0x7f761406d990 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f7620035000 tx=0x7f7620008030 comp rx=0 tx=0).stop 2024-02-21T22:53:20.233 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.242+0000 7f76375c8640 1 -- 172.21.15.116:0/2233769115 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f76300d0df0 msgr2=0x7f7630158940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:20.233 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.242+0000 7f76375c8640 1 --2- 172.21.15.116:0/2233769115 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f76300d0df0 0x7f7630158940 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f762c009f60 tx=0x7f762c009f90 comp rx=0 tx=0).stop 2024-02-21T22:53:20.234 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.242+0000 7f76375c8640 1 -- 172.21.15.116:0/2233769115 shutdown_connections 2024-02-21T22:53:20.234 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.242+0000 7f76375c8640 1 --2- 172.21.15.116:0/2233769115 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7630162840 0x7f76301e83a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:20.234 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.242+0000 7f76375c8640 1 --2- 172.21.15.116:0/2233769115 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f761406b4d0 0x7f761406d990 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:20.234 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.242+0000 7f76375c8640 1 --2- 172.21.15.116:0/2233769115 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f763015dfe0 0x7f7630158e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:20.234 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.242+0000 7f76375c8640 1 --2- 172.21.15.116:0/2233769115 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f76300d0df0 0x7f7630158940 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:20.234 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.242+0000 7f76375c8640 1 -- 172.21.15.116:0/2233769115 >> 172.21.15.116:0/2233769115 conn(0x7f76300b36c0 msgr2=0x7f763006f4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:20.234 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.243+0000 7f76375c8640 1 -- 172.21.15.116:0/2233769115 shutdown_connections 2024-02-21T22:53:20.234 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.243+0000 7f76375c8640 1 -- 172.21.15.116:0/2233769115 wait complete. 2024-02-21T22:53:20.244 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-02-21T22:53:20.348 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.357+0000 7f93f4a36640 1 Processor -- start 2024-02-21T22:53:20.348 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.357+0000 7f93f4a36640 1 -- start start 2024-02-21T22:53:20.349 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.358+0000 7f93f4a36640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f93f00b4790 0x7f93f00d4940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:20.349 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.358+0000 7f93f4a36640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93f00ceea0 con 0x7f93f00d2b10 2024-02-21T22:53:20.349 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.358+0000 7f93f4a36640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93f00cf180 con 0x7f93f00d0ca0 2024-02-21T22:53:20.350 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.358+0000 7f93f4a36640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93f00cf460 con 0x7f93f00b4790 2024-02-21T22:53:20.350 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.358+0000 7f93edd9b640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f93f00d2b10 0x7f93f015da70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:54886/0 (socket says 172.21.15.116:54886) 2024-02-21T22:53:20.350 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.358+0000 7f93edd9b640 1 -- 172.21.15.116:0/3014603239 learned_addr learned my addr 172.21.15.116:0/3014603239 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-02-21T22:53:20.350 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.358+0000 7f93eed9d640 1 --2- 172.21.15.116:0/3014603239 >> v2:172.21.15.142:3300/0 conn(0x7f93f00b4790 0x7f93f00d4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:20.350 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.359+0000 7f93ed59a640 1 -- 172.21.15.116:0/3014603239 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3075988057 0 0) 0x7f93f00ceea0 con 0x7f93f00d2b10 2024-02-21T22:53:20.350 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.359+0000 7f93ed59a640 1 -- 172.21.15.116:0/3014603239 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f93d8003520 con 0x7f93f00d2b10 2024-02-21T22:53:20.350 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.359+0000 7f93ed59a640 1 -- 172.21.15.116:0/3014603239 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1292808698 0 0) 0x7f93f00cf180 con 0x7f93f00d0ca0 2024-02-21T22:53:20.350 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.359+0000 7f93ed59a640 1 -- 172.21.15.116:0/3014603239 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f93f00ceea0 con 0x7f93f00d0ca0 2024-02-21T22:53:20.350 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.359+0000 7f93eed9d640 1 -- 172.21.15.116:0/3014603239 >> v1:172.21.15.142:6789/0 conn(0x7f93f00d0ca0 legacy=0x7f93f00d2400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:20.350 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.359+0000 7f93eed9d640 1 -- 172.21.15.116:0/3014603239 >> v1:172.21.15.116:6789/0 conn(0x7f93f00d2b10 legacy=0x7f93f015da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:20.351 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.359+0000 7f93eed9d640 1 -- 172.21.15.116:0/3014603239 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93f00cf740 con 0x7f93f00b4790 2024-02-21T22:53:20.352 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.360+0000 7f93eed9d640 1 --2- 172.21.15.116:0/3014603239 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f93f00b4790 0x7f93f00d4940 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f93e80097a0 tx=0x7f93e802b9f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8af0027d7aa94ad6 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:20.352 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.360+0000 7f93ed59a640 1 -- 172.21.15.116:0/3014603239 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93e802f810 con 0x7f93f00b4790 2024-02-21T22:53:20.352 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.360+0000 7f93ed59a640 1 -- 172.21.15.116:0/3014603239 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93e802f9b0 con 0x7f93f00b4790 2024-02-21T22:53:20.352 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.360+0000 7f93ed59a640 1 -- 172.21.15.116:0/3014603239 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93e802fd60 con 0x7f93f00b4790 2024-02-21T22:53:20.352 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.360+0000 7f93f4a36640 1 -- 172.21.15.116:0/3014603239 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f93f00b4790 msgr2=0x7f93f00d4940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:20.353 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.360+0000 7f93f4a36640 1 --2- 172.21.15.116:0/3014603239 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f93f00b4790 0x7f93f00d4940 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f93e80097a0 tx=0x7f93e802b9f0 comp rx=0 tx=0).stop 2024-02-21T22:53:20.353 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.360+0000 7f93f4a36640 1 -- 172.21.15.116:0/3014603239 shutdown_connections 2024-02-21T22:53:20.353 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.360+0000 7f93f4a36640 1 --2- 172.21.15.116:0/3014603239 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f93f00b4790 0x7f93f00d4940 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:20.353 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.360+0000 7f93f4a36640 1 -- 172.21.15.116:0/3014603239 >> 172.21.15.116:0/3014603239 conn(0x7f93f00d3e20 msgr2=0x7f93f00d4230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:20.353 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.360+0000 7f93f4a36640 1 -- 172.21.15.116:0/3014603239 shutdown_connections 2024-02-21T22:53:20.353 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.360+0000 7f93f4a36640 1 -- 172.21.15.116:0/3014603239 wait complete. 2024-02-21T22:53:20.353 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.362+0000 7f93f4a36640 1 Processor -- start 2024-02-21T22:53:20.353 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.362+0000 7f93f4a36640 1 -- start start 2024-02-21T22:53:20.356 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.362+0000 7f93f4a36640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f93f00b4790 0x7f93f00b8940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:20.356 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.362+0000 7f93f4a36640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f93f00d0ca0 0x7f93f015b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:20.357 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.362+0000 7f93f4a36640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f93f00d2b10 0x7f93f015b640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:20.357 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.362+0000 7f93f4a36640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93f00d1200 con 0x7f93f00d2b10 2024-02-21T22:53:20.357 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.362+0000 7f93f4a36640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93f00d1080 con 0x7f93f00d0ca0 2024-02-21T22:53:20.357 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.362+0000 7f93f4a36640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93f00ceaa0 con 0x7f93f00b4790 2024-02-21T22:53:20.357 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.362+0000 7f93eed9d640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f93f00d2b10 0x7f93f015b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:20.357 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.362+0000 7f93eed9d640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f93f00d2b10 0x7f93f015b640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:38540/0 (socket says 172.21.15.116:38540) 2024-02-21T22:53:20.357 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.362+0000 7f93ee59c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f93f00b4790 0x7f93f00b8940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:20.357 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.362+0000 7f93eed9d640 1 -- 172.21.15.116:0/1299443657 learned_addr learned my addr 172.21.15.116:0/1299443657 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:20.357 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.363+0000 7f93edd9b640 1 --2- 172.21.15.116:0/1299443657 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f93f00d0ca0 0x7f93f015b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:20.357 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.363+0000 7f93eed9d640 1 -- 172.21.15.116:0/1299443657 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f93f00b4790 msgr2=0x7f93f00b8940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:20.357 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.363+0000 7f93eed9d640 1 --2- 172.21.15.116:0/1299443657 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f93f00b4790 0x7f93f00b8940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:20.357 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.363+0000 7f93eed9d640 1 -- 172.21.15.116:0/1299443657 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f93f00d0ca0 msgr2=0x7f93f015b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:20.357 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.363+0000 7f93eed9d640 1 --2- 172.21.15.116:0/1299443657 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f93f00d0ca0 0x7f93f015b100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:20.357 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.363+0000 7f93eed9d640 1 -- 172.21.15.116:0/1299443657 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93f015bdd0 con 0x7f93f00d2b10 2024-02-21T22:53:20.358 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.363+0000 7f93eed9d640 1 --2- 172.21.15.116:0/1299443657 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f93f00d2b10 0x7f93f015b640 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f93e802ba30 tx=0x7f93e80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:20.358 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.363+0000 7f93deffd640 1 -- 172.21.15.116:0/1299443657 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93e8037810 con 0x7f93f00d2b10 2024-02-21T22:53:20.358 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.363+0000 7f93deffd640 1 -- 172.21.15.116:0/1299443657 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93e803d040 con 0x7f93f00d2b10 2024-02-21T22:53:20.358 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.363+0000 7f93deffd640 1 -- 172.21.15.116:0/1299443657 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93e8037c10 con 0x7f93f00d2b10 2024-02-21T22:53:20.358 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.363+0000 7f93f4a36640 1 -- 172.21.15.116:0/1299443657 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93f015c0b0 con 0x7f93f00d2b10 2024-02-21T22:53:20.358 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.363+0000 7f93f4a36640 1 -- 172.21.15.116:0/1299443657 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93f015c670 con 0x7f93f00d2b10 2024-02-21T22:53:20.358 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.364+0000 7f93f4a36640 1 -- 172.21.15.116:0/1299443657 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93f015ca50 con 0x7f93f00d2b10 2024-02-21T22:53:20.358 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.364+0000 7f93deffd640 1 -- 172.21.15.116:0/1299443657 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f93e8043440 con 0x7f93f00d2b10 2024-02-21T22:53:20.358 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.365+0000 7f93deffd640 1 --2- 172.21.15.116:0/1299443657 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f93d006b4d0 0x7f93d006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:20.358 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.365+0000 7f93deffd640 1 -- 172.21.15.116:0/1299443657 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f93e80ac620 con 0x7f93f00d2b10 2024-02-21T22:53:20.358 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.365+0000 7f93ee59c640 1 --2- 172.21.15.116:0/1299443657 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f93d006b4d0 0x7f93d006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:20.358 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.365+0000 7f93ee59c640 1 --2- 172.21.15.116:0/1299443657 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f93d006b4d0 0x7f93d006d990 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f93e0001ea0 tx=0x7f93e0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:20.359 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.369+0000 7f93deffd640 1 -- 172.21.15.116:0/1299443657 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f93f015ca50 con 0x7f93f00d2b10 2024-02-21T22:53:20.532 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.541+0000 7f93f4a36640 1 -- 172.21.15.116:0/1299443657 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f93f00752f0 con 0x7f93f00d2b10 2024-02-21T22:53:20.532 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.542+0000 7f93deffd640 1 -- 172.21.15.116:0/1299443657 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f93e8033030 con 0x7f93f00d2b10 2024-02-21T22:53:20.532 INFO:teuthology.orchestra.run.smithi116.stdout:pg_num: 32 2024-02-21T22:53:20.534 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.543+0000 7f93f4a36640 1 -- 172.21.15.116:0/1299443657 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f93d006b4d0 msgr2=0x7f93d006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:20.534 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.543+0000 7f93f4a36640 1 --2- 172.21.15.116:0/1299443657 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f93d006b4d0 0x7f93d006d990 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f93e0001ea0 tx=0x7f93e0009040 comp rx=0 tx=0).stop 2024-02-21T22:53:20.534 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.543+0000 7f93f4a36640 1 -- 172.21.15.116:0/1299443657 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f93f00d2b10 msgr2=0x7f93f015b640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:20.535 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.544+0000 7f93f4a36640 1 --2- 172.21.15.116:0/1299443657 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f93f00d2b10 0x7f93f015b640 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f93e802ba30 tx=0x7f93e80046c0 comp rx=0 tx=0).stop 2024-02-21T22:53:20.535 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.544+0000 7f93f4a36640 1 -- 172.21.15.116:0/1299443657 shutdown_connections 2024-02-21T22:53:20.535 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.544+0000 7f93f4a36640 1 --2- 172.21.15.116:0/1299443657 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f93f00d2b10 0x7f93f015b640 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:20.535 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.544+0000 7f93f4a36640 1 --2- 172.21.15.116:0/1299443657 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f93f00d0ca0 0x7f93f015b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:20.535 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.544+0000 7f93f4a36640 1 --2- 172.21.15.116:0/1299443657 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f93d006b4d0 0x7f93d006d990 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:20.535 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.544+0000 7f93f4a36640 1 --2- 172.21.15.116:0/1299443657 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f93f00b4790 0x7f93f00b8940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:20.535 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.544+0000 7f93f4a36640 1 -- 172.21.15.116:0/1299443657 >> 172.21.15.116:0/1299443657 conn(0x7f93f00d3e20 msgr2=0x7f93f00d19d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:20.535 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.544+0000 7f93f4a36640 1 -- 172.21.15.116:0/1299443657 shutdown_connections 2024-02-21T22:53:20.535 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.544+0000 7f93f4a36640 1 -- 172.21.15.116:0/1299443657 wait complete. 2024-02-21T22:53:20.545 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-02-21T22:53:20.648 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.657+0000 7f4aceade640 1 Processor -- start 2024-02-21T22:53:20.648 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.657+0000 7f4aceade640 1 -- start start 2024-02-21T22:53:20.650 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.658+0000 7f4aceade640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4ac815dfe0 0x7f4ac806eb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:20.650 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.658+0000 7f4aceade640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f4ac8162840 0x7f4ac806f540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:20.650 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.658+0000 7f4aceade640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ac80d0030 con 0x7f4ac80d0df0 2024-02-21T22:53:20.650 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.658+0000 7f4aceade640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ac80d0310 con 0x7f4ac8162840 2024-02-21T22:53:20.650 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.658+0000 7f4aceade640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ac80d05f0 con 0x7f4ac815dfe0 2024-02-21T22:53:20.650 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.658+0000 7f4ac7fff640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f4ac8162840 0x7f4ac806f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:20.651 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.658+0000 7f4acd07b640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f4ac80d0df0 0x7f4ac80cc200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:54890/0 (socket says 172.21.15.116:54890) 2024-02-21T22:53:20.651 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.658+0000 7f4acd07b640 1 -- 172.21.15.116:0/1467931599 learned_addr learned my addr 172.21.15.116:0/1467931599 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-02-21T22:53:20.651 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.658+0000 7f4acc87a640 1 --2- 172.21.15.116:0/1467931599 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4ac815dfe0 0x7f4ac806eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:20.651 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.658+0000 7f4ac7fff640 1 -- 172.21.15.116:0/1467931599 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4ac815dfe0 msgr2=0x7f4ac806eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:53:20.651 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.658+0000 7f4ac7fff640 1 --2- 172.21.15.116:0/1467931599 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4ac815dfe0 0x7f4ac806eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:20.651 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.658+0000 7f4ac7fff640 1 -- 172.21.15.116:0/1467931599 >> v1:172.21.15.116:6789/0 conn(0x7f4ac80d0df0 legacy=0x7f4ac80cc200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:20.651 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.658+0000 7f4ac77fe640 1 -- 172.21.15.116:0/1467931599 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1388260633 0 0) 0x7f4ac80d0030 con 0x7f4ac80d0df0 2024-02-21T22:53:20.651 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.658+0000 7f4ac7fff640 1 -- 172.21.15.116:0/1467931599 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ac80d08d0 con 0x7f4ac8162840 2024-02-21T22:53:20.651 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.659+0000 7f4ac7fff640 1 --2- 172.21.15.116:0/1467931599 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4ac8162840 0x7f4ac806f540 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f4ab40097a0 tx=0x7f4ab402b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4e2262202e63927 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:20.651 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.659+0000 7f4ac77fe640 1 -- 172.21.15.116:0/1467931599 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ab4038070 con 0x7f4ac8162840 2024-02-21T22:53:20.651 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.659+0000 7f4ac77fe640 1 -- 172.21.15.116:0/1467931599 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ab4031700 con 0x7f4ac8162840 2024-02-21T22:53:20.651 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.659+0000 7f4ac77fe640 1 -- 172.21.15.116:0/1467931599 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ab4031ad0 con 0x7f4ac8162840 2024-02-21T22:53:20.651 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.659+0000 7f4aceade640 1 -- 172.21.15.116:0/1467931599 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4ac8162840 msgr2=0x7f4ac806f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:20.651 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.660+0000 7f4aceade640 1 --2- 172.21.15.116:0/1467931599 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4ac8162840 0x7f4ac806f540 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f4ab40097a0 tx=0x7f4ab402b7a0 comp rx=0 tx=0).stop 2024-02-21T22:53:20.651 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.660+0000 7f4aceade640 1 -- 172.21.15.116:0/1467931599 shutdown_connections 2024-02-21T22:53:20.652 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.660+0000 7f4aceade640 1 --2- 172.21.15.116:0/1467931599 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4ac8162840 0x7f4ac806f540 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:20.652 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.660+0000 7f4aceade640 1 --2- 172.21.15.116:0/1467931599 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4ac815dfe0 0x7f4ac806eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:20.652 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.660+0000 7f4aceade640 1 -- 172.21.15.116:0/1467931599 >> 172.21.15.116:0/1467931599 conn(0x7f4ac80b36c0 msgr2=0x7f4ac80b3ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:20.652 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.660+0000 7f4aceade640 1 -- 172.21.15.116:0/1467931599 shutdown_connections 2024-02-21T22:53:20.652 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.660+0000 7f4aceade640 1 -- 172.21.15.116:0/1467931599 wait complete. 2024-02-21T22:53:20.655 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.661+0000 7f4aceade640 1 Processor -- start 2024-02-21T22:53:20.655 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.661+0000 7f4aceade640 1 -- start start 2024-02-21T22:53:20.655 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.662+0000 7f4aceade640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4ac80d0df0 0x7f4ac81f39a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:20.655 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.662+0000 7f4aceade640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4ac815dfe0 0x7f4ac815ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:20.655 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.662+0000 7f4aceade640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4ac8162840 0x7f4ac806c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:20.655 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.662+0000 7f4aceade640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ac806f090 con 0x7f4ac80d0df0 2024-02-21T22:53:20.655 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.662+0000 7f4aceade640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ac815e3c0 con 0x7f4ac8162840 2024-02-21T22:53:20.655 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.662+0000 7f4aceade640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ac806f210 con 0x7f4ac815dfe0 2024-02-21T22:53:20.655 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.662+0000 7f4acc87a640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4ac80d0df0 0x7f4ac81f39a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:20.655 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.662+0000 7f4acc87a640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4ac80d0df0 0x7f4ac81f39a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:38564/0 (socket says 172.21.15.116:38564) 2024-02-21T22:53:20.655 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.662+0000 7f4acc87a640 1 -- 172.21.15.116:0/2768178120 learned_addr learned my addr 172.21.15.116:0/2768178120 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:20.655 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.662+0000 7f4acd07b640 1 --2- 172.21.15.116:0/2768178120 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4ac8162840 0x7f4ac806c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:20.655 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.662+0000 7f4ac7fff640 1 --2- 172.21.15.116:0/2768178120 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4ac815dfe0 0x7f4ac815ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:20.655 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.662+0000 7f4acc87a640 1 -- 172.21.15.116:0/2768178120 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4ac815dfe0 msgr2=0x7f4ac815ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:20.656 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.662+0000 7f4acc87a640 1 --2- 172.21.15.116:0/2768178120 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4ac815dfe0 0x7f4ac815ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:20.656 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.662+0000 7f4acc87a640 1 -- 172.21.15.116:0/2768178120 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4ac8162840 msgr2=0x7f4ac806c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:20.656 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.662+0000 7f4acc87a640 1 --2- 172.21.15.116:0/2768178120 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4ac8162840 0x7f4ac806c530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:20.656 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.662+0000 7f4acc87a640 1 -- 172.21.15.116:0/2768178120 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ac815e670 con 0x7f4ac80d0df0 2024-02-21T22:53:20.656 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.662+0000 7f4acc87a640 1 --2- 172.21.15.116:0/2768178120 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4ac80d0df0 0x7f4ac81f39a0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f4abc00e9e0 tx=0x7f4abc00eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:20.656 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.662+0000 7f4ac57fa640 1 -- 172.21.15.116:0/2768178120 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4abc017070 con 0x7f4ac80d0df0 2024-02-21T22:53:20.656 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.662+0000 7f4ac57fa640 1 -- 172.21.15.116:0/2768178120 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4abc00c9d0 con 0x7f4ac80d0df0 2024-02-21T22:53:20.656 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.662+0000 7f4aceade640 1 -- 172.21.15.116:0/2768178120 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ac81f3ee0 con 0x7f4ac80d0df0 2024-02-21T22:53:20.656 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.662+0000 7f4ac57fa640 1 -- 172.21.15.116:0/2768178120 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4abc00cdc0 con 0x7f4ac80d0df0 2024-02-21T22:53:20.656 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.662+0000 7f4aceade640 1 -- 172.21.15.116:0/2768178120 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ac815ebf0 con 0x7f4ac80d0df0 2024-02-21T22:53:20.656 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.663+0000 7f4aceade640 1 -- 172.21.15.116:0/2768178120 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ac80752f0 con 0x7f4ac80d0df0 2024-02-21T22:53:20.656 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.664+0000 7f4ac57fa640 1 -- 172.21.15.116:0/2768178120 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f4abc01a070 con 0x7f4ac80d0df0 2024-02-21T22:53:20.656 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.664+0000 7f4ac57fa640 1 --2- 172.21.15.116:0/2768178120 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f4aac06b4d0 0x7f4aac06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:20.656 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.664+0000 7f4ac57fa640 1 -- 172.21.15.116:0/2768178120 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4abc08a0b0 con 0x7f4ac80d0df0 2024-02-21T22:53:20.656 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.664+0000 7f4ac7fff640 1 --2- 172.21.15.116:0/2768178120 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f4aac06b4d0 0x7f4aac06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:20.657 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.665+0000 7f4ac7fff640 1 --2- 172.21.15.116:0/2768178120 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f4aac06b4d0 0x7f4aac06d990 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f4ab4035000 tx=0x7f4ab4008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:20.659 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.669+0000 7f4ac57fa640 1 -- 172.21.15.116:0/2768178120 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f4abc058970 con 0x7f4ac80d0df0 2024-02-21T22:53:20.831 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.840+0000 7f4aceade640 1 -- 172.21.15.116:0/2768178120 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4ac80d1620 con 0x7f4ac80d0df0 2024-02-21T22:53:20.832 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.840+0000 7f4ac57fa640 1 -- 172.21.15.116:0/2768178120 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4abc05ca10 con 0x7f4ac80d0df0 2024-02-21T22:53:20.832 INFO:teuthology.orchestra.run.smithi116.stdout:pg_num: 64 2024-02-21T22:53:20.833 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.842+0000 7f4aceade640 1 -- 172.21.15.116:0/2768178120 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f4aac06b4d0 msgr2=0x7f4aac06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:20.833 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.842+0000 7f4aceade640 1 --2- 172.21.15.116:0/2768178120 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f4aac06b4d0 0x7f4aac06d990 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f4ab4035000 tx=0x7f4ab4008030 comp rx=0 tx=0).stop 2024-02-21T22:53:20.833 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.842+0000 7f4aceade640 1 -- 172.21.15.116:0/2768178120 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4ac80d0df0 msgr2=0x7f4ac81f39a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:20.834 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.842+0000 7f4aceade640 1 --2- 172.21.15.116:0/2768178120 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4ac80d0df0 0x7f4ac81f39a0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f4abc00e9e0 tx=0x7f4abc00eea0 comp rx=0 tx=0).stop 2024-02-21T22:53:20.834 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.843+0000 7f4aceade640 1 -- 172.21.15.116:0/2768178120 shutdown_connections 2024-02-21T22:53:20.834 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.843+0000 7f4aceade640 1 --2- 172.21.15.116:0/2768178120 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4ac8162840 0x7f4ac806c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:20.834 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.843+0000 7f4aceade640 1 --2- 172.21.15.116:0/2768178120 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f4aac06b4d0 0x7f4aac06d990 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:20.834 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.843+0000 7f4aceade640 1 --2- 172.21.15.116:0/2768178120 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4ac815dfe0 0x7f4ac815ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:20.834 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.843+0000 7f4aceade640 1 --2- 172.21.15.116:0/2768178120 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4ac80d0df0 0x7f4ac81f39a0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:20.834 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.843+0000 7f4aceade640 1 -- 172.21.15.116:0/2768178120 >> 172.21.15.116:0/2768178120 conn(0x7f4ac80b36c0 msgr2=0x7f4ac806f4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:20.834 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.843+0000 7f4aceade640 1 -- 172.21.15.116:0/2768178120 shutdown_connections 2024-02-21T22:53:20.834 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.843+0000 7f4aceade640 1 -- 172.21.15.116:0/2768178120 wait complete. 2024-02-21T22:53:20.844 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic' 2024-02-21T22:53:20.945 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.954+0000 7f58d7288640 1 Processor -- start 2024-02-21T22:53:20.945 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.955+0000 7f58d7288640 1 -- start start 2024-02-21T22:53:20.949 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.955+0000 7f58d7288640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f58d00afa80 0x7f58d00b5990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:20.949 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.955+0000 7f58d7288640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f58d006b550 0x7f58d00b0220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:20.949 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.955+0000 7f58d7288640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58d00afe60 con 0x7f58d00b5ed0 2024-02-21T22:53:20.949 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.955+0000 7f58d7288640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58d00b5500 con 0x7f58d00afa80 2024-02-21T22:53:20.949 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.955+0000 7f58d7288640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58d015f510 con 0x7f58d006b550 2024-02-21T22:53:20.949 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.956+0000 7f58d5024640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f58d00afa80 0x7f58d00b5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:20.949 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.956+0000 7f58d4823640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f58d00b5ed0 0x7f58d006ae40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.116:59474/0 (socket says 172.21.15.116:59474) 2024-02-21T22:53:20.950 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.956+0000 7f58d4823640 1 -- 172.21.15.116:0/2483599832 learned_addr learned my addr 172.21.15.116:0/2483599832 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-02-21T22:53:20.950 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.956+0000 7f58d5825640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f58d006b550 0x7f58d00b0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:20.950 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.956+0000 7f58d5825640 1 -- 172.21.15.116:0/2483599832 >> v2:172.21.15.142:3300/0 conn(0x7f58d00afa80 msgr2=0x7f58d00b5990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:53:20.950 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.956+0000 7f58d5825640 1 --2- 172.21.15.116:0/2483599832 >> v2:172.21.15.142:3300/0 conn(0x7f58d00afa80 0x7f58d00b5990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:20.950 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.956+0000 7f58d5825640 1 -- 172.21.15.116:0/2483599832 >> v1:172.21.15.142:6789/0 conn(0x7f58d00b5ed0 legacy=0x7f58d006ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:20.950 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.956+0000 7f58d5825640 1 -- 172.21.15.116:0/2483599832 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58d015f7f0 con 0x7f58d006b550 2024-02-21T22:53:20.950 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.956+0000 7f58d5024640 1 --2- 172.21.15.116:0/2483599832 >> v2:172.21.15.142:3300/0 conn(0x7f58d00afa80 0x7f58d00b5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T22:53:20.950 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.957+0000 7f58d5825640 1 --2- 172.21.15.116:0/2483599832 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f58d006b550 0x7f58d00b0220 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f58c8009d90 tx=0x7f58c802bce0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d7328f1d93dce441 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:20.950 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.957+0000 7f58c7fff640 1 -- 172.21.15.116:0/2483599832 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58c8039070 con 0x7f58d006b550 2024-02-21T22:53:20.950 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.957+0000 7f58c7fff640 1 -- 172.21.15.116:0/2483599832 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58c802ca10 con 0x7f58d006b550 2024-02-21T22:53:20.950 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.957+0000 7f58c7fff640 1 -- 172.21.15.116:0/2483599832 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58c802cde0 con 0x7f58d006b550 2024-02-21T22:53:20.951 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.957+0000 7f58d7288640 1 -- 172.21.15.116:0/2483599832 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f58d006b550 msgr2=0x7f58d00b0220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:20.951 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.957+0000 7f58d7288640 1 --2- 172.21.15.116:0/2483599832 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f58d006b550 0x7f58d00b0220 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f58c8009d90 tx=0x7f58c802bce0 comp rx=0 tx=0).stop 2024-02-21T22:53:20.951 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.957+0000 7f58d7288640 1 -- 172.21.15.116:0/2483599832 shutdown_connections 2024-02-21T22:53:20.951 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.957+0000 7f58d7288640 1 --2- 172.21.15.116:0/2483599832 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f58d006b550 0x7f58d00b0220 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:20.951 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.957+0000 7f58d7288640 1 --2- 172.21.15.116:0/2483599832 >> v2:172.21.15.142:3300/0 conn(0x7f58d00afa80 0x7f58d00b5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:20.951 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.957+0000 7f58d7288640 1 -- 172.21.15.116:0/2483599832 >> 172.21.15.116:0/2483599832 conn(0x7f58d00724f0 msgr2=0x7f58d0072900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:20.951 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.957+0000 7f58d7288640 1 -- 172.21.15.116:0/2483599832 shutdown_connections 2024-02-21T22:53:20.951 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.957+0000 7f58d7288640 1 -- 172.21.15.116:0/2483599832 wait complete. 2024-02-21T22:53:20.951 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.959+0000 7f58d7288640 1 Processor -- start 2024-02-21T22:53:20.951 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.959+0000 7f58d7288640 1 -- start start 2024-02-21T22:53:20.954 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.959+0000 7f58d7288640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f58d006b550 0x7f58d015cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:20.954 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.959+0000 7f58d7288640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f58d00afa80 0x7f58d015d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:20.954 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.959+0000 7f58d7288640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f58d00b5ed0 0x7f58d0150200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:20.954 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.959+0000 7f58d7288640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58d00b08e0 con 0x7f58d00b5ed0 2024-02-21T22:53:20.954 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.959+0000 7f58d7288640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58d00b0760 con 0x7f58d00afa80 2024-02-21T22:53:20.955 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.959+0000 7f58d7288640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58d00b0a60 con 0x7f58d006b550 2024-02-21T22:53:20.955 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.959+0000 7f58d5825640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f58d00b5ed0 0x7f58d0150200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:20.955 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.959+0000 7f58d5825640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f58d00b5ed0 0x7f58d0150200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:38570/0 (socket says 172.21.15.116:38570) 2024-02-21T22:53:20.955 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.959+0000 7f58d5825640 1 -- 172.21.15.116:0/2661739650 learned_addr learned my addr 172.21.15.116:0/2661739650 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:20.955 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.959+0000 7f58d4823640 1 --2- 172.21.15.116:0/2661739650 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f58d00afa80 0x7f58d015d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:20.955 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.959+0000 7f58d5024640 1 --2- 172.21.15.116:0/2661739650 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f58d006b550 0x7f58d015cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:20.955 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.960+0000 7f58d5825640 1 -- 172.21.15.116:0/2661739650 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f58d006b550 msgr2=0x7f58d015cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:20.955 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.960+0000 7f58d5825640 1 --2- 172.21.15.116:0/2661739650 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f58d006b550 0x7f58d015cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:20.955 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.960+0000 7f58d5825640 1 -- 172.21.15.116:0/2661739650 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f58d00afa80 msgr2=0x7f58d015d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:20.955 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.960+0000 7f58d5825640 1 --2- 172.21.15.116:0/2661739650 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f58d00afa80 0x7f58d015d220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:20.955 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.960+0000 7f58d5825640 1 -- 172.21.15.116:0/2661739650 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58d014e180 con 0x7f58d00b5ed0 2024-02-21T22:53:20.955 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.960+0000 7f58d5825640 1 --2- 172.21.15.116:0/2661739650 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f58d00b5ed0 0x7f58d0150200 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f58c8009d90 tx=0x7f58c8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:20.955 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.960+0000 7f58c5ffb640 1 -- 172.21.15.116:0/2661739650 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58c8039050 con 0x7f58d00b5ed0 2024-02-21T22:53:20.955 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.960+0000 7f58c5ffb640 1 -- 172.21.15.116:0/2661739650 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58c8045070 con 0x7f58d00b5ed0 2024-02-21T22:53:20.955 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.960+0000 7f58d7288640 1 -- 172.21.15.116:0/2661739650 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58d009e090 con 0x7f58d00b5ed0 2024-02-21T22:53:20.955 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.960+0000 7f58c5ffb640 1 -- 172.21.15.116:0/2661739650 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58c8009450 con 0x7f58d00b5ed0 2024-02-21T22:53:20.956 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.960+0000 7f58d7288640 1 -- 172.21.15.116:0/2661739650 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58d014e700 con 0x7f58d00b5ed0 2024-02-21T22:53:20.956 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.961+0000 7f58d7288640 1 -- 172.21.15.116:0/2661739650 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58d00752f0 con 0x7f58d00b5ed0 2024-02-21T22:53:20.956 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.962+0000 7f58c5ffb640 1 -- 172.21.15.116:0/2661739650 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f58c804a460 con 0x7f58d00b5ed0 2024-02-21T22:53:20.956 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.962+0000 7f58c5ffb640 1 --2- 172.21.15.116:0/2661739650 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f58b406b4d0 0x7f58b406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:20.956 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.962+0000 7f58c5ffb640 1 -- 172.21.15.116:0/2661739650 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f58c80ac9a0 con 0x7f58d00b5ed0 2024-02-21T22:53:20.956 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.962+0000 7f58d5024640 1 --2- 172.21.15.116:0/2661739650 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f58b406b4d0 0x7f58b406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:20.956 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.962+0000 7f58d5024640 1 --2- 172.21.15.116:0/2661739650 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f58b406b4d0 0x7f58b406d990 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f58c0009560 tx=0x7f58c0009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:20.956 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:20.966+0000 7f58c5ffb640 1 -- 172.21.15.116:0/2661739650 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f58c807b150 con 0x7f58d00b5ed0 2024-02-21T22:53:21.194 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:21.204+0000 7f58d7288640 1 -- 172.21.15.116:0/2661739650 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]} v 0) v1 -- 0x7f58d006b1c0 con 0x7f58d00b5ed0 2024-02-21T22:53:21.885 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:21.894+0000 7f58c5ffb640 1 -- 172.21.15.116:0/2661739650 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]}]=0 v52) v1 ==== 147+0+0 (secure 0 0 0) 0x7f58c807f1f0 con 0x7f58d00b5ed0 2024-02-21T22:53:21.888 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:21.896+0000 7f58d7288640 1 -- 172.21.15.116:0/2661739650 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f58b406b4d0 msgr2=0x7f58b406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:21.888 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:21.896+0000 7f58d7288640 1 --2- 172.21.15.116:0/2661739650 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f58b406b4d0 0x7f58b406d990 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f58c0009560 tx=0x7f58c0009190 comp rx=0 tx=0).stop 2024-02-21T22:53:21.888 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:21.896+0000 7f58d7288640 1 -- 172.21.15.116:0/2661739650 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f58d00b5ed0 msgr2=0x7f58d0150200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:21.888 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:21.896+0000 7f58d7288640 1 --2- 172.21.15.116:0/2661739650 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f58d00b5ed0 0x7f58d0150200 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f58c8009d90 tx=0x7f58c8004a40 comp rx=0 tx=0).stop 2024-02-21T22:53:21.888 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:21.897+0000 7f58d7288640 1 -- 172.21.15.116:0/2661739650 shutdown_connections 2024-02-21T22:53:21.888 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:21.897+0000 7f58d7288640 1 --2- 172.21.15.116:0/2661739650 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f58d00b5ed0 0x7f58d0150200 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:21.888 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:21.897+0000 7f58d7288640 1 --2- 172.21.15.116:0/2661739650 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f58d00afa80 0x7f58d015d220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:21.888 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:21.897+0000 7f58d7288640 1 --2- 172.21.15.116:0/2661739650 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f58b406b4d0 0x7f58b406d990 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:21.888 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:21.897+0000 7f58d7288640 1 --2- 172.21.15.116:0/2661739650 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f58d006b550 0x7f58d015cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:21.888 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:21.897+0000 7f58d7288640 1 -- 172.21.15.116:0/2661739650 >> 172.21.15.116:0/2661739650 conn(0x7f58d00724f0 msgr2=0x7f58d00cde70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:21.888 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:21.897+0000 7f58d7288640 1 -- 172.21.15.116:0/2661739650 shutdown_connections 2024-02-21T22:53:21.888 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:21.897+0000 7f58d7288640 1 -- 172.21.15.116:0/2661739650 wait complete. 2024-02-21T22:53:21.899 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-02-21T22:53:22.005 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.014+0000 7fabdc277640 1 Processor -- start 2024-02-21T22:53:22.005 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.014+0000 7fabdc277640 1 -- start start 2024-02-21T22:53:22.006 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.015+0000 7fabdc277640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fabd415dfe0 0x7fabd406eb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:22.006 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.015+0000 7fabdc277640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fabd406fc50 0x7fabd40cc200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:22.006 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.015+0000 7fabdc277640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabd40d0030 con 0x7fabd4162840 2024-02-21T22:53:22.006 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.015+0000 7fabdc277640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabd40d0310 con 0x7fabd406fc50 2024-02-21T22:53:22.006 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.015+0000 7fabdc277640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabd40d05f0 con 0x7fabd415dfe0 2024-02-21T22:53:22.006 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.015+0000 7fabda814640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fabd406fc50 0x7fabd40cc200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:22.007 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.015+0000 7fabda013640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fabd415dfe0 0x7fabd406eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:22.007 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.015+0000 7fabd9812640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fabd4162840 0x7fabd406f540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.116:59480/0 (socket says 172.21.15.116:59480) 2024-02-21T22:53:22.007 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.015+0000 7fabd9812640 1 -- 172.21.15.116:0/2479648603 learned_addr learned my addr 172.21.15.116:0/2479648603 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-02-21T22:53:22.007 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.016+0000 7fabda013640 1 -- 172.21.15.116:0/2479648603 >> v2:172.21.15.142:3300/0 conn(0x7fabd406fc50 msgr2=0x7fabd40cc200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:53:22.007 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.016+0000 7fabda013640 1 --2- 172.21.15.116:0/2479648603 >> v2:172.21.15.142:3300/0 conn(0x7fabd406fc50 0x7fabd40cc200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:22.007 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.016+0000 7fabda013640 1 -- 172.21.15.116:0/2479648603 >> v1:172.21.15.142:6789/0 conn(0x7fabd4162840 legacy=0x7fabd406f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:22.007 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.016+0000 7fabda013640 1 -- 172.21.15.116:0/2479648603 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabd40d08d0 con 0x7fabd415dfe0 2024-02-21T22:53:22.007 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.016+0000 7fabd9011640 1 -- 172.21.15.116:0/2479648603 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2845545003 0 0) 0x7fabd40d0030 con 0x7fabd4162840 2024-02-21T22:53:22.007 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.016+0000 7fabda814640 1 --2- 172.21.15.116:0/2479648603 >> v2:172.21.15.142:3300/0 conn(0x7fabd406fc50 0x7fabd40cc200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T22:53:22.009 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.016+0000 7fabda013640 1 --2- 172.21.15.116:0/2479648603 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fabd415dfe0 0x7fabd406eb50 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fabd00097a0 tx=0x7fabd002b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8bd30c89ea6e98dc server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:22.009 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.016+0000 7fabd9011640 1 -- 172.21.15.116:0/2479648603 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabd00315a0 con 0x7fabd415dfe0 2024-02-21T22:53:22.009 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.016+0000 7fabd9011640 1 -- 172.21.15.116:0/2479648603 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabd0037070 con 0x7fabd415dfe0 2024-02-21T22:53:22.009 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.016+0000 7fabd9011640 1 -- 172.21.15.116:0/2479648603 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabd0031960 con 0x7fabd415dfe0 2024-02-21T22:53:22.009 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.017+0000 7fabdc277640 1 -- 172.21.15.116:0/2479648603 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fabd415dfe0 msgr2=0x7fabd406eb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:22.009 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.017+0000 7fabdc277640 1 --2- 172.21.15.116:0/2479648603 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fabd415dfe0 0x7fabd406eb50 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fabd00097a0 tx=0x7fabd002b840 comp rx=0 tx=0).stop 2024-02-21T22:53:22.009 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.017+0000 7fabdc277640 1 -- 172.21.15.116:0/2479648603 shutdown_connections 2024-02-21T22:53:22.009 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.017+0000 7fabdc277640 1 --2- 172.21.15.116:0/2479648603 >> v2:172.21.15.142:3300/0 conn(0x7fabd406fc50 0x7fabd40cc200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:22.009 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.017+0000 7fabdc277640 1 --2- 172.21.15.116:0/2479648603 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fabd415dfe0 0x7fabd406eb50 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:22.009 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.017+0000 7fabdc277640 1 -- 172.21.15.116:0/2479648603 >> 172.21.15.116:0/2479648603 conn(0x7fabd40b36c0 msgr2=0x7fabd40b3ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:22.009 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.017+0000 7fabdc277640 1 -- 172.21.15.116:0/2479648603 shutdown_connections 2024-02-21T22:53:22.009 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.017+0000 7fabdc277640 1 -- 172.21.15.116:0/2479648603 wait complete. 2024-02-21T22:53:22.010 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.018+0000 7fabdc277640 1 Processor -- start 2024-02-21T22:53:22.010 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.018+0000 7fabdc277640 1 -- start start 2024-02-21T22:53:22.012 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.019+0000 7fabdc277640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fabd406fc50 0x7fabd414ff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:22.013 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.019+0000 7fabdc277640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fabd415dfe0 0x7fabd4158f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:22.013 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.019+0000 7fabdc277640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fabd4162840 0x7fabd40b2940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:22.013 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.019+0000 7fabdc277640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabd406f090 con 0x7fabd406fc50 2024-02-21T22:53:22.013 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.019+0000 7fabdc277640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabd415e3c0 con 0x7fabd415dfe0 2024-02-21T22:53:22.013 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.019+0000 7fabdc277640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabd406f210 con 0x7fabd4162840 2024-02-21T22:53:22.013 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.019+0000 7fabda013640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fabd406fc50 0x7fabd414ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:22.013 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.019+0000 7fabda013640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fabd406fc50 0x7fabd414ff00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:38572/0 (socket says 172.21.15.116:38572) 2024-02-21T22:53:22.013 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.019+0000 7fabda013640 1 -- 172.21.15.116:0/94974220 learned_addr learned my addr 172.21.15.116:0/94974220 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:22.013 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.019+0000 7fabd9812640 1 --2- 172.21.15.116:0/94974220 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fabd415dfe0 0x7fabd4158f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:22.013 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.019+0000 7fabda814640 1 --2- 172.21.15.116:0/94974220 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fabd4162840 0x7fabd40b2940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:22.013 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.019+0000 7fabda013640 1 -- 172.21.15.116:0/94974220 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fabd4162840 msgr2=0x7fabd40b2940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:22.013 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.019+0000 7fabda013640 1 --2- 172.21.15.116:0/94974220 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fabd4162840 0x7fabd40b2940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:22.013 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.019+0000 7fabda013640 1 -- 172.21.15.116:0/94974220 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fabd415dfe0 msgr2=0x7fabd4158f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:22.013 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.019+0000 7fabda013640 1 --2- 172.21.15.116:0/94974220 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fabd415dfe0 0x7fabd4158f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:22.013 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.019+0000 7fabda013640 1 -- 172.21.15.116:0/94974220 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabd40b0d10 con 0x7fabd406fc50 2024-02-21T22:53:22.014 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.020+0000 7fabda013640 1 --2- 172.21.15.116:0/94974220 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fabd406fc50 0x7fabd414ff00 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fabd0000c00 tx=0x7fabd00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:22.014 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.020+0000 7fabcaffd640 1 -- 172.21.15.116:0/94974220 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabd0032630 con 0x7fabd406fc50 2024-02-21T22:53:22.014 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.020+0000 7fabcaffd640 1 -- 172.21.15.116:0/94974220 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabd00327d0 con 0x7fabd406fc50 2024-02-21T22:53:22.014 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.020+0000 7fabdc277640 1 -- 172.21.15.116:0/94974220 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabd40b0ff0 con 0x7fabd406fc50 2024-02-21T22:53:22.014 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.020+0000 7fabcaffd640 1 -- 172.21.15.116:0/94974220 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabd0032bc0 con 0x7fabd406fc50 2024-02-21T22:53:22.014 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.020+0000 7fabdc277640 1 -- 172.21.15.116:0/94974220 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabd40b15b0 con 0x7fabd406fc50 2024-02-21T22:53:22.014 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.021+0000 7fabdc277640 1 -- 172.21.15.116:0/94974220 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabd40752f0 con 0x7fabd406fc50 2024-02-21T22:53:22.014 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.021+0000 7fabcaffd640 1 -- 172.21.15.116:0/94974220 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fabd004d3f0 con 0x7fabd406fc50 2024-02-21T22:53:22.014 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.021+0000 7fabcaffd640 1 --2- 172.21.15.116:0/94974220 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fabb806b4d0 0x7fabb806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:22.014 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.021+0000 7fabcaffd640 1 -- 172.21.15.116:0/94974220 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fabd002f030 con 0x7fabd406fc50 2024-02-21T22:53:22.015 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.022+0000 7fabd9812640 1 --2- 172.21.15.116:0/94974220 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fabb806b4d0 0x7fabb806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:22.015 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.022+0000 7fabd9812640 1 --2- 172.21.15.116:0/94974220 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fabb806b4d0 0x7fabb806d990 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fabd415ba20 tx=0x7fabc4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:22.016 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.026+0000 7fabcaffd640 1 -- 172.21.15.116:0/94974220 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7fabd0040070 con 0x7fabd406fc50 2024-02-21T22:53:22.189 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.198+0000 7fabdc277640 1 -- 172.21.15.116:0/94974220 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fabd406ee70 con 0x7fabd406fc50 2024-02-21T22:53:22.191 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.201+0000 7fabcaffd640 1 -- 172.21.15.116:0/94974220 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7fabd007a490 con 0x7fabd406fc50 2024-02-21T22:53:22.194 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.203+0000 7fabdc277640 1 -- 172.21.15.116:0/94974220 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fabb806b4d0 msgr2=0x7fabb806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:22.194 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.203+0000 7fabdc277640 1 --2- 172.21.15.116:0/94974220 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fabb806b4d0 0x7fabb806d990 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fabd415ba20 tx=0x7fabc4009040 comp rx=0 tx=0).stop 2024-02-21T22:53:22.194 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.203+0000 7fabdc277640 1 -- 172.21.15.116:0/94974220 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fabd406fc50 msgr2=0x7fabd414ff00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:22.194 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.203+0000 7fabdc277640 1 --2- 172.21.15.116:0/94974220 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fabd406fc50 0x7fabd414ff00 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fabd0000c00 tx=0x7fabd00046c0 comp rx=0 tx=0).stop 2024-02-21T22:53:22.195 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.203+0000 7fabdc277640 1 -- 172.21.15.116:0/94974220 shutdown_connections 2024-02-21T22:53:22.195 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.203+0000 7fabdc277640 1 --2- 172.21.15.116:0/94974220 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fabb806b4d0 0x7fabb806d990 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:22.195 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.203+0000 7fabdc277640 1 --2- 172.21.15.116:0/94974220 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fabd4162840 0x7fabd40b2940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:22.195 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.203+0000 7fabdc277640 1 --2- 172.21.15.116:0/94974220 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fabd415dfe0 0x7fabd4158f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:22.195 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.203+0000 7fabdc277640 1 --2- 172.21.15.116:0/94974220 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fabd406fc50 0x7fabd414ff00 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:22.195 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.203+0000 7fabdc277640 1 -- 172.21.15.116:0/94974220 >> 172.21.15.116:0/94974220 conn(0x7fabd40b36c0 msgr2=0x7fabd40ce220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:22.195 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.203+0000 7fabdc277640 1 -- 172.21.15.116:0/94974220 shutdown_connections 2024-02-21T22:53:22.195 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.203+0000 7fabdc277640 1 -- 172.21.15.116:0/94974220 wait complete. 2024-02-21T22:53:22.205 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-02-21T22:53:22.205 DEBUG:teuthology.orchestra.run.smithi116:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-02-21T22:53:22.240 DEBUG:teuthology.orchestra.run.smithi142:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-02-21T22:53:22.294 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-02-21T22:53:22.295 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-02-21T22:53:22.295 DEBUG:teuthology.orchestra.run.smithi116:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-21T22:53:22.310 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-02-21T22:53:22.310 DEBUG:teuthology.orchestra.run.smithi116:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-21T22:53:22.365 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-02-21T22:53:22.365 DEBUG:teuthology.orchestra.run.smithi116:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-21T22:53:22.422 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-21T22:53:22.561 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.571+0000 7fdae27f7640 1 Processor -- start 2024-02-21T22:53:22.562 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.571+0000 7fdae27f7640 1 -- start start 2024-02-21T22:53:22.564 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.571+0000 7fdae27f7640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fdadc0afa80 0x7fdadc0b5990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:22.565 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.572+0000 7fdae27f7640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdadc0afe60 con 0x7fdadc0b5ed0 2024-02-21T22:53:22.565 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.572+0000 7fdae27f7640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdadc15f510 con 0x7fdadc06b550 2024-02-21T22:53:22.565 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.572+0000 7fdae27f7640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdadc0b5500 con 0x7fdadc0afa80 2024-02-21T22:53:22.565 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.572+0000 7fdadb7fe640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7fdadc0b5ed0 0x7fdadc06ae40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:54894/0 (socket says 172.21.15.116:54894) 2024-02-21T22:53:22.565 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.572+0000 7fdadb7fe640 1 -- 172.21.15.116:0/1035224552 learned_addr learned my addr 172.21.15.116:0/1035224552 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-02-21T22:53:22.566 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.572+0000 7fdadbfff640 1 --2- 172.21.15.116:0/1035224552 >> v2:172.21.15.142:3300/0 conn(0x7fdadc0afa80 0x7fdadc0b5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:22.566 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.572+0000 7fdadaffd640 1 -- 172.21.15.116:0/1035224552 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3890412216 0 0) 0x7fdad0001110 con 0x7fdadc0b5ed0 2024-02-21T22:53:22.566 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.572+0000 7fdadaffd640 1 -- 172.21.15.116:0/1035224552 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdac4003520 con 0x7fdadc0b5ed0 2024-02-21T22:53:22.566 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.572+0000 7fdadbfff640 1 -- 172.21.15.116:0/1035224552 >> v1:172.21.15.142:6789/0 conn(0x7fdadc06b550 legacy=0x7fdadc0b0220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:22.566 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.572+0000 7fdadbfff640 1 -- 172.21.15.116:0/1035224552 >> v1:172.21.15.116:6789/0 conn(0x7fdadc0b5ed0 legacy=0x7fdadc06ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:22.566 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.572+0000 7fdadbfff640 1 -- 172.21.15.116:0/1035224552 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdadc15f7f0 con 0x7fdadc0afa80 2024-02-21T22:53:22.566 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.573+0000 7fdadbfff640 1 --2- 172.21.15.116:0/1035224552 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdadc0afa80 0x7fdadc0b5990 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fdacc0097a0 tx=0x7fdacc02b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8a66c9b81af1d0b2 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:22.566 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.573+0000 7fdadaffd640 1 -- 172.21.15.116:0/1035224552 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdacc034070 con 0x7fdadc0afa80 2024-02-21T22:53:22.566 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.573+0000 7fdadaffd640 1 -- 172.21.15.116:0/1035224552 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdacc030610 con 0x7fdadc0afa80 2024-02-21T22:53:22.566 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.573+0000 7fdadaffd640 1 -- 172.21.15.116:0/1035224552 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdacc0309e0 con 0x7fdadc0afa80 2024-02-21T22:53:22.566 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.574+0000 7fdae27f7640 1 -- 172.21.15.116:0/1035224552 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdadc0afa80 msgr2=0x7fdadc0b5990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:22.566 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.574+0000 7fdae27f7640 1 --2- 172.21.15.116:0/1035224552 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdadc0afa80 0x7fdadc0b5990 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fdacc0097a0 tx=0x7fdacc02b960 comp rx=0 tx=0).stop 2024-02-21T22:53:22.566 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.574+0000 7fdae27f7640 1 -- 172.21.15.116:0/1035224552 shutdown_connections 2024-02-21T22:53:22.567 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.574+0000 7fdae27f7640 1 --2- 172.21.15.116:0/1035224552 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdadc0afa80 0x7fdadc0b5990 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:22.567 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.574+0000 7fdae27f7640 1 -- 172.21.15.116:0/1035224552 >> 172.21.15.116:0/1035224552 conn(0x7fdadc0724f0 msgr2=0x7fdadc072900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:22.567 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.574+0000 7fdae27f7640 1 -- 172.21.15.116:0/1035224552 shutdown_connections 2024-02-21T22:53:22.567 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.574+0000 7fdae27f7640 1 -- 172.21.15.116:0/1035224552 wait complete. 2024-02-21T22:53:22.570 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.575+0000 7fdae27f7640 1 Processor -- start 2024-02-21T22:53:22.570 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.575+0000 7fdae27f7640 1 -- start start 2024-02-21T22:53:22.570 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.576+0000 7fdae27f7640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdadc06b550 0x7fdadc06eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:22.570 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.576+0000 7fdae27f7640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdadc0afa80 0x7fdadc1f3520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:22.570 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.576+0000 7fdae27f7640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdadc0b5ed0 0x7fdadc14e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:22.570 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.576+0000 7fdae27f7640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdadc0b0ab0 con 0x7fdadc06b550 2024-02-21T22:53:22.570 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.576+0000 7fdae27f7640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdadc0b0930 con 0x7fdadc0b5ed0 2024-02-21T22:53:22.570 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.576+0000 7fdae27f7640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdadc0b0c30 con 0x7fdadc0afa80 2024-02-21T22:53:22.570 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.576+0000 7fdadbfff640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdadc06b550 0x7fdadc06eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:22.570 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.576+0000 7fdadbfff640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdadc06b550 0x7fdadc06eaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:38578/0 (socket says 172.21.15.116:38578) 2024-02-21T22:53:22.570 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.576+0000 7fdadbfff640 1 -- 172.21.15.116:0/3392367933 learned_addr learned my addr 172.21.15.116:0/3392367933 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:22.571 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.576+0000 7fdadb7fe640 1 --2- 172.21.15.116:0/3392367933 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdadc0afa80 0x7fdadc1f3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:22.571 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.576+0000 7fdae0d94640 1 --2- 172.21.15.116:0/3392367933 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdadc0b5ed0 0x7fdadc14e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:22.571 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.576+0000 7fdadbfff640 1 -- 172.21.15.116:0/3392367933 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdadc0afa80 msgr2=0x7fdadc1f3520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:22.571 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.576+0000 7fdadbfff640 1 --2- 172.21.15.116:0/3392367933 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdadc0afa80 0x7fdadc1f3520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:22.571 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.576+0000 7fdadbfff640 1 -- 172.21.15.116:0/3392367933 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdadc0b5ed0 msgr2=0x7fdadc14e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:22.571 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.576+0000 7fdadbfff640 1 --2- 172.21.15.116:0/3392367933 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdadc0b5ed0 0x7fdadc14e3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:22.571 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.576+0000 7fdadbfff640 1 -- 172.21.15.116:0/3392367933 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdadc09a320 con 0x7fdadc06b550 2024-02-21T22:53:22.571 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.576+0000 7fdadb7fe640 1 --2- 172.21.15.116:0/3392367933 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdadc0afa80 0x7fdadc1f3520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T22:53:22.571 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.576+0000 7fdae0d94640 1 --2- 172.21.15.116:0/3392367933 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdadc0b5ed0 0x7fdadc14e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T22:53:22.571 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.576+0000 7fdadbfff640 1 --2- 172.21.15.116:0/3392367933 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdadc06b550 0x7fdadc06eaa0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fdacc0098c0 tx=0x7fdacc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:22.571 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.576+0000 7fdad8ff9640 1 -- 172.21.15.116:0/3392367933 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdacc034040 con 0x7fdadc06b550 2024-02-21T22:53:22.571 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.576+0000 7fdad8ff9640 1 -- 172.21.15.116:0/3392367933 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdacc030410 con 0x7fdadc06b550 2024-02-21T22:53:22.571 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.576+0000 7fdae27f7640 1 -- 172.21.15.116:0/3392367933 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdadc157e20 con 0x7fdadc06b550 2024-02-21T22:53:22.571 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.576+0000 7fdad8ff9640 1 -- 172.21.15.116:0/3392367933 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdacc039c50 con 0x7fdadc06b550 2024-02-21T22:53:22.571 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.576+0000 7fdae27f7640 1 -- 172.21.15.116:0/3392367933 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdadc158100 con 0x7fdadc06b550 2024-02-21T22:53:22.572 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.578+0000 7fdae27f7640 1 -- 172.21.15.116:0/3392367933 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdadc0752f0 con 0x7fdadc06b550 2024-02-21T22:53:22.572 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.578+0000 7fdad8ff9640 1 -- 172.21.15.116:0/3392367933 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fdacc037070 con 0x7fdadc06b550 2024-02-21T22:53:22.572 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.578+0000 7fdad8ff9640 1 --2- 172.21.15.116:0/3392367933 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fdac806b4d0 0x7fdac806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:22.572 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.578+0000 7fdad8ff9640 1 -- 172.21.15.116:0/3392367933 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdacc0ac0f0 con 0x7fdadc06b550 2024-02-21T22:53:22.572 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.578+0000 7fdadb7fe640 1 --2- 172.21.15.116:0/3392367933 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fdac806b4d0 0x7fdac806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:22.572 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.579+0000 7fdadb7fe640 1 --2- 172.21.15.116:0/3392367933 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fdac806b4d0 0x7fdac806d990 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fdad0007fd0 tx=0x7fdad0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:22.573 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.583+0000 7fdad8ff9640 1 -- 172.21.15.116:0/3392367933 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7fdacc0305e0 con 0x7fdadc06b550 2024-02-21T22:53:22.748 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.758+0000 7fdae27f7640 1 -- 172.21.15.116:0/3392367933 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdadc09a800 con 0x7fdadc06b550 2024-02-21T22:53:22.750 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.759+0000 7fdad8ff9640 1 -- 172.21.15.116:0/3392367933 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16653 (secure 0 0 0) 0x7fdacc07b000 con 0x7fdadc06b550 2024-02-21T22:53:22.750 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-02-21T22:53:22.750 INFO:teuthology.orchestra.run.smithi116.stdout:{"epoch":20,"fsid":"7c298660-5f63-4b5c-a800-58c5be9a8445","created":"2024-02-21T22:52:25.994613+0000","modified":"2024-02-21T22:52:51.786454+0000","last_up_change":"2024-02-21T22:52:37.313595+0000","last_in_change":"2024-02-21T22:52:28.176031+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-21T22:52:38.328796+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-21T22:52:48.145152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-21T22:52:49.096955+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4f09126b-b5e4-4876-8b08-f5cbb967388a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":1613202231},{"type":"v1","addr":"172.21.15.116:6809","nonce":1613202231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":1613202231},{"type":"v1","addr":"172.21.15.116:6811","nonce":1613202231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":1613202231},{"type":"v1","addr":"172.21.15.116:6815","nonce":1613202231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":1613202231},{"type":"v1","addr":"172.21.15.116:6813","nonce":1613202231}]},"public_addr":"172.21.15.116:6809/1613202231","cluster_addr":"172.21.15.116:6811/1613202231","heartbeat_back_addr":"172.21.15.116:6815/1613202231","heartbeat_front_addr":"172.21.15.116:6813/1613202231","state":["exists","up"]},{"osd":1,"uuid":"7272c51d-51f9-4536-931d-33ad7a4b377e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6816","nonce":172614746},{"type":"v1","addr":"172.21.15.116:6817","nonce":172614746}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":172614746},{"type":"v1","addr":"172.21.15.116:6819","nonce":172614746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":172614746},{"type":"v1","addr":"172.21.15.116:6823","nonce":172614746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":172614746},{"type":"v1","addr":"172.21.15.116:6821","nonce":172614746}]},"public_addr":"172.21.15.116:6817/172614746","cluster_addr":"172.21.15.116:6819/172614746","heartbeat_back_addr":"172.21.15.116:6823/172614746","heartbeat_front_addr":"172.21.15.116:6821/172614746","state":["exists","up"]},{"osd":2,"uuid":"2589616c-adf1-4187-aac3-735256cf624b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":1029280577},{"type":"v1","addr":"172.21.15.116:6825","nonce":1029280577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":1029280577},{"type":"v1","addr":"172.21.15.116:6827","nonce":1029280577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":1029280577},{"type":"v1","addr":"172.21.15.116:6831","nonce":1029280577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":1029280577},{"type":"v1","addr":"172.21.15.116:6829","nonce":1029280577}]},"public_addr":"172.21.15.116:6825/1029280577","cluster_addr":"172.21.15.116:6827/1029280577","heartbeat_back_addr":"172.21.15.116:6831/1029280577","heartbeat_front_addr":"172.21.15.116:6829/1029280577","state":["exists","up"]},{"osd":3,"uuid":"0fd2e563-7c5b-46f6-82c2-b60c86072c93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":3106627557},{"type":"v1","addr":"172.21.15.116:6801","nonce":3106627557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":3106627557},{"type":"v1","addr":"172.21.15.116:6803","nonce":3106627557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":3106627557},{"type":"v1","addr":"172.21.15.116:6807","nonce":3106627557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":3106627557},{"type":"v1","addr":"172.21.15.116:6805","nonce":3106627557}]},"public_addr":"172.21.15.116:6801/3106627557","cluster_addr":"172.21.15.116:6803/3106627557","heartbeat_back_addr":"172.21.15.116:6807/3106627557","heartbeat_front_addr":"172.21.15.116:6805/3106627557","state":["exists","up"]},{"osd":4,"uuid":"79ae35b7-dda8-4ab8-96ce-47515afde082","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":3231407772},{"type":"v1","addr":"172.21.15.142:6825","nonce":3231407772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":3231407772},{"type":"v1","addr":"172.21.15.142:6827","nonce":3231407772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":3231407772},{"type":"v1","addr":"172.21.15.142:6831","nonce":3231407772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":3231407772},{"type":"v1","addr":"172.21.15.142:6829","nonce":3231407772}]},"public_addr":"172.21.15.142:6825/3231407772","cluster_addr":"172.21.15.142:6827/3231407772","heartbeat_back_addr":"172.21.15.142:6831/3231407772","heartbeat_front_addr":"172.21.15.142:6829/3231407772","state":["exists","up"]},{"osd":5,"uuid":"3166eb2c-3fcf-41c8-9362-45bafaabaa39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":1184158716},{"type":"v1","addr":"172.21.15.142:6817","nonce":1184158716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":1184158716},{"type":"v1","addr":"172.21.15.142:6819","nonce":1184158716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":1184158716},{"type":"v1","addr":"172.21.15.142:6823","nonce":1184158716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":1184158716},{"type":"v1","addr":"172.21.15.142:6821","nonce":1184158716}]},"public_addr":"172.21.15.142:6817/1184158716","cluster_addr":"172.21.15.142:6819/1184158716","heartbeat_back_addr":"172.21.15.142:6823/1184158716","heartbeat_front_addr":"172.21.15.142:6821/1184158716","state":["exists","up"]},{"osd":6,"uuid":"f9aa9672-7527-43e2-963e-b61868e5e63f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":1987868911},{"type":"v1","addr":"172.21.15.142:6801","nonce":1987868911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":1987868911},{"type":"v1","addr":"172.21.15.142:6803","nonce":1987868911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":1987868911},{"type":"v1","addr":"172.21.15.142:6807","nonce":1987868911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":1987868911},{"type":"v1","addr":"172.21.15.142:6805","nonce":1987868911}]},"public_addr":"172.21.15.142:6801/1987868911","cluster_addr":"172.21.15.142:6803/1987868911","heartbeat_back_addr":"172.21.15.142:6807/1987868911","heartbeat_front_addr":"172.21.15.142:6805/1987868911","state":["exists","up"]},{"osd":7,"uuid":"7ed29226-fc42-4382-a91a-fa50f7ec5426","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":1272081937},{"type":"v1","addr":"172.21.15.142:6809","nonce":1272081937}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":1272081937},{"type":"v1","addr":"172.21.15.142:6811","nonce":1272081937}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":1272081937},{"type":"v1","addr":"172.21.15.142:6815","nonce":1272081937}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":1272081937},{"type":"v1","addr":"172.21.15.142:6813","nonce":1272081937}]},"public_addr":"172.21.15.142:6809/1272081937","cluster_addr":"172.21.15.142:6811/1272081937","heartbeat_back_addr":"172.21.15.142:6815/1272081937","heartbeat_front_addr":"172.21.15.142:6813/1272081937","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.350998+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.307201+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.289112+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.243888+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.312091+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.370472+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.275659+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.289297+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-21T22:53:22.752 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.761+0000 7fdae27f7640 1 -- 172.21.15.116:0/3392367933 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fdac806b4d0 msgr2=0x7fdac806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:22.752 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.761+0000 7fdae27f7640 1 --2- 172.21.15.116:0/3392367933 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fdac806b4d0 0x7fdac806d990 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fdad0007fd0 tx=0x7fdad0009040 comp rx=0 tx=0).stop 2024-02-21T22:53:22.752 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.761+0000 7fdae27f7640 1 -- 172.21.15.116:0/3392367933 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdadc06b550 msgr2=0x7fdadc06eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:22.752 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.761+0000 7fdae27f7640 1 --2- 172.21.15.116:0/3392367933 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdadc06b550 0x7fdadc06eaa0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fdacc0098c0 tx=0x7fdacc0046c0 comp rx=0 tx=0).stop 2024-02-21T22:53:22.752 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.761+0000 7fdae27f7640 1 -- 172.21.15.116:0/3392367933 shutdown_connections 2024-02-21T22:53:22.752 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.761+0000 7fdae27f7640 1 --2- 172.21.15.116:0/3392367933 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdadc0b5ed0 0x7fdadc14e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:22.753 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.761+0000 7fdae27f7640 1 --2- 172.21.15.116:0/3392367933 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fdac806b4d0 0x7fdac806d990 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:22.753 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.761+0000 7fdae27f7640 1 --2- 172.21.15.116:0/3392367933 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdadc0afa80 0x7fdadc1f3520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:22.753 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.761+0000 7fdae27f7640 1 --2- 172.21.15.116:0/3392367933 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdadc06b550 0x7fdadc06eaa0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:22.753 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.761+0000 7fdae27f7640 1 -- 172.21.15.116:0/3392367933 >> 172.21.15.116:0/3392367933 conn(0x7fdadc0724f0 msgr2=0x7fdadc06d1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:22.753 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.762+0000 7fdae27f7640 1 -- 172.21.15.116:0/3392367933 shutdown_connections 2024-02-21T22:53:22.753 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.762+0000 7fdae27f7640 1 -- 172.21.15.116:0/3392367933 wait complete. 2024-02-21T22:53:22.764 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-21T22:52:38.328796+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-02-21T22:52:48.145152+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-02-21T22:52:49.096955+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-21T22:53:22.765 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-21T22:53:22.870 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.879+0000 7f447142d640 1 Processor -- start 2024-02-21T22:53:22.870 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.879+0000 7f447142d640 1 -- start start 2024-02-21T22:53:22.872 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.880+0000 7f447142d640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f446c0d0ca0 0x7f446c0d4940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:22.873 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.880+0000 7f447142d640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f446c0d2400 0x7f446c0d2870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:22.873 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.880+0000 7f447142d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f446c15da70 0x7f446c15df00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:22.873 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.880+0000 7f447142d640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f446c0d2db0 con 0x7f446c0d2400 2024-02-21T22:53:22.873 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.880+0000 7f447142d640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f446c0ceea0 con 0x7f446c0d0ca0 2024-02-21T22:53:22.873 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.880+0000 7f447142d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f446c0cf180 con 0x7f446c15da70 2024-02-21T22:53:22.873 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.880+0000 7f446a7fc640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f446c0d2400 0x7f446c0d2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:22.873 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.880+0000 7f446a7fc640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f446c0d2400 0x7f446c0d2870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:38592/0 (socket says 172.21.15.116:38592) 2024-02-21T22:53:22.873 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.880+0000 7f446a7fc640 1 -- 172.21.15.116:0/2931475487 learned_addr learned my addr 172.21.15.116:0/2931475487 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:22.874 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.880+0000 7f446b7fe640 1 --2- 172.21.15.116:0/2931475487 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f446c15da70 0x7f446c15df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:22.874 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.880+0000 7f446affd640 1 --2- 172.21.15.116:0/2931475487 >> v2:172.21.15.142:3300/0 conn(0x7f446c0d0ca0 0x7f446c0d4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:22.874 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.880+0000 7f446a7fc640 1 -- 172.21.15.116:0/2931475487 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f446c15da70 msgr2=0x7f446c15df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:53:22.874 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.880+0000 7f446a7fc640 1 --2- 172.21.15.116:0/2931475487 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f446c15da70 0x7f446c15df00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:22.874 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.880+0000 7f446a7fc640 1 -- 172.21.15.116:0/2931475487 >> v2:172.21.15.142:3300/0 conn(0x7f446c0d0ca0 msgr2=0x7f446c0d4940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:53:22.874 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.880+0000 7f446a7fc640 1 --2- 172.21.15.116:0/2931475487 >> v2:172.21.15.142:3300/0 conn(0x7f446c0d0ca0 0x7f446c0d4940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:22.874 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.880+0000 7f446a7fc640 1 -- 172.21.15.116:0/2931475487 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f446c0cf460 con 0x7f446c0d2400 2024-02-21T22:53:22.874 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.881+0000 7f446a7fc640 1 --2- 172.21.15.116:0/2931475487 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f446c0d2400 0x7f446c0d2870 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f446c0b69c0 tx=0x7f446002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d5d7b0bf2fd674d server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:22.874 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.881+0000 7f4469ffb640 1 -- 172.21.15.116:0/2931475487 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4460034070 con 0x7f446c0d2400 2024-02-21T22:53:22.874 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.881+0000 7f4469ffb640 1 -- 172.21.15.116:0/2931475487 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4460030860 con 0x7f446c0d2400 2024-02-21T22:53:22.874 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.881+0000 7f4469ffb640 1 -- 172.21.15.116:0/2931475487 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4460030c30 con 0x7f446c0d2400 2024-02-21T22:53:22.874 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.882+0000 7f447142d640 1 -- 172.21.15.116:0/2931475487 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f446c0d2400 msgr2=0x7f446c0d2870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:22.874 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.882+0000 7f447142d640 1 --2- 172.21.15.116:0/2931475487 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f446c0d2400 0x7f446c0d2870 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f446c0b69c0 tx=0x7f446002b9a0 comp rx=0 tx=0).stop 2024-02-21T22:53:22.874 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.882+0000 7f447142d640 1 -- 172.21.15.116:0/2931475487 shutdown_connections 2024-02-21T22:53:22.874 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.882+0000 7f447142d640 1 --2- 172.21.15.116:0/2931475487 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f446c15da70 0x7f446c15df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:22.875 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.882+0000 7f447142d640 1 --2- 172.21.15.116:0/2931475487 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f446c0d2400 0x7f446c0d2870 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:22.875 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.882+0000 7f447142d640 1 --2- 172.21.15.116:0/2931475487 >> v2:172.21.15.142:3300/0 conn(0x7f446c0d0ca0 0x7f446c0d4940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:22.875 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.882+0000 7f447142d640 1 -- 172.21.15.116:0/2931475487 >> 172.21.15.116:0/2931475487 conn(0x7f446c0d3e20 msgr2=0x7f446c0d4230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:22.875 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.882+0000 7f447142d640 1 -- 172.21.15.116:0/2931475487 shutdown_connections 2024-02-21T22:53:22.875 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.882+0000 7f447142d640 1 -- 172.21.15.116:0/2931475487 wait complete. 2024-02-21T22:53:22.877 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.883+0000 7f447142d640 1 Processor -- start 2024-02-21T22:53:22.878 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.883+0000 7f447142d640 1 -- start start 2024-02-21T22:53:22.878 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.884+0000 7f447142d640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f446c0d0ca0 0x7f446c15a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:22.878 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.884+0000 7f447142d640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f446c0d2400 0x7f446c150d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:22.878 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.884+0000 7f447142d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f446c15da70 0x7f446c15e880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:22.878 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.884+0000 7f447142d640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f446c0d1080 con 0x7f446c0d0ca0 2024-02-21T22:53:22.878 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.884+0000 7f447142d640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f446c0cfa20 con 0x7f446c0d2400 2024-02-21T22:53:22.878 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.884+0000 7f447142d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f446c0d1200 con 0x7f446c15da70 2024-02-21T22:53:22.878 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.884+0000 7f446affd640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f446c0d0ca0 0x7f446c15a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:22.878 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.884+0000 7f446affd640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f446c0d0ca0 0x7f446c15a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:38594/0 (socket says 172.21.15.116:38594) 2024-02-21T22:53:22.878 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.884+0000 7f446affd640 1 -- 172.21.15.116:0/1180726017 learned_addr learned my addr 172.21.15.116:0/1180726017 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:22.878 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.884+0000 7f446b7fe640 1 --2- 172.21.15.116:0/1180726017 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f446c15da70 0x7f446c15e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:22.878 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.884+0000 7f446a7fc640 1 --2- 172.21.15.116:0/1180726017 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f446c0d2400 0x7f446c150d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:22.878 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.884+0000 7f446affd640 1 -- 172.21.15.116:0/1180726017 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f446c15da70 msgr2=0x7f446c15e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:22.879 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.884+0000 7f446affd640 1 --2- 172.21.15.116:0/1180726017 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f446c15da70 0x7f446c15e880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:22.879 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.884+0000 7f446affd640 1 -- 172.21.15.116:0/1180726017 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f446c0d2400 msgr2=0x7f446c150d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:22.879 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.884+0000 7f446affd640 1 --2- 172.21.15.116:0/1180726017 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f446c0d2400 0x7f446c150d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:22.879 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.884+0000 7f446affd640 1 -- 172.21.15.116:0/1180726017 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f446c0cd3d0 con 0x7f446c0d0ca0 2024-02-21T22:53:22.879 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.884+0000 7f446affd640 1 --2- 172.21.15.116:0/1180726017 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f446c0d0ca0 0x7f446c15a5e0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f445c00e870 tx=0x7f445c00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:22.879 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.884+0000 7f44537fe640 1 -- 172.21.15.116:0/1180726017 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f445c017070 con 0x7f446c0d0ca0 2024-02-21T22:53:22.879 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.884+0000 7f44537fe640 1 -- 172.21.15.116:0/1180726017 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f445c00ee60 con 0x7f446c0d0ca0 2024-02-21T22:53:22.879 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.884+0000 7f447142d640 1 -- 172.21.15.116:0/1180726017 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f446c0cd6b0 con 0x7f446c0d0ca0 2024-02-21T22:53:22.879 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.884+0000 7f44537fe640 1 -- 172.21.15.116:0/1180726017 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f445c00cb20 con 0x7f446c0d0ca0 2024-02-21T22:53:22.879 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.885+0000 7f447142d640 1 -- 172.21.15.116:0/1180726017 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f446c0cdc70 con 0x7f446c0d0ca0 2024-02-21T22:53:22.879 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.885+0000 7f447142d640 1 -- 172.21.15.116:0/1180726017 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f446c0b4eb0 con 0x7f446c0d0ca0 2024-02-21T22:53:22.879 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.886+0000 7f44537fe640 1 -- 172.21.15.116:0/1180726017 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f445c01a070 con 0x7f446c0d0ca0 2024-02-21T22:53:22.879 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.886+0000 7f44537fe640 1 --2- 172.21.15.116:0/1180726017 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f445806b4d0 0x7f445806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:22.879 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.886+0000 7f44537fe640 1 -- 172.21.15.116:0/1180726017 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f445c08a2d0 con 0x7f446c0d0ca0 2024-02-21T22:53:22.879 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.886+0000 7f446a7fc640 1 --2- 172.21.15.116:0/1180726017 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f445806b4d0 0x7f445806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:22.880 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.887+0000 7f446a7fc640 1 --2- 172.21.15.116:0/1180726017 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f445806b4d0 0x7f445806d990 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f4460036000 tx=0x7f4460008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:22.881 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:22.890+0000 7f44537fe640 1 -- 172.21.15.116:0/1180726017 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f446c0b4eb0 con 0x7f446c0d0ca0 2024-02-21T22:53:23.055 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.065+0000 7f447142d640 1 -- 172.21.15.116:0/1180726017 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f446c0d3910 con 0x7f446c0d0ca0 2024-02-21T22:53:23.056 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.065+0000 7f44537fe640 1 -- 172.21.15.116:0/1180726017 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f446c0d3910 con 0x7f446c0d0ca0 2024-02-21T22:53:23.056 INFO:teuthology.orchestra.run.smithi116.stdout:pg_num: 1 2024-02-21T22:53:23.058 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.067+0000 7f447142d640 1 -- 172.21.15.116:0/1180726017 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f445806b4d0 msgr2=0x7f445806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:23.058 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.067+0000 7f447142d640 1 --2- 172.21.15.116:0/1180726017 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f445806b4d0 0x7f445806d990 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f4460036000 tx=0x7f4460008030 comp rx=0 tx=0).stop 2024-02-21T22:53:23.058 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.067+0000 7f447142d640 1 -- 172.21.15.116:0/1180726017 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f446c0d0ca0 msgr2=0x7f446c15a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:23.058 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.067+0000 7f447142d640 1 --2- 172.21.15.116:0/1180726017 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f446c0d0ca0 0x7f446c15a5e0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f445c00e870 tx=0x7f445c00ed30 comp rx=0 tx=0).stop 2024-02-21T22:53:23.058 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.067+0000 7f447142d640 1 -- 172.21.15.116:0/1180726017 shutdown_connections 2024-02-21T22:53:23.058 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.067+0000 7f447142d640 1 --2- 172.21.15.116:0/1180726017 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f445806b4d0 0x7f445806d990 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:23.058 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.067+0000 7f447142d640 1 --2- 172.21.15.116:0/1180726017 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f446c15da70 0x7f446c15e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:23.058 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.067+0000 7f447142d640 1 --2- 172.21.15.116:0/1180726017 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f446c0d2400 0x7f446c150d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:23.058 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.067+0000 7f447142d640 1 --2- 172.21.15.116:0/1180726017 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f446c0d0ca0 0x7f446c15a5e0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:23.058 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.067+0000 7f447142d640 1 -- 172.21.15.116:0/1180726017 >> 172.21.15.116:0/1180726017 conn(0x7f446c0d3e20 msgr2=0x7f446c06ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:23.058 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.067+0000 7f447142d640 1 -- 172.21.15.116:0/1180726017 shutdown_connections 2024-02-21T22:53:23.059 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.067+0000 7f447142d640 1 -- 172.21.15.116:0/1180726017 wait complete. 2024-02-21T22:53:23.069 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-02-21T22:53:23.172 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.181+0000 7f13902d5640 1 Processor -- start 2024-02-21T22:53:23.172 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.181+0000 7f13902d5640 1 -- start start 2024-02-21T22:53:23.174 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.182+0000 7f13902d5640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f13880d0ca0 0x7f13880d4940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:23.175 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.182+0000 7f13902d5640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f13880d2400 0x7f13880d2870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:23.175 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.182+0000 7f13902d5640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13880ceea0 con 0x7f138815da70 2024-02-21T22:53:23.175 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.182+0000 7f13902d5640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13880d2db0 con 0x7f13880d2400 2024-02-21T22:53:23.175 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.182+0000 7f13902d5640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13880cf180 con 0x7f13880d0ca0 2024-02-21T22:53:23.175 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.182+0000 7f138d870640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f13880d2400 0x7f13880d2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:23.175 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.182+0000 7f138d870640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f13880d2400 0x7f13880d2870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:38606/0 (socket says 172.21.15.116:38606) 2024-02-21T22:53:23.175 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.182+0000 7f138e872640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f138815da70 0x7f138815dee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:54904/0 (socket says 172.21.15.116:54904) 2024-02-21T22:53:23.175 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.182+0000 7f138d870640 1 -- 172.21.15.116:0/1588372675 learned_addr learned my addr 172.21.15.116:0/1588372675 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:23.175 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.182+0000 7f138e071640 1 --2- 172.21.15.116:0/1588372675 >> v2:172.21.15.142:3300/0 conn(0x7f13880d0ca0 0x7f13880d4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:23.175 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.182+0000 7f138d870640 1 -- 172.21.15.116:0/1588372675 >> v2:172.21.15.142:3300/0 conn(0x7f13880d0ca0 msgr2=0x7f13880d4940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:53:23.175 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.182+0000 7f138d870640 1 --2- 172.21.15.116:0/1588372675 >> v2:172.21.15.142:3300/0 conn(0x7f13880d0ca0 0x7f13880d4940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:23.176 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.182+0000 7f138d870640 1 -- 172.21.15.116:0/1588372675 >> v1:172.21.15.116:6789/0 conn(0x7f138815da70 legacy=0x7f138815dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:23.176 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.182+0000 7f138d870640 1 -- 172.21.15.116:0/1588372675 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13880cf460 con 0x7f13880d2400 2024-02-21T22:53:23.176 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.183+0000 7f138d870640 1 --2- 172.21.15.116:0/1588372675 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f13880d2400 0x7f13880d2870 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f13880b69c0 tx=0x7f137802ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e7ac3a4419b32f9 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:23.176 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.183+0000 7f138d06f640 1 -- 172.21.15.116:0/1588372675 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f137802f850 con 0x7f13880d2400 2024-02-21T22:53:23.176 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.183+0000 7f138d06f640 1 -- 172.21.15.116:0/1588372675 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f137802f9f0 con 0x7f13880d2400 2024-02-21T22:53:23.176 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.183+0000 7f138d06f640 1 -- 172.21.15.116:0/1588372675 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f137802fdc0 con 0x7f13880d2400 2024-02-21T22:53:23.176 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.184+0000 7f13902d5640 1 -- 172.21.15.116:0/1588372675 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f13880d2400 msgr2=0x7f13880d2870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:23.176 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.184+0000 7f13902d5640 1 --2- 172.21.15.116:0/1588372675 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f13880d2400 0x7f13880d2870 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f13880b69c0 tx=0x7f137802ba30 comp rx=0 tx=0).stop 2024-02-21T22:53:23.176 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.184+0000 7f13902d5640 1 -- 172.21.15.116:0/1588372675 shutdown_connections 2024-02-21T22:53:23.177 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.184+0000 7f13902d5640 1 --2- 172.21.15.116:0/1588372675 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f13880d2400 0x7f13880d2870 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:23.177 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.184+0000 7f13902d5640 1 --2- 172.21.15.116:0/1588372675 >> v2:172.21.15.142:3300/0 conn(0x7f13880d0ca0 0x7f13880d4940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:23.177 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.184+0000 7f13902d5640 1 -- 172.21.15.116:0/1588372675 >> 172.21.15.116:0/1588372675 conn(0x7f13880d3e20 msgr2=0x7f13880d4230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:23.177 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.184+0000 7f13902d5640 1 -- 172.21.15.116:0/1588372675 shutdown_connections 2024-02-21T22:53:23.177 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.184+0000 7f13902d5640 1 -- 172.21.15.116:0/1588372675 wait complete. 2024-02-21T22:53:23.180 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.185+0000 7f13902d5640 1 Processor -- start 2024-02-21T22:53:23.180 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.185+0000 7f13902d5640 1 -- start start 2024-02-21T22:53:23.180 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.186+0000 7f13902d5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f13880d0ca0 0x7f138815e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:23.180 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.186+0000 7f13902d5640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f13880d2400 0x7f13880b7dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:23.180 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.186+0000 7f13902d5640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f138815da70 0x7f13880b8ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:23.180 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.186+0000 7f13902d5640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13880d1080 con 0x7f138815da70 2024-02-21T22:53:23.180 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.186+0000 7f13902d5640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13880cfa20 con 0x7f13880d0ca0 2024-02-21T22:53:23.181 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.186+0000 7f13902d5640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13880d1200 con 0x7f13880d2400 2024-02-21T22:53:23.181 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.186+0000 7f138e872640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f138815da70 0x7f13880b8ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:23.181 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.186+0000 7f138e872640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f138815da70 0x7f13880b8ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:38610/0 (socket says 172.21.15.116:38610) 2024-02-21T22:53:23.181 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.186+0000 7f138e872640 1 -- 172.21.15.116:0/747219428 learned_addr learned my addr 172.21.15.116:0/747219428 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:23.181 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.186+0000 7f138e071640 1 --2- 172.21.15.116:0/747219428 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f13880d0ca0 0x7f138815e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:23.181 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.186+0000 7f138d870640 1 --2- 172.21.15.116:0/747219428 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f13880d2400 0x7f13880b7dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:23.181 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.186+0000 7f138e872640 1 -- 172.21.15.116:0/747219428 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f13880d2400 msgr2=0x7f13880b7dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:23.181 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.186+0000 7f138e872640 1 --2- 172.21.15.116:0/747219428 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f13880d2400 0x7f13880b7dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:23.181 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.186+0000 7f138e872640 1 -- 172.21.15.116:0/747219428 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f13880d0ca0 msgr2=0x7f138815e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:23.181 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.186+0000 7f138e872640 1 --2- 172.21.15.116:0/747219428 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f13880d0ca0 0x7f138815e440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:23.181 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.186+0000 7f138e872640 1 -- 172.21.15.116:0/747219428 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13880caf90 con 0x7f138815da70 2024-02-21T22:53:23.181 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.186+0000 7f138e872640 1 --2- 172.21.15.116:0/747219428 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f138815da70 0x7f13880b8ca0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f138000c730 tx=0x7f138000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:23.182 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.186+0000 7f137effd640 1 -- 172.21.15.116:0/747219428 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1380017070 con 0x7f138815da70 2024-02-21T22:53:23.182 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.186+0000 7f137effd640 1 -- 172.21.15.116:0/747219428 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f138000ce40 con 0x7f138815da70 2024-02-21T22:53:23.182 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.186+0000 7f13902d5640 1 -- 172.21.15.116:0/747219428 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13880cb270 con 0x7f138815da70 2024-02-21T22:53:23.182 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.186+0000 7f137effd640 1 -- 172.21.15.116:0/747219428 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f138000a840 con 0x7f138815da70 2024-02-21T22:53:23.182 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.186+0000 7f13902d5640 1 -- 172.21.15.116:0/747219428 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13880b8300 con 0x7f138815da70 2024-02-21T22:53:23.182 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.187+0000 7f13902d5640 1 -- 172.21.15.116:0/747219428 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13880d3070 con 0x7f138815da70 2024-02-21T22:53:23.182 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.188+0000 7f137effd640 1 -- 172.21.15.116:0/747219428 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f138001a070 con 0x7f138815da70 2024-02-21T22:53:23.182 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.188+0000 7f137effd640 1 --2- 172.21.15.116:0/747219428 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f136c06b4d0 0x7f136c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:23.182 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.188+0000 7f137effd640 1 -- 172.21.15.116:0/747219428 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f13800896f0 con 0x7f138815da70 2024-02-21T22:53:23.182 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.188+0000 7f138e071640 1 --2- 172.21.15.116:0/747219428 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f136c06b4d0 0x7f136c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:23.182 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.189+0000 7f138e071640 1 --2- 172.21.15.116:0/747219428 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f136c06b4d0 0x7f136c06d990 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f1384009b40 tx=0x7f1384009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:23.183 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.193+0000 7f137effd640 1 -- 172.21.15.116:0/747219428 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f13880d3070 con 0x7f138815da70 2024-02-21T22:53:23.354 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.363+0000 7f13902d5640 1 -- 172.21.15.116:0/747219428 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f13880752f0 con 0x7f138815da70 2024-02-21T22:53:23.354 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.364+0000 7f137effd640 1 -- 172.21.15.116:0/747219428 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1380057e90 con 0x7f138815da70 2024-02-21T22:53:23.355 INFO:teuthology.orchestra.run.smithi116.stdout:pg_num: 32 2024-02-21T22:53:23.357 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.366+0000 7f13902d5640 1 -- 172.21.15.116:0/747219428 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f136c06b4d0 msgr2=0x7f136c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:23.357 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.366+0000 7f13902d5640 1 --2- 172.21.15.116:0/747219428 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f136c06b4d0 0x7f136c06d990 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f1384009b40 tx=0x7f1384009190 comp rx=0 tx=0).stop 2024-02-21T22:53:23.357 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.366+0000 7f13902d5640 1 -- 172.21.15.116:0/747219428 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f138815da70 msgr2=0x7f13880b8ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:23.357 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.366+0000 7f13902d5640 1 --2- 172.21.15.116:0/747219428 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f138815da70 0x7f13880b8ca0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f138000c730 tx=0x7f138000cbf0 comp rx=0 tx=0).stop 2024-02-21T22:53:23.357 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.366+0000 7f13902d5640 1 -- 172.21.15.116:0/747219428 shutdown_connections 2024-02-21T22:53:23.357 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.366+0000 7f13902d5640 1 --2- 172.21.15.116:0/747219428 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f138815da70 0x7f13880b8ca0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:23.357 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.366+0000 7f13902d5640 1 --2- 172.21.15.116:0/747219428 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f136c06b4d0 0x7f136c06d990 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:23.358 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.366+0000 7f13902d5640 1 --2- 172.21.15.116:0/747219428 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f13880d2400 0x7f13880b7dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:23.358 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.366+0000 7f13902d5640 1 --2- 172.21.15.116:0/747219428 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f13880d0ca0 0x7f138815e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:23.358 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.366+0000 7f13902d5640 1 -- 172.21.15.116:0/747219428 >> 172.21.15.116:0/747219428 conn(0x7f13880d3e20 msgr2=0x7f13880b3780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:23.358 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.366+0000 7f13902d5640 1 -- 172.21.15.116:0/747219428 shutdown_connections 2024-02-21T22:53:23.358 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.366+0000 7f13902d5640 1 -- 172.21.15.116:0/747219428 wait complete. 2024-02-21T22:53:23.367 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-02-21T22:53:23.471 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.480+0000 7f05fd1f0640 1 Processor -- start 2024-02-21T22:53:23.471 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.481+0000 7f05fd1f0640 1 -- start start 2024-02-21T22:53:23.473 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.481+0000 7f05fd1f0640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f05f80d0ca0 0x7f05f80d4940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:23.473 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.481+0000 7f05fd1f0640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f05f80d2400 0x7f05f80d2840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:23.473 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.481+0000 7f05fd1f0640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05f80ceea0 con 0x7f05f815da70 2024-02-21T22:53:23.473 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.481+0000 7f05fd1f0640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05f80d2d80 con 0x7f05f80d2400 2024-02-21T22:53:23.473 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.481+0000 7f05fd1f0640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05f80cf180 con 0x7f05f80d0ca0 2024-02-21T22:53:23.473 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.481+0000 7f05f659c640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f05f80d2400 0x7f05f80d2840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:23.473 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.481+0000 7f05f659c640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f05f80d2400 0x7f05f80d2840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:38620/0 (socket says 172.21.15.116:38620) 2024-02-21T22:53:23.474 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.481+0000 7f05f759e640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f05f815da70 0x7f05f815df00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:54910/0 (socket says 172.21.15.116:54910) 2024-02-21T22:53:23.474 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.481+0000 7f05f659c640 1 -- 172.21.15.116:0/2689379672 learned_addr learned my addr 172.21.15.116:0/2689379672 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:23.474 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.482+0000 7f05f6d9d640 1 --2- 172.21.15.116:0/2689379672 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f05f80d0ca0 0x7f05f80d4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:23.474 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.482+0000 7f05f659c640 1 -- 172.21.15.116:0/2689379672 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f05f80d0ca0 msgr2=0x7f05f80d4940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:53:23.474 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.482+0000 7f05f659c640 1 --2- 172.21.15.116:0/2689379672 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f05f80d0ca0 0x7f05f80d4940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:23.474 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.482+0000 7f05f659c640 1 -- 172.21.15.116:0/2689379672 >> v1:172.21.15.116:6789/0 conn(0x7f05f815da70 legacy=0x7f05f815df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:23.474 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.482+0000 7f05f5d9b640 1 -- 172.21.15.116:0/2689379672 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4262303926 0 0) 0x7f05f80ceea0 con 0x7f05f815da70 2024-02-21T22:53:23.474 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.482+0000 7f05f659c640 1 -- 172.21.15.116:0/2689379672 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05f80cf460 con 0x7f05f80d2400 2024-02-21T22:53:23.474 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.483+0000 7f05f659c640 1 --2- 172.21.15.116:0/2689379672 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f05f80d2400 0x7f05f80d2840 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f05e8009870 tx=0x7f05e802ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b08724112e87e22d server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:23.474 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.483+0000 7f05f5d9b640 1 -- 172.21.15.116:0/2689379672 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05e802f840 con 0x7f05f80d2400 2024-02-21T22:53:23.474 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.483+0000 7f05f5d9b640 1 -- 172.21.15.116:0/2689379672 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05e802f9e0 con 0x7f05f80d2400 2024-02-21T22:53:23.474 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.483+0000 7f05f5d9b640 1 -- 172.21.15.116:0/2689379672 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05e802fdb0 con 0x7f05f80d2400 2024-02-21T22:53:23.475 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.483+0000 7f05fd1f0640 1 -- 172.21.15.116:0/2689379672 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f05f80d2400 msgr2=0x7f05f80d2840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:23.475 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.483+0000 7f05fd1f0640 1 --2- 172.21.15.116:0/2689379672 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f05f80d2400 0x7f05f80d2840 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f05e8009870 tx=0x7f05e802ba20 comp rx=0 tx=0).stop 2024-02-21T22:53:23.475 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.483+0000 7f05fd1f0640 1 -- 172.21.15.116:0/2689379672 shutdown_connections 2024-02-21T22:53:23.475 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.483+0000 7f05fd1f0640 1 --2- 172.21.15.116:0/2689379672 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f05f80d2400 0x7f05f80d2840 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:23.475 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.483+0000 7f05fd1f0640 1 --2- 172.21.15.116:0/2689379672 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f05f80d0ca0 0x7f05f80d4940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:23.476 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.483+0000 7f05fd1f0640 1 -- 172.21.15.116:0/2689379672 >> 172.21.15.116:0/2689379672 conn(0x7f05f80d3e20 msgr2=0x7f05f80d4230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:23.476 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.483+0000 7f05fd1f0640 1 -- 172.21.15.116:0/2689379672 shutdown_connections 2024-02-21T22:53:23.476 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.483+0000 7f05fd1f0640 1 -- 172.21.15.116:0/2689379672 wait complete. 2024-02-21T22:53:23.476 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.485+0000 7f05fd1f0640 1 Processor -- start 2024-02-21T22:53:23.476 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.485+0000 7f05fd1f0640 1 -- start start 2024-02-21T22:53:23.478 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.485+0000 7f05fd1f0640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f05f80d0ca0 0x7f05f815a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:23.478 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.485+0000 7f05fd1f0640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f05f80d2400 0x7f05f80b2ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:23.478 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.485+0000 7f05fd1f0640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f05f815da70 0x7f05f80b3000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:23.478 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.485+0000 7f05fd1f0640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05f815e610 con 0x7f05f80d2400 2024-02-21T22:53:23.479 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.485+0000 7f05fd1f0640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05f80cfa20 con 0x7f05f80d0ca0 2024-02-21T22:53:23.479 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.485+0000 7f05fd1f0640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05f815e790 con 0x7f05f815da70 2024-02-21T22:53:23.479 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.485+0000 7f05f659c640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f05f80d2400 0x7f05f80b2ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:23.479 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.485+0000 7f05f659c640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f05f80d2400 0x7f05f80b2ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:38622/0 (socket says 172.21.15.116:38622) 2024-02-21T22:53:23.479 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.486+0000 7f05f659c640 1 -- 172.21.15.116:0/1168041035 learned_addr learned my addr 172.21.15.116:0/1168041035 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:23.479 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.486+0000 7f05f759e640 1 --2- 172.21.15.116:0/1168041035 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f05f815da70 0x7f05f80b3000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:23.479 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.486+0000 7f05f6d9d640 1 --2- 172.21.15.116:0/1168041035 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f05f80d0ca0 0x7f05f815a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:23.479 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.486+0000 7f05f659c640 1 -- 172.21.15.116:0/1168041035 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f05f815da70 msgr2=0x7f05f80b3000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:23.479 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.486+0000 7f05f659c640 1 --2- 172.21.15.116:0/1168041035 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f05f815da70 0x7f05f80b3000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:23.479 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.486+0000 7f05f659c640 1 -- 172.21.15.116:0/1168041035 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f05f80d0ca0 msgr2=0x7f05f815a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:23.479 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.486+0000 7f05f659c640 1 --2- 172.21.15.116:0/1168041035 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f05f80d0ca0 0x7f05f815a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:23.479 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.486+0000 7f05f659c640 1 -- 172.21.15.116:0/1168041035 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05f81e8e30 con 0x7f05f80d2400 2024-02-21T22:53:23.479 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.486+0000 7f05f659c640 1 --2- 172.21.15.116:0/1168041035 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f05f80d2400 0x7f05f80b2ac0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f05e8009870 tx=0x7f05e8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:23.479 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.486+0000 7f05df7fe640 1 -- 172.21.15.116:0/1168041035 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05e8047070 con 0x7f05f80d2400 2024-02-21T22:53:23.479 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.486+0000 7f05df7fe640 1 -- 172.21.15.116:0/1168041035 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05e8037bc0 con 0x7f05f80d2400 2024-02-21T22:53:23.480 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.486+0000 7f05df7fe640 1 -- 172.21.15.116:0/1168041035 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05e8004030 con 0x7f05f80d2400 2024-02-21T22:53:23.480 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.486+0000 7f05fd1f0640 1 -- 172.21.15.116:0/1168041035 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05f81e9110 con 0x7f05f80d2400 2024-02-21T22:53:23.480 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.486+0000 7f05fd1f0640 1 -- 172.21.15.116:0/1168041035 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05f815ac10 con 0x7f05f80d2400 2024-02-21T22:53:23.480 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.487+0000 7f05fd1f0640 1 -- 172.21.15.116:0/1168041035 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05f80752f0 con 0x7f05f80d2400 2024-02-21T22:53:23.480 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.487+0000 7f05df7fe640 1 -- 172.21.15.116:0/1168041035 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f05e804a070 con 0x7f05f80d2400 2024-02-21T22:53:23.480 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.488+0000 7f05df7fe640 1 --2- 172.21.15.116:0/1168041035 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f05e406b500 0x7f05e406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:23.480 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.488+0000 7f05df7fe640 1 -- 172.21.15.116:0/1168041035 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f05e80ac1a0 con 0x7f05f80d2400 2024-02-21T22:53:23.480 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.488+0000 7f05f6d9d640 1 --2- 172.21.15.116:0/1168041035 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f05e406b500 0x7f05e406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:23.480 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.489+0000 7f05f6d9d640 1 --2- 172.21.15.116:0/1168041035 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f05e406b500 0x7f05e406d9c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f05ec009b40 tx=0x7f05ec009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:23.482 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.492+0000 7f05df7fe640 1 -- 172.21.15.116:0/1168041035 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f05e8033030 con 0x7f05f80d2400 2024-02-21T22:53:23.653 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.663+0000 7f05fd1f0640 1 -- 172.21.15.116:0/1168041035 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f05f80d21e0 con 0x7f05f80d2400 2024-02-21T22:53:23.654 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.663+0000 7f05df7fe640 1 -- 172.21.15.116:0/1168041035 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f05e807a9d0 con 0x7f05f80d2400 2024-02-21T22:53:23.654 INFO:teuthology.orchestra.run.smithi116.stdout:pg_num: 64 2024-02-21T22:53:23.656 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.665+0000 7f05fd1f0640 1 -- 172.21.15.116:0/1168041035 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f05e406b500 msgr2=0x7f05e406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:23.656 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.665+0000 7f05fd1f0640 1 --2- 172.21.15.116:0/1168041035 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f05e406b500 0x7f05e406d9c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f05ec009b40 tx=0x7f05ec009190 comp rx=0 tx=0).stop 2024-02-21T22:53:23.656 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.665+0000 7f05fd1f0640 1 -- 172.21.15.116:0/1168041035 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f05f80d2400 msgr2=0x7f05f80b2ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:23.656 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.665+0000 7f05fd1f0640 1 --2- 172.21.15.116:0/1168041035 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f05f80d2400 0x7f05f80b2ac0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f05e8009870 tx=0x7f05e8004730 comp rx=0 tx=0).stop 2024-02-21T22:53:23.656 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.665+0000 7f05fd1f0640 1 -- 172.21.15.116:0/1168041035 shutdown_connections 2024-02-21T22:53:23.656 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.665+0000 7f05fd1f0640 1 --2- 172.21.15.116:0/1168041035 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f05e406b500 0x7f05e406d9c0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:23.656 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.665+0000 7f05fd1f0640 1 --2- 172.21.15.116:0/1168041035 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f05f815da70 0x7f05f80b3000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:23.656 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.665+0000 7f05fd1f0640 1 --2- 172.21.15.116:0/1168041035 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f05f80d2400 0x7f05f80b2ac0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:23.656 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.665+0000 7f05fd1f0640 1 --2- 172.21.15.116:0/1168041035 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f05f80d0ca0 0x7f05f815a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:23.656 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.665+0000 7f05fd1f0640 1 -- 172.21.15.116:0/1168041035 >> 172.21.15.116:0/1168041035 conn(0x7f05f80d3e20 msgr2=0x7f05f806b680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:23.657 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.665+0000 7f05fd1f0640 1 -- 172.21.15.116:0/1168041035 shutdown_connections 2024-02-21T22:53:23.657 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.665+0000 7f05fd1f0640 1 -- 172.21.15.116:0/1168041035 wait complete. 2024-02-21T22:53:23.667 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-02-21T22:53:23.768 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.777+0000 7f37090c4640 1 Processor -- start 2024-02-21T22:53:23.768 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.777+0000 7f37090c4640 1 -- start start 2024-02-21T22:53:23.770 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.778+0000 7f37090c4640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f37040b0290 0x7f370406f290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:23.770 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.778+0000 7f37090c4640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f37040b3f90 0x7f370406ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:23.770 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.778+0000 7f37090c4640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f370415f570 con 0x7f370406b380 2024-02-21T22:53:23.770 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.778+0000 7f37090c4640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3704072c90 con 0x7f37040b0290 2024-02-21T22:53:23.770 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.778+0000 7f37090c4640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f370406b7d0 con 0x7f37040b3f90 2024-02-21T22:53:23.770 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.778+0000 7f3702d9d640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f37040b0290 0x7f370406f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:23.770 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.778+0000 7f370359e640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f370406b380 0x7f3704161bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.116:59502/0 (socket says 172.21.15.116:59502) 2024-02-21T22:53:23.771 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.778+0000 7f370259c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f37040b3f90 0x7f370406ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:23.771 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.778+0000 7f370359e640 1 -- 172.21.15.116:0/3104586086 learned_addr learned my addr 172.21.15.116:0/3104586086 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-02-21T22:53:23.771 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.778+0000 7f3702d9d640 1 -- 172.21.15.116:0/3104586086 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f37040b3f90 msgr2=0x7f370406ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:53:23.771 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.778+0000 7f3702d9d640 1 --2- 172.21.15.116:0/3104586086 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f37040b3f90 0x7f370406ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:23.771 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.778+0000 7f3702d9d640 1 -- 172.21.15.116:0/3104586086 >> v1:172.21.15.142:6789/0 conn(0x7f370406b380 legacy=0x7f3704161bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:23.771 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.778+0000 7f3702d9d640 1 -- 172.21.15.116:0/3104586086 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f370415e7b0 con 0x7f37040b0290 2024-02-21T22:53:23.771 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.778+0000 7f3701d9b640 1 -- 172.21.15.116:0/3104586086 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2275447659 0 0) 0x7f370415f570 con 0x7f370406b380 2024-02-21T22:53:23.771 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.778+0000 7f370259c640 1 --2- 172.21.15.116:0/3104586086 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f37040b3f90 0x7f370406ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T22:53:23.771 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.779+0000 7f3702d9d640 1 --2- 172.21.15.116:0/3104586086 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f37040b0290 0x7f370406f290 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f36f4009dc0 tx=0x7f36f402be00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4a21236262b0f49c server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:23.771 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.779+0000 7f3701d9b640 1 -- 172.21.15.116:0/3104586086 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36f4039070 con 0x7f37040b0290 2024-02-21T22:53:23.771 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.779+0000 7f3701d9b640 1 -- 172.21.15.116:0/3104586086 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36f402cbb0 con 0x7f37040b0290 2024-02-21T22:53:23.771 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.779+0000 7f3701d9b640 1 -- 172.21.15.116:0/3104586086 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36f4034440 con 0x7f37040b0290 2024-02-21T22:53:23.774 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.780+0000 7f37090c4640 1 -- 172.21.15.116:0/3104586086 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f37040b0290 msgr2=0x7f370406f290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:23.774 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.780+0000 7f37090c4640 1 --2- 172.21.15.116:0/3104586086 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f37040b0290 0x7f370406f290 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f36f4009dc0 tx=0x7f36f402be00 comp rx=0 tx=0).stop 2024-02-21T22:53:23.774 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.780+0000 7f37090c4640 1 -- 172.21.15.116:0/3104586086 shutdown_connections 2024-02-21T22:53:23.774 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.780+0000 7f37090c4640 1 --2- 172.21.15.116:0/3104586086 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f37040b3f90 0x7f370406ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:23.774 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.780+0000 7f37090c4640 1 --2- 172.21.15.116:0/3104586086 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f37040b0290 0x7f370406f290 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:23.775 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.780+0000 7f37090c4640 1 -- 172.21.15.116:0/3104586086 >> 172.21.15.116:0/3104586086 conn(0x7f37040b29f0 msgr2=0x7f37040b2e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:23.775 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.780+0000 7f37090c4640 1 -- 172.21.15.116:0/3104586086 shutdown_connections 2024-02-21T22:53:23.775 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.780+0000 7f37090c4640 1 -- 172.21.15.116:0/3104586086 wait complete. 2024-02-21T22:53:23.775 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.781+0000 7f37090c4640 1 Processor -- start 2024-02-21T22:53:23.775 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.781+0000 7f37090c4640 1 -- start start 2024-02-21T22:53:23.775 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.782+0000 7f37090c4640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f370406b380 0x7f3704152520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:23.775 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.782+0000 7f37090c4640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f37040b0290 0x7f370413e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:23.775 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.782+0000 7f37090c4640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f37040b3f90 0x7f3704140d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:23.775 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.782+0000 7f37090c4640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f370415ed70 con 0x7f37040b3f90 2024-02-21T22:53:23.775 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.782+0000 7f37090c4640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f370415f0e0 con 0x7f370406b380 2024-02-21T22:53:23.775 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.782+0000 7f37090c4640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37040b0670 con 0x7f37040b0290 2024-02-21T22:53:23.775 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.782+0000 7f370359e640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f37040b3f90 0x7f3704140d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:23.775 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.782+0000 7f370359e640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f37040b3f90 0x7f3704140d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:38634/0 (socket says 172.21.15.116:38634) 2024-02-21T22:53:23.775 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.782+0000 7f370359e640 1 -- 172.21.15.116:0/1609334039 learned_addr learned my addr 172.21.15.116:0/1609334039 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:23.775 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.782+0000 7f3702d9d640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f370406b380 0x7f3704152520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:23.775 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.782+0000 7f370259c640 1 --2- 172.21.15.116:0/1609334039 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f37040b0290 0x7f370413e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:23.776 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.783+0000 7f370359e640 1 -- 172.21.15.116:0/1609334039 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f37040b0290 msgr2=0x7f370413e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:23.776 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.783+0000 7f370359e640 1 --2- 172.21.15.116:0/1609334039 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f37040b0290 0x7f370413e3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:23.776 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.783+0000 7f370359e640 1 -- 172.21.15.116:0/1609334039 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f370406b380 msgr2=0x7f3704152520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:23.776 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.783+0000 7f370359e640 1 --2- 172.21.15.116:0/1609334039 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f370406b380 0x7f3704152520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:23.776 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.783+0000 7f370359e640 1 -- 172.21.15.116:0/1609334039 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3704154eb0 con 0x7f37040b3f90 2024-02-21T22:53:23.776 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.783+0000 7f3702d9d640 1 --2- 172.21.15.116:0/1609334039 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f370406b380 0x7f3704152520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T22:53:23.776 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.783+0000 7f370359e640 1 --2- 172.21.15.116:0/1609334039 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f37040b3f90 0x7f3704140d80 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f36fc00c480 tx=0x7f36fc00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:23.776 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.783+0000 7f36eb7fe640 1 -- 172.21.15.116:0/1609334039 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36fc018070 con 0x7f37040b3f90 2024-02-21T22:53:23.776 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.783+0000 7f36eb7fe640 1 -- 172.21.15.116:0/1609334039 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36fc007500 con 0x7f37040b3f90 2024-02-21T22:53:23.776 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.783+0000 7f37090c4640 1 -- 172.21.15.116:0/1609334039 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3704155190 con 0x7f37040b3f90 2024-02-21T22:53:23.776 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.783+0000 7f36eb7fe640 1 -- 172.21.15.116:0/1609334039 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36fc004a20 con 0x7f37040b3f90 2024-02-21T22:53:23.776 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.783+0000 7f37090c4640 1 -- 172.21.15.116:0/1609334039 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3704155750 con 0x7f37040b3f90 2024-02-21T22:53:23.776 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.784+0000 7f37090c4640 1 -- 172.21.15.116:0/1609334039 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37040752f0 con 0x7f37040b3f90 2024-02-21T22:53:23.777 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.784+0000 7f36eb7fe640 1 -- 172.21.15.116:0/1609334039 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f36fc004bc0 con 0x7f37040b3f90 2024-02-21T22:53:23.777 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.785+0000 7f36eb7fe640 1 --2- 172.21.15.116:0/1609334039 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f36f006b4d0 0x7f36f006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:23.777 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.785+0000 7f36eb7fe640 1 -- 172.21.15.116:0/1609334039 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f36fc089400 con 0x7f37040b3f90 2024-02-21T22:53:23.777 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.785+0000 7f3702d9d640 1 --2- 172.21.15.116:0/1609334039 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f36f006b4d0 0x7f36f006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:23.777 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.785+0000 7f3702d9d640 1 --2- 172.21.15.116:0/1609334039 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f36f006b4d0 0x7f36f006d990 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f36f4036000 tx=0x7f36f4030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:23.780 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.789+0000 7f36eb7fe640 1 -- 172.21.15.116:0/1609334039 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f36fc057c40 con 0x7f37040b3f90 2024-02-21T22:53:23.963 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.972+0000 7f37090c4640 1 -- 172.21.15.116:0/1609334039 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f370406d390 con 0x7f37040b3f90 2024-02-21T22:53:23.963 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.973+0000 7f36eb7fe640 1 -- 172.21.15.116:0/1609334039 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) v1 ==== 80+0+0 (secure 0 0 0) 0x7f36fc05bce0 con 0x7f37040b3f90 2024-02-21T22:53:23.963 INFO:teuthology.orchestra.run.smithi116.stderr:listed 0 entries 2024-02-21T22:53:23.968 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.975+0000 7f37090c4640 1 -- 172.21.15.116:0/1609334039 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f36f006b4d0 msgr2=0x7f36f006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:23.968 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.975+0000 7f37090c4640 1 --2- 172.21.15.116:0/1609334039 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f36f006b4d0 0x7f36f006d990 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f36f4036000 tx=0x7f36f4030000 comp rx=0 tx=0).stop 2024-02-21T22:53:23.968 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.975+0000 7f37090c4640 1 -- 172.21.15.116:0/1609334039 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f37040b3f90 msgr2=0x7f3704140d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:23.968 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.975+0000 7f37090c4640 1 --2- 172.21.15.116:0/1609334039 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f37040b3f90 0x7f3704140d80 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f36fc00c480 tx=0x7f36fc00c940 comp rx=0 tx=0).stop 2024-02-21T22:53:23.968 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.975+0000 7f37090c4640 1 -- 172.21.15.116:0/1609334039 shutdown_connections 2024-02-21T22:53:23.968 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.975+0000 7f37090c4640 1 --2- 172.21.15.116:0/1609334039 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f37040b3f90 0x7f3704140d80 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:23.969 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.975+0000 7f37090c4640 1 --2- 172.21.15.116:0/1609334039 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f36f006b4d0 0x7f36f006d990 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:23.969 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.975+0000 7f37090c4640 1 --2- 172.21.15.116:0/1609334039 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f37040b0290 0x7f370413e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:23.969 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.975+0000 7f37090c4640 1 --2- 172.21.15.116:0/1609334039 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f370406b380 0x7f3704152520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:23.969 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.975+0000 7f37090c4640 1 -- 172.21.15.116:0/1609334039 >> 172.21.15.116:0/1609334039 conn(0x7f37040b29f0 msgr2=0x7f37041605b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:23.969 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.975+0000 7f37090c4640 1 -- 172.21.15.116:0/1609334039 shutdown_connections 2024-02-21T22:53:23.969 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:23.975+0000 7f37090c4640 1 -- 172.21.15.116:0/1609334039 wait complete. 2024-02-21T22:53:23.976 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-02-21T22:53:23.976 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T22:53:23.976 DEBUG:teuthology.orchestra.run.smithi116:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-02-21T22:53:24.004 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi116.front.sepia.ceph.com 2024-02-21T22:53:24.005 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T22:53:24.005 DEBUG:teuthology.orchestra.run.smithi116:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-02-21T22:53:24.064 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-02-21T22:53:24.065 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-21T22:53:24.081 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-02-21T22:53:24.081 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-21T22:53:24.137 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-02-21T22:53:24.137 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-21T22:53:24.192 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-21T22:53:24.291 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.301+0000 7f847db84640 1 Processor -- start 2024-02-21T22:53:24.292 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.301+0000 7f847db84640 1 -- start start 2024-02-21T22:53:24.293 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.302+0000 7f847db84640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f84780d08d0 0x7f8478166e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:24.294 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.302+0000 7f847db84640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84780cca40 con 0x7f84780cd800 2024-02-21T22:53:24.294 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.302+0000 7f847db84640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84780ccd20 con 0x7f847815be60 2024-02-21T22:53:24.294 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.302+0000 7f847db84640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84780cfec0 con 0x7f84780d08d0 2024-02-21T22:53:24.294 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.302+0000 7f8476ffd640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f84780cd800 0x7f84780d01c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:54926/0 (socket says 172.21.15.116:54926) 2024-02-21T22:53:24.294 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.302+0000 7f8476ffd640 1 -- 172.21.15.116:0/3170552623 learned_addr learned my addr 172.21.15.116:0/3170552623 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-02-21T22:53:24.294 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.302+0000 7f8477fff640 1 --2- 172.21.15.116:0/3170552623 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f84780d08d0 0x7f8478166e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:24.294 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.302+0000 7f84767fc640 1 -- 172.21.15.116:0/3170552623 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1108251535 0 0) 0x7f84780cca40 con 0x7f84780cd800 2024-02-21T22:53:24.294 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.302+0000 7f84767fc640 1 -- 172.21.15.116:0/3170552623 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8460003520 con 0x7f84780cd800 2024-02-21T22:53:24.294 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.302+0000 7f84767fc640 1 -- 172.21.15.116:0/3170552623 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 592945540 0 0) 0x7f84780ccd20 con 0x7f847815be60 2024-02-21T22:53:24.295 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.302+0000 7f84767fc640 1 -- 172.21.15.116:0/3170552623 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f84780cca40 con 0x7f847815be60 2024-02-21T22:53:24.295 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.302+0000 7f8477fff640 1 -- 172.21.15.116:0/3170552623 >> v1:172.21.15.142:6789/0 conn(0x7f847815be60 legacy=0x7f84780cf7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:24.295 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.302+0000 7f8477fff640 1 -- 172.21.15.116:0/3170552623 >> v1:172.21.15.116:6789/0 conn(0x7f84780cd800 legacy=0x7f84780d01c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:24.295 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.302+0000 7f8477fff640 1 -- 172.21.15.116:0/3170552623 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84780cd000 con 0x7f84780d08d0 2024-02-21T22:53:24.295 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.303+0000 7f8477fff640 1 --2- 172.21.15.116:0/3170552623 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f84780d08d0 0x7f8478166e00 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8470009dc0 tx=0x7f847002bf20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=801ae018c8739f87 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:24.295 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.303+0000 7f84767fc640 1 -- 172.21.15.116:0/3170552623 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8470039070 con 0x7f84780d08d0 2024-02-21T22:53:24.295 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.303+0000 7f84767fc640 1 -- 172.21.15.116:0/3170552623 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f847002ccd0 con 0x7f84780d08d0 2024-02-21T22:53:24.295 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.303+0000 7f84767fc640 1 -- 172.21.15.116:0/3170552623 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8470034640 con 0x7f84780d08d0 2024-02-21T22:53:24.298 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.304+0000 7f847db84640 1 -- 172.21.15.116:0/3170552623 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f84780d08d0 msgr2=0x7f8478166e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:24.298 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.304+0000 7f847db84640 1 --2- 172.21.15.116:0/3170552623 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f84780d08d0 0x7f8478166e00 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8470009dc0 tx=0x7f847002bf20 comp rx=0 tx=0).stop 2024-02-21T22:53:24.298 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.304+0000 7f847db84640 1 -- 172.21.15.116:0/3170552623 shutdown_connections 2024-02-21T22:53:24.298 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.304+0000 7f847db84640 1 --2- 172.21.15.116:0/3170552623 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f84780d08d0 0x7f8478166e00 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:24.298 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.304+0000 7f847db84640 1 -- 172.21.15.116:0/3170552623 >> 172.21.15.116:0/3170552623 conn(0x7f84780b3730 msgr2=0x7f84780b3b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:24.298 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.304+0000 7f847db84640 1 -- 172.21.15.116:0/3170552623 shutdown_connections 2024-02-21T22:53:24.298 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.304+0000 7f847db84640 1 -- 172.21.15.116:0/3170552623 wait complete. 2024-02-21T22:53:24.298 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.305+0000 7f847db84640 1 Processor -- start 2024-02-21T22:53:24.298 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.305+0000 7f847db84640 1 -- start start 2024-02-21T22:53:24.299 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.306+0000 7f847db84640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f84780cd800 0x7f84781f1420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:24.299 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.306+0000 7f847db84640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f84780d08d0 0x7f84781e62a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:24.299 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.306+0000 7f847db84640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f847815be60 0x7f847815dec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:24.299 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.306+0000 7f847db84640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f847815c240 con 0x7f84780d08d0 2024-02-21T22:53:24.299 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.306+0000 7f847db84640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84780cc6f0 con 0x7f847815be60 2024-02-21T22:53:24.299 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.306+0000 7f847db84640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f847815c3c0 con 0x7f84780cd800 2024-02-21T22:53:24.299 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.306+0000 7f8476ffd640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f84780d08d0 0x7f84781e62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:24.299 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.306+0000 7f8476ffd640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f84780d08d0 0x7f84781e62a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:38640/0 (socket says 172.21.15.116:38640) 2024-02-21T22:53:24.300 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.306+0000 7f8476ffd640 1 -- 172.21.15.116:0/1941632066 learned_addr learned my addr 172.21.15.116:0/1941632066 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:24.300 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.306+0000 7f84777fe640 1 --2- 172.21.15.116:0/1941632066 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f84780cd800 0x7f84781f1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:24.300 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.306+0000 7f8477fff640 1 --2- 172.21.15.116:0/1941632066 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f847815be60 0x7f847815dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:24.300 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.306+0000 7f8476ffd640 1 -- 172.21.15.116:0/1941632066 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f84780cd800 msgr2=0x7f84781f1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:24.300 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.306+0000 7f8476ffd640 1 --2- 172.21.15.116:0/1941632066 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f84780cd800 0x7f84781f1420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:24.300 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.306+0000 7f8476ffd640 1 -- 172.21.15.116:0/1941632066 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f847815be60 msgr2=0x7f847815dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:24.300 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.306+0000 7f8476ffd640 1 --2- 172.21.15.116:0/1941632066 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f847815be60 0x7f847815dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:24.300 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.306+0000 7f8476ffd640 1 -- 172.21.15.116:0/1941632066 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84781e6c40 con 0x7f84780d08d0 2024-02-21T22:53:24.300 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.306+0000 7f8476ffd640 1 --2- 172.21.15.116:0/1941632066 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f84780d08d0 0x7f84781e62a0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f846c00c410 tx=0x7f846c00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:24.300 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.306+0000 7f845ffff640 1 -- 172.21.15.116:0/1941632066 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f846c017070 con 0x7f84780d08d0 2024-02-21T22:53:24.300 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.306+0000 7f845ffff640 1 -- 172.21.15.116:0/1941632066 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f846c005ce0 con 0x7f84780d08d0 2024-02-21T22:53:24.300 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.307+0000 7f847db84640 1 -- 172.21.15.116:0/1941632066 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84781e6f20 con 0x7f84780d08d0 2024-02-21T22:53:24.300 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.307+0000 7f845ffff640 1 -- 172.21.15.116:0/1941632066 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f846c0072d0 con 0x7f84780d08d0 2024-02-21T22:53:24.300 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.307+0000 7f847db84640 1 -- 172.21.15.116:0/1941632066 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84780c62d0 con 0x7f84780d08d0 2024-02-21T22:53:24.301 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.307+0000 7f847db84640 1 -- 172.21.15.116:0/1941632066 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84780752f0 con 0x7f84780d08d0 2024-02-21T22:53:24.301 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.308+0000 7f845ffff640 1 -- 172.21.15.116:0/1941632066 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f846c01a070 con 0x7f84780d08d0 2024-02-21T22:53:24.301 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.308+0000 7f845ffff640 1 --2- 172.21.15.116:0/1941632066 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f846406b4d0 0x7f846406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:24.301 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.308+0000 7f845ffff640 1 -- 172.21.15.116:0/1941632066 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f846c089550 con 0x7f84780d08d0 2024-02-21T22:53:24.301 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.308+0000 7f84777fe640 1 --2- 172.21.15.116:0/1941632066 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f846406b4d0 0x7f846406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:24.302 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.309+0000 7f84777fe640 1 --2- 172.21.15.116:0/1941632066 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f846406b4d0 0x7f846406d990 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f8468007fd0 tx=0x7f8468009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:24.303 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.313+0000 7f845ffff640 1 -- 172.21.15.116:0/1941632066 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f846c057d80 con 0x7f84780d08d0 2024-02-21T22:53:24.476 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.486+0000 7f847db84640 1 -- 172.21.15.116:0/1941632066 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f84780d0690 con 0x7f84780d08d0 2024-02-21T22:53:24.477 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.487+0000 7f845ffff640 1 -- 172.21.15.116:0/1941632066 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16653 (secure 0 0 0) 0x7f846c05be20 con 0x7f84780d08d0 2024-02-21T22:53:24.477 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-02-21T22:53:24.478 INFO:teuthology.orchestra.run.smithi116.stdout:{"epoch":20,"fsid":"7c298660-5f63-4b5c-a800-58c5be9a8445","created":"2024-02-21T22:52:25.994613+0000","modified":"2024-02-21T22:52:51.786454+0000","last_up_change":"2024-02-21T22:52:37.313595+0000","last_in_change":"2024-02-21T22:52:28.176031+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-21T22:52:38.328796+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-21T22:52:48.145152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-21T22:52:49.096955+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4f09126b-b5e4-4876-8b08-f5cbb967388a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":1613202231},{"type":"v1","addr":"172.21.15.116:6809","nonce":1613202231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":1613202231},{"type":"v1","addr":"172.21.15.116:6811","nonce":1613202231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":1613202231},{"type":"v1","addr":"172.21.15.116:6815","nonce":1613202231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":1613202231},{"type":"v1","addr":"172.21.15.116:6813","nonce":1613202231}]},"public_addr":"172.21.15.116:6809/1613202231","cluster_addr":"172.21.15.116:6811/1613202231","heartbeat_back_addr":"172.21.15.116:6815/1613202231","heartbeat_front_addr":"172.21.15.116:6813/1613202231","state":["exists","up"]},{"osd":1,"uuid":"7272c51d-51f9-4536-931d-33ad7a4b377e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6816","nonce":172614746},{"type":"v1","addr":"172.21.15.116:6817","nonce":172614746}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":172614746},{"type":"v1","addr":"172.21.15.116:6819","nonce":172614746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":172614746},{"type":"v1","addr":"172.21.15.116:6823","nonce":172614746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":172614746},{"type":"v1","addr":"172.21.15.116:6821","nonce":172614746}]},"public_addr":"172.21.15.116:6817/172614746","cluster_addr":"172.21.15.116:6819/172614746","heartbeat_back_addr":"172.21.15.116:6823/172614746","heartbeat_front_addr":"172.21.15.116:6821/172614746","state":["exists","up"]},{"osd":2,"uuid":"2589616c-adf1-4187-aac3-735256cf624b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":1029280577},{"type":"v1","addr":"172.21.15.116:6825","nonce":1029280577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":1029280577},{"type":"v1","addr":"172.21.15.116:6827","nonce":1029280577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":1029280577},{"type":"v1","addr":"172.21.15.116:6831","nonce":1029280577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":1029280577},{"type":"v1","addr":"172.21.15.116:6829","nonce":1029280577}]},"public_addr":"172.21.15.116:6825/1029280577","cluster_addr":"172.21.15.116:6827/1029280577","heartbeat_back_addr":"172.21.15.116:6831/1029280577","heartbeat_front_addr":"172.21.15.116:6829/1029280577","state":["exists","up"]},{"osd":3,"uuid":"0fd2e563-7c5b-46f6-82c2-b60c86072c93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":3106627557},{"type":"v1","addr":"172.21.15.116:6801","nonce":3106627557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":3106627557},{"type":"v1","addr":"172.21.15.116:6803","nonce":3106627557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":3106627557},{"type":"v1","addr":"172.21.15.116:6807","nonce":3106627557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":3106627557},{"type":"v1","addr":"172.21.15.116:6805","nonce":3106627557}]},"public_addr":"172.21.15.116:6801/3106627557","cluster_addr":"172.21.15.116:6803/3106627557","heartbeat_back_addr":"172.21.15.116:6807/3106627557","heartbeat_front_addr":"172.21.15.116:6805/3106627557","state":["exists","up"]},{"osd":4,"uuid":"79ae35b7-dda8-4ab8-96ce-47515afde082","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":3231407772},{"type":"v1","addr":"172.21.15.142:6825","nonce":3231407772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":3231407772},{"type":"v1","addr":"172.21.15.142:6827","nonce":3231407772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":3231407772},{"type":"v1","addr":"172.21.15.142:6831","nonce":3231407772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":3231407772},{"type":"v1","addr":"172.21.15.142:6829","nonce":3231407772}]},"public_addr":"172.21.15.142:6825/3231407772","cluster_addr":"172.21.15.142:6827/3231407772","heartbeat_back_addr":"172.21.15.142:6831/3231407772","heartbeat_front_addr":"172.21.15.142:6829/3231407772","state":["exists","up"]},{"osd":5,"uuid":"3166eb2c-3fcf-41c8-9362-45bafaabaa39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":1184158716},{"type":"v1","addr":"172.21.15.142:6817","nonce":1184158716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":1184158716},{"type":"v1","addr":"172.21.15.142:6819","nonce":1184158716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":1184158716},{"type":"v1","addr":"172.21.15.142:6823","nonce":1184158716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":1184158716},{"type":"v1","addr":"172.21.15.142:6821","nonce":1184158716}]},"public_addr":"172.21.15.142:6817/1184158716","cluster_addr":"172.21.15.142:6819/1184158716","heartbeat_back_addr":"172.21.15.142:6823/1184158716","heartbeat_front_addr":"172.21.15.142:6821/1184158716","state":["exists","up"]},{"osd":6,"uuid":"f9aa9672-7527-43e2-963e-b61868e5e63f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":1987868911},{"type":"v1","addr":"172.21.15.142:6801","nonce":1987868911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":1987868911},{"type":"v1","addr":"172.21.15.142:6803","nonce":1987868911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":1987868911},{"type":"v1","addr":"172.21.15.142:6807","nonce":1987868911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":1987868911},{"type":"v1","addr":"172.21.15.142:6805","nonce":1987868911}]},"public_addr":"172.21.15.142:6801/1987868911","cluster_addr":"172.21.15.142:6803/1987868911","heartbeat_back_addr":"172.21.15.142:6807/1987868911","heartbeat_front_addr":"172.21.15.142:6805/1987868911","state":["exists","up"]},{"osd":7,"uuid":"7ed29226-fc42-4382-a91a-fa50f7ec5426","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":1272081937},{"type":"v1","addr":"172.21.15.142:6809","nonce":1272081937}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":1272081937},{"type":"v1","addr":"172.21.15.142:6811","nonce":1272081937}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":1272081937},{"type":"v1","addr":"172.21.15.142:6815","nonce":1272081937}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":1272081937},{"type":"v1","addr":"172.21.15.142:6813","nonce":1272081937}]},"public_addr":"172.21.15.142:6809/1272081937","cluster_addr":"172.21.15.142:6811/1272081937","heartbeat_back_addr":"172.21.15.142:6815/1272081937","heartbeat_front_addr":"172.21.15.142:6813/1272081937","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.350998+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.307201+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.289112+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.243888+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.312091+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.370472+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.275659+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.289297+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-21T22:53:24.479 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.489+0000 7f847db84640 1 -- 172.21.15.116:0/1941632066 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f846406b4d0 msgr2=0x7f846406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:24.480 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.489+0000 7f847db84640 1 --2- 172.21.15.116:0/1941632066 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f846406b4d0 0x7f846406d990 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f8468007fd0 tx=0x7f8468009040 comp rx=0 tx=0).stop 2024-02-21T22:53:24.480 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.489+0000 7f847db84640 1 -- 172.21.15.116:0/1941632066 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f84780d08d0 msgr2=0x7f84781e62a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:24.480 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.489+0000 7f847db84640 1 --2- 172.21.15.116:0/1941632066 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f84780d08d0 0x7f84781e62a0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f846c00c410 tx=0x7f846c00c8d0 comp rx=0 tx=0).stop 2024-02-21T22:53:24.480 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.489+0000 7f847db84640 1 -- 172.21.15.116:0/1941632066 shutdown_connections 2024-02-21T22:53:24.480 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.489+0000 7f847db84640 1 --2- 172.21.15.116:0/1941632066 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f847815be60 0x7f847815dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:24.480 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.489+0000 7f847db84640 1 --2- 172.21.15.116:0/1941632066 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f84780d08d0 0x7f84781e62a0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:24.480 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.489+0000 7f847db84640 1 --2- 172.21.15.116:0/1941632066 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f846406b4d0 0x7f846406d990 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:24.480 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.489+0000 7f847db84640 1 --2- 172.21.15.116:0/1941632066 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f84780cd800 0x7f84781f1420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:24.480 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.489+0000 7f847db84640 1 -- 172.21.15.116:0/1941632066 >> 172.21.15.116:0/1941632066 conn(0x7f84780b3730 msgr2=0x7f84780d1be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:24.480 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.489+0000 7f847db84640 1 -- 172.21.15.116:0/1941632066 shutdown_connections 2024-02-21T22:53:24.480 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.489+0000 7f847db84640 1 -- 172.21.15.116:0/1941632066 wait complete. 2024-02-21T22:53:24.490 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-21T22:52:38.328796+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-02-21T22:52:48.145152+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-02-21T22:52:49.096955+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-21T22:53:24.491 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-21T22:53:24.596 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.603+0000 7f37731ed640 1 Processor -- start 2024-02-21T22:53:24.596 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.604+0000 7f37731ed640 1 -- start start 2024-02-21T22:53:24.596 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.604+0000 7f37731ed640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f376c15ae80 0x7f376c0b2dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:24.596 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.604+0000 7f37731ed640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f376c0ce100 0x7f376c0b3300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:24.596 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.604+0000 7f37731ed640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f376c071d90 con 0x7f376c06e310 2024-02-21T22:53:24.596 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.604+0000 7f37731ed640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f376c072070 con 0x7f376c15ae80 2024-02-21T22:53:24.596 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.604+0000 7f37731ed640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f376c072350 con 0x7f376c0ce100 2024-02-21T22:53:24.597 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.604+0000 7f3770f89640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f376c15ae80 0x7f376c0b2dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:24.597 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.604+0000 7f3770f89640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f376c15ae80 0x7f376c0b2dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:38644/0 (socket says 172.21.15.116:38644) 2024-02-21T22:53:24.597 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.604+0000 7f3770f89640 1 -- 172.21.15.116:0/711511535 learned_addr learned my addr 172.21.15.116:0/711511535 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:24.597 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.605+0000 7f377178a640 1 --2- 172.21.15.116:0/711511535 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f376c0ce100 0x7f376c0b3300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:24.597 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.605+0000 7f3770f89640 1 -- 172.21.15.116:0/711511535 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f376c0ce100 msgr2=0x7f376c0b3300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:53:24.597 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.605+0000 7f3770f89640 1 --2- 172.21.15.116:0/711511535 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f376c0ce100 0x7f376c0b3300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:24.597 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.605+0000 7f3770f89640 1 -- 172.21.15.116:0/711511535 >> v1:172.21.15.142:6789/0 conn(0x7f376c06e310 legacy=0x7f376c070910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:24.597 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.605+0000 7f3770f89640 1 -- 172.21.15.116:0/711511535 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f376c072630 con 0x7f376c15ae80 2024-02-21T22:53:24.597 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.605+0000 7f3770f89640 1 --2- 172.21.15.116:0/711511535 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f376c15ae80 0x7f376c0b2dc0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f3760009870 tx=0x7f376002b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18ef63d8b54b42f5 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:24.597 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.606+0000 7f376b7fe640 1 -- 172.21.15.116:0/711511535 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3760034070 con 0x7f376c15ae80 2024-02-21T22:53:24.597 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.606+0000 7f376b7fe640 1 -- 172.21.15.116:0/711511535 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3760030840 con 0x7f376c15ae80 2024-02-21T22:53:24.597 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.606+0000 7f376b7fe640 1 -- 172.21.15.116:0/711511535 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3760030c10 con 0x7f376c15ae80 2024-02-21T22:53:24.600 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.606+0000 7f37731ed640 1 -- 172.21.15.116:0/711511535 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f376c15ae80 msgr2=0x7f376c0b2dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:24.600 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.606+0000 7f37731ed640 1 --2- 172.21.15.116:0/711511535 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f376c15ae80 0x7f376c0b2dc0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f3760009870 tx=0x7f376002b980 comp rx=0 tx=0).stop 2024-02-21T22:53:24.600 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.606+0000 7f37731ed640 1 -- 172.21.15.116:0/711511535 shutdown_connections 2024-02-21T22:53:24.600 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.606+0000 7f37731ed640 1 --2- 172.21.15.116:0/711511535 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f376c0ce100 0x7f376c0b3300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:24.600 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.606+0000 7f37731ed640 1 --2- 172.21.15.116:0/711511535 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f376c15ae80 0x7f376c0b2dc0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:24.601 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.606+0000 7f37731ed640 1 -- 172.21.15.116:0/711511535 >> 172.21.15.116:0/711511535 conn(0x7f376c0b1740 msgr2=0x7f376c0b1b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:24.601 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.606+0000 7f37731ed640 1 -- 172.21.15.116:0/711511535 shutdown_connections 2024-02-21T22:53:24.601 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.606+0000 7f37731ed640 1 -- 172.21.15.116:0/711511535 wait complete. 2024-02-21T22:53:24.601 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.607+0000 7f37731ed640 1 Processor -- start 2024-02-21T22:53:24.601 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.607+0000 7f37731ed640 1 -- start start 2024-02-21T22:53:24.601 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.608+0000 7f37731ed640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f376c06e310 0x7f376c142f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:24.601 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.608+0000 7f37731ed640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f376c0ce100 0x7f376c142420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:24.601 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.608+0000 7f37731ed640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f376c152550 0x7f376c15c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:24.601 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.608+0000 7f37731ed640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f376c0b4610 con 0x7f376c0ce100 2024-02-21T22:53:24.601 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.608+0000 7f37731ed640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f376c0b4490 con 0x7f376c152550 2024-02-21T22:53:24.601 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.608+0000 7f37731ed640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f376c0b4790 con 0x7f376c06e310 2024-02-21T22:53:24.601 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.608+0000 7f376bfff640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f376c0ce100 0x7f376c142420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:24.601 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.608+0000 7f376bfff640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f376c0ce100 0x7f376c142420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:38656/0 (socket says 172.21.15.116:38656) 2024-02-21T22:53:24.601 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.608+0000 7f376bfff640 1 -- 172.21.15.116:0/2395573264 learned_addr learned my addr 172.21.15.116:0/2395573264 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:24.601 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.608+0000 7f3770f89640 1 --2- 172.21.15.116:0/2395573264 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f376c06e310 0x7f376c142f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:24.602 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.608+0000 7f377178a640 1 --2- 172.21.15.116:0/2395573264 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f376c152550 0x7f376c15c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:24.602 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.609+0000 7f376bfff640 1 -- 172.21.15.116:0/2395573264 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f376c06e310 msgr2=0x7f376c142f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:24.602 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.609+0000 7f376bfff640 1 --2- 172.21.15.116:0/2395573264 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f376c06e310 0x7f376c142f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:24.602 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.609+0000 7f376bfff640 1 -- 172.21.15.116:0/2395573264 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f376c152550 msgr2=0x7f376c15c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:24.602 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.609+0000 7f376bfff640 1 --2- 172.21.15.116:0/2395573264 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f376c152550 0x7f376c15c7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:24.602 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.609+0000 7f376bfff640 1 -- 172.21.15.116:0/2395573264 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f376c154590 con 0x7f376c0ce100 2024-02-21T22:53:24.602 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.609+0000 7f376bfff640 1 --2- 172.21.15.116:0/2395573264 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f376c0ce100 0x7f376c142420 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f375800c3c0 tx=0x7f375800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:24.602 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.609+0000 7f37697fa640 1 -- 172.21.15.116:0/2395573264 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37580052d0 con 0x7f376c0ce100 2024-02-21T22:53:24.602 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.609+0000 7f37697fa640 1 -- 172.21.15.116:0/2395573264 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3758005490 con 0x7f376c0ce100 2024-02-21T22:53:24.602 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.609+0000 7f37731ed640 1 -- 172.21.15.116:0/2395573264 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f376c154870 con 0x7f376c0ce100 2024-02-21T22:53:24.602 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.609+0000 7f37697fa640 1 -- 172.21.15.116:0/2395573264 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3758007260 con 0x7f376c0ce100 2024-02-21T22:53:24.602 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.609+0000 7f37731ed640 1 -- 172.21.15.116:0/2395573264 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f376c154e30 con 0x7f376c0ce100 2024-02-21T22:53:24.602 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.610+0000 7f37731ed640 1 -- 172.21.15.116:0/2395573264 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f376c0752f0 con 0x7f376c0ce100 2024-02-21T22:53:24.603 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.610+0000 7f37697fa640 1 -- 172.21.15.116:0/2395573264 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f3758007400 con 0x7f376c0ce100 2024-02-21T22:53:24.603 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.611+0000 7f37697fa640 1 --2- 172.21.15.116:0/2395573264 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f375006b4d0 0x7f375006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:24.603 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.611+0000 7f37697fa640 1 -- 172.21.15.116:0/2395573264 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f37580895f0 con 0x7f376c0ce100 2024-02-21T22:53:24.603 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.611+0000 7f3770f89640 1 --2- 172.21.15.116:0/2395573264 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f375006b4d0 0x7f375006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:24.604 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.611+0000 7f3770f89640 1 --2- 172.21.15.116:0/2395573264 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f375006b4d0 0x7f375006d990 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f3760036000 tx=0x7f3760008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:24.605 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.615+0000 7f37697fa640 1 -- 172.21.15.116:0/2395573264 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f3758057e20 con 0x7f376c0ce100 2024-02-21T22:53:24.776 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.785+0000 7f37731ed640 1 -- 172.21.15.116:0/2395573264 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f376c0b0eb0 con 0x7f376c0ce100 2024-02-21T22:53:24.776 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.785+0000 7f37697fa640 1 -- 172.21.15.116:0/2395573264 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f375805bec0 con 0x7f376c0ce100 2024-02-21T22:53:24.776 INFO:teuthology.orchestra.run.smithi116.stdout:pg_num: 1 2024-02-21T22:53:24.778 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.787+0000 7f37731ed640 1 -- 172.21.15.116:0/2395573264 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f375006b4d0 msgr2=0x7f375006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:24.778 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.787+0000 7f37731ed640 1 --2- 172.21.15.116:0/2395573264 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f375006b4d0 0x7f375006d990 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f3760036000 tx=0x7f3760008030 comp rx=0 tx=0).stop 2024-02-21T22:53:24.778 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.787+0000 7f37731ed640 1 -- 172.21.15.116:0/2395573264 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f376c0ce100 msgr2=0x7f376c142420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:24.778 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.787+0000 7f37731ed640 1 --2- 172.21.15.116:0/2395573264 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f376c0ce100 0x7f376c142420 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f375800c3c0 tx=0x7f375800c880 comp rx=0 tx=0).stop 2024-02-21T22:53:24.778 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.787+0000 7f37731ed640 1 -- 172.21.15.116:0/2395573264 shutdown_connections 2024-02-21T22:53:24.778 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.787+0000 7f37731ed640 1 --2- 172.21.15.116:0/2395573264 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f376c152550 0x7f376c15c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:24.779 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.787+0000 7f37731ed640 1 --2- 172.21.15.116:0/2395573264 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f376c0ce100 0x7f376c142420 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:24.779 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.787+0000 7f37731ed640 1 --2- 172.21.15.116:0/2395573264 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f375006b4d0 0x7f375006d990 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:24.779 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.787+0000 7f37731ed640 1 --2- 172.21.15.116:0/2395573264 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f376c06e310 0x7f376c142f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:24.779 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.787+0000 7f37731ed640 1 -- 172.21.15.116:0/2395573264 >> 172.21.15.116:0/2395573264 conn(0x7f376c0b1740 msgr2=0x7f376c0ce9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:24.779 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.787+0000 7f37731ed640 1 -- 172.21.15.116:0/2395573264 shutdown_connections 2024-02-21T22:53:24.779 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.787+0000 7f37731ed640 1 -- 172.21.15.116:0/2395573264 wait complete. 2024-02-21T22:53:24.789 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-02-21T22:53:24.893 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.902+0000 7f5ad6e36640 1 Processor -- start 2024-02-21T22:53:24.893 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.902+0000 7f5ad6e36640 1 -- start start 2024-02-21T22:53:24.895 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.903+0000 7f5ad6e36640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f5ad015dfe0 0x7f5ad006eb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:24.895 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.903+0000 7f5ad6e36640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f5ad0162840 0x7f5ad006f540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:24.895 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.903+0000 7f5ad6e36640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ad00d0030 con 0x7f5ad00d0df0 2024-02-21T22:53:24.895 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.903+0000 7f5ad6e36640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ad00d0310 con 0x7f5ad015dfe0 2024-02-21T22:53:24.896 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.903+0000 7f5ad6e36640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ad00d05f0 con 0x7f5ad0162840 2024-02-21T22:53:24.896 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.903+0000 7f5ad4bd2640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f5ad015dfe0 0x7f5ad006eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:24.896 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.903+0000 7f5ad53d3640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f5ad00d0df0 0x7f5ad00cc200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:54936/0 (socket says 172.21.15.116:54936) 2024-02-21T22:53:24.896 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.903+0000 7f5ad53d3640 1 -- 172.21.15.116:0/1670871632 learned_addr learned my addr 172.21.15.116:0/1670871632 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-02-21T22:53:24.896 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.903+0000 7f5acffff640 1 --2- 172.21.15.116:0/1670871632 >> v2:172.21.15.142:3300/0 conn(0x7f5ad0162840 0x7f5ad006f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:24.896 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.903+0000 7f5ad4bd2640 1 -- 172.21.15.116:0/1670871632 >> v2:172.21.15.142:3300/0 conn(0x7f5ad0162840 msgr2=0x7f5ad006f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:53:24.896 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.903+0000 7f5ad4bd2640 1 --2- 172.21.15.116:0/1670871632 >> v2:172.21.15.142:3300/0 conn(0x7f5ad0162840 0x7f5ad006f540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:24.896 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.903+0000 7f5ad4bd2640 1 -- 172.21.15.116:0/1670871632 >> v1:172.21.15.116:6789/0 conn(0x7f5ad00d0df0 legacy=0x7f5ad00cc200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:24.896 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.903+0000 7f5acf7fe640 1 -- 172.21.15.116:0/1670871632 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 821805218 0 0) 0x7f5ad00d0030 con 0x7f5ad00d0df0 2024-02-21T22:53:24.897 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.903+0000 7f5ad4bd2640 1 -- 172.21.15.116:0/1670871632 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ad00d08d0 con 0x7f5ad015dfe0 2024-02-21T22:53:24.897 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.904+0000 7f5ad4bd2640 1 --2- 172.21.15.116:0/1670871632 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5ad015dfe0 0x7f5ad006eb50 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f5ad0071a10 tx=0x7f5ac402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e53db297563ca1ed server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:24.897 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.904+0000 7f5acf7fe640 1 -- 172.21.15.116:0/1670871632 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ac40315a0 con 0x7f5ad015dfe0 2024-02-21T22:53:24.897 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.904+0000 7f5acf7fe640 1 -- 172.21.15.116:0/1670871632 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ac4037070 con 0x7f5ad015dfe0 2024-02-21T22:53:24.897 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.904+0000 7f5acf7fe640 1 -- 172.21.15.116:0/1670871632 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ac4031960 con 0x7f5ad015dfe0 2024-02-21T22:53:24.897 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.905+0000 7f5ad6e36640 1 -- 172.21.15.116:0/1670871632 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5ad015dfe0 msgr2=0x7f5ad006eb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:24.897 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.905+0000 7f5ad6e36640 1 --2- 172.21.15.116:0/1670871632 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5ad015dfe0 0x7f5ad006eb50 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f5ad0071a10 tx=0x7f5ac402b840 comp rx=0 tx=0).stop 2024-02-21T22:53:24.898 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.905+0000 7f5ad6e36640 1 -- 172.21.15.116:0/1670871632 shutdown_connections 2024-02-21T22:53:24.898 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.905+0000 7f5ad6e36640 1 --2- 172.21.15.116:0/1670871632 >> v2:172.21.15.142:3300/0 conn(0x7f5ad0162840 0x7f5ad006f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:24.898 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.905+0000 7f5ad6e36640 1 --2- 172.21.15.116:0/1670871632 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5ad015dfe0 0x7f5ad006eb50 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:24.898 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.905+0000 7f5ad6e36640 1 -- 172.21.15.116:0/1670871632 >> 172.21.15.116:0/1670871632 conn(0x7f5ad00b36c0 msgr2=0x7f5ad00b3ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:24.898 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.905+0000 7f5ad6e36640 1 -- 172.21.15.116:0/1670871632 shutdown_connections 2024-02-21T22:53:24.898 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.905+0000 7f5ad6e36640 1 -- 172.21.15.116:0/1670871632 wait complete. 2024-02-21T22:53:24.901 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.906+0000 7f5ad6e36640 1 Processor -- start 2024-02-21T22:53:24.901 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.906+0000 7f5ad6e36640 1 -- start start 2024-02-21T22:53:24.901 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.907+0000 7f5ad6e36640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5ad00d0df0 0x7f5ad00afc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:24.901 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.907+0000 7f5ad6e36640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5ad015dfe0 0x7f5ad015aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:24.901 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.907+0000 7f5ad6e36640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5ad0162840 0x7f5ad015b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:24.901 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.907+0000 7f5ad6e36640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ad006f090 con 0x7f5ad0162840 2024-02-21T22:53:24.901 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.907+0000 7f5ad6e36640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ad015e3c0 con 0x7f5ad00d0df0 2024-02-21T22:53:24.901 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.907+0000 7f5ad6e36640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ad006f210 con 0x7f5ad015dfe0 2024-02-21T22:53:24.901 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.907+0000 7f5ad53d3640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5ad0162840 0x7f5ad015b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:24.902 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.907+0000 7f5ad53d3640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5ad0162840 0x7f5ad015b400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:38680/0 (socket says 172.21.15.116:38680) 2024-02-21T22:53:24.902 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.907+0000 7f5ad53d3640 1 -- 172.21.15.116:0/2765632039 learned_addr learned my addr 172.21.15.116:0/2765632039 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:24.902 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.907+0000 7f5ad4bd2640 1 --2- 172.21.15.116:0/2765632039 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5ad00d0df0 0x7f5ad00afc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:24.902 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.907+0000 7f5acffff640 1 --2- 172.21.15.116:0/2765632039 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5ad015dfe0 0x7f5ad015aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:24.902 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.907+0000 7f5ad53d3640 1 -- 172.21.15.116:0/2765632039 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5ad015dfe0 msgr2=0x7f5ad015aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:24.902 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.907+0000 7f5ad53d3640 1 --2- 172.21.15.116:0/2765632039 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5ad015dfe0 0x7f5ad015aec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:24.902 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.907+0000 7f5ad53d3640 1 -- 172.21.15.116:0/2765632039 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5ad00d0df0 msgr2=0x7f5ad00afc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:24.902 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.907+0000 7f5ad53d3640 1 --2- 172.21.15.116:0/2765632039 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5ad00d0df0 0x7f5ad00afc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:24.902 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.907+0000 7f5ad53d3640 1 -- 172.21.15.116:0/2765632039 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ad00c8d20 con 0x7f5ad0162840 2024-02-21T22:53:24.902 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.907+0000 7f5ad53d3640 1 --2- 172.21.15.116:0/2765632039 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5ad0162840 0x7f5ad015b400 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f5ac800c7a0 tx=0x7f5ac800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:24.902 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.907+0000 7f5acd7fa640 1 -- 172.21.15.116:0/2765632039 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ac8018070 con 0x7f5ad0162840 2024-02-21T22:53:24.902 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.907+0000 7f5acd7fa640 1 -- 172.21.15.116:0/2765632039 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ac800a640 con 0x7f5ad0162840 2024-02-21T22:53:24.902 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.907+0000 7f5ad6e36640 1 -- 172.21.15.116:0/2765632039 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ad015b940 con 0x7f5ad0162840 2024-02-21T22:53:24.903 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.907+0000 7f5acd7fa640 1 -- 172.21.15.116:0/2765632039 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ac800aab0 con 0x7f5ad0162840 2024-02-21T22:53:24.903 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.908+0000 7f5ad6e36640 1 -- 172.21.15.116:0/2765632039 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ad015bbf0 con 0x7f5ad0162840 2024-02-21T22:53:24.903 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.908+0000 7f5ad6e36640 1 -- 172.21.15.116:0/2765632039 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ad00c90d0 con 0x7f5ad0162840 2024-02-21T22:53:24.903 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.909+0000 7f5acd7fa640 1 -- 172.21.15.116:0/2765632039 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f5ac801b070 con 0x7f5ad0162840 2024-02-21T22:53:24.903 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.909+0000 7f5acd7fa640 1 --2- 172.21.15.116:0/2765632039 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f5ab406b4d0 0x7f5ab406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:24.903 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.909+0000 7f5acd7fa640 1 -- 172.21.15.116:0/2765632039 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5ac8089700 con 0x7f5ad0162840 2024-02-21T22:53:24.903 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.909+0000 7f5ad4bd2640 1 --2- 172.21.15.116:0/2765632039 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f5ab406b4d0 0x7f5ab406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:24.903 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.910+0000 7f5ad4bd2640 1 --2- 172.21.15.116:0/2765632039 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f5ab406b4d0 0x7f5ab406d990 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f5ac4036000 tx=0x7f5ac403d040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:24.904 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:24.914+0000 7f5acd7fa640 1 -- 172.21.15.116:0/2765632039 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f5ac8057fc0 con 0x7f5ad0162840 2024-02-21T22:53:25.073 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:25.083+0000 7f5ad6e36640 1 -- 172.21.15.116:0/2765632039 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5ad00d1620 con 0x7f5ad0162840 2024-02-21T22:53:25.074 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:25.083+0000 7f5acd7fa640 1 -- 172.21.15.116:0/2765632039 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5ac805c060 con 0x7f5ad0162840 2024-02-21T22:53:25.074 INFO:teuthology.orchestra.run.smithi116.stdout:pg_num: 32 2024-02-21T22:53:25.076 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:25.085+0000 7f5ad6e36640 1 -- 172.21.15.116:0/2765632039 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f5ab406b4d0 msgr2=0x7f5ab406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:25.076 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:25.085+0000 7f5ad6e36640 1 --2- 172.21.15.116:0/2765632039 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f5ab406b4d0 0x7f5ab406d990 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f5ac4036000 tx=0x7f5ac403d040 comp rx=0 tx=0).stop 2024-02-21T22:53:25.076 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:25.085+0000 7f5ad6e36640 1 -- 172.21.15.116:0/2765632039 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5ad0162840 msgr2=0x7f5ad015b400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:25.076 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:25.085+0000 7f5ad6e36640 1 --2- 172.21.15.116:0/2765632039 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5ad0162840 0x7f5ad015b400 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f5ac800c7a0 tx=0x7f5ac800cc60 comp rx=0 tx=0).stop 2024-02-21T22:53:25.076 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:25.085+0000 7f5ad6e36640 1 -- 172.21.15.116:0/2765632039 shutdown_connections 2024-02-21T22:53:25.076 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:25.085+0000 7f5ad6e36640 1 --2- 172.21.15.116:0/2765632039 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5ad0162840 0x7f5ad015b400 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:25.076 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:25.085+0000 7f5ad6e36640 1 --2- 172.21.15.116:0/2765632039 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f5ab406b4d0 0x7f5ab406d990 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:25.077 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:25.085+0000 7f5ad6e36640 1 --2- 172.21.15.116:0/2765632039 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5ad015dfe0 0x7f5ad015aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:25.077 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:25.085+0000 7f5ad6e36640 1 --2- 172.21.15.116:0/2765632039 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5ad00d0df0 0x7f5ad00afc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:25.077 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:25.085+0000 7f5ad6e36640 1 -- 172.21.15.116:0/2765632039 >> 172.21.15.116:0/2765632039 conn(0x7f5ad00b36c0 msgr2=0x7f5ad00b3ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:25.077 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:25.085+0000 7f5ad6e36640 1 -- 172.21.15.116:0/2765632039 shutdown_connections 2024-02-21T22:53:25.077 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:25.085+0000 7f5ad6e36640 1 -- 172.21.15.116:0/2765632039 wait complete. 2024-02-21T22:53:25.087 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-02-21T22:53:25.190 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:25.199+0000 7f1685036640 1 Processor -- start 2024-02-21T22:53:25.190 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:25.199+0000 7f1685036640 1 -- start start 2024-02-21T22:53:25.192 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:25.200+0000 7f1685036640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f16800b4790 0x7f16800d4940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:25.193 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:25.200+0000 7f1685036640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16800ceea0 con 0x7f16800d0ca0 2024-02-21T22:53:25.193 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:25.200+0000 7f1685036640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16800cf180 con 0x7f16800d2b10 2024-02-21T22:53:25.193 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:25.200+0000 7f1685036640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16800cf460 con 0x7f16800b4790 2024-02-21T22:53:25.193 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:25.200+0000 7f167ed9d640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f16800d0ca0 0x7f16800d2400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:54942/0 (socket says 172.21.15.116:54942) 2024-02-21T22:53:25.193 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:25.200+0000 7f167ed9d640 1 -- 172.21.15.116:0/2097556236 learned_addr learned my addr 172.21.15.116:0/2097556236 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-02-21T22:53:25.193 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:25.200+0000 7f167f59e640 1 --2- 172.21.15.116:0/2097556236 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f16800b4790 0x7f16800d4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:25.193 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:25.200+0000 7f167dd9b640 1 -- 172.21.15.116:0/2097556236 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2004812043 0 0) 0x7f16800ceea0 con 0x7f16800d0ca0 2024-02-21T22:53:25.193 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:25.200+0000 7f167dd9b640 1 -- 172.21.15.116:0/2097556236 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1668003520 con 0x7f16800d0ca0 2024-02-21T22:53:25.193 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:25.200+0000 7f167dd9b640 1 -- 172.21.15.116:0/2097556236 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4127530864 0 0) 0x7f16800cf180 con 0x7f16800d2b10 2024-02-21T22:53:25.193 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:25.200+0000 7f167dd9b640 1 -- 172.21.15.116:0/2097556236 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f16800ceea0 con 0x7f16800d2b10 2024-02-21T22:53:25.193 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:25.201+0000 7f167f59e640 1 -- 172.21.15.116:0/2097556236 >> v1:172.21.15.142:6789/0 conn(0x7f16800d2b10 legacy=0x7f168015da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:25.193 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:25.201+0000 7f167f59e640 1 -- 172.21.15.116:0/2097556236 >> v1:172.21.15.116:6789/0 conn(0x7f16800d0ca0 legacy=0x7f16800d2400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:25.193 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:25.201+0000 7f167dd9b640 1 -- 172.21.15.116:0/2097556236 <== mon.0 v1:172.21.15.116:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1604288649 0 0) 0x7f1668003520 con 0x7f16800d0ca0 2024-02-21T22:53:25.193 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:25.201+0000 7f167f59e640 1 -- 172.21.15.116:0/2097556236 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16800cf740 con 0x7f16800b4790 2024-02-21T22:53:25.193 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:25.201+0000 7f167f59e640 1 --2- 172.21.15.116:0/2097556236 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f16800b4790 0x7f16800d4940 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f1678009dc0 tx=0x7f167802be70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f42f406543a05a73 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:25.194 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:25.201+0000 7f167dd9b640 1 -- 172.21.15.116:0/2097556236 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1678039070 con 0x7f16800b4790 2024-02-21T22:53:25.194 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:25.202+0000 7f167dd9b640 1 -- 172.21.15.116:0/2097556236 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f167802c9a0 con 0x7f16800b4790 2024-02-21T22:53:25.194 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:25.202+0000 7f167dd9b640 1 -- 172.21.15.116:0/2097556236 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1670001670 con 0x7f16800b4790 2024-02-21T22:53:25.194 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:25.202+0000 7f1685036640 1 -- 172.21.15.116:0/2097556236 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f16800b4790 msgr2=0x7f16800d4940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:25.194 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:25.202+0000 7f1685036640 1 --2- 172.21.15.116:0/2097556236 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f16800b4790 0x7f16800d4940 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f1678009dc0 tx=0x7f167802be70 comp rx=0 tx=0).stop 2024-02-21T22:53:25.194 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:25.202+0000 7f1685036640 1 -- 172.21.15.116:0/2097556236 shutdown_connections 2024-02-21T22:53:25.194 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:25.202+0000 7f1685036640 1 --2- 172.21.15.116:0/2097556236 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f16800b4790 0x7f16800d4940 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:25.194 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:25.202+0000 7f1685036640 1 -- 172.21.15.116:0/2097556236 >> 172.21.15.116:0/2097556236 conn(0x7f16800d3e20 msgr2=0x7f16800d4230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:25.194 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:25.202+0000 7f1685036640 1 -- 172.21.15.116:0/2097556236 shutdown_connections 2024-02-21T22:53:25.194 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:25.202+0000 7f1685036640 1 -- 172.21.15.116:0/2097556236 wait complete. 2024-02-21T22:53:25.197 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:25.204+0000 7f1685036640 1 Processor -- start 2024-02-21T22:53:25.197 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:25.204+0000 7f1685036640 1 -- start start 2024-02-21T22:53:25.197 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:25.204+0000 7f1685036640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f16800b4790 0x7f168009dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:25.197 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:25.204+0000 7f1685036640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f16800d0ca0 0x7f1680162050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:25.197 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:25.204+0000 7f1685036640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f16800d2b10 0x7f16800cd3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:25.197 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:25.204+0000 7f1685036640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16800d1200 con 0x7f16800d0ca0 2024-02-21T22:53:25.197 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:25.204+0000 7f1685036640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16800d1080 con 0x7f16800d2b10 2024-02-21T22:53:25.197 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:25.204+0000 7f1685036640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16800ceaa0 con 0x7f16800b4790 2024-02-21T22:53:25.197 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:25.204+0000 7f167e59c640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f16800d0ca0 0x7f1680162050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:25.197 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:25.204+0000 7f167e59c640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f16800d0ca0 0x7f1680162050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:38688/0 (socket says 172.21.15.116:38688) 2024-02-21T22:53:25.198 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:25.204+0000 7f167e59c640 1 -- 172.21.15.116:0/4180091193 learned_addr learned my addr 172.21.15.116:0/4180091193 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:25.198 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:25.205+0000 7f167ed9d640 1 --2- 172.21.15.116:0/4180091193 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f16800b4790 0x7f168009dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:25.198 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:25.205+0000 7f167f59e640 1 --2- 172.21.15.116:0/4180091193 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f16800d2b10 0x7f16800cd3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:25.198 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:25.205+0000 7f167e59c640 1 -- 172.21.15.116:0/4180091193 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f16800b4790 msgr2=0x7f168009dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:25.198 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:25.205+0000 7f167e59c640 1 --2- 172.21.15.116:0/4180091193 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f16800b4790 0x7f168009dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:25.198 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:25.205+0000 7f167e59c640 1 -- 172.21.15.116:0/4180091193 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f16800d2b10 msgr2=0x7f16800cd3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:25.198 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:25.205+0000 7f167e59c640 1 --2- 172.21.15.116:0/4180091193 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f16800d2b10 0x7f16800cd3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:25.198 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:25.205+0000 7f167e59c640 1 -- 172.21.15.116:0/4180091193 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16801f4060 con 0x7f16800d0ca0 2024-02-21T22:53:25.198 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:25.205+0000 7f167f59e640 1 --2- 172.21.15.116:0/4180091193 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f16800d2b10 0x7f16800cd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T22:53:25.198 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:25.205+0000 7f167e59c640 1 --2- 172.21.15.116:0/4180091193 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f16800d0ca0 0x7f1680162050 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f167400c460 tx=0x7f167400c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:25.198 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:25.205+0000 7f16677fe640 1 -- 172.21.15.116:0/4180091193 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1674017070 con 0x7f16800d0ca0 2024-02-21T22:53:25.198 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:25.205+0000 7f16677fe640 1 -- 172.21.15.116:0/4180091193 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16740052f0 con 0x7f16800d0ca0 2024-02-21T22:53:25.198 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:25.205+0000 7f16677fe640 1 -- 172.21.15.116:0/4180091193 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1674003830 con 0x7f16800d0ca0 2024-02-21T22:53:25.198 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:25.205+0000 7f1685036640 1 -- 172.21.15.116:0/4180091193 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16801f4340 con 0x7f16800d0ca0 2024-02-21T22:53:25.198 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:25.205+0000 7f1685036640 1 -- 172.21.15.116:0/4180091193 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16801f4900 con 0x7f16800d0ca0 2024-02-21T22:53:25.198 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:25.206+0000 7f1685036640 1 -- 172.21.15.116:0/4180091193 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16800752f0 con 0x7f16800d0ca0 2024-02-21T22:53:25.199 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:25.206+0000 7f16677fe640 1 -- 172.21.15.116:0/4180091193 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f167401a070 con 0x7f16800d0ca0 2024-02-21T22:53:25.199 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:25.207+0000 7f16677fe640 1 --2- 172.21.15.116:0/4180091193 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f166c06b4d0 0x7f166c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:25.199 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:25.207+0000 7f16677fe640 1 -- 172.21.15.116:0/4180091193 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f16740894c0 con 0x7f16800d0ca0 2024-02-21T22:53:25.199 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:25.207+0000 7f167ed9d640 1 --2- 172.21.15.116:0/4180091193 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f166c06b4d0 0x7f166c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:25.199 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:25.207+0000 7f167ed9d640 1 --2- 172.21.15.116:0/4180091193 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f166c06b4d0 0x7f166c06d990 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f16700011e0 tx=0x7f16700016f0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:25.201 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:25.211+0000 7f16677fe640 1 -- 172.21.15.116:0/4180091193 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f1674057d80 con 0x7f16800d0ca0 2024-02-21T22:53:25.376 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:25.386+0000 7f1685036640 1 -- 172.21.15.116:0/4180091193 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f16800d21e0 con 0x7f16800d0ca0 2024-02-21T22:53:25.376 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:25.386+0000 7f16677fe640 1 -- 172.21.15.116:0/4180091193 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f167405be20 con 0x7f16800d0ca0 2024-02-21T22:53:25.377 INFO:teuthology.orchestra.run.smithi116.stdout:pg_num: 64 2024-02-21T22:53:25.379 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:25.388+0000 7f1685036640 1 -- 172.21.15.116:0/4180091193 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f166c06b4d0 msgr2=0x7f166c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:25.379 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:25.388+0000 7f1685036640 1 --2- 172.21.15.116:0/4180091193 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f166c06b4d0 0x7f166c06d990 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f16700011e0 tx=0x7f16700016f0 comp rx=0 tx=0).stop 2024-02-21T22:53:25.379 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:25.388+0000 7f1685036640 1 -- 172.21.15.116:0/4180091193 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f16800d0ca0 msgr2=0x7f1680162050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:25.379 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:25.388+0000 7f1685036640 1 --2- 172.21.15.116:0/4180091193 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f16800d0ca0 0x7f1680162050 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f167400c460 tx=0x7f167400c920 comp rx=0 tx=0).stop 2024-02-21T22:53:25.379 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:25.388+0000 7f1685036640 1 -- 172.21.15.116:0/4180091193 shutdown_connections 2024-02-21T22:53:25.379 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:25.388+0000 7f1685036640 1 --2- 172.21.15.116:0/4180091193 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f16800d2b10 0x7f16800cd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:25.380 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:25.388+0000 7f1685036640 1 --2- 172.21.15.116:0/4180091193 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f16800d0ca0 0x7f1680162050 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:25.380 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:25.388+0000 7f1685036640 1 --2- 172.21.15.116:0/4180091193 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f166c06b4d0 0x7f166c06d990 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:25.380 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:25.388+0000 7f1685036640 1 --2- 172.21.15.116:0/4180091193 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f16800b4790 0x7f168009dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:25.380 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:25.388+0000 7f1685036640 1 -- 172.21.15.116:0/4180091193 >> 172.21.15.116:0/4180091193 conn(0x7f16800d3e20 msgr2=0x7f16800d19d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:25.380 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:25.388+0000 7f1685036640 1 -- 172.21.15.116:0/4180091193 shutdown_connections 2024-02-21T22:53:25.380 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:25.388+0000 7f1685036640 1 -- 172.21.15.116:0/4180091193 wait complete. 2024-02-21T22:53:25.390 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-02-21T22:53:25.490 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:25.500+0000 7faf28f1e640 1 Processor -- start 2024-02-21T22:53:25.491 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:25.500+0000 7faf28f1e640 1 -- start start 2024-02-21T22:53:25.492 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:25.501+0000 7faf28f1e640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7faf24070b70 0x7faf24071580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:25.492 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:25.501+0000 7faf28f1e640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf240710e0 con 0x7faf24071ac0 2024-02-21T22:53:25.492 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:25.501+0000 7faf28f1e640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf240b2d80 con 0x7faf2415afb0 2024-02-21T22:53:25.492 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:25.501+0000 7faf28f1e640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf2415b390 con 0x7faf24070b70 2024-02-21T22:53:25.492 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:25.501+0000 7faf1bfff640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7faf24070b70 0x7faf24071580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:25.492 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:25.501+0000 7faf22d9d640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7faf24071ac0 0x7faf240b3860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:36816/0 (socket says 172.21.15.116:36816) 2024-02-21T22:53:25.493 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:25.501+0000 7faf22d9d640 1 -- 172.21.15.116:0/2067509765 learned_addr learned my addr 172.21.15.116:0/2067509765 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-02-21T22:53:25.493 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:25.501+0000 7faf1bfff640 1 -- 172.21.15.116:0/2067509765 >> v1:172.21.15.142:6789/0 conn(0x7faf2415afb0 legacy=0x7faf240af080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:25.493 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:25.501+0000 7faf1bfff640 1 -- 172.21.15.116:0/2067509765 >> v1:172.21.15.116:6789/0 conn(0x7faf24071ac0 legacy=0x7faf240b3860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:25.493 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:25.501+0000 7faf21d9b640 1 -- 172.21.15.116:0/2067509765 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1174409124 0 0) 0x7faf240710e0 con 0x7faf24071ac0 2024-02-21T22:53:25.493 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:25.501+0000 7faf1bfff640 1 -- 172.21.15.116:0/2067509765 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf240b3060 con 0x7faf24070b70 2024-02-21T22:53:25.496 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:25.502+0000 7faf1bfff640 1 --2- 172.21.15.116:0/2067509765 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faf24070b70 0x7faf24071580 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7faf0c0097d0 tx=0x7faf0c02b9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b843ca87f43eed83 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:25.496 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:25.502+0000 7faf21d9b640 1 -- 172.21.15.116:0/2067509765 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf0c034070 con 0x7faf24070b70 2024-02-21T22:53:25.496 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:25.502+0000 7faf21d9b640 1 -- 172.21.15.116:0/2067509765 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf0c030890 con 0x7faf24070b70 2024-02-21T22:53:25.497 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:25.502+0000 7faf21d9b640 1 -- 172.21.15.116:0/2067509765 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf0c030c60 con 0x7faf24070b70 2024-02-21T22:53:25.497 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:25.503+0000 7faf28f1e640 1 -- 172.21.15.116:0/2067509765 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faf24070b70 msgr2=0x7faf24071580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:25.497 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:25.503+0000 7faf28f1e640 1 --2- 172.21.15.116:0/2067509765 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faf24070b70 0x7faf24071580 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7faf0c0097d0 tx=0x7faf0c02b9d0 comp rx=0 tx=0).stop 2024-02-21T22:53:25.497 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:25.503+0000 7faf28f1e640 1 -- 172.21.15.116:0/2067509765 shutdown_connections 2024-02-21T22:53:25.497 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:25.503+0000 7faf28f1e640 1 --2- 172.21.15.116:0/2067509765 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faf24070b70 0x7faf24071580 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:25.497 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:25.503+0000 7faf28f1e640 1 -- 172.21.15.116:0/2067509765 >> 172.21.15.116:0/2067509765 conn(0x7faf240b18e0 msgr2=0x7faf240b1cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:25.497 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:25.503+0000 7faf28f1e640 1 -- 172.21.15.116:0/2067509765 shutdown_connections 2024-02-21T22:53:25.497 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:25.503+0000 7faf28f1e640 1 -- 172.21.15.116:0/2067509765 wait complete. 2024-02-21T22:53:25.497 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:25.504+0000 7faf28f1e640 1 Processor -- start 2024-02-21T22:53:25.497 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:25.504+0000 7faf28f1e640 1 -- start start 2024-02-21T22:53:25.497 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:25.505+0000 7faf28f1e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faf24070b70 0x7faf240cae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:25.497 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:25.505+0000 7faf28f1e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faf24071ac0 0x7faf24157790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:25.497 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:25.505+0000 7faf28f1e640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faf2415afb0 0x7faf240b2060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:25.497 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:25.505+0000 7faf28f1e640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf240713c0 con 0x7faf2415afb0 2024-02-21T22:53:25.497 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:25.505+0000 7faf28f1e640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf24071f30 con 0x7faf24070b70 2024-02-21T22:53:25.498 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:25.505+0000 7faf28f1e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf240b3f70 con 0x7faf24071ac0 2024-02-21T22:53:25.498 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:25.505+0000 7faf22d9d640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faf2415afb0 0x7faf240b2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:25.498 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:25.505+0000 7faf22d9d640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faf2415afb0 0x7faf240b2060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:36004/0 (socket says 172.21.15.116:36004) 2024-02-21T22:53:25.498 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:25.505+0000 7faf22d9d640 1 -- 172.21.15.116:0/1841223427 learned_addr learned my addr 172.21.15.116:0/1841223427 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:25.498 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:25.505+0000 7faf2259c640 1 --2- 172.21.15.116:0/1841223427 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faf24070b70 0x7faf240cae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:25.498 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:25.505+0000 7faf1bfff640 1 --2- 172.21.15.116:0/1841223427 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faf24071ac0 0x7faf24157790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:25.498 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:25.505+0000 7faf22d9d640 1 -- 172.21.15.116:0/1841223427 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faf24071ac0 msgr2=0x7faf24157790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:25.498 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:25.505+0000 7faf22d9d640 1 --2- 172.21.15.116:0/1841223427 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faf24071ac0 0x7faf24157790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:25.498 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:25.505+0000 7faf22d9d640 1 -- 172.21.15.116:0/1841223427 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faf24070b70 msgr2=0x7faf240cae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:25.498 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:25.505+0000 7faf22d9d640 1 --2- 172.21.15.116:0/1841223427 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faf24070b70 0x7faf240cae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:25.498 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:25.505+0000 7faf22d9d640 1 -- 172.21.15.116:0/1841223427 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf24157cd0 con 0x7faf2415afb0 2024-02-21T22:53:25.498 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:25.505+0000 7faf22d9d640 1 --2- 172.21.15.116:0/1841223427 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faf2415afb0 0x7faf240b2060 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7faf1c00c7a0 tx=0x7faf1c00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:25.498 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:25.505+0000 7faf1affd640 1 -- 172.21.15.116:0/1841223427 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf1c018070 con 0x7faf2415afb0 2024-02-21T22:53:25.498 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:25.505+0000 7faf1affd640 1 -- 172.21.15.116:0/1841223427 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf1c00a640 con 0x7faf2415afb0 2024-02-21T22:53:25.499 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:25.505+0000 7faf28f1e640 1 -- 172.21.15.116:0/1841223427 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf240c9db0 con 0x7faf2415afb0 2024-02-21T22:53:25.499 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:25.505+0000 7faf1affd640 1 -- 172.21.15.116:0/1841223427 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf1c00aab0 con 0x7faf2415afb0 2024-02-21T22:53:25.499 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:25.505+0000 7faf28f1e640 1 -- 172.21.15.116:0/1841223427 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf240ca650 con 0x7faf2415afb0 2024-02-21T22:53:25.499 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:25.506+0000 7faf28f1e640 1 -- 172.21.15.116:0/1841223427 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf240ca1a0 con 0x7faf2415afb0 2024-02-21T22:53:25.500 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:25.507+0000 7faf1affd640 1 -- 172.21.15.116:0/1841223427 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7faf1c01b070 con 0x7faf2415afb0 2024-02-21T22:53:25.500 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:25.507+0000 7faf1affd640 1 --2- 172.21.15.116:0/1841223427 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7faf0406b500 0x7faf0406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:25.501 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:25.507+0000 7faf1affd640 1 -- 172.21.15.116:0/1841223427 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7faf1c089670 con 0x7faf2415afb0 2024-02-21T22:53:25.501 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:25.507+0000 7faf2259c640 1 --2- 172.21.15.116:0/1841223427 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7faf0406b500 0x7faf0406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:25.501 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:25.508+0000 7faf2259c640 1 --2- 172.21.15.116:0/1841223427 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7faf0406b500 0x7faf0406d9c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7faf241588f0 tx=0x7faf14009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:25.502 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:25.511+0000 7faf1affd640 1 -- 172.21.15.116:0/1841223427 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7faf1c057f30 con 0x7faf2415afb0 2024-02-21T22:53:25.685 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:25.694+0000 7faf28f1e640 1 -- 172.21.15.116:0/1841223427 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7faf24158cd0 con 0x7faf2415afb0 2024-02-21T22:53:25.685 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:25.694+0000 7faf1affd640 1 -- 172.21.15.116:0/1841223427 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) v1 ==== 80+0+0 (secure 0 0 0) 0x7faf1c05bfd0 con 0x7faf2415afb0 2024-02-21T22:53:25.685 INFO:teuthology.orchestra.run.smithi116.stderr:listed 0 entries 2024-02-21T22:53:25.687 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:25.696+0000 7faf28f1e640 1 -- 172.21.15.116:0/1841223427 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7faf0406b500 msgr2=0x7faf0406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:25.687 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:25.696+0000 7faf28f1e640 1 --2- 172.21.15.116:0/1841223427 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7faf0406b500 0x7faf0406d9c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7faf241588f0 tx=0x7faf14009040 comp rx=0 tx=0).stop 2024-02-21T22:53:25.687 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:25.696+0000 7faf28f1e640 1 -- 172.21.15.116:0/1841223427 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faf2415afb0 msgr2=0x7faf240b2060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:25.687 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:25.696+0000 7faf28f1e640 1 --2- 172.21.15.116:0/1841223427 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faf2415afb0 0x7faf240b2060 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7faf1c00c7a0 tx=0x7faf1c00cc60 comp rx=0 tx=0).stop 2024-02-21T22:53:25.687 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:25.696+0000 7faf28f1e640 1 -- 172.21.15.116:0/1841223427 shutdown_connections 2024-02-21T22:53:25.687 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:25.696+0000 7faf28f1e640 1 --2- 172.21.15.116:0/1841223427 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faf2415afb0 0x7faf240b2060 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:25.687 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:25.696+0000 7faf28f1e640 1 --2- 172.21.15.116:0/1841223427 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7faf0406b500 0x7faf0406d9c0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:25.687 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:25.696+0000 7faf28f1e640 1 --2- 172.21.15.116:0/1841223427 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faf24071ac0 0x7faf24157790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:25.687 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:25.696+0000 7faf28f1e640 1 --2- 172.21.15.116:0/1841223427 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faf24070b70 0x7faf240cae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:25.687 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:25.696+0000 7faf28f1e640 1 -- 172.21.15.116:0/1841223427 >> 172.21.15.116:0/1841223427 conn(0x7faf240b18e0 msgr2=0x7faf240b4300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:25.688 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:25.696+0000 7faf28f1e640 1 -- 172.21.15.116:0/1841223427 shutdown_connections 2024-02-21T22:53:25.688 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:25.696+0000 7faf28f1e640 1 -- 172.21.15.116:0/1841223427 wait complete. 2024-02-21T22:53:25.697 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-02-21T22:53:25.698 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T22:53:25.698 DEBUG:teuthology.orchestra.run.smithi142:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2024-02-21T22:53:25.726 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi142.front.sepia.ceph.com 2024-02-21T22:53:25.726 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T22:53:25.726 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-02-21T22:53:25.791 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-02-21T22:53:25.791 DEBUG:teuthology.orchestra.run.smithi116:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-21T22:53:25.807 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-02-21T22:53:25.807 DEBUG:teuthology.orchestra.run.smithi116:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-21T22:53:25.862 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-02-21T22:53:25.862 DEBUG:teuthology.orchestra.run.smithi116:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-21T22:53:25.918 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-21T22:53:26.058 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.068+0000 7f1fbb0a2640 1 Processor -- start 2024-02-21T22:53:26.058 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.068+0000 7f1fbb0a2640 1 -- start start 2024-02-21T22:53:26.060 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.068+0000 7f1fbb0a2640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f1fb415e190 0x7f1fb40d4910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:26.060 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.068+0000 7f1fbb0a2640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fb40d1c70 con 0x7f1fb40d23d0 2024-02-21T22:53:26.060 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.068+0000 7f1fbb0a2640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fb40b1150 con 0x7f1fb40b2e40 2024-02-21T22:53:26.060 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.068+0000 7f1fbb0a2640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fb40cea00 con 0x7f1fb415e190 2024-02-21T22:53:26.060 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.069+0000 7f1fb8e3e640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f1fb415e190 0x7f1fb40d4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:26.060 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.069+0000 7f1fb963f640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f1fb40d23d0 0x7f1fb40d27e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:36830/0 (socket says 172.21.15.116:36830) 2024-02-21T22:53:26.061 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.069+0000 7f1fb963f640 1 -- 172.21.15.116:0/2336562710 learned_addr learned my addr 172.21.15.116:0/2336562710 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-02-21T22:53:26.061 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.069+0000 7f1fb8e3e640 1 -- 172.21.15.116:0/2336562710 >> v1:172.21.15.142:6789/0 conn(0x7f1fb40b2e40 legacy=0x7f1fb40b0a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:26.061 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.069+0000 7f1fb8e3e640 1 -- 172.21.15.116:0/2336562710 >> v1:172.21.15.116:6789/0 conn(0x7f1fb40d23d0 legacy=0x7f1fb40d27e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:26.061 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.069+0000 7f1fb8e3e640 1 -- 172.21.15.116:0/2336562710 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fb40d1160 con 0x7f1fb415e190 2024-02-21T22:53:26.061 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.070+0000 7f1fb8e3e640 1 --2- 172.21.15.116:0/2336562710 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1fb415e190 0x7f1fb40d4910 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f1fa80097a0 tx=0x7f1fa802b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89acea3bc7da8076 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:26.061 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.070+0000 7f1fb37fe640 1 -- 172.21.15.116:0/2336562710 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fa8034070 con 0x7f1fb415e190 2024-02-21T22:53:26.061 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.070+0000 7f1fb37fe640 1 -- 172.21.15.116:0/2336562710 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fa8030610 con 0x7f1fb415e190 2024-02-21T22:53:26.061 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.070+0000 7f1fb37fe640 1 -- 172.21.15.116:0/2336562710 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fa80309e0 con 0x7f1fb415e190 2024-02-21T22:53:26.065 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.070+0000 7f1fbb0a2640 1 -- 172.21.15.116:0/2336562710 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1fb415e190 msgr2=0x7f1fb40d4910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:26.065 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.070+0000 7f1fbb0a2640 1 --2- 172.21.15.116:0/2336562710 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1fb415e190 0x7f1fb40d4910 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f1fa80097a0 tx=0x7f1fa802b960 comp rx=0 tx=0).stop 2024-02-21T22:53:26.065 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.070+0000 7f1fbb0a2640 1 -- 172.21.15.116:0/2336562710 shutdown_connections 2024-02-21T22:53:26.065 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.070+0000 7f1fbb0a2640 1 --2- 172.21.15.116:0/2336562710 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1fb415e190 0x7f1fb40d4910 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:26.065 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.070+0000 7f1fbb0a2640 1 -- 172.21.15.116:0/2336562710 >> 172.21.15.116:0/2336562710 conn(0x7f1fb40d3df0 msgr2=0x7f1fb40d4200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:26.066 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.070+0000 7f1fbb0a2640 1 -- 172.21.15.116:0/2336562710 shutdown_connections 2024-02-21T22:53:26.066 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.070+0000 7f1fbb0a2640 1 -- 172.21.15.116:0/2336562710 wait complete. 2024-02-21T22:53:26.066 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.071+0000 7f1fbb0a2640 1 Processor -- start 2024-02-21T22:53:26.066 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.071+0000 7f1fbb0a2640 1 -- start start 2024-02-21T22:53:26.066 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.072+0000 7f1fbb0a2640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1fb40b2e40 0x7f1fb40b5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:26.066 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.072+0000 7f1fbb0a2640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1fb40d23d0 0x7f1fb40b3320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:26.066 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.072+0000 7f1fbb0a2640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1fb415e190 0x7f1fb4157fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:26.066 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.072+0000 7f1fbb0a2640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fb40d21f0 con 0x7f1fb40d23d0 2024-02-21T22:53:26.066 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.072+0000 7f1fbb0a2640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fb40cefa0 con 0x7f1fb40b2e40 2024-02-21T22:53:26.066 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.072+0000 7f1fbb0a2640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fb40cec30 con 0x7f1fb415e190 2024-02-21T22:53:26.066 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.072+0000 7f1fb3fff640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1fb40d23d0 0x7f1fb40b3320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:26.066 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.072+0000 7f1fb3fff640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1fb40d23d0 0x7f1fb40b3320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:36010/0 (socket says 172.21.15.116:36010) 2024-02-21T22:53:26.067 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.072+0000 7f1fb3fff640 1 -- 172.21.15.116:0/2258366865 learned_addr learned my addr 172.21.15.116:0/2258366865 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:26.067 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.072+0000 7f1fb8e3e640 1 --2- 172.21.15.116:0/2258366865 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1fb40b2e40 0x7f1fb40b5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:26.067 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.072+0000 7f1fb963f640 1 --2- 172.21.15.116:0/2258366865 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1fb415e190 0x7f1fb4157fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:26.067 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.073+0000 7f1fb3fff640 1 -- 172.21.15.116:0/2258366865 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1fb415e190 msgr2=0x7f1fb4157fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:26.067 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.073+0000 7f1fb3fff640 1 --2- 172.21.15.116:0/2258366865 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1fb415e190 0x7f1fb4157fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:26.067 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.073+0000 7f1fb3fff640 1 -- 172.21.15.116:0/2258366865 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1fb40b2e40 msgr2=0x7f1fb40b5150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:26.067 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.073+0000 7f1fb3fff640 1 --2- 172.21.15.116:0/2258366865 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1fb40b2e40 0x7f1fb40b5150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:26.067 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.073+0000 7f1fb3fff640 1 -- 172.21.15.116:0/2258366865 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fb40b3a90 con 0x7f1fb40d23d0 2024-02-21T22:53:26.067 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.073+0000 7f1fb8e3e640 1 --2- 172.21.15.116:0/2258366865 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1fb40b2e40 0x7f1fb40b5150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T22:53:26.067 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.073+0000 7f1fb3fff640 1 --2- 172.21.15.116:0/2258366865 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1fb40d23d0 0x7f1fb40b3320 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f1fa000c460 tx=0x7f1fa000c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:26.067 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.073+0000 7f1fb17fa640 1 -- 172.21.15.116:0/2258366865 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fa00052d0 con 0x7f1fb40d23d0 2024-02-21T22:53:26.067 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.073+0000 7f1fb17fa640 1 -- 172.21.15.116:0/2258366865 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fa0012630 con 0x7f1fb40d23d0 2024-02-21T22:53:26.067 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.073+0000 7f1fbb0a2640 1 -- 172.21.15.116:0/2258366865 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fb40b3d70 con 0x7f1fb40d23d0 2024-02-21T22:53:26.067 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.073+0000 7f1fb17fa640 1 -- 172.21.15.116:0/2258366865 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fa00054b0 con 0x7f1fb40d23d0 2024-02-21T22:53:26.067 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.073+0000 7f1fbb0a2640 1 -- 172.21.15.116:0/2258366865 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fb406c000 con 0x7f1fb40d23d0 2024-02-21T22:53:26.068 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.074+0000 7f1fbb0a2640 1 -- 172.21.15.116:0/2258366865 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fb40752f0 con 0x7f1fb40d23d0 2024-02-21T22:53:26.068 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.074+0000 7f1fb17fa640 1 -- 172.21.15.116:0/2258366865 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f1fa0012a20 con 0x7f1fb40d23d0 2024-02-21T22:53:26.068 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.075+0000 7f1fb17fa640 1 --2- 172.21.15.116:0/2258366865 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f1f9806b4d0 0x7f1f9806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:26.068 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.075+0000 7f1fb8e3e640 1 --2- 172.21.15.116:0/2258366865 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f1f9806b4d0 0x7f1f9806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:26.068 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.075+0000 7f1fb17fa640 1 -- 172.21.15.116:0/2258366865 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1fa0089b60 con 0x7f1fb40d23d0 2024-02-21T22:53:26.068 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.075+0000 7f1fb8e3e640 1 --2- 172.21.15.116:0/2258366865 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f1f9806b4d0 0x7f1f9806d990 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f1fa8036000 tx=0x7f1fa803b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:26.070 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.079+0000 7f1fb17fa640 1 -- 172.21.15.116:0/2258366865 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f1fa0058420 con 0x7f1fb40d23d0 2024-02-21T22:53:26.240 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.250+0000 7f1fbb0a2640 1 -- 172.21.15.116:0/2258366865 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1fb408d5d0 con 0x7f1fb40d23d0 2024-02-21T22:53:26.242 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.251+0000 7f1fb17fa640 1 -- 172.21.15.116:0/2258366865 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16653 (secure 0 0 0) 0x7f1fa005c4c0 con 0x7f1fb40d23d0 2024-02-21T22:53:26.242 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-02-21T22:53:26.242 INFO:teuthology.orchestra.run.smithi116.stdout:{"epoch":20,"fsid":"7c298660-5f63-4b5c-a800-58c5be9a8445","created":"2024-02-21T22:52:25.994613+0000","modified":"2024-02-21T22:52:51.786454+0000","last_up_change":"2024-02-21T22:52:37.313595+0000","last_in_change":"2024-02-21T22:52:28.176031+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-21T22:52:38.328796+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-21T22:52:48.145152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-21T22:52:49.096955+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4f09126b-b5e4-4876-8b08-f5cbb967388a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":1613202231},{"type":"v1","addr":"172.21.15.116:6809","nonce":1613202231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":1613202231},{"type":"v1","addr":"172.21.15.116:6811","nonce":1613202231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":1613202231},{"type":"v1","addr":"172.21.15.116:6815","nonce":1613202231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":1613202231},{"type":"v1","addr":"172.21.15.116:6813","nonce":1613202231}]},"public_addr":"172.21.15.116:6809/1613202231","cluster_addr":"172.21.15.116:6811/1613202231","heartbeat_back_addr":"172.21.15.116:6815/1613202231","heartbeat_front_addr":"172.21.15.116:6813/1613202231","state":["exists","up"]},{"osd":1,"uuid":"7272c51d-51f9-4536-931d-33ad7a4b377e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6816","nonce":172614746},{"type":"v1","addr":"172.21.15.116:6817","nonce":172614746}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":172614746},{"type":"v1","addr":"172.21.15.116:6819","nonce":172614746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":172614746},{"type":"v1","addr":"172.21.15.116:6823","nonce":172614746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":172614746},{"type":"v1","addr":"172.21.15.116:6821","nonce":172614746}]},"public_addr":"172.21.15.116:6817/172614746","cluster_addr":"172.21.15.116:6819/172614746","heartbeat_back_addr":"172.21.15.116:6823/172614746","heartbeat_front_addr":"172.21.15.116:6821/172614746","state":["exists","up"]},{"osd":2,"uuid":"2589616c-adf1-4187-aac3-735256cf624b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":1029280577},{"type":"v1","addr":"172.21.15.116:6825","nonce":1029280577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":1029280577},{"type":"v1","addr":"172.21.15.116:6827","nonce":1029280577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":1029280577},{"type":"v1","addr":"172.21.15.116:6831","nonce":1029280577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":1029280577},{"type":"v1","addr":"172.21.15.116:6829","nonce":1029280577}]},"public_addr":"172.21.15.116:6825/1029280577","cluster_addr":"172.21.15.116:6827/1029280577","heartbeat_back_addr":"172.21.15.116:6831/1029280577","heartbeat_front_addr":"172.21.15.116:6829/1029280577","state":["exists","up"]},{"osd":3,"uuid":"0fd2e563-7c5b-46f6-82c2-b60c86072c93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":3106627557},{"type":"v1","addr":"172.21.15.116:6801","nonce":3106627557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":3106627557},{"type":"v1","addr":"172.21.15.116:6803","nonce":3106627557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":3106627557},{"type":"v1","addr":"172.21.15.116:6807","nonce":3106627557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":3106627557},{"type":"v1","addr":"172.21.15.116:6805","nonce":3106627557}]},"public_addr":"172.21.15.116:6801/3106627557","cluster_addr":"172.21.15.116:6803/3106627557","heartbeat_back_addr":"172.21.15.116:6807/3106627557","heartbeat_front_addr":"172.21.15.116:6805/3106627557","state":["exists","up"]},{"osd":4,"uuid":"79ae35b7-dda8-4ab8-96ce-47515afde082","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":3231407772},{"type":"v1","addr":"172.21.15.142:6825","nonce":3231407772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":3231407772},{"type":"v1","addr":"172.21.15.142:6827","nonce":3231407772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":3231407772},{"type":"v1","addr":"172.21.15.142:6831","nonce":3231407772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":3231407772},{"type":"v1","addr":"172.21.15.142:6829","nonce":3231407772}]},"public_addr":"172.21.15.142:6825/3231407772","cluster_addr":"172.21.15.142:6827/3231407772","heartbeat_back_addr":"172.21.15.142:6831/3231407772","heartbeat_front_addr":"172.21.15.142:6829/3231407772","state":["exists","up"]},{"osd":5,"uuid":"3166eb2c-3fcf-41c8-9362-45bafaabaa39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":1184158716},{"type":"v1","addr":"172.21.15.142:6817","nonce":1184158716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":1184158716},{"type":"v1","addr":"172.21.15.142:6819","nonce":1184158716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":1184158716},{"type":"v1","addr":"172.21.15.142:6823","nonce":1184158716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":1184158716},{"type":"v1","addr":"172.21.15.142:6821","nonce":1184158716}]},"public_addr":"172.21.15.142:6817/1184158716","cluster_addr":"172.21.15.142:6819/1184158716","heartbeat_back_addr":"172.21.15.142:6823/1184158716","heartbeat_front_addr":"172.21.15.142:6821/1184158716","state":["exists","up"]},{"osd":6,"uuid":"f9aa9672-7527-43e2-963e-b61868e5e63f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":1987868911},{"type":"v1","addr":"172.21.15.142:6801","nonce":1987868911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":1987868911},{"type":"v1","addr":"172.21.15.142:6803","nonce":1987868911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":1987868911},{"type":"v1","addr":"172.21.15.142:6807","nonce":1987868911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":1987868911},{"type":"v1","addr":"172.21.15.142:6805","nonce":1987868911}]},"public_addr":"172.21.15.142:6801/1987868911","cluster_addr":"172.21.15.142:6803/1987868911","heartbeat_back_addr":"172.21.15.142:6807/1987868911","heartbeat_front_addr":"172.21.15.142:6805/1987868911","state":["exists","up"]},{"osd":7,"uuid":"7ed29226-fc42-4382-a91a-fa50f7ec5426","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":1272081937},{"type":"v1","addr":"172.21.15.142:6809","nonce":1272081937}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":1272081937},{"type":"v1","addr":"172.21.15.142:6811","nonce":1272081937}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":1272081937},{"type":"v1","addr":"172.21.15.142:6815","nonce":1272081937}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":1272081937},{"type":"v1","addr":"172.21.15.142:6813","nonce":1272081937}]},"public_addr":"172.21.15.142:6809/1272081937","cluster_addr":"172.21.15.142:6811/1272081937","heartbeat_back_addr":"172.21.15.142:6815/1272081937","heartbeat_front_addr":"172.21.15.142:6813/1272081937","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.350998+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.307201+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.289112+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.243888+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.312091+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.370472+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.275659+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.289297+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-21T22:53:26.244 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.253+0000 7f1fbb0a2640 1 -- 172.21.15.116:0/2258366865 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f1f9806b4d0 msgr2=0x7f1f9806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:26.244 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.253+0000 7f1fbb0a2640 1 --2- 172.21.15.116:0/2258366865 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f1f9806b4d0 0x7f1f9806d990 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f1fa8036000 tx=0x7f1fa803b040 comp rx=0 tx=0).stop 2024-02-21T22:53:26.244 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.253+0000 7f1fbb0a2640 1 -- 172.21.15.116:0/2258366865 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1fb40d23d0 msgr2=0x7f1fb40b3320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:26.244 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.253+0000 7f1fbb0a2640 1 --2- 172.21.15.116:0/2258366865 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1fb40d23d0 0x7f1fb40b3320 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f1fa000c460 tx=0x7f1fa000c920 comp rx=0 tx=0).stop 2024-02-21T22:53:26.244 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.253+0000 7f1fbb0a2640 1 -- 172.21.15.116:0/2258366865 shutdown_connections 2024-02-21T22:53:26.244 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.253+0000 7f1fbb0a2640 1 --2- 172.21.15.116:0/2258366865 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f1f9806b4d0 0x7f1f9806d990 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:26.245 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.253+0000 7f1fbb0a2640 1 --2- 172.21.15.116:0/2258366865 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1fb415e190 0x7f1fb4157fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:26.245 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.253+0000 7f1fbb0a2640 1 --2- 172.21.15.116:0/2258366865 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1fb40d23d0 0x7f1fb40b3320 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:26.245 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.253+0000 7f1fbb0a2640 1 --2- 172.21.15.116:0/2258366865 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1fb40b2e40 0x7f1fb40b5150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:26.245 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.253+0000 7f1fbb0a2640 1 -- 172.21.15.116:0/2258366865 >> 172.21.15.116:0/2258366865 conn(0x7f1fb40d3df0 msgr2=0x7f1fb40cf430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:26.245 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.253+0000 7f1fbb0a2640 1 -- 172.21.15.116:0/2258366865 shutdown_connections 2024-02-21T22:53:26.245 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.253+0000 7f1fbb0a2640 1 -- 172.21.15.116:0/2258366865 wait complete. 2024-02-21T22:53:26.255 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-21T22:52:38.328796+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-02-21T22:52:48.145152+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-02-21T22:52:49.096955+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-21T22:53:26.255 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-21T22:53:26.359 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.368+0000 7ff15ab68640 1 Processor -- start 2024-02-21T22:53:26.359 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.368+0000 7ff15ab68640 1 -- start start 2024-02-21T22:53:26.361 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.369+0000 7ff15ab68640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7ff15415f720 0x7ff1540724f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:26.361 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.369+0000 7ff15ab68640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff1540b3d70 0x7ff1540ad0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:26.361 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.369+0000 7ff15ab68640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff15406b370 con 0x7ff1540ad610 2024-02-21T22:53:26.361 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.369+0000 7ff15ab68640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff15415fb00 con 0x7ff15415f720 2024-02-21T22:53:26.361 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.369+0000 7ff15ab68640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff15406ae40 con 0x7ff1540b3d70 2024-02-21T22:53:26.361 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.369+0000 7ff158904640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7ff15415f720 0x7ff1540724f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:26.362 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.369+0000 7ff159105640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7ff1540ad610 0x7ff1540d0150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:36842/0 (socket says 172.21.15.116:36842) 2024-02-21T22:53:26.362 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.369+0000 7ff159105640 1 -- 172.21.15.116:0/208113178 learned_addr learned my addr 172.21.15.116:0/208113178 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-02-21T22:53:26.362 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.369+0000 7ff153fff640 1 --2- 172.21.15.116:0/208113178 >> v2:172.21.15.142:3300/0 conn(0x7ff1540b3d70 0x7ff1540ad0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:26.362 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.369+0000 7ff153fff640 1 -- 172.21.15.116:0/208113178 >> v2:172.21.15.116:3300/0 conn(0x7ff15415f720 msgr2=0x7ff1540724f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:53:26.362 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.369+0000 7ff153fff640 1 --2- 172.21.15.116:0/208113178 >> v2:172.21.15.116:3300/0 conn(0x7ff15415f720 0x7ff1540724f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:26.362 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.369+0000 7ff153fff640 1 -- 172.21.15.116:0/208113178 >> v1:172.21.15.116:6789/0 conn(0x7ff1540ad610 legacy=0x7ff1540d0150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:26.362 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.369+0000 7ff153fff640 1 -- 172.21.15.116:0/208113178 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff154066e70 con 0x7ff1540b3d70 2024-02-21T22:53:26.362 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.369+0000 7ff1537fe640 1 -- 172.21.15.116:0/208113178 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3269564820 0 0) 0x7ff15406b370 con 0x7ff1540ad610 2024-02-21T22:53:26.362 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.369+0000 7ff158904640 1 --2- 172.21.15.116:0/208113178 >> v2:172.21.15.116:3300/0 conn(0x7ff15415f720 0x7ff1540724f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T22:53:26.362 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.370+0000 7ff153fff640 1 --2- 172.21.15.116:0/208113178 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff1540b3d70 0x7ff1540ad0d0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7ff154070b10 tx=0x7ff14002b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8b606ee5a2a1d959 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:26.362 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.370+0000 7ff1537fe640 1 -- 172.21.15.116:0/208113178 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1400315a0 con 0x7ff1540b3d70 2024-02-21T22:53:26.362 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.370+0000 7ff1537fe640 1 -- 172.21.15.116:0/208113178 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff140037070 con 0x7ff1540b3d70 2024-02-21T22:53:26.362 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.370+0000 7ff1537fe640 1 -- 172.21.15.116:0/208113178 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff140031960 con 0x7ff1540b3d70 2024-02-21T22:53:26.362 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.371+0000 7ff15ab68640 1 -- 172.21.15.116:0/208113178 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff1540b3d70 msgr2=0x7ff1540ad0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:26.363 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.371+0000 7ff15ab68640 1 --2- 172.21.15.116:0/208113178 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff1540b3d70 0x7ff1540ad0d0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7ff154070b10 tx=0x7ff14002b840 comp rx=0 tx=0).stop 2024-02-21T22:53:26.363 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.371+0000 7ff15ab68640 1 -- 172.21.15.116:0/208113178 shutdown_connections 2024-02-21T22:53:26.363 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.371+0000 7ff15ab68640 1 --2- 172.21.15.116:0/208113178 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff1540b3d70 0x7ff1540ad0d0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:26.363 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.371+0000 7ff15ab68640 1 --2- 172.21.15.116:0/208113178 >> v2:172.21.15.116:3300/0 conn(0x7ff15415f720 0x7ff1540724f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:26.363 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.371+0000 7ff15ab68640 1 -- 172.21.15.116:0/208113178 >> 172.21.15.116:0/208113178 conn(0x7ff1540b3250 msgr2=0x7ff1540b3660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:26.363 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.371+0000 7ff15ab68640 1 -- 172.21.15.116:0/208113178 shutdown_connections 2024-02-21T22:53:26.363 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.371+0000 7ff15ab68640 1 -- 172.21.15.116:0/208113178 wait complete. 2024-02-21T22:53:26.367 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.372+0000 7ff15ab68640 1 Processor -- start 2024-02-21T22:53:26.367 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.372+0000 7ff15ab68640 1 -- start start 2024-02-21T22:53:26.367 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.373+0000 7ff15ab68640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff1540ad610 0x7ff1540ca930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:26.367 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.373+0000 7ff15ab68640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff1540b3d70 0x7ff1541f49f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:26.367 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.373+0000 7ff15ab68640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff15415f720 0x7ff1540c8930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:26.367 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.373+0000 7ff15ab68640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff15406b090 con 0x7ff1540ad610 2024-02-21T22:53:26.368 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.373+0000 7ff15ab68640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1540731c0 con 0x7ff1540b3d70 2024-02-21T22:53:26.368 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.373+0000 7ff15ab68640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1540ada60 con 0x7ff15415f720 2024-02-21T22:53:26.368 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.373+0000 7ff158904640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff1540ad610 0x7ff1540ca930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:26.368 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.373+0000 7ff158904640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff1540ad610 0x7ff1540ca930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:36026/0 (socket says 172.21.15.116:36026) 2024-02-21T22:53:26.368 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.373+0000 7ff158904640 1 -- 172.21.15.116:0/724234128 learned_addr learned my addr 172.21.15.116:0/724234128 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:26.368 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.373+0000 7ff153fff640 1 --2- 172.21.15.116:0/724234128 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff1540b3d70 0x7ff1541f49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:26.368 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.373+0000 7ff159105640 1 --2- 172.21.15.116:0/724234128 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff15415f720 0x7ff1540c8930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:26.368 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.373+0000 7ff158904640 1 -- 172.21.15.116:0/724234128 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff15415f720 msgr2=0x7ff1540c8930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:26.369 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.373+0000 7ff158904640 1 --2- 172.21.15.116:0/724234128 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff15415f720 0x7ff1540c8930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:26.369 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.373+0000 7ff158904640 1 -- 172.21.15.116:0/724234128 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff1540b3d70 msgr2=0x7ff1541f49f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:26.369 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.373+0000 7ff158904640 1 --2- 172.21.15.116:0/724234128 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff1540b3d70 0x7ff1541f49f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:26.369 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.373+0000 7ff158904640 1 -- 172.21.15.116:0/724234128 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1540c9580 con 0x7ff1540ad610 2024-02-21T22:53:26.369 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.373+0000 7ff158904640 1 --2- 172.21.15.116:0/724234128 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff1540ad610 0x7ff1540ca930 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7ff14800ec10 tx=0x7ff14800c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:26.369 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.373+0000 7ff1517fa640 1 -- 172.21.15.116:0/724234128 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff148017070 con 0x7ff1540ad610 2024-02-21T22:53:26.369 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.374+0000 7ff15ab68640 1 -- 172.21.15.116:0/724234128 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1540c9840 con 0x7ff1540ad610 2024-02-21T22:53:26.369 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.374+0000 7ff1517fa640 1 -- 172.21.15.116:0/724234128 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff14800cc30 con 0x7ff1540ad610 2024-02-21T22:53:26.369 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.374+0000 7ff1517fa640 1 -- 172.21.15.116:0/724234128 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff148013470 con 0x7ff1540ad610 2024-02-21T22:53:26.369 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.374+0000 7ff15ab68640 1 -- 172.21.15.116:0/724234128 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1540c8e70 con 0x7ff1540ad610 2024-02-21T22:53:26.370 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.374+0000 7ff15ab68640 1 -- 172.21.15.116:0/724234128 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff154070be0 con 0x7ff1540ad610 2024-02-21T22:53:26.370 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.375+0000 7ff1517fa640 1 -- 172.21.15.116:0/724234128 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ff14801a070 con 0x7ff1540ad610 2024-02-21T22:53:26.370 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.375+0000 7ff1517fa640 1 --2- 172.21.15.116:0/724234128 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7ff13806b500 0x7ff13806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:26.370 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.375+0000 7ff1517fa640 1 -- 172.21.15.116:0/724234128 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff14808a0f0 con 0x7ff1540ad610 2024-02-21T22:53:26.370 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.375+0000 7ff153fff640 1 --2- 172.21.15.116:0/724234128 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7ff13806b500 0x7ff13806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:26.370 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.376+0000 7ff153fff640 1 --2- 172.21.15.116:0/724234128 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7ff13806b500 0x7ff13806d9c0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7ff140036000 tx=0x7ff140008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:26.370 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.379+0000 7ff1517fa640 1 -- 172.21.15.116:0/724234128 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7ff154070be0 con 0x7ff1540ad610 2024-02-21T22:53:26.540 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.550+0000 7ff15ab68640 1 -- 172.21.15.116:0/724234128 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff1540b2880 con 0x7ff1540ad610 2024-02-21T22:53:26.541 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.550+0000 7ff1517fa640 1 -- 172.21.15.116:0/724234128 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff1540b2880 con 0x7ff1540ad610 2024-02-21T22:53:26.541 INFO:teuthology.orchestra.run.smithi116.stdout:pg_num: 1 2024-02-21T22:53:26.543 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.552+0000 7ff15ab68640 1 -- 172.21.15.116:0/724234128 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7ff13806b500 msgr2=0x7ff13806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:26.543 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.552+0000 7ff15ab68640 1 --2- 172.21.15.116:0/724234128 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7ff13806b500 0x7ff13806d9c0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7ff140036000 tx=0x7ff140008030 comp rx=0 tx=0).stop 2024-02-21T22:53:26.543 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.552+0000 7ff15ab68640 1 -- 172.21.15.116:0/724234128 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff1540ad610 msgr2=0x7ff1540ca930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:26.544 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.552+0000 7ff15ab68640 1 --2- 172.21.15.116:0/724234128 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff1540ad610 0x7ff1540ca930 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7ff14800ec10 tx=0x7ff14800c520 comp rx=0 tx=0).stop 2024-02-21T22:53:26.544 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.553+0000 7ff15ab68640 1 -- 172.21.15.116:0/724234128 shutdown_connections 2024-02-21T22:53:26.544 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.553+0000 7ff15ab68640 1 --2- 172.21.15.116:0/724234128 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7ff13806b500 0x7ff13806d9c0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:26.544 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.553+0000 7ff15ab68640 1 --2- 172.21.15.116:0/724234128 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff15415f720 0x7ff1540c8930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:26.544 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.553+0000 7ff15ab68640 1 --2- 172.21.15.116:0/724234128 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff1540b3d70 0x7ff1541f49f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:26.544 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.553+0000 7ff15ab68640 1 --2- 172.21.15.116:0/724234128 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff1540ad610 0x7ff1540ca930 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:26.544 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.553+0000 7ff15ab68640 1 -- 172.21.15.116:0/724234128 >> 172.21.15.116:0/724234128 conn(0x7ff1540b3250 msgr2=0x7ff1540adce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:26.544 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.553+0000 7ff15ab68640 1 -- 172.21.15.116:0/724234128 shutdown_connections 2024-02-21T22:53:26.544 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.553+0000 7ff15ab68640 1 -- 172.21.15.116:0/724234128 wait complete. 2024-02-21T22:53:26.554 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-02-21T22:53:26.658 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.667+0000 7f7bf98c8640 1 Processor -- start 2024-02-21T22:53:26.658 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.667+0000 7f7bf98c8640 1 -- start start 2024-02-21T22:53:26.660 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.668+0000 7f7bf98c8640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f7bf40d2b10 0x7f7bf40d4940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:26.660 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.668+0000 7f7bf98c8640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bf40ceea0 con 0x7f7bf415da70 2024-02-21T22:53:26.660 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.668+0000 7f7bf98c8640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bf40cf180 con 0x7f7bf40d0ca0 2024-02-21T22:53:26.660 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.668+0000 7f7bf98c8640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bf40cf460 con 0x7f7bf40d2b10 2024-02-21T22:53:26.660 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.668+0000 7f7bf37fe640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f7bf415da70 0x7f7bf415dee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:36852/0 (socket says 172.21.15.116:36852) 2024-02-21T22:53:26.660 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.668+0000 7f7bf37fe640 1 -- 172.21.15.116:0/2328043330 learned_addr learned my addr 172.21.15.116:0/2328043330 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-02-21T22:53:26.660 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.668+0000 7f7bf27fc640 1 --2- 172.21.15.116:0/2328043330 >> v2:172.21.15.142:3300/0 conn(0x7f7bf40d2b10 0x7f7bf40d4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:26.660 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.668+0000 7f7bf1ffb640 1 -- 172.21.15.116:0/2328043330 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1092211068 0 0) 0x7f7bf40ceea0 con 0x7f7bf415da70 2024-02-21T22:53:26.660 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.668+0000 7f7bf1ffb640 1 -- 172.21.15.116:0/2328043330 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7bdc003520 con 0x7f7bf415da70 2024-02-21T22:53:26.660 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.668+0000 7f7bf27fc640 1 -- 172.21.15.116:0/2328043330 >> v1:172.21.15.142:6789/0 conn(0x7f7bf40d0ca0 legacy=0x7f7bf40d2400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:26.661 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.668+0000 7f7bf1ffb640 1 -- 172.21.15.116:0/2328043330 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2516796782 0 0) 0x7f7bf40cf180 con 0x7f7bf40d0ca0 2024-02-21T22:53:26.661 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.668+0000 7f7bf27fc640 1 -- 172.21.15.116:0/2328043330 >> v1:172.21.15.116:6789/0 conn(0x7f7bf415da70 legacy=0x7f7bf415dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:26.661 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.668+0000 7f7bf27fc640 1 -- 172.21.15.116:0/2328043330 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bf40cf740 con 0x7f7bf40d2b10 2024-02-21T22:53:26.661 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.669+0000 7f7bf27fc640 1 --2- 172.21.15.116:0/2328043330 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7bf40d2b10 0x7f7bf40d4940 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f7be80097a0 tx=0x7f7be802b9f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ce251f7e15dbf85d server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:26.661 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.669+0000 7f7bf1ffb640 1 -- 172.21.15.116:0/2328043330 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7be802f810 con 0x7f7bf40d2b10 2024-02-21T22:53:26.661 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.669+0000 7f7bf1ffb640 1 -- 172.21.15.116:0/2328043330 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7be802f9b0 con 0x7f7bf40d2b10 2024-02-21T22:53:26.661 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.669+0000 7f7bf1ffb640 1 -- 172.21.15.116:0/2328043330 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7be802fd60 con 0x7f7bf40d2b10 2024-02-21T22:53:26.664 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.670+0000 7f7bf98c8640 1 -- 172.21.15.116:0/2328043330 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7bf40d2b10 msgr2=0x7f7bf40d4940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:26.664 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.670+0000 7f7bf98c8640 1 --2- 172.21.15.116:0/2328043330 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7bf40d2b10 0x7f7bf40d4940 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f7be80097a0 tx=0x7f7be802b9f0 comp rx=0 tx=0).stop 2024-02-21T22:53:26.664 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.670+0000 7f7bf98c8640 1 -- 172.21.15.116:0/2328043330 shutdown_connections 2024-02-21T22:53:26.664 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.670+0000 7f7bf98c8640 1 --2- 172.21.15.116:0/2328043330 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7bf40d2b10 0x7f7bf40d4940 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:26.665 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.670+0000 7f7bf98c8640 1 -- 172.21.15.116:0/2328043330 >> 172.21.15.116:0/2328043330 conn(0x7f7bf40d3e20 msgr2=0x7f7bf40d4230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:26.665 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.670+0000 7f7bf98c8640 1 -- 172.21.15.116:0/2328043330 shutdown_connections 2024-02-21T22:53:26.665 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.670+0000 7f7bf98c8640 1 -- 172.21.15.116:0/2328043330 wait complete. 2024-02-21T22:53:26.665 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.671+0000 7f7bf98c8640 1 Processor -- start 2024-02-21T22:53:26.665 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.671+0000 7f7bf98c8640 1 -- start start 2024-02-21T22:53:26.665 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.672+0000 7f7bf98c8640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7bf40d0ca0 0x7f7bf414d370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:26.665 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.672+0000 7f7bf98c8640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7bf40d2b10 0x7f7bf40b24a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:26.665 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.672+0000 7f7bf98c8640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7bf415da70 0x7f7bf40b29e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:26.665 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.672+0000 7f7bf98c8640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bf40d1200 con 0x7f7bf40d2b10 2024-02-21T22:53:26.665 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.672+0000 7f7bf98c8640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bf40d1080 con 0x7f7bf40d0ca0 2024-02-21T22:53:26.665 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.672+0000 7f7bf98c8640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bf40ceaa0 con 0x7f7bf415da70 2024-02-21T22:53:26.665 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.672+0000 7f7bf27fc640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7bf40d2b10 0x7f7bf40b24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:26.665 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.672+0000 7f7bf27fc640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7bf40d2b10 0x7f7bf40b24a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:36032/0 (socket says 172.21.15.116:36032) 2024-02-21T22:53:26.665 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.672+0000 7f7bf27fc640 1 -- 172.21.15.116:0/342332119 learned_addr learned my addr 172.21.15.116:0/342332119 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:26.666 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.672+0000 7f7bf2ffd640 1 --2- 172.21.15.116:0/342332119 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7bf40d0ca0 0x7f7bf414d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:26.666 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.672+0000 7f7bf37fe640 1 --2- 172.21.15.116:0/342332119 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7bf415da70 0x7f7bf40b29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:26.666 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.672+0000 7f7bf27fc640 1 -- 172.21.15.116:0/342332119 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7bf415da70 msgr2=0x7f7bf40b29e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:26.666 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.672+0000 7f7bf27fc640 1 --2- 172.21.15.116:0/342332119 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7bf415da70 0x7f7bf40b29e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:26.666 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.672+0000 7f7bf27fc640 1 -- 172.21.15.116:0/342332119 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7bf40d0ca0 msgr2=0x7f7bf414d370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:26.666 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.672+0000 7f7bf27fc640 1 --2- 172.21.15.116:0/342332119 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7bf40d0ca0 0x7f7bf414d370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:26.666 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.672+0000 7f7bf27fc640 1 -- 172.21.15.116:0/342332119 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bf40b7950 con 0x7f7bf40d2b10 2024-02-21T22:53:26.666 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.672+0000 7f7bf2ffd640 1 --2- 172.21.15.116:0/342332119 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7bf40d0ca0 0x7f7bf414d370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T22:53:26.666 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.673+0000 7f7bf27fc640 1 --2- 172.21.15.116:0/342332119 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7bf40d2b10 0x7f7bf40b24a0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f7be80098c0 tx=0x7f7be80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:26.666 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.673+0000 7f7bdbfff640 1 -- 172.21.15.116:0/342332119 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7be8037810 con 0x7f7bf40d2b10 2024-02-21T22:53:26.666 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.673+0000 7f7bdbfff640 1 -- 172.21.15.116:0/342332119 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7be803d040 con 0x7f7bf40d2b10 2024-02-21T22:53:26.666 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.673+0000 7f7bf98c8640 1 -- 172.21.15.116:0/342332119 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bf40b7c30 con 0x7f7bf40d2b10 2024-02-21T22:53:26.666 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.673+0000 7f7bdbfff640 1 -- 172.21.15.116:0/342332119 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7be8037bf0 con 0x7f7bf40d2b10 2024-02-21T22:53:26.666 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.673+0000 7f7bf98c8640 1 -- 172.21.15.116:0/342332119 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bf40b81f0 con 0x7f7bf40d2b10 2024-02-21T22:53:26.666 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.674+0000 7f7bf98c8640 1 -- 172.21.15.116:0/342332119 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bf40752f0 con 0x7f7bf40d2b10 2024-02-21T22:53:26.667 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.674+0000 7f7bdbfff640 1 -- 172.21.15.116:0/342332119 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f7be8043440 con 0x7f7bf40d2b10 2024-02-21T22:53:26.667 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.674+0000 7f7bdbfff640 1 --2- 172.21.15.116:0/342332119 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f7be006b4d0 0x7f7be006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:26.667 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.675+0000 7f7bdbfff640 1 -- 172.21.15.116:0/342332119 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7be80ac870 con 0x7f7bf40d2b10 2024-02-21T22:53:26.667 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.675+0000 7f7bf2ffd640 1 --2- 172.21.15.116:0/342332119 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f7be006b4d0 0x7f7be006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:26.668 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.675+0000 7f7bf2ffd640 1 --2- 172.21.15.116:0/342332119 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f7be006b4d0 0x7f7be006d990 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f7be4000f60 tx=0x7f7be4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:26.669 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.679+0000 7f7bdbfff640 1 -- 172.21.15.116:0/342332119 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f7be8033030 con 0x7f7bf40d2b10 2024-02-21T22:53:26.840 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.850+0000 7f7bf98c8640 1 -- 172.21.15.116:0/342332119 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7bf4069060 con 0x7f7bf40d2b10 2024-02-21T22:53:26.840 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.850+0000 7f7bdbfff640 1 -- 172.21.15.116:0/342332119 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7be807b0a0 con 0x7f7bf40d2b10 2024-02-21T22:53:26.841 INFO:teuthology.orchestra.run.smithi116.stdout:pg_num: 32 2024-02-21T22:53:26.843 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.852+0000 7f7bf98c8640 1 -- 172.21.15.116:0/342332119 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f7be006b4d0 msgr2=0x7f7be006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:26.843 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.852+0000 7f7bf98c8640 1 --2- 172.21.15.116:0/342332119 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f7be006b4d0 0x7f7be006d990 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f7be4000f60 tx=0x7f7be4009040 comp rx=0 tx=0).stop 2024-02-21T22:53:26.843 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.852+0000 7f7bf98c8640 1 -- 172.21.15.116:0/342332119 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7bf40d2b10 msgr2=0x7f7bf40b24a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:26.843 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.852+0000 7f7bf98c8640 1 --2- 172.21.15.116:0/342332119 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7bf40d2b10 0x7f7bf40b24a0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f7be80098c0 tx=0x7f7be80046c0 comp rx=0 tx=0).stop 2024-02-21T22:53:26.843 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.852+0000 7f7bf98c8640 1 -- 172.21.15.116:0/342332119 shutdown_connections 2024-02-21T22:53:26.843 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.852+0000 7f7bf98c8640 1 --2- 172.21.15.116:0/342332119 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f7be006b4d0 0x7f7be006d990 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:26.843 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.852+0000 7f7bf98c8640 1 --2- 172.21.15.116:0/342332119 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7bf415da70 0x7f7bf40b29e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:26.843 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.852+0000 7f7bf98c8640 1 --2- 172.21.15.116:0/342332119 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7bf40d2b10 0x7f7bf40b24a0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:26.844 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.852+0000 7f7bf98c8640 1 --2- 172.21.15.116:0/342332119 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7bf40d0ca0 0x7f7bf414d370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:26.844 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.852+0000 7f7bf98c8640 1 -- 172.21.15.116:0/342332119 >> 172.21.15.116:0/342332119 conn(0x7f7bf40d3e20 msgr2=0x7f7bf406bf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:26.844 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.852+0000 7f7bf98c8640 1 -- 172.21.15.116:0/342332119 shutdown_connections 2024-02-21T22:53:26.844 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.852+0000 7f7bf98c8640 1 -- 172.21.15.116:0/342332119 wait complete. 2024-02-21T22:53:26.854 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-02-21T22:53:26.957 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.966+0000 7f7706784640 1 Processor -- start 2024-02-21T22:53:26.957 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.966+0000 7f7706784640 1 -- start start 2024-02-21T22:53:26.959 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.967+0000 7f7706784640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f77000b2260 0x7f7700160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:26.959 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.967+0000 7f7706784640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f770006d030 0x7f770006d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:26.960 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.967+0000 7f7706784640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77000b3c30 con 0x7f77001456c0 2024-02-21T22:53:26.960 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.967+0000 7f7706784640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77000b3f10 con 0x7f770006d030 2024-02-21T22:53:26.960 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.967+0000 7f7706784640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77000b41f0 con 0x7f77000b2260 2024-02-21T22:53:26.960 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.967+0000 7f76fffff640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f77001456c0 0x7f770015f920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:36864/0 (socket says 172.21.15.116:36864) 2024-02-21T22:53:26.960 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.967+0000 7f76fffff640 1 -- 172.21.15.116:0/1638403879 learned_addr learned my addr 172.21.15.116:0/1638403879 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-02-21T22:53:26.960 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.967+0000 7f7704d21640 1 --2- 172.21.15.116:0/1638403879 >> v2:172.21.15.116:3300/0 conn(0x7f770006d030 0x7f770006d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:26.960 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.967+0000 7f76ff7fe640 1 --2- 172.21.15.116:0/1638403879 >> v2:172.21.15.142:3300/0 conn(0x7f77000b2260 0x7f7700160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:26.960 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.967+0000 7f76feffd640 1 -- 172.21.15.116:0/1638403879 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3747423145 0 0) 0x7f77000b3c30 con 0x7f77001456c0 2024-02-21T22:53:26.960 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.967+0000 7f76feffd640 1 -- 172.21.15.116:0/1638403879 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f76e8003520 con 0x7f77001456c0 2024-02-21T22:53:26.960 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.967+0000 7f7704d21640 1 -- 172.21.15.116:0/1638403879 >> v2:172.21.15.142:3300/0 conn(0x7f77000b2260 msgr2=0x7f7700160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:53:26.960 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.967+0000 7f7704d21640 1 --2- 172.21.15.116:0/1638403879 >> v2:172.21.15.142:3300/0 conn(0x7f77000b2260 0x7f7700160030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:26.960 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.967+0000 7f7704d21640 1 -- 172.21.15.116:0/1638403879 >> v1:172.21.15.116:6789/0 conn(0x7f77001456c0 legacy=0x7f770015f920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:26.960 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.967+0000 7f7704d21640 1 -- 172.21.15.116:0/1638403879 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f770006cb10 con 0x7f770006d030 2024-02-21T22:53:26.961 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.968+0000 7f7704d21640 1 --2- 172.21.15.116:0/1638403879 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f770006d030 0x7f770006d460 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f7700072d90 tx=0x7f76f802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b20c35eb37219ac0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:26.961 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.968+0000 7f76feffd640 1 -- 172.21.15.116:0/1638403879 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76f8039070 con 0x7f770006d030 2024-02-21T22:53:26.961 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.968+0000 7f76feffd640 1 -- 172.21.15.116:0/1638403879 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76f802cc80 con 0x7f770006d030 2024-02-21T22:53:26.961 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.968+0000 7f76feffd640 1 -- 172.21.15.116:0/1638403879 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76f8034660 con 0x7f770006d030 2024-02-21T22:53:26.961 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.969+0000 7f7706784640 1 -- 172.21.15.116:0/1638403879 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f770006d030 msgr2=0x7f770006d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:26.961 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.969+0000 7f7706784640 1 --2- 172.21.15.116:0/1638403879 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f770006d030 0x7f770006d460 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f7700072d90 tx=0x7f76f802bed0 comp rx=0 tx=0).stop 2024-02-21T22:53:26.961 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.969+0000 7f7706784640 1 -- 172.21.15.116:0/1638403879 shutdown_connections 2024-02-21T22:53:26.961 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.969+0000 7f7706784640 1 --2- 172.21.15.116:0/1638403879 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f770006d030 0x7f770006d460 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:26.961 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.969+0000 7f7706784640 1 --2- 172.21.15.116:0/1638403879 >> v2:172.21.15.142:3300/0 conn(0x7f77000b2260 0x7f7700160030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:26.961 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.969+0000 7f7706784640 1 -- 172.21.15.116:0/1638403879 >> 172.21.15.116:0/1638403879 conn(0x7f77000b1740 msgr2=0x7f77000b1b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:26.961 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.969+0000 7f7706784640 1 -- 172.21.15.116:0/1638403879 shutdown_connections 2024-02-21T22:53:26.961 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.969+0000 7f7706784640 1 -- 172.21.15.116:0/1638403879 wait complete. 2024-02-21T22:53:26.964 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.970+0000 7f7706784640 1 Processor -- start 2024-02-21T22:53:26.964 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.970+0000 7f7706784640 1 -- start start 2024-02-21T22:53:26.964 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.971+0000 7f7706784640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f770006d030 0x7f770013b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:26.964 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.971+0000 7f7706784640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f77000b2260 0x7f77000cc300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:26.964 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.971+0000 7f7706784640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f77001456c0 0x7f770013c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:26.964 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.971+0000 7f7706784640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77001606f0 con 0x7f77000b2260 2024-02-21T22:53:26.964 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.971+0000 7f7706784640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7700160570 con 0x7f77001456c0 2024-02-21T22:53:26.964 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.971+0000 7f7706784640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f770006d9a0 con 0x7f770006d030 2024-02-21T22:53:26.964 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.971+0000 7f76ff7fe640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f77000b2260 0x7f77000cc300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:26.965 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.971+0000 7f76ff7fe640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f77000b2260 0x7f77000cc300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:36054/0 (socket says 172.21.15.116:36054) 2024-02-21T22:53:26.965 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.971+0000 7f76ff7fe640 1 -- 172.21.15.116:0/738208892 learned_addr learned my addr 172.21.15.116:0/738208892 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:26.965 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.971+0000 7f76fffff640 1 --2- 172.21.15.116:0/738208892 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f770006d030 0x7f770013b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:26.965 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.971+0000 7f7704d21640 1 --2- 172.21.15.116:0/738208892 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f77001456c0 0x7f770013c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:26.965 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.971+0000 7f76ff7fe640 1 -- 172.21.15.116:0/738208892 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f770006d030 msgr2=0x7f770013b7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:26.965 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.971+0000 7f76ff7fe640 1 --2- 172.21.15.116:0/738208892 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f770006d030 0x7f770013b7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:26.965 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.971+0000 7f76ff7fe640 1 -- 172.21.15.116:0/738208892 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f77001456c0 msgr2=0x7f770013c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:26.965 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.971+0000 7f76ff7fe640 1 --2- 172.21.15.116:0/738208892 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f77001456c0 0x7f770013c9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:26.965 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.971+0000 7f76ff7fe640 1 -- 172.21.15.116:0/738208892 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f770013da00 con 0x7f77000b2260 2024-02-21T22:53:26.965 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.971+0000 7f7704d21640 1 --2- 172.21.15.116:0/738208892 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f77001456c0 0x7f770013c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T22:53:26.965 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.972+0000 7f76ff7fe640 1 --2- 172.21.15.116:0/738208892 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f77000b2260 0x7f77000cc300 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f76f400e9b0 tx=0x7f76f400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:26.965 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.972+0000 7f76fcff9640 1 -- 172.21.15.116:0/738208892 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76f4017070 con 0x7f77000b2260 2024-02-21T22:53:26.965 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.972+0000 7f76fcff9640 1 -- 172.21.15.116:0/738208892 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76f400c9a0 con 0x7f77000b2260 2024-02-21T22:53:26.965 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.972+0000 7f7706784640 1 -- 172.21.15.116:0/738208892 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f770013dce0 con 0x7f77000b2260 2024-02-21T22:53:26.965 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.972+0000 7f76fcff9640 1 -- 172.21.15.116:0/738208892 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76f400cd90 con 0x7f77000b2260 2024-02-21T22:53:26.966 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.972+0000 7f7706784640 1 -- 172.21.15.116:0/738208892 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f770013c490 con 0x7f77000b2260 2024-02-21T22:53:26.966 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.973+0000 7f7706784640 1 -- 172.21.15.116:0/738208892 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77000752f0 con 0x7f77000b2260 2024-02-21T22:53:26.966 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.973+0000 7f76fcff9640 1 -- 172.21.15.116:0/738208892 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f76f401a070 con 0x7f77000b2260 2024-02-21T22:53:26.966 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.973+0000 7f76fcff9640 1 --2- 172.21.15.116:0/738208892 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f76ec06b4d0 0x7f76ec06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:26.966 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.974+0000 7f76fcff9640 1 -- 172.21.15.116:0/738208892 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f76f408a4a0 con 0x7f77000b2260 2024-02-21T22:53:26.966 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.974+0000 7f76fffff640 1 --2- 172.21.15.116:0/738208892 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f76ec06b4d0 0x7f76ec06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:26.966 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.974+0000 7f76fffff640 1 --2- 172.21.15.116:0/738208892 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f76ec06b4d0 0x7f76ec06d990 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f76f0005880 tx=0x7f76f0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:26.968 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:26.978+0000 7f76fcff9640 1 -- 172.21.15.116:0/738208892 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f76f4058d60 con 0x7f77000b2260 2024-02-21T22:53:27.139 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:27.149+0000 7f7706784640 1 -- 172.21.15.116:0/738208892 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f770013deb0 con 0x7f77000b2260 2024-02-21T22:53:27.140 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:27.149+0000 7f76fcff9640 1 -- 172.21.15.116:0/738208892 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f76f405ce00 con 0x7f77000b2260 2024-02-21T22:53:27.140 INFO:teuthology.orchestra.run.smithi116.stdout:pg_num: 64 2024-02-21T22:53:27.142 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:27.151+0000 7f7706784640 1 -- 172.21.15.116:0/738208892 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f76ec06b4d0 msgr2=0x7f76ec06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:27.142 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:27.151+0000 7f7706784640 1 --2- 172.21.15.116:0/738208892 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f76ec06b4d0 0x7f76ec06d990 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f76f0005880 tx=0x7f76f0009040 comp rx=0 tx=0).stop 2024-02-21T22:53:27.142 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:27.151+0000 7f7706784640 1 -- 172.21.15.116:0/738208892 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f77000b2260 msgr2=0x7f77000cc300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:27.142 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:27.151+0000 7f7706784640 1 --2- 172.21.15.116:0/738208892 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f77000b2260 0x7f77000cc300 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f76f400e9b0 tx=0x7f76f400ee70 comp rx=0 tx=0).stop 2024-02-21T22:53:27.142 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:27.151+0000 7f7706784640 1 -- 172.21.15.116:0/738208892 shutdown_connections 2024-02-21T22:53:27.143 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:27.151+0000 7f7706784640 1 --2- 172.21.15.116:0/738208892 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f77001456c0 0x7f770013c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:27.143 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:27.151+0000 7f7706784640 1 --2- 172.21.15.116:0/738208892 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f77000b2260 0x7f77000cc300 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:27.143 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:27.151+0000 7f7706784640 1 --2- 172.21.15.116:0/738208892 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f76ec06b4d0 0x7f76ec06d990 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:27.143 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:27.151+0000 7f7706784640 1 --2- 172.21.15.116:0/738208892 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f770006d030 0x7f770013b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:27.143 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:27.151+0000 7f7706784640 1 -- 172.21.15.116:0/738208892 >> 172.21.15.116:0/738208892 conn(0x7f77000b1740 msgr2=0x7f7700142fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:27.143 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:27.152+0000 7f7706784640 1 -- 172.21.15.116:0/738208892 shutdown_connections 2024-02-21T22:53:27.143 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:27.152+0000 7f7706784640 1 -- 172.21.15.116:0/738208892 wait complete. 2024-02-21T22:53:27.153 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-02-21T22:53:27.254 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:27.264+0000 7f5588236640 1 Processor -- start 2024-02-21T22:53:27.255 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:27.264+0000 7f5588236640 1 -- start start 2024-02-21T22:53:27.256 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:27.265+0000 7f5588236640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f558015afb0 0x7f55800af080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:27.256 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:27.265+0000 7f5588236640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f5580071c90 0x7f55800b3860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:27.256 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:27.265+0000 7f5588236640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55800710e0 con 0x7f5580070b70 2024-02-21T22:53:27.256 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:27.265+0000 7f5588236640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f558015b390 con 0x7f5580071c90 2024-02-21T22:53:27.256 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:27.265+0000 7f5588236640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55800713c0 con 0x7f558015afb0 2024-02-21T22:53:27.256 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:27.265+0000 7f55867d3640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f5580071c90 0x7f55800b3860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:27.256 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:27.265+0000 7f55867d3640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f5580071c90 0x7f55800b3860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:36070/0 (socket says 172.21.15.116:36070) 2024-02-21T22:53:27.257 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:27.265+0000 7f55867d3640 1 -- 172.21.15.116:0/1055822038 learned_addr learned my addr 172.21.15.116:0/1055822038 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:27.257 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:27.265+0000 7f5585fd2640 1 --2- 172.21.15.116:0/1055822038 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f558015afb0 0x7f55800af080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:27.257 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:27.265+0000 7f55867d3640 1 -- 172.21.15.116:0/1055822038 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f558015afb0 msgr2=0x7f55800af080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:53:27.257 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:27.265+0000 7f55867d3640 1 --2- 172.21.15.116:0/1055822038 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f558015afb0 0x7f55800af080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:27.257 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:27.266+0000 7f55867d3640 1 -- 172.21.15.116:0/1055822038 >> v1:172.21.15.142:6789/0 conn(0x7f5580070b70 legacy=0x7f5580071580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:27.257 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:27.266+0000 7f5584fd0640 1 -- 172.21.15.116:0/1055822038 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1076171026 0 0) 0x7f55800710e0 con 0x7f5580070b70 2024-02-21T22:53:27.257 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:27.266+0000 7f55867d3640 1 -- 172.21.15.116:0/1055822038 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55800b2d80 con 0x7f5580071c90 2024-02-21T22:53:27.258 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:27.266+0000 7f55867d3640 1 --2- 172.21.15.116:0/1055822038 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5580071c90 0x7f55800b3860 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f5578009e50 tx=0x7f557802e200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ece097e766c33f8 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:27.258 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:27.266+0000 7f5584fd0640 1 -- 172.21.15.116:0/1055822038 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f557802eda0 con 0x7f5580071c90 2024-02-21T22:53:27.258 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:27.266+0000 7f5584fd0640 1 -- 172.21.15.116:0/1055822038 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55780363f0 con 0x7f5580071c90 2024-02-21T22:53:27.258 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:27.266+0000 7f5584fd0640 1 -- 172.21.15.116:0/1055822038 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55780367c0 con 0x7f5580071c90 2024-02-21T22:53:27.258 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:27.267+0000 7f5588236640 1 -- 172.21.15.116:0/1055822038 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5580071c90 msgr2=0x7f55800b3860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:27.258 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:27.267+0000 7f5588236640 1 --2- 172.21.15.116:0/1055822038 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5580071c90 0x7f55800b3860 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f5578009e50 tx=0x7f557802e200 comp rx=0 tx=0).stop 2024-02-21T22:53:27.259 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:27.267+0000 7f5588236640 1 -- 172.21.15.116:0/1055822038 shutdown_connections 2024-02-21T22:53:27.259 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:27.267+0000 7f5588236640 1 --2- 172.21.15.116:0/1055822038 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5580071c90 0x7f55800b3860 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:27.259 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:27.267+0000 7f5588236640 1 --2- 172.21.15.116:0/1055822038 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f558015afb0 0x7f55800af080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:27.259 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:27.267+0000 7f5588236640 1 -- 172.21.15.116:0/1055822038 >> 172.21.15.116:0/1055822038 conn(0x7f55800b18e0 msgr2=0x7f55800b1cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:27.259 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:27.267+0000 7f5588236640 1 -- 172.21.15.116:0/1055822038 shutdown_connections 2024-02-21T22:53:27.259 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:27.267+0000 7f5588236640 1 -- 172.21.15.116:0/1055822038 wait complete. 2024-02-21T22:53:27.261 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:27.268+0000 7f5588236640 1 Processor -- start 2024-02-21T22:53:27.261 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:27.268+0000 7f5588236640 1 -- start start 2024-02-21T22:53:27.261 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:27.269+0000 7f5588236640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5580070b70 0x7f55800cda10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:27.261 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:27.269+0000 7f5588236640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5580071c90 0x7f558014bde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:27.261 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:27.269+0000 7f5588236640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f558015afb0 0x7f55800cbec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:27.261 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:27.269+0000 7f5588236640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55800af5c0 con 0x7f5580071c90 2024-02-21T22:53:27.262 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:27.269+0000 7f5588236640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55800b3340 con 0x7f558015afb0 2024-02-21T22:53:27.262 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:27.269+0000 7f5588236640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55800b3da0 con 0x7f5580070b70 2024-02-21T22:53:27.262 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:27.269+0000 7f55857d1640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5580071c90 0x7f558014bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:27.262 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:27.269+0000 7f55857d1640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5580071c90 0x7f558014bde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:36076/0 (socket says 172.21.15.116:36076) 2024-02-21T22:53:27.262 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:27.269+0000 7f55857d1640 1 -- 172.21.15.116:0/1342460985 learned_addr learned my addr 172.21.15.116:0/1342460985 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:27.262 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:27.269+0000 7f55867d3640 1 --2- 172.21.15.116:0/1342460985 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f558015afb0 0x7f55800cbec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:27.262 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:27.269+0000 7f5585fd2640 1 --2- 172.21.15.116:0/1342460985 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5580070b70 0x7f55800cda10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:27.262 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:27.269+0000 7f55857d1640 1 -- 172.21.15.116:0/1342460985 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5580070b70 msgr2=0x7f55800cda10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:27.263 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:27.269+0000 7f55857d1640 1 --2- 172.21.15.116:0/1342460985 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5580070b70 0x7f55800cda10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:27.263 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:27.269+0000 7f55857d1640 1 -- 172.21.15.116:0/1342460985 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f558015afb0 msgr2=0x7f55800cbec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:27.263 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:27.269+0000 7f55857d1640 1 --2- 172.21.15.116:0/1342460985 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f558015afb0 0x7f55800cbec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:27.263 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:27.269+0000 7f55857d1640 1 -- 172.21.15.116:0/1342460985 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55801f7090 con 0x7f5580071c90 2024-02-21T22:53:27.263 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:27.270+0000 7f55857d1640 1 --2- 172.21.15.116:0/1342460985 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5580071c90 0x7f558014bde0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f557000c4b0 tx=0x7f557000c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:27.263 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:27.270+0000 7f55767fc640 1 -- 172.21.15.116:0/1342460985 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5570017070 con 0x7f5580071c90 2024-02-21T22:53:27.263 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:27.270+0000 7f55767fc640 1 -- 172.21.15.116:0/1342460985 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5570005480 con 0x7f5580071c90 2024-02-21T22:53:27.263 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:27.270+0000 7f55767fc640 1 -- 172.21.15.116:0/1342460985 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5570003830 con 0x7f5580071c90 2024-02-21T22:53:27.263 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:27.270+0000 7f5588236640 1 -- 172.21.15.116:0/1342460985 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55801f7370 con 0x7f5580071c90 2024-02-21T22:53:27.263 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:27.270+0000 7f5588236640 1 -- 172.21.15.116:0/1342460985 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55801f7930 con 0x7f5580071c90 2024-02-21T22:53:27.263 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:27.271+0000 7f5588236640 1 -- 172.21.15.116:0/1342460985 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55800752f0 con 0x7f5580071c90 2024-02-21T22:53:27.263 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:27.271+0000 7f55767fc640 1 -- 172.21.15.116:0/1342460985 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f557001a070 con 0x7f5580071c90 2024-02-21T22:53:27.264 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:27.272+0000 7f55767fc640 1 --2- 172.21.15.116:0/1342460985 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f556406b4d0 0x7f556406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:27.264 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:27.272+0000 7f55767fc640 1 -- 172.21.15.116:0/1342460985 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5570089530 con 0x7f5580071c90 2024-02-21T22:53:27.264 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:27.272+0000 7f5585fd2640 1 --2- 172.21.15.116:0/1342460985 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f556406b4d0 0x7f556406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:27.264 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:27.272+0000 7f5585fd2640 1 --2- 172.21.15.116:0/1342460985 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f556406b4d0 0x7f556406d990 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f557c009aa0 tx=0x7f557c009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:27.266 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:27.276+0000 7f55767fc640 1 -- 172.21.15.116:0/1342460985 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f5570057d60 con 0x7f5580071c90 2024-02-21T22:53:27.451 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:27.461+0000 7f5588236640 1 -- 172.21.15.116:0/1342460985 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f55800b2820 con 0x7f5580071c90 2024-02-21T22:53:27.452 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:27.461+0000 7f55767fc640 1 -- 172.21.15.116:0/1342460985 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) v1 ==== 80+0+0 (secure 0 0 0) 0x7f557005be00 con 0x7f5580071c90 2024-02-21T22:53:27.452 INFO:teuthology.orchestra.run.smithi116.stderr:listed 0 entries 2024-02-21T22:53:27.456 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:27.463+0000 7f5588236640 1 -- 172.21.15.116:0/1342460985 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f556406b4d0 msgr2=0x7f556406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:27.456 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:27.463+0000 7f5588236640 1 --2- 172.21.15.116:0/1342460985 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f556406b4d0 0x7f556406d990 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f557c009aa0 tx=0x7f557c009190 comp rx=0 tx=0).stop 2024-02-21T22:53:27.456 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:27.463+0000 7f5588236640 1 -- 172.21.15.116:0/1342460985 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5580071c90 msgr2=0x7f558014bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:27.456 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:27.463+0000 7f5588236640 1 --2- 172.21.15.116:0/1342460985 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5580071c90 0x7f558014bde0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f557000c4b0 tx=0x7f557000c970 comp rx=0 tx=0).stop 2024-02-21T22:53:27.456 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:27.463+0000 7f5588236640 1 -- 172.21.15.116:0/1342460985 shutdown_connections 2024-02-21T22:53:27.456 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:27.463+0000 7f5588236640 1 --2- 172.21.15.116:0/1342460985 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f558015afb0 0x7f55800cbec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:27.456 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:27.463+0000 7f5588236640 1 --2- 172.21.15.116:0/1342460985 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5580071c90 0x7f558014bde0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:27.456 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:27.463+0000 7f5588236640 1 --2- 172.21.15.116:0/1342460985 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f556406b4d0 0x7f556406d990 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:27.456 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:27.463+0000 7f5588236640 1 --2- 172.21.15.116:0/1342460985 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5580070b70 0x7f55800cda10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:27.456 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:27.463+0000 7f5588236640 1 -- 172.21.15.116:0/1342460985 >> 172.21.15.116:0/1342460985 conn(0x7f55800b18e0 msgr2=0x7f55800ad7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:27.457 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:27.463+0000 7f5588236640 1 -- 172.21.15.116:0/1342460985 shutdown_connections 2024-02-21T22:53:27.457 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:27.463+0000 7f5588236640 1 -- 172.21.15.116:0/1342460985 wait complete. 2024-02-21T22:53:27.464 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2024-02-21T22:53:27.465 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T22:53:27.465 DEBUG:teuthology.orchestra.run.smithi116:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2024-02-21T22:53:27.492 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi116.front.sepia.ceph.com 2024-02-21T22:53:27.492 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T22:53:27.492 DEBUG:teuthology.orchestra.run.smithi116:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-02-21T22:53:27.547 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-02-21T22:53:27.547 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-21T22:53:27.563 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-02-21T22:53:27.563 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-21T22:53:27.619 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-02-21T22:53:27.619 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-21T22:53:27.675 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-21T22:53:27.776 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:27.785+0000 7fb4c6384640 1 Processor -- start 2024-02-21T22:53:27.776 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:27.785+0000 7fb4c6384640 1 -- start start 2024-02-21T22:53:27.777 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:27.786+0000 7fb4c6384640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb4c006b550 0x7fb4c0168f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:27.777 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:27.786+0000 7fb4c6384640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4c015f570 con 0x7fb4c00b3f90 2024-02-21T22:53:27.777 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:27.786+0000 7fb4c6384640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4c015e7b0 con 0x7fb4c00b0290 2024-02-21T22:53:27.777 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:27.786+0000 7fb4c6384640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4c0072c90 con 0x7fb4c006b550 2024-02-21T22:53:27.777 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:27.786+0000 7fb4bf7fe640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7fb4c00b3f90 0x7fb4c006ae40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:36876/0 (socket says 172.21.15.116:36876) 2024-02-21T22:53:27.777 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:27.786+0000 7fb4bf7fe640 1 -- 172.21.15.116:0/2159696345 learned_addr learned my addr 172.21.15.116:0/2159696345 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-02-21T22:53:27.778 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:27.786+0000 7fb4c4921640 1 --2- 172.21.15.116:0/2159696345 >> v2:172.21.15.142:3300/0 conn(0x7fb4c006b550 0x7fb4c0168f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:27.778 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:27.786+0000 7fb4beffd640 1 -- 172.21.15.116:0/2159696345 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 304359049 0 0) 0x7fb4c015f570 con 0x7fb4c00b3f90 2024-02-21T22:53:27.778 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:27.786+0000 7fb4beffd640 1 -- 172.21.15.116:0/2159696345 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb4a8003520 con 0x7fb4c00b3f90 2024-02-21T22:53:27.778 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:27.786+0000 7fb4c4921640 1 -- 172.21.15.116:0/2159696345 >> v1:172.21.15.142:6789/0 conn(0x7fb4c00b0290 legacy=0x7fb4c006f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:27.778 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:27.786+0000 7fb4c4921640 1 -- 172.21.15.116:0/2159696345 >> v1:172.21.15.116:6789/0 conn(0x7fb4c00b3f90 legacy=0x7fb4c006ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:27.778 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:27.786+0000 7fb4c4921640 1 -- 172.21.15.116:0/2159696345 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4c015ea90 con 0x7fb4c006b550 2024-02-21T22:53:27.779 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:27.787+0000 7fb4c4921640 1 --2- 172.21.15.116:0/2159696345 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb4c006b550 0x7fb4c0168f40 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fb4b8009d90 tx=0x7fb4b802beb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=874399803119354a server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:27.779 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:27.787+0000 7fb4beffd640 1 -- 172.21.15.116:0/2159696345 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4b8039070 con 0x7fb4c006b550 2024-02-21T22:53:27.780 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:27.787+0000 7fb4beffd640 1 -- 172.21.15.116:0/2159696345 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4b802cc60 con 0x7fb4c006b550 2024-02-21T22:53:27.780 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:27.787+0000 7fb4beffd640 1 -- 172.21.15.116:0/2159696345 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4b8034660 con 0x7fb4c006b550 2024-02-21T22:53:27.780 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:27.788+0000 7fb4c6384640 1 -- 172.21.15.116:0/2159696345 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb4c006b550 msgr2=0x7fb4c0168f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:27.780 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:27.788+0000 7fb4c6384640 1 --2- 172.21.15.116:0/2159696345 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb4c006b550 0x7fb4c0168f40 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fb4b8009d90 tx=0x7fb4b802beb0 comp rx=0 tx=0).stop 2024-02-21T22:53:27.780 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:27.788+0000 7fb4c6384640 1 -- 172.21.15.116:0/2159696345 shutdown_connections 2024-02-21T22:53:27.780 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:27.788+0000 7fb4c6384640 1 --2- 172.21.15.116:0/2159696345 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb4c006b550 0x7fb4c0168f40 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:27.780 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:27.788+0000 7fb4c6384640 1 -- 172.21.15.116:0/2159696345 >> 172.21.15.116:0/2159696345 conn(0x7fb4c00b29f0 msgr2=0x7fb4c00b2e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:27.780 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:27.788+0000 7fb4c6384640 1 -- 172.21.15.116:0/2159696345 shutdown_connections 2024-02-21T22:53:27.780 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:27.788+0000 7fb4c6384640 1 -- 172.21.15.116:0/2159696345 wait complete. 2024-02-21T22:53:27.780 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:27.789+0000 7fb4c6384640 1 Processor -- start 2024-02-21T22:53:27.780 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:27.789+0000 7fb4c6384640 1 -- start start 2024-02-21T22:53:27.783 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:27.790+0000 7fb4c6384640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb4c006b550 0x7fb4c014e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:27.783 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:27.790+0000 7fb4c6384640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb4c00b0290 0x7fb4c00b1ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:27.783 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:27.790+0000 7fb4c6384640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb4c00b3f90 0x7fb4c014c760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:27.783 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:27.790+0000 7fb4c6384640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4c00b0670 con 0x7fb4c00b0290 2024-02-21T22:53:27.783 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:27.790+0000 7fb4c6384640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4c015f0e0 con 0x7fb4c006b550 2024-02-21T22:53:27.783 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:27.790+0000 7fb4c6384640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4c0169480 con 0x7fb4c00b3f90 2024-02-21T22:53:27.783 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:27.790+0000 7fb4bf7fe640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb4c00b0290 0x7fb4c00b1ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:27.783 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:27.790+0000 7fb4bf7fe640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb4c00b0290 0x7fb4c00b1ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:36088/0 (socket says 172.21.15.116:36088) 2024-02-21T22:53:27.784 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:27.790+0000 7fb4bf7fe640 1 -- 172.21.15.116:0/4114724271 learned_addr learned my addr 172.21.15.116:0/4114724271 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:27.784 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:27.790+0000 7fb4bffff640 1 --2- 172.21.15.116:0/4114724271 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb4c006b550 0x7fb4c014e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:27.784 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:27.790+0000 7fb4c4921640 1 --2- 172.21.15.116:0/4114724271 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb4c00b3f90 0x7fb4c014c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:27.784 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:27.790+0000 7fb4bf7fe640 1 -- 172.21.15.116:0/4114724271 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb4c00b3f90 msgr2=0x7fb4c014c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:27.784 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:27.790+0000 7fb4bf7fe640 1 --2- 172.21.15.116:0/4114724271 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb4c00b3f90 0x7fb4c014c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:27.784 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:27.790+0000 7fb4bf7fe640 1 -- 172.21.15.116:0/4114724271 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb4c006b550 msgr2=0x7fb4c014e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:27.784 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:27.790+0000 7fb4bf7fe640 1 --2- 172.21.15.116:0/4114724271 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb4c006b550 0x7fb4c014e1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:27.784 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:27.790+0000 7fb4bf7fe640 1 -- 172.21.15.116:0/4114724271 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4c014d950 con 0x7fb4c00b0290 2024-02-21T22:53:27.784 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:27.791+0000 7fb4bf7fe640 1 --2- 172.21.15.116:0/4114724271 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb4c00b0290 0x7fb4c00b1ff0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fb4b400c440 tx=0x7fb4b400c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:27.784 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:27.791+0000 7fb4bcff9640 1 -- 172.21.15.116:0/4114724271 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4b4017070 con 0x7fb4c00b0290 2024-02-21T22:53:27.784 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:27.791+0000 7fb4bcff9640 1 -- 172.21.15.116:0/4114724271 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4b4005ce0 con 0x7fb4c00b0290 2024-02-21T22:53:27.784 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:27.791+0000 7fb4c6384640 1 -- 172.21.15.116:0/4114724271 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4c01563b0 con 0x7fb4c00b0290 2024-02-21T22:53:27.784 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:27.791+0000 7fb4bcff9640 1 -- 172.21.15.116:0/4114724271 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4b40072b0 con 0x7fb4c00b0290 2024-02-21T22:53:27.784 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:27.791+0000 7fb4c6384640 1 -- 172.21.15.116:0/4114724271 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4c00b19d0 con 0x7fb4c00b0290 2024-02-21T22:53:27.785 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:27.792+0000 7fb4c6384640 1 -- 172.21.15.116:0/4114724271 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4c00752f0 con 0x7fb4c00b0290 2024-02-21T22:53:27.785 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:27.792+0000 7fb4bcff9640 1 -- 172.21.15.116:0/4114724271 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fb4b401a070 con 0x7fb4c00b0290 2024-02-21T22:53:27.785 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:27.793+0000 7fb4bcff9640 1 --2- 172.21.15.116:0/4114724271 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fb4ac06b4d0 0x7fb4ac06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:27.785 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:27.793+0000 7fb4bcff9640 1 -- 172.21.15.116:0/4114724271 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb4b4089490 con 0x7fb4c00b0290 2024-02-21T22:53:27.785 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:27.793+0000 7fb4bffff640 1 --2- 172.21.15.116:0/4114724271 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fb4ac06b4d0 0x7fb4ac06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:27.785 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:27.793+0000 7fb4bffff640 1 --2- 172.21.15.116:0/4114724271 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fb4ac06b4d0 0x7fb4ac06d990 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fb4b0001780 tx=0x7fb4b0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:27.787 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:27.797+0000 7fb4bcff9640 1 -- 172.21.15.116:0/4114724271 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7fb4b4057e10 con 0x7fb4c00b0290 2024-02-21T22:53:27.960 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:27.969+0000 7fb4c6384640 1 -- 172.21.15.116:0/4114724271 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb4c006ae40 con 0x7fb4c00b0290 2024-02-21T22:53:27.961 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:27.970+0000 7fb4bcff9640 1 -- 172.21.15.116:0/4114724271 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16653 (secure 0 0 0) 0x7fb4b405beb0 con 0x7fb4c00b0290 2024-02-21T22:53:27.961 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-02-21T22:53:27.961 INFO:teuthology.orchestra.run.smithi116.stdout:{"epoch":20,"fsid":"7c298660-5f63-4b5c-a800-58c5be9a8445","created":"2024-02-21T22:52:25.994613+0000","modified":"2024-02-21T22:52:51.786454+0000","last_up_change":"2024-02-21T22:52:37.313595+0000","last_in_change":"2024-02-21T22:52:28.176031+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-21T22:52:38.328796+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-21T22:52:48.145152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-21T22:52:49.096955+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4f09126b-b5e4-4876-8b08-f5cbb967388a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":1613202231},{"type":"v1","addr":"172.21.15.116:6809","nonce":1613202231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":1613202231},{"type":"v1","addr":"172.21.15.116:6811","nonce":1613202231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":1613202231},{"type":"v1","addr":"172.21.15.116:6815","nonce":1613202231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":1613202231},{"type":"v1","addr":"172.21.15.116:6813","nonce":1613202231}]},"public_addr":"172.21.15.116:6809/1613202231","cluster_addr":"172.21.15.116:6811/1613202231","heartbeat_back_addr":"172.21.15.116:6815/1613202231","heartbeat_front_addr":"172.21.15.116:6813/1613202231","state":["exists","up"]},{"osd":1,"uuid":"7272c51d-51f9-4536-931d-33ad7a4b377e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6816","nonce":172614746},{"type":"v1","addr":"172.21.15.116:6817","nonce":172614746}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":172614746},{"type":"v1","addr":"172.21.15.116:6819","nonce":172614746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":172614746},{"type":"v1","addr":"172.21.15.116:6823","nonce":172614746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":172614746},{"type":"v1","addr":"172.21.15.116:6821","nonce":172614746}]},"public_addr":"172.21.15.116:6817/172614746","cluster_addr":"172.21.15.116:6819/172614746","heartbeat_back_addr":"172.21.15.116:6823/172614746","heartbeat_front_addr":"172.21.15.116:6821/172614746","state":["exists","up"]},{"osd":2,"uuid":"2589616c-adf1-4187-aac3-735256cf624b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":1029280577},{"type":"v1","addr":"172.21.15.116:6825","nonce":1029280577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":1029280577},{"type":"v1","addr":"172.21.15.116:6827","nonce":1029280577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":1029280577},{"type":"v1","addr":"172.21.15.116:6831","nonce":1029280577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":1029280577},{"type":"v1","addr":"172.21.15.116:6829","nonce":1029280577}]},"public_addr":"172.21.15.116:6825/1029280577","cluster_addr":"172.21.15.116:6827/1029280577","heartbeat_back_addr":"172.21.15.116:6831/1029280577","heartbeat_front_addr":"172.21.15.116:6829/1029280577","state":["exists","up"]},{"osd":3,"uuid":"0fd2e563-7c5b-46f6-82c2-b60c86072c93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":3106627557},{"type":"v1","addr":"172.21.15.116:6801","nonce":3106627557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":3106627557},{"type":"v1","addr":"172.21.15.116:6803","nonce":3106627557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":3106627557},{"type":"v1","addr":"172.21.15.116:6807","nonce":3106627557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":3106627557},{"type":"v1","addr":"172.21.15.116:6805","nonce":3106627557}]},"public_addr":"172.21.15.116:6801/3106627557","cluster_addr":"172.21.15.116:6803/3106627557","heartbeat_back_addr":"172.21.15.116:6807/3106627557","heartbeat_front_addr":"172.21.15.116:6805/3106627557","state":["exists","up"]},{"osd":4,"uuid":"79ae35b7-dda8-4ab8-96ce-47515afde082","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":3231407772},{"type":"v1","addr":"172.21.15.142:6825","nonce":3231407772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":3231407772},{"type":"v1","addr":"172.21.15.142:6827","nonce":3231407772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":3231407772},{"type":"v1","addr":"172.21.15.142:6831","nonce":3231407772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":3231407772},{"type":"v1","addr":"172.21.15.142:6829","nonce":3231407772}]},"public_addr":"172.21.15.142:6825/3231407772","cluster_addr":"172.21.15.142:6827/3231407772","heartbeat_back_addr":"172.21.15.142:6831/3231407772","heartbeat_front_addr":"172.21.15.142:6829/3231407772","state":["exists","up"]},{"osd":5,"uuid":"3166eb2c-3fcf-41c8-9362-45bafaabaa39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":1184158716},{"type":"v1","addr":"172.21.15.142:6817","nonce":1184158716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":1184158716},{"type":"v1","addr":"172.21.15.142:6819","nonce":1184158716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":1184158716},{"type":"v1","addr":"172.21.15.142:6823","nonce":1184158716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":1184158716},{"type":"v1","addr":"172.21.15.142:6821","nonce":1184158716}]},"public_addr":"172.21.15.142:6817/1184158716","cluster_addr":"172.21.15.142:6819/1184158716","heartbeat_back_addr":"172.21.15.142:6823/1184158716","heartbeat_front_addr":"172.21.15.142:6821/1184158716","state":["exists","up"]},{"osd":6,"uuid":"f9aa9672-7527-43e2-963e-b61868e5e63f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":1987868911},{"type":"v1","addr":"172.21.15.142:6801","nonce":1987868911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":1987868911},{"type":"v1","addr":"172.21.15.142:6803","nonce":1987868911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":1987868911},{"type":"v1","addr":"172.21.15.142:6807","nonce":1987868911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":1987868911},{"type":"v1","addr":"172.21.15.142:6805","nonce":1987868911}]},"public_addr":"172.21.15.142:6801/1987868911","cluster_addr":"172.21.15.142:6803/1987868911","heartbeat_back_addr":"172.21.15.142:6807/1987868911","heartbeat_front_addr":"172.21.15.142:6805/1987868911","state":["exists","up"]},{"osd":7,"uuid":"7ed29226-fc42-4382-a91a-fa50f7ec5426","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":1272081937},{"type":"v1","addr":"172.21.15.142:6809","nonce":1272081937}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":1272081937},{"type":"v1","addr":"172.21.15.142:6811","nonce":1272081937}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":1272081937},{"type":"v1","addr":"172.21.15.142:6815","nonce":1272081937}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":1272081937},{"type":"v1","addr":"172.21.15.142:6813","nonce":1272081937}]},"public_addr":"172.21.15.142:6809/1272081937","cluster_addr":"172.21.15.142:6811/1272081937","heartbeat_back_addr":"172.21.15.142:6815/1272081937","heartbeat_front_addr":"172.21.15.142:6813/1272081937","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.350998+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.307201+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.289112+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.243888+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.312091+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.370472+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.275659+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.289297+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-21T22:53:27.963 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:27.972+0000 7fb4c6384640 1 -- 172.21.15.116:0/4114724271 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fb4ac06b4d0 msgr2=0x7fb4ac06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:27.963 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:27.972+0000 7fb4c6384640 1 --2- 172.21.15.116:0/4114724271 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fb4ac06b4d0 0x7fb4ac06d990 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fb4b0001780 tx=0x7fb4b0009040 comp rx=0 tx=0).stop 2024-02-21T22:53:27.963 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:27.972+0000 7fb4c6384640 1 -- 172.21.15.116:0/4114724271 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb4c00b0290 msgr2=0x7fb4c00b1ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:27.963 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:27.972+0000 7fb4c6384640 1 --2- 172.21.15.116:0/4114724271 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb4c00b0290 0x7fb4c00b1ff0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fb4b400c440 tx=0x7fb4b400c900 comp rx=0 tx=0).stop 2024-02-21T22:53:27.963 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:27.973+0000 7fb4c6384640 1 -- 172.21.15.116:0/4114724271 shutdown_connections 2024-02-21T22:53:27.963 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:27.973+0000 7fb4c6384640 1 --2- 172.21.15.116:0/4114724271 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fb4ac06b4d0 0x7fb4ac06d990 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:27.964 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:27.973+0000 7fb4c6384640 1 --2- 172.21.15.116:0/4114724271 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb4c00b3f90 0x7fb4c014c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:27.964 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:27.973+0000 7fb4c6384640 1 --2- 172.21.15.116:0/4114724271 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb4c00b0290 0x7fb4c00b1ff0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:27.964 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:27.973+0000 7fb4c6384640 1 --2- 172.21.15.116:0/4114724271 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb4c006b550 0x7fb4c014e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:27.964 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:27.973+0000 7fb4c6384640 1 -- 172.21.15.116:0/4114724271 >> 172.21.15.116:0/4114724271 conn(0x7fb4c00b29f0 msgr2=0x7fb4c01583e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:27.964 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:27.973+0000 7fb4c6384640 1 -- 172.21.15.116:0/4114724271 shutdown_connections 2024-02-21T22:53:27.964 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:27.973+0000 7fb4c6384640 1 -- 172.21.15.116:0/4114724271 wait complete. 2024-02-21T22:53:27.974 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-21T22:52:38.328796+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-02-21T22:52:48.145152+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-02-21T22:52:49.096955+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-21T22:53:27.974 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-21T22:53:28.078 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.087+0000 7ff36dade640 1 Processor -- start 2024-02-21T22:53:28.078 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.087+0000 7ff36dade640 1 -- start start 2024-02-21T22:53:28.080 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.088+0000 7ff36dade640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff36806e310 0x7ff3680cd800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:28.080 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.088+0000 7ff36dade640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff368071d90 con 0x7ff36815ae80 2024-02-21T22:53:28.080 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.088+0000 7ff36dade640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff368072070 con 0x7ff3680b34d0 2024-02-21T22:53:28.080 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.088+0000 7ff36dade640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff368072350 con 0x7ff36806e310 2024-02-21T22:53:28.080 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.088+0000 7ff3677fe640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7ff36815ae80 0x7ff3680b2dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:36878/0 (socket says 172.21.15.116:36878) 2024-02-21T22:53:28.080 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.088+0000 7ff3677fe640 1 -- 172.21.15.116:0/2984483777 learned_addr learned my addr 172.21.15.116:0/2984483777 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-02-21T22:53:28.080 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.088+0000 7ff367fff640 1 --2- 172.21.15.116:0/2984483777 >> v2:172.21.15.142:3300/0 conn(0x7ff36806e310 0x7ff3680cd800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:28.080 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.088+0000 7ff3667fc640 1 -- 172.21.15.116:0/2984483777 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3892474404 0 0) 0x7ff368071d90 con 0x7ff36815ae80 2024-02-21T22:53:28.080 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.088+0000 7ff3667fc640 1 -- 172.21.15.116:0/2984483777 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff350005730 con 0x7ff36815ae80 2024-02-21T22:53:28.080 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.088+0000 7ff3667fc640 1 -- 172.21.15.116:0/2984483777 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3858146726 0 0) 0x7ff368072070 con 0x7ff3680b34d0 2024-02-21T22:53:28.080 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.088+0000 7ff3667fc640 1 -- 172.21.15.116:0/2984483777 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff368071d90 con 0x7ff3680b34d0 2024-02-21T22:53:28.080 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.088+0000 7ff367fff640 1 -- 172.21.15.116:0/2984483777 >> v1:172.21.15.142:6789/0 conn(0x7ff3680b34d0 legacy=0x7ff3680cd0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:28.080 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.088+0000 7ff367fff640 1 -- 172.21.15.116:0/2984483777 >> v1:172.21.15.116:6789/0 conn(0x7ff36815ae80 legacy=0x7ff3680b2dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:28.081 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.088+0000 7ff367fff640 1 -- 172.21.15.116:0/2984483777 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff368072630 con 0x7ff36806e310 2024-02-21T22:53:28.081 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.089+0000 7ff367fff640 1 --2- 172.21.15.116:0/2984483777 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff36806e310 0x7ff3680cd800 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ff360009d90 tx=0x7ff36002bf50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e319c32d54562d17 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:28.081 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.089+0000 7ff3667fc640 1 -- 172.21.15.116:0/2984483777 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff360039070 con 0x7ff36806e310 2024-02-21T22:53:28.081 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.089+0000 7ff3667fc640 1 -- 172.21.15.116:0/2984483777 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff36002cd00 con 0x7ff36806e310 2024-02-21T22:53:28.081 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.089+0000 7ff3667fc640 1 -- 172.21.15.116:0/2984483777 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff360034660 con 0x7ff36806e310 2024-02-21T22:53:28.084 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.090+0000 7ff36dade640 1 -- 172.21.15.116:0/2984483777 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff36806e310 msgr2=0x7ff3680cd800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:28.085 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.090+0000 7ff36dade640 1 --2- 172.21.15.116:0/2984483777 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff36806e310 0x7ff3680cd800 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ff360009d90 tx=0x7ff36002bf50 comp rx=0 tx=0).stop 2024-02-21T22:53:28.085 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.090+0000 7ff36dade640 1 -- 172.21.15.116:0/2984483777 shutdown_connections 2024-02-21T22:53:28.085 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.090+0000 7ff36dade640 1 --2- 172.21.15.116:0/2984483777 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff36806e310 0x7ff3680cd800 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:28.085 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.090+0000 7ff36dade640 1 -- 172.21.15.116:0/2984483777 >> 172.21.15.116:0/2984483777 conn(0x7ff3680b1740 msgr2=0x7ff3680b1b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:28.085 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.090+0000 7ff36dade640 1 -- 172.21.15.116:0/2984483777 shutdown_connections 2024-02-21T22:53:28.085 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.090+0000 7ff36dade640 1 -- 172.21.15.116:0/2984483777 wait complete. 2024-02-21T22:53:28.085 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.091+0000 7ff36dade640 1 Processor -- start 2024-02-21T22:53:28.085 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.091+0000 7ff36dade640 1 -- start start 2024-02-21T22:53:28.085 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.092+0000 7ff36dade640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff36806e310 0x7ff36813e290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:28.085 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.092+0000 7ff36dade640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff3680b34d0 0x7ff3680ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:28.085 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.092+0000 7ff36dade640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff3680cec50 0x7ff3680cd530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:28.085 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.092+0000 7ff36dade640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff368071aa0 con 0x7ff36806e310 2024-02-21T22:53:28.085 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.092+0000 7ff36dade640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff368071920 con 0x7ff3680cec50 2024-02-21T22:53:28.085 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.092+0000 7ff36dade640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3680b4490 con 0x7ff3680b34d0 2024-02-21T22:53:28.086 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.092+0000 7ff3677fe640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff36806e310 0x7ff36813e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:28.086 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.092+0000 7ff3677fe640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff36806e310 0x7ff36813e290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:36096/0 (socket says 172.21.15.116:36096) 2024-02-21T22:53:28.086 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.092+0000 7ff3677fe640 1 -- 172.21.15.116:0/1276198329 learned_addr learned my addr 172.21.15.116:0/1276198329 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:28.086 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.092+0000 7ff367fff640 1 --2- 172.21.15.116:0/1276198329 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff3680cec50 0x7ff3680cd530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:28.086 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.092+0000 7ff366ffd640 1 --2- 172.21.15.116:0/1276198329 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff3680b34d0 0x7ff3680ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:28.086 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.092+0000 7ff3677fe640 1 -- 172.21.15.116:0/1276198329 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff3680b34d0 msgr2=0x7ff3680ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:28.086 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.092+0000 7ff3677fe640 1 --2- 172.21.15.116:0/1276198329 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff3680b34d0 0x7ff3680ccff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:28.086 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.092+0000 7ff3677fe640 1 -- 172.21.15.116:0/1276198329 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff3680cec50 msgr2=0x7ff3680cd530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:28.086 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.092+0000 7ff3677fe640 1 --2- 172.21.15.116:0/1276198329 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff3680cec50 0x7ff3680cd530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:28.086 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.092+0000 7ff3677fe640 1 -- 172.21.15.116:0/1276198329 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3680cdbb0 con 0x7ff36806e310 2024-02-21T22:53:28.086 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.092+0000 7ff3677fe640 1 --2- 172.21.15.116:0/1276198329 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff36806e310 0x7ff36813e290 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7ff35800c410 tx=0x7ff35800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:28.086 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.092+0000 7ff34ffff640 1 -- 172.21.15.116:0/1276198329 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff358017070 con 0x7ff36806e310 2024-02-21T22:53:28.086 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.092+0000 7ff34ffff640 1 -- 172.21.15.116:0/1276198329 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff358005ce0 con 0x7ff36806e310 2024-02-21T22:53:28.086 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.092+0000 7ff36dade640 1 -- 172.21.15.116:0/1276198329 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3680cde90 con 0x7ff36806e310 2024-02-21T22:53:28.087 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.092+0000 7ff34ffff640 1 -- 172.21.15.116:0/1276198329 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3580072d0 con 0x7ff36806e310 2024-02-21T22:53:28.087 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.093+0000 7ff36dade640 1 -- 172.21.15.116:0/1276198329 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3680ce450 con 0x7ff36806e310 2024-02-21T22:53:28.087 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.093+0000 7ff36dade640 1 -- 172.21.15.116:0/1276198329 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff36806ebc0 con 0x7ff36806e310 2024-02-21T22:53:28.087 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.094+0000 7ff34ffff640 1 -- 172.21.15.116:0/1276198329 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ff35801a070 con 0x7ff36806e310 2024-02-21T22:53:28.087 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.094+0000 7ff34ffff640 1 --2- 172.21.15.116:0/1276198329 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7ff35406b4d0 0x7ff35406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:28.087 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.094+0000 7ff34ffff640 1 -- 172.21.15.116:0/1276198329 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff358089550 con 0x7ff36806e310 2024-02-21T22:53:28.087 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.094+0000 7ff366ffd640 1 --2- 172.21.15.116:0/1276198329 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7ff35406b4d0 0x7ff35406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:28.087 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.095+0000 7ff366ffd640 1 --2- 172.21.15.116:0/1276198329 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7ff35406b4d0 0x7ff35406d990 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7ff35c007fd0 tx=0x7ff35c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:28.089 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.098+0000 7ff34ffff640 1 -- 172.21.15.116:0/1276198329 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7ff36806ebc0 con 0x7ff36806e310 2024-02-21T22:53:28.258 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.267+0000 7ff36dade640 1 -- 172.21.15.116:0/1276198329 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff3680752f0 con 0x7ff36806e310 2024-02-21T22:53:28.258 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.268+0000 7ff34ffff640 1 -- 172.21.15.116:0/1276198329 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff358057d80 con 0x7ff36806e310 2024-02-21T22:53:28.258 INFO:teuthology.orchestra.run.smithi116.stdout:pg_num: 1 2024-02-21T22:53:28.260 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.269+0000 7ff36dade640 1 -- 172.21.15.116:0/1276198329 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7ff35406b4d0 msgr2=0x7ff35406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:28.261 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.270+0000 7ff36dade640 1 --2- 172.21.15.116:0/1276198329 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7ff35406b4d0 0x7ff35406d990 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7ff35c007fd0 tx=0x7ff35c009040 comp rx=0 tx=0).stop 2024-02-21T22:53:28.261 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.270+0000 7ff36dade640 1 -- 172.21.15.116:0/1276198329 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff36806e310 msgr2=0x7ff36813e290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:28.261 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.270+0000 7ff36dade640 1 --2- 172.21.15.116:0/1276198329 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff36806e310 0x7ff36813e290 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7ff35800c410 tx=0x7ff35800c8d0 comp rx=0 tx=0).stop 2024-02-21T22:53:28.261 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.270+0000 7ff36dade640 1 -- 172.21.15.116:0/1276198329 shutdown_connections 2024-02-21T22:53:28.261 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.270+0000 7ff36dade640 1 --2- 172.21.15.116:0/1276198329 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff3680cec50 0x7ff3680cd530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:28.261 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.270+0000 7ff36dade640 1 --2- 172.21.15.116:0/1276198329 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7ff35406b4d0 0x7ff35406d990 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:28.261 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.270+0000 7ff36dade640 1 --2- 172.21.15.116:0/1276198329 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff3680b34d0 0x7ff3680ccff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:28.261 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.270+0000 7ff36dade640 1 --2- 172.21.15.116:0/1276198329 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff36806e310 0x7ff36813e290 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:28.261 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.270+0000 7ff36dade640 1 -- 172.21.15.116:0/1276198329 >> 172.21.15.116:0/1276198329 conn(0x7ff3680b1740 msgr2=0x7ff3680b38b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:28.261 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.270+0000 7ff36dade640 1 -- 172.21.15.116:0/1276198329 shutdown_connections 2024-02-21T22:53:28.261 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.270+0000 7ff36dade640 1 -- 172.21.15.116:0/1276198329 wait complete. 2024-02-21T22:53:28.272 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-02-21T22:53:28.378 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.387+0000 7faaca5cc640 1 Processor -- start 2024-02-21T22:53:28.378 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.387+0000 7faaca5cc640 1 -- start start 2024-02-21T22:53:28.380 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.388+0000 7faaca5cc640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7faac406d200 0x7faac406d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:28.380 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.388+0000 7faaca5cc640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faac40b2c70 0x7faac40cf240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:28.380 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.388+0000 7faaca5cc640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7faac415ba50 0x7faac415bec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:28.380 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.388+0000 7faaca5cc640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faac406db20 con 0x7faac406d200 2024-02-21T22:53:28.380 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.388+0000 7faaca5cc640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faac415a9a0 con 0x7faac415ba50 2024-02-21T22:53:28.380 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.388+0000 7faaca5cc640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faac415ac80 con 0x7faac40b2c70 2024-02-21T22:53:28.380 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.388+0000 7faac3fff640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7faac406d200 0x7faac406d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:28.380 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.388+0000 7faac3fff640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7faac406d200 0x7faac406d5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:36098/0 (socket says 172.21.15.116:36098) 2024-02-21T22:53:28.380 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.388+0000 7faac3fff640 1 -- 172.21.15.116:0/560058942 learned_addr learned my addr 172.21.15.116:0/560058942 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:28.381 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.388+0000 7faac37fe640 1 --2- 172.21.15.116:0/560058942 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faac40b2c70 0x7faac40cf240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:28.381 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.388+0000 7faac8b69640 1 --2- 172.21.15.116:0/560058942 >> v2:172.21.15.142:3300/0 conn(0x7faac415ba50 0x7faac415bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:28.381 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.389+0000 7faac3fff640 1 -- 172.21.15.116:0/560058942 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faac40b2c70 msgr2=0x7faac40cf240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:53:28.381 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.389+0000 7faac3fff640 1 --2- 172.21.15.116:0/560058942 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faac40b2c70 0x7faac40cf240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:28.381 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.389+0000 7faac3fff640 1 -- 172.21.15.116:0/560058942 >> v2:172.21.15.142:3300/0 conn(0x7faac415ba50 msgr2=0x7faac415bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:53:28.381 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.389+0000 7faac3fff640 1 --2- 172.21.15.116:0/560058942 >> v2:172.21.15.142:3300/0 conn(0x7faac415ba50 0x7faac415bec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:28.381 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.389+0000 7faac3fff640 1 -- 172.21.15.116:0/560058942 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faac415af60 con 0x7faac406d200 2024-02-21T22:53:28.381 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.389+0000 7faac3fff640 1 --2- 172.21.15.116:0/560058942 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faac406d200 0x7faac406d5e0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7faac40b27e0 tx=0x7faab802e0e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=464e6a41f30bcbcb server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:28.381 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.390+0000 7faac2ffd640 1 -- 172.21.15.116:0/560058942 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faab803b070 con 0x7faac406d200 2024-02-21T22:53:28.381 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.390+0000 7faac2ffd640 1 -- 172.21.15.116:0/560058942 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faab8036440 con 0x7faac406d200 2024-02-21T22:53:28.381 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.390+0000 7faac2ffd640 1 -- 172.21.15.116:0/560058942 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faab8036810 con 0x7faac406d200 2024-02-21T22:53:28.382 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.390+0000 7faaca5cc640 1 -- 172.21.15.116:0/560058942 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faac406d200 msgr2=0x7faac406d5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:28.382 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.390+0000 7faaca5cc640 1 --2- 172.21.15.116:0/560058942 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faac406d200 0x7faac406d5e0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7faac40b27e0 tx=0x7faab802e0e0 comp rx=0 tx=0).stop 2024-02-21T22:53:28.383 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.390+0000 7faaca5cc640 1 -- 172.21.15.116:0/560058942 shutdown_connections 2024-02-21T22:53:28.383 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.390+0000 7faaca5cc640 1 --2- 172.21.15.116:0/560058942 >> v2:172.21.15.142:3300/0 conn(0x7faac415ba50 0x7faac415bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:28.383 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.390+0000 7faaca5cc640 1 --2- 172.21.15.116:0/560058942 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faac40b2c70 0x7faac40cf240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:28.383 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.390+0000 7faaca5cc640 1 --2- 172.21.15.116:0/560058942 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faac406d200 0x7faac406d5e0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:28.383 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.390+0000 7faaca5cc640 1 -- 172.21.15.116:0/560058942 >> 172.21.15.116:0/560058942 conn(0x7faac40b1740 msgr2=0x7faac40b1b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:28.383 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.390+0000 7faaca5cc640 1 -- 172.21.15.116:0/560058942 shutdown_connections 2024-02-21T22:53:28.383 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.390+0000 7faaca5cc640 1 -- 172.21.15.116:0/560058942 wait complete. 2024-02-21T22:53:28.383 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.392+0000 7faaca5cc640 1 Processor -- start 2024-02-21T22:53:28.383 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.392+0000 7faaca5cc640 1 -- start start 2024-02-21T22:53:28.385 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.393+0000 7faaca5cc640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faac406d200 0x7faac40ce820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:28.386 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.393+0000 7faaca5cc640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faac40b2c70 0x7faac41f3370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:28.386 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.393+0000 7faaca5cc640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faac415ba50 0x7faac40b3150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:28.386 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.393+0000 7faaca5cc640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faac4158130 con 0x7faac406d200 2024-02-21T22:53:28.386 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.393+0000 7faaca5cc640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faac40cf780 con 0x7faac415ba50 2024-02-21T22:53:28.386 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.393+0000 7faaca5cc640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faac41582b0 con 0x7faac40b2c70 2024-02-21T22:53:28.386 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.393+0000 7faac3fff640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faac406d200 0x7faac40ce820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:28.386 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.393+0000 7faac3fff640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faac406d200 0x7faac40ce820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:36110/0 (socket says 172.21.15.116:36110) 2024-02-21T22:53:28.386 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.393+0000 7faac3fff640 1 -- 172.21.15.116:0/110173356 learned_addr learned my addr 172.21.15.116:0/110173356 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:28.386 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.393+0000 7faac37fe640 1 --2- 172.21.15.116:0/110173356 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faac40b2c70 0x7faac41f3370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:28.386 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.393+0000 7faac8b69640 1 --2- 172.21.15.116:0/110173356 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faac415ba50 0x7faac40b3150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:28.386 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.393+0000 7faac3fff640 1 -- 172.21.15.116:0/110173356 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faac40b2c70 msgr2=0x7faac41f3370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:28.386 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.393+0000 7faac3fff640 1 --2- 172.21.15.116:0/110173356 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faac40b2c70 0x7faac41f3370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:28.386 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.393+0000 7faac3fff640 1 -- 172.21.15.116:0/110173356 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faac415ba50 msgr2=0x7faac40b3150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:28.387 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.393+0000 7faac3fff640 1 --2- 172.21.15.116:0/110173356 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faac415ba50 0x7faac40b3150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:28.387 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.393+0000 7faac3fff640 1 -- 172.21.15.116:0/110173356 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faac40adc50 con 0x7faac406d200 2024-02-21T22:53:28.387 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.393+0000 7faac3fff640 1 --2- 172.21.15.116:0/110173356 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faac406d200 0x7faac40ce820 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7faab802e120 tx=0x7faab80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:28.387 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.393+0000 7faac0ff9640 1 -- 172.21.15.116:0/110173356 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faab8046070 con 0x7faac406d200 2024-02-21T22:53:28.387 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.393+0000 7faac0ff9640 1 -- 172.21.15.116:0/110173356 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faab803d050 con 0x7faac406d200 2024-02-21T22:53:28.387 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.393+0000 7faac0ff9640 1 -- 172.21.15.116:0/110173356 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faab803b030 con 0x7faac406d200 2024-02-21T22:53:28.387 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.393+0000 7faaca5cc640 1 -- 172.21.15.116:0/110173356 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faac40adf30 con 0x7faac406d200 2024-02-21T22:53:28.387 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.393+0000 7faaca5cc640 1 -- 172.21.15.116:0/110173356 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faac40ae4f0 con 0x7faac406d200 2024-02-21T22:53:28.387 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.394+0000 7faaca5cc640 1 -- 172.21.15.116:0/110173356 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faac40752f0 con 0x7faac406d200 2024-02-21T22:53:28.387 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.395+0000 7faac0ff9640 1 -- 172.21.15.116:0/110173356 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7faab8049070 con 0x7faac406d200 2024-02-21T22:53:28.387 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.395+0000 7faac0ff9640 1 --2- 172.21.15.116:0/110173356 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7faab006b4d0 0x7faab006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:28.387 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.395+0000 7faac0ff9640 1 -- 172.21.15.116:0/110173356 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7faab80abab0 con 0x7faac406d200 2024-02-21T22:53:28.387 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.395+0000 7faac37fe640 1 --2- 172.21.15.116:0/110173356 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7faab006b4d0 0x7faab006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:28.388 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.396+0000 7faac37fe640 1 --2- 172.21.15.116:0/110173356 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7faab006b4d0 0x7faab006d990 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7faac40ce540 tx=0x7faab4009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:28.390 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.399+0000 7faac0ff9640 1 -- 172.21.15.116:0/110173356 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7faab807a370 con 0x7faac406d200 2024-02-21T22:53:28.568 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.578+0000 7faaca5cc640 1 -- 172.21.15.116:0/110173356 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7faac4070d90 con 0x7faac406d200 2024-02-21T22:53:28.569 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.578+0000 7faac0ff9640 1 -- 172.21.15.116:0/110173356 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7faab807e410 con 0x7faac406d200 2024-02-21T22:53:28.569 INFO:teuthology.orchestra.run.smithi116.stdout:pg_num: 32 2024-02-21T22:53:28.571 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.580+0000 7faaca5cc640 1 -- 172.21.15.116:0/110173356 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7faab006b4d0 msgr2=0x7faab006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:28.571 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.580+0000 7faaca5cc640 1 --2- 172.21.15.116:0/110173356 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7faab006b4d0 0x7faab006d990 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7faac40ce540 tx=0x7faab4009190 comp rx=0 tx=0).stop 2024-02-21T22:53:28.571 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.580+0000 7faaca5cc640 1 -- 172.21.15.116:0/110173356 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faac406d200 msgr2=0x7faac40ce820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:28.571 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.580+0000 7faaca5cc640 1 --2- 172.21.15.116:0/110173356 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faac406d200 0x7faac40ce820 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7faab802e120 tx=0x7faab80046c0 comp rx=0 tx=0).stop 2024-02-21T22:53:28.571 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.580+0000 7faaca5cc640 1 -- 172.21.15.116:0/110173356 shutdown_connections 2024-02-21T22:53:28.571 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.580+0000 7faaca5cc640 1 --2- 172.21.15.116:0/110173356 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faac415ba50 0x7faac40b3150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:28.571 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.580+0000 7faaca5cc640 1 --2- 172.21.15.116:0/110173356 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7faab006b4d0 0x7faab006d990 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:28.571 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.580+0000 7faaca5cc640 1 --2- 172.21.15.116:0/110173356 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faac40b2c70 0x7faac41f3370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:28.571 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.580+0000 7faaca5cc640 1 --2- 172.21.15.116:0/110173356 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faac406d200 0x7faac40ce820 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:28.571 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.580+0000 7faaca5cc640 1 -- 172.21.15.116:0/110173356 >> 172.21.15.116:0/110173356 conn(0x7faac40b1740 msgr2=0x7faac4156350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:28.572 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.580+0000 7faaca5cc640 1 -- 172.21.15.116:0/110173356 shutdown_connections 2024-02-21T22:53:28.572 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.580+0000 7faaca5cc640 1 -- 172.21.15.116:0/110173356 wait complete. 2024-02-21T22:53:28.582 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-02-21T22:53:28.690 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.700+0000 7fcd1a39c640 1 Processor -- start 2024-02-21T22:53:28.690 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.700+0000 7fcd1a39c640 1 -- start start 2024-02-21T22:53:28.692 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.701+0000 7fcd1a39c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcd1415ee40 0x7fcd1406f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:28.693 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.701+0000 7fcd1a39c640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fcd1406b550 0x7fcd14161a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:28.693 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.701+0000 7fcd1a39c640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd140cd710 con 0x7fcd1415f220 2024-02-21T22:53:28.693 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.701+0000 7fcd1a39c640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd1415e6d0 con 0x7fcd1406b550 2024-02-21T22:53:28.693 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.701+0000 7fcd1a39c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd140cd9f0 con 0x7fcd1415ee40 2024-02-21T22:53:28.693 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.701+0000 7fcd18939640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fcd1406b550 0x7fcd14161a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:28.693 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.701+0000 7fcd18939640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fcd1406b550 0x7fcd14161a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:36122/0 (socket says 172.21.15.116:36122) 2024-02-21T22:53:28.693 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.701+0000 7fcd137fe640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fcd1415f220 0x7fcd1406ae40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.116:45730/0 (socket says 172.21.15.116:45730) 2024-02-21T22:53:28.693 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.701+0000 7fcd18939640 1 -- 172.21.15.116:0/3736270046 learned_addr learned my addr 172.21.15.116:0/3736270046 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:28.693 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.701+0000 7fcd13fff640 1 --2- 172.21.15.116:0/3736270046 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcd1415ee40 0x7fcd1406f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:28.693 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.701+0000 7fcd12ffd640 1 -- 172.21.15.116:0/3736270046 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2018183057 0 0) 0x7fcd140cd710 con 0x7fcd1415f220 2024-02-21T22:53:28.693 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.701+0000 7fcd18939640 1 -- 172.21.15.116:0/3736270046 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcd1415ee40 msgr2=0x7fcd1406f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:53:28.693 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.701+0000 7fcd18939640 1 --2- 172.21.15.116:0/3736270046 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcd1415ee40 0x7fcd1406f0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:28.693 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.701+0000 7fcd18939640 1 -- 172.21.15.116:0/3736270046 >> v1:172.21.15.142:6789/0 conn(0x7fcd1415f220 legacy=0x7fcd1406ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:28.694 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.701+0000 7fcd18939640 1 -- 172.21.15.116:0/3736270046 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd140cdcd0 con 0x7fcd1406b550 2024-02-21T22:53:28.694 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.701+0000 7fcd13fff640 1 --2- 172.21.15.116:0/3736270046 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcd1415ee40 0x7fcd1406f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T22:53:28.694 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.702+0000 7fcd18939640 1 --2- 172.21.15.116:0/3736270046 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcd1406b550 0x7fcd14161a60 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fcd0c009e50 tx=0x7fcd0c02bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcf30d44fe0ffa8b server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:28.694 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.702+0000 7fcd12ffd640 1 -- 172.21.15.116:0/3736270046 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd0c02cb00 con 0x7fcd1406b550 2024-02-21T22:53:28.694 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.702+0000 7fcd12ffd640 1 -- 172.21.15.116:0/3736270046 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd0c02cca0 con 0x7fcd1406b550 2024-02-21T22:53:28.694 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.702+0000 7fcd12ffd640 1 -- 172.21.15.116:0/3736270046 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd0c034610 con 0x7fcd1406b550 2024-02-21T22:53:28.695 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.703+0000 7fcd1a39c640 1 -- 172.21.15.116:0/3736270046 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcd1406b550 msgr2=0x7fcd14161a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:28.695 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.703+0000 7fcd1a39c640 1 --2- 172.21.15.116:0/3736270046 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcd1406b550 0x7fcd14161a60 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fcd0c009e50 tx=0x7fcd0c02bf60 comp rx=0 tx=0).stop 2024-02-21T22:53:28.695 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.703+0000 7fcd1a39c640 1 -- 172.21.15.116:0/3736270046 shutdown_connections 2024-02-21T22:53:28.695 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.703+0000 7fcd1a39c640 1 --2- 172.21.15.116:0/3736270046 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcd1406b550 0x7fcd14161a60 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:28.695 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.703+0000 7fcd1a39c640 1 --2- 172.21.15.116:0/3736270046 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcd1415ee40 0x7fcd1406f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:28.695 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.703+0000 7fcd1a39c640 1 -- 172.21.15.116:0/3736270046 >> 172.21.15.116:0/3736270046 conn(0x7fcd140b2590 msgr2=0x7fcd140b2970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:28.695 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.703+0000 7fcd1a39c640 1 -- 172.21.15.116:0/3736270046 shutdown_connections 2024-02-21T22:53:28.695 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.703+0000 7fcd1a39c640 1 -- 172.21.15.116:0/3736270046 wait complete. 2024-02-21T22:53:28.696 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.704+0000 7fcd1a39c640 1 Processor -- start 2024-02-21T22:53:28.696 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.704+0000 7fcd1a39c640 1 -- start start 2024-02-21T22:53:28.698 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.705+0000 7fcd1a39c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcd1406b550 0x7fcd140c6b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:28.698 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.705+0000 7fcd1a39c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcd1415ee40 0x7fcd14152610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:28.698 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.705+0000 7fcd1a39c640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcd140c4ad0 0x7fcd14160aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:28.698 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.705+0000 7fcd1a39c640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd1406f5f0 con 0x7fcd140c4ad0 2024-02-21T22:53:28.698 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.705+0000 7fcd1a39c640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd140cd400 con 0x7fcd1406b550 2024-02-21T22:53:28.698 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.705+0000 7fcd1a39c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd140b0010 con 0x7fcd1415ee40 2024-02-21T22:53:28.699 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.705+0000 7fcd18939640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcd140c4ad0 0x7fcd14160aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:28.699 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.705+0000 7fcd18939640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcd140c4ad0 0x7fcd14160aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:36136/0 (socket says 172.21.15.116:36136) 2024-02-21T22:53:28.699 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.705+0000 7fcd18939640 1 -- 172.21.15.116:0/3969017406 learned_addr learned my addr 172.21.15.116:0/3969017406 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:28.699 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.705+0000 7fcd137fe640 1 --2- 172.21.15.116:0/3969017406 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcd1415ee40 0x7fcd14152610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:28.699 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.705+0000 7fcd13fff640 1 --2- 172.21.15.116:0/3969017406 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcd1406b550 0x7fcd140c6b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:28.699 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.706+0000 7fcd18939640 1 -- 172.21.15.116:0/3969017406 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcd1415ee40 msgr2=0x7fcd14152610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:28.699 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.706+0000 7fcd18939640 1 --2- 172.21.15.116:0/3969017406 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcd1415ee40 0x7fcd14152610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:28.699 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.706+0000 7fcd18939640 1 -- 172.21.15.116:0/3969017406 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcd1406b550 msgr2=0x7fcd140c6b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:28.699 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.706+0000 7fcd18939640 1 --2- 172.21.15.116:0/3969017406 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcd1406b550 0x7fcd140c6b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:28.699 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.706+0000 7fcd18939640 1 -- 172.21.15.116:0/3969017406 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd140c5dc0 con 0x7fcd140c4ad0 2024-02-21T22:53:28.699 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.706+0000 7fcd18939640 1 --2- 172.21.15.116:0/3969017406 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcd140c4ad0 0x7fcd14160aa0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fcd0c036040 tx=0x7fcd0c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:28.699 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.706+0000 7fcd10ff9640 1 -- 172.21.15.116:0/3969017406 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd0c043020 con 0x7fcd140c4ad0 2024-02-21T22:53:28.699 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.706+0000 7fcd10ff9640 1 -- 172.21.15.116:0/3969017406 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd0c02ce50 con 0x7fcd140c4ad0 2024-02-21T22:53:28.699 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.706+0000 7fcd10ff9640 1 -- 172.21.15.116:0/3969017406 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd0c009510 con 0x7fcd140c4ad0 2024-02-21T22:53:28.699 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.706+0000 7fcd1a39c640 1 -- 172.21.15.116:0/3969017406 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd140c60a0 con 0x7fcd140c4ad0 2024-02-21T22:53:28.700 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.706+0000 7fcd1a39c640 1 -- 172.21.15.116:0/3969017406 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd140c6660 con 0x7fcd140c4ad0 2024-02-21T22:53:28.700 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.707+0000 7fcd1a39c640 1 -- 172.21.15.116:0/3969017406 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd140752f0 con 0x7fcd140c4ad0 2024-02-21T22:53:28.700 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.707+0000 7fcd10ff9640 1 -- 172.21.15.116:0/3969017406 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fcd0c046020 con 0x7fcd140c4ad0 2024-02-21T22:53:28.700 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.708+0000 7fcd10ff9640 1 --2- 172.21.15.116:0/3969017406 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fcd0006b4d0 0x7fcd0006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:28.700 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.708+0000 7fcd10ff9640 1 -- 172.21.15.116:0/3969017406 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcd0c0ac6e0 con 0x7fcd140c4ad0 2024-02-21T22:53:28.700 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.708+0000 7fcd13fff640 1 --2- 172.21.15.116:0/3969017406 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fcd0006b4d0 0x7fcd0006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:28.700 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.708+0000 7fcd13fff640 1 --2- 172.21.15.116:0/3969017406 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fcd0006b4d0 0x7fcd0006d990 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fcd04009560 tx=0x7fcd04009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:28.702 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.712+0000 7fcd10ff9640 1 -- 172.21.15.116:0/3969017406 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7fcd0c04d030 con 0x7fcd140c4ad0 2024-02-21T22:53:28.882 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.891+0000 7fcd1a39c640 1 -- 172.21.15.116:0/3969017406 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fcd140c6830 con 0x7fcd140c4ad0 2024-02-21T22:53:28.882 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.892+0000 7fcd10ff9640 1 -- 172.21.15.116:0/3969017406 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fcd0c07ae90 con 0x7fcd140c4ad0 2024-02-21T22:53:28.883 INFO:teuthology.orchestra.run.smithi116.stdout:pg_num: 64 2024-02-21T22:53:28.888 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.894+0000 7fcd1a39c640 1 -- 172.21.15.116:0/3969017406 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fcd0006b4d0 msgr2=0x7fcd0006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:28.888 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.894+0000 7fcd1a39c640 1 --2- 172.21.15.116:0/3969017406 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fcd0006b4d0 0x7fcd0006d990 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fcd04009560 tx=0x7fcd04009190 comp rx=0 tx=0).stop 2024-02-21T22:53:28.888 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.894+0000 7fcd1a39c640 1 -- 172.21.15.116:0/3969017406 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcd140c4ad0 msgr2=0x7fcd14160aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:28.888 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.894+0000 7fcd1a39c640 1 --2- 172.21.15.116:0/3969017406 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcd140c4ad0 0x7fcd14160aa0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fcd0c036040 tx=0x7fcd0c004a40 comp rx=0 tx=0).stop 2024-02-21T22:53:28.888 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.894+0000 7fcd1a39c640 1 -- 172.21.15.116:0/3969017406 shutdown_connections 2024-02-21T22:53:28.888 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.894+0000 7fcd1a39c640 1 --2- 172.21.15.116:0/3969017406 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcd140c4ad0 0x7fcd14160aa0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:28.888 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.894+0000 7fcd1a39c640 1 --2- 172.21.15.116:0/3969017406 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fcd0006b4d0 0x7fcd0006d990 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:28.888 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.894+0000 7fcd1a39c640 1 --2- 172.21.15.116:0/3969017406 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcd1415ee40 0x7fcd14152610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:28.888 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.894+0000 7fcd1a39c640 1 --2- 172.21.15.116:0/3969017406 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcd1406b550 0x7fcd140c6b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:28.889 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.894+0000 7fcd1a39c640 1 -- 172.21.15.116:0/3969017406 >> 172.21.15.116:0/3969017406 conn(0x7fcd140b2590 msgr2=0x7fcd140b0410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:28.889 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.894+0000 7fcd1a39c640 1 -- 172.21.15.116:0/3969017406 shutdown_connections 2024-02-21T22:53:28.889 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:28.894+0000 7fcd1a39c640 1 -- 172.21.15.116:0/3969017406 wait complete. 2024-02-21T22:53:28.895 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-02-21T22:53:29.000 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.009+0000 7f087b95e640 1 Processor -- start 2024-02-21T22:53:29.000 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.010+0000 7f087b95e640 1 -- start start 2024-02-21T22:53:29.002 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.010+0000 7f087b95e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f08740acd30 0x7f08740ad1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:29.002 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.010+0000 7f087b95e640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08740b3690 con 0x7f087415a680 2024-02-21T22:53:29.002 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.010+0000 7f087b95e640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08740b3930 con 0x7f0874071580 2024-02-21T22:53:29.002 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.010+0000 7f087b95e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08740b3c10 con 0x7f08740acd30 2024-02-21T22:53:29.002 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.010+0000 7f08796fa640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f087415a680 0x7f087406e200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:36882/0 (socket says 172.21.15.116:36882) 2024-02-21T22:53:29.003 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.010+0000 7f08796fa640 1 -- 172.21.15.116:0/2888197729 learned_addr learned my addr 172.21.15.116:0/2888197729 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-02-21T22:53:29.003 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.011+0000 7f0879efb640 1 --2- 172.21.15.116:0/2888197729 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f08740acd30 0x7f08740ad1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:29.003 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.011+0000 7f086bfff640 1 -- 172.21.15.116:0/2888197729 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2047357965 0 0) 0x7f08740b3690 con 0x7f087415a680 2024-02-21T22:53:29.003 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.011+0000 7f086bfff640 1 -- 172.21.15.116:0/2888197729 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0860003520 con 0x7f087415a680 2024-02-21T22:53:29.003 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.011+0000 7f086bfff640 1 -- 172.21.15.116:0/2888197729 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4154923968 0 0) 0x7f08740b3930 con 0x7f0874071580 2024-02-21T22:53:29.003 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.011+0000 7f086bfff640 1 -- 172.21.15.116:0/2888197729 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f08740b3690 con 0x7f0874071580 2024-02-21T22:53:29.003 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.011+0000 7f0879efb640 1 -- 172.21.15.116:0/2888197729 >> v1:172.21.15.142:6789/0 conn(0x7f0874071580 legacy=0x7f08740b46f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:29.003 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.011+0000 7f0879efb640 1 -- 172.21.15.116:0/2888197729 >> v1:172.21.15.116:6789/0 conn(0x7f087415a680 legacy=0x7f087406e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:29.003 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.011+0000 7f0879efb640 1 -- 172.21.15.116:0/2888197729 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08740b3ef0 con 0x7f08740acd30 2024-02-21T22:53:29.003 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.012+0000 7f0879efb640 1 --2- 172.21.15.116:0/2888197729 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f08740acd30 0x7f08740ad1e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f087000aed0 tx=0x7f087002d020 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e0a39f6e29e5185b server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:29.003 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.012+0000 7f086bfff640 1 -- 172.21.15.116:0/2888197729 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f087002dbc0 con 0x7f08740acd30 2024-02-21T22:53:29.003 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.012+0000 7f086bfff640 1 -- 172.21.15.116:0/2888197729 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f087002dd60 con 0x7f08740acd30 2024-02-21T22:53:29.003 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.012+0000 7f086bfff640 1 -- 172.21.15.116:0/2888197729 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0870008660 con 0x7f08740acd30 2024-02-21T22:53:29.006 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.012+0000 7f087b95e640 1 -- 172.21.15.116:0/2888197729 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f08740acd30 msgr2=0x7f08740ad1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:29.006 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.012+0000 7f087b95e640 1 --2- 172.21.15.116:0/2888197729 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f08740acd30 0x7f08740ad1e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f087000aed0 tx=0x7f087002d020 comp rx=0 tx=0).stop 2024-02-21T22:53:29.006 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.012+0000 7f087b95e640 1 -- 172.21.15.116:0/2888197729 shutdown_connections 2024-02-21T22:53:29.006 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.012+0000 7f087b95e640 1 --2- 172.21.15.116:0/2888197729 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f08740acd30 0x7f08740ad1e0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:29.006 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.012+0000 7f087b95e640 1 -- 172.21.15.116:0/2888197729 >> 172.21.15.116:0/2888197729 conn(0x7f08740b18e0 msgr2=0x7f08740b1cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:29.006 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.013+0000 7f087b95e640 1 -- 172.21.15.116:0/2888197729 shutdown_connections 2024-02-21T22:53:29.007 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.013+0000 7f087b95e640 1 -- 172.21.15.116:0/2888197729 wait complete. 2024-02-21T22:53:29.007 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.014+0000 7f087b95e640 1 Processor -- start 2024-02-21T22:53:29.007 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.014+0000 7f087b95e640 1 -- start start 2024-02-21T22:53:29.007 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.014+0000 7f087b95e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0874071580 0x7f087415b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:29.007 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.014+0000 7f087b95e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f08740acd30 0x7f087415cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:29.007 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.014+0000 7f087b95e640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f08741f1c20 0x7f08741f20d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:29.007 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.014+0000 7f087b95e640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f087406c8f0 con 0x7f08741f1c20 2024-02-21T22:53:29.007 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.014+0000 7f087b95e640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08740b4e00 con 0x7f08740acd30 2024-02-21T22:53:29.007 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.014+0000 7f087b95e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f087406ca70 con 0x7f0874071580 2024-02-21T22:53:29.007 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.014+0000 7f0879efb640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f08741f1c20 0x7f08741f20d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:29.007 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.014+0000 7f0879efb640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f08741f1c20 0x7f08741f20d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:36146/0 (socket says 172.21.15.116:36146) 2024-02-21T22:53:29.007 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.014+0000 7f0879efb640 1 -- 172.21.15.116:0/2780499578 learned_addr learned my addr 172.21.15.116:0/2780499578 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:29.007 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.014+0000 7f08796fa640 1 --2- 172.21.15.116:0/2780499578 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0874071580 0x7f087415b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:29.007 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.014+0000 7f0878ef9640 1 --2- 172.21.15.116:0/2780499578 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f08740acd30 0x7f087415cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:29.008 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.015+0000 7f0879efb640 1 -- 172.21.15.116:0/2780499578 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0874071580 msgr2=0x7f087415b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:29.008 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.015+0000 7f0879efb640 1 --2- 172.21.15.116:0/2780499578 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0874071580 0x7f087415b480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:29.008 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.015+0000 7f0879efb640 1 -- 172.21.15.116:0/2780499578 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f08740acd30 msgr2=0x7f087415cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:29.008 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.015+0000 7f0879efb640 1 --2- 172.21.15.116:0/2780499578 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f08740acd30 0x7f087415cf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:29.008 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.015+0000 7f0879efb640 1 -- 172.21.15.116:0/2780499578 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08741f4f60 con 0x7f08741f1c20 2024-02-21T22:53:29.008 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.015+0000 7f0878ef9640 1 --2- 172.21.15.116:0/2780499578 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f08740acd30 0x7f087415cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T22:53:29.008 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.015+0000 7f0879efb640 1 --2- 172.21.15.116:0/2780499578 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f08741f1c20 0x7f08741f20d0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f087002d060 tx=0x7f0870004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:29.008 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.015+0000 7f0869ffb640 1 -- 172.21.15.116:0/2780499578 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0870044020 con 0x7f08741f1c20 2024-02-21T22:53:29.008 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.015+0000 7f0869ffb640 1 -- 172.21.15.116:0/2780499578 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0870040670 con 0x7f08741f1c20 2024-02-21T22:53:29.008 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.015+0000 7f087b95e640 1 -- 172.21.15.116:0/2780499578 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f087415ba60 con 0x7f08741f1c20 2024-02-21T22:53:29.008 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.015+0000 7f0869ffb640 1 -- 172.21.15.116:0/2780499578 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f087000a560 con 0x7f08741f1c20 2024-02-21T22:53:29.008 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.015+0000 7f087b95e640 1 -- 172.21.15.116:0/2780499578 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f087415c020 con 0x7f08741f1c20 2024-02-21T22:53:29.009 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.016+0000 7f087b95e640 1 -- 172.21.15.116:0/2780499578 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08740752f0 con 0x7f08741f1c20 2024-02-21T22:53:29.009 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.017+0000 7f0869ffb640 1 -- 172.21.15.116:0/2780499578 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f0870047020 con 0x7f08741f1c20 2024-02-21T22:53:29.009 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.018+0000 7f0869ffb640 1 --2- 172.21.15.116:0/2780499578 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f085806b4d0 0x7f085806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:29.010 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.018+0000 7f0869ffb640 1 -- 172.21.15.116:0/2780499578 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f08700acd60 con 0x7f08741f1c20 2024-02-21T22:53:29.010 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.018+0000 7f08796fa640 1 --2- 172.21.15.116:0/2780499578 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f085806b4d0 0x7f085806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:29.010 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.018+0000 7f08796fa640 1 --2- 172.21.15.116:0/2780499578 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f085806b4d0 0x7f085806d990 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f086c000f60 tx=0x7f086c007d70 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:29.012 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.022+0000 7f0869ffb640 1 -- 172.21.15.116:0/2780499578 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f087004e070 con 0x7f08741f1c20 2024-02-21T22:53:29.202 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.211+0000 7f087b95e640 1 -- 172.21.15.116:0/2780499578 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f087415e480 con 0x7f08741f1c20 2024-02-21T22:53:29.202 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.212+0000 7f0869ffb640 1 -- 172.21.15.116:0/2780499578 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) v1 ==== 80+0+0 (secure 0 0 0) 0x7f087007bd30 con 0x7f08741f1c20 2024-02-21T22:53:29.202 INFO:teuthology.orchestra.run.smithi116.stderr:listed 0 entries 2024-02-21T22:53:29.204 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.214+0000 7f087b95e640 1 -- 172.21.15.116:0/2780499578 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f085806b4d0 msgr2=0x7f085806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:29.205 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.214+0000 7f087b95e640 1 --2- 172.21.15.116:0/2780499578 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f085806b4d0 0x7f085806d990 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f086c000f60 tx=0x7f086c007d70 comp rx=0 tx=0).stop 2024-02-21T22:53:29.205 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.214+0000 7f087b95e640 1 -- 172.21.15.116:0/2780499578 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f08741f1c20 msgr2=0x7f08741f20d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:29.205 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.214+0000 7f087b95e640 1 --2- 172.21.15.116:0/2780499578 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f08741f1c20 0x7f08741f20d0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f087002d060 tx=0x7f0870004a40 comp rx=0 tx=0).stop 2024-02-21T22:53:29.205 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.214+0000 7f087b95e640 1 -- 172.21.15.116:0/2780499578 shutdown_connections 2024-02-21T22:53:29.205 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.214+0000 7f087b95e640 1 --2- 172.21.15.116:0/2780499578 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f08741f1c20 0x7f08741f20d0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:29.205 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.214+0000 7f087b95e640 1 --2- 172.21.15.116:0/2780499578 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f08740acd30 0x7f087415cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:29.205 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.214+0000 7f087b95e640 1 --2- 172.21.15.116:0/2780499578 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f085806b4d0 0x7f085806d990 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:29.205 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.214+0000 7f087b95e640 1 --2- 172.21.15.116:0/2780499578 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0874071580 0x7f087415b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:29.205 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.214+0000 7f087b95e640 1 -- 172.21.15.116:0/2780499578 >> 172.21.15.116:0/2780499578 conn(0x7f08740b18e0 msgr2=0x7f08740d00b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:29.205 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.214+0000 7f087b95e640 1 -- 172.21.15.116:0/2780499578 shutdown_connections 2024-02-21T22:53:29.205 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.214+0000 7f087b95e640 1 -- 172.21.15.116:0/2780499578 wait complete. 2024-02-21T22:53:29.215 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2024-02-21T22:53:29.215 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T22:53:29.215 DEBUG:teuthology.orchestra.run.smithi142:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2024-02-21T22:53:29.244 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi142.front.sepia.ceph.com 2024-02-21T22:53:29.244 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T22:53:29.244 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-02-21T22:53:29.299 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-02-21T22:53:29.300 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-21T22:53:29.401 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.411+0000 7fa5139b4640 1 Processor -- start 2024-02-21T22:53:29.401 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.411+0000 7fa5139b4640 1 -- start start 2024-02-21T22:53:29.403 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.411+0000 7fa5139b4640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fa50c0d0510 0x7fa50c0d08f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:29.403 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.411+0000 7fa5139b4640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa50c0cb930 0x7fa50c0cbd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:29.403 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.411+0000 7fa5139b4640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa50c0cfa50 con 0x7fa50c0d1c30 2024-02-21T22:53:29.403 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.411+0000 7fa5139b4640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa50c0d1450 con 0x7fa50c0d0510 2024-02-21T22:53:29.403 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.411+0000 7fa5139b4640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa50c0d0e30 con 0x7fa50c0cb930 2024-02-21T22:53:29.404 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.412+0000 7fa511750640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fa50c0d0510 0x7fa50c0d08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:29.404 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.412+0000 7fa511750640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fa50c0d0510 0x7fa50c0d08f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:36148/0 (socket says 172.21.15.116:36148) 2024-02-21T22:53:29.404 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.412+0000 7fa511750640 1 -- 172.21.15.116:0/2973629176 learned_addr learned my addr 172.21.15.116:0/2973629176 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:29.404 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.412+0000 7fa511f51640 1 --2- 172.21.15.116:0/2973629176 >> v2:172.21.15.142:3300/0 conn(0x7fa50c0cb930 0x7fa50c0cbd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:29.404 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.412+0000 7fa511750640 1 -- 172.21.15.116:0/2973629176 >> v2:172.21.15.142:3300/0 conn(0x7fa50c0cb930 msgr2=0x7fa50c0cbd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:53:29.404 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.412+0000 7fa511750640 1 --2- 172.21.15.116:0/2973629176 >> v2:172.21.15.142:3300/0 conn(0x7fa50c0cb930 0x7fa50c0cbd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:29.404 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.412+0000 7fa511750640 1 -- 172.21.15.116:0/2973629176 >> v1:172.21.15.142:6789/0 conn(0x7fa50c0d1c30 legacy=0x7fa50c0d2430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:29.404 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.412+0000 7fa511750640 1 -- 172.21.15.116:0/2973629176 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa50c0cfcc0 con 0x7fa50c0d0510 2024-02-21T22:53:29.404 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.413+0000 7fa511750640 1 --2- 172.21.15.116:0/2973629176 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa50c0d0510 0x7fa50c0d08f0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fa50c0d15d0 tx=0x7fa50802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70ed706aa52aba5d server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:29.404 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.413+0000 7fa503fff640 1 -- 172.21.15.116:0/2973629176 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa508035020 con 0x7fa50c0d0510 2024-02-21T22:53:29.404 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.413+0000 7fa503fff640 1 -- 172.21.15.116:0/2973629176 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa508031870 con 0x7fa50c0d0510 2024-02-21T22:53:29.404 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.413+0000 7fa503fff640 1 -- 172.21.15.116:0/2973629176 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa508031c40 con 0x7fa50c0d0510 2024-02-21T22:53:29.407 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.413+0000 7fa5139b4640 1 -- 172.21.15.116:0/2973629176 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa50c0d0510 msgr2=0x7fa50c0d08f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:29.407 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.413+0000 7fa5139b4640 1 --2- 172.21.15.116:0/2973629176 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa50c0d0510 0x7fa50c0d08f0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fa50c0d15d0 tx=0x7fa50802b910 comp rx=0 tx=0).stop 2024-02-21T22:53:29.407 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.413+0000 7fa5139b4640 1 -- 172.21.15.116:0/2973629176 shutdown_connections 2024-02-21T22:53:29.407 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.413+0000 7fa5139b4640 1 --2- 172.21.15.116:0/2973629176 >> v2:172.21.15.142:3300/0 conn(0x7fa50c0cb930 0x7fa50c0cbd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:29.407 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.413+0000 7fa5139b4640 1 --2- 172.21.15.116:0/2973629176 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa50c0d0510 0x7fa50c0d08f0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:29.407 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.413+0000 7fa5139b4640 1 -- 172.21.15.116:0/2973629176 >> 172.21.15.116:0/2973629176 conn(0x7fa50c0d3e50 msgr2=0x7fa50c0d4260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:29.408 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.414+0000 7fa5139b4640 1 -- 172.21.15.116:0/2973629176 shutdown_connections 2024-02-21T22:53:29.408 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.414+0000 7fa5139b4640 1 -- 172.21.15.116:0/2973629176 wait complete. 2024-02-21T22:53:29.408 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.415+0000 7fa5139b4640 1 Processor -- start 2024-02-21T22:53:29.408 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.415+0000 7fa5139b4640 1 -- start start 2024-02-21T22:53:29.408 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.415+0000 7fa5139b4640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa50c0cb930 0x7fa50c158d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:29.408 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.415+0000 7fa5139b4640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa50c0d0510 0x7fa50c159290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:29.408 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.415+0000 7fa5139b4640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa50c0d1c30 0x7fa50c1575d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:29.408 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.415+0000 7fa5139b4640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa50c15e640 con 0x7fa50c0d0510 2024-02-21T22:53:29.408 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.415+0000 7fa5139b4640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa50c0d10e0 con 0x7fa50c0d1c30 2024-02-21T22:53:29.408 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.415+0000 7fa5139b4640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa50c0cc2c0 con 0x7fa50c0cb930 2024-02-21T22:53:29.408 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.416+0000 7fa510f4f640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa50c0d0510 0x7fa50c159290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:29.408 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.416+0000 7fa510f4f640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa50c0d0510 0x7fa50c159290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:36158/0 (socket says 172.21.15.116:36158) 2024-02-21T22:53:29.408 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.416+0000 7fa510f4f640 1 -- 172.21.15.116:0/2333024594 learned_addr learned my addr 172.21.15.116:0/2333024594 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:29.408 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.416+0000 7fa511750640 1 --2- 172.21.15.116:0/2333024594 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa50c0cb930 0x7fa50c158d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:29.408 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.416+0000 7fa511f51640 1 --2- 172.21.15.116:0/2333024594 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa50c0d1c30 0x7fa50c1575d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:29.409 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.416+0000 7fa510f4f640 1 -- 172.21.15.116:0/2333024594 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa50c0cb930 msgr2=0x7fa50c158d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:29.409 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.416+0000 7fa510f4f640 1 --2- 172.21.15.116:0/2333024594 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa50c0cb930 0x7fa50c158d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:29.409 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.416+0000 7fa510f4f640 1 -- 172.21.15.116:0/2333024594 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa50c0d1c30 msgr2=0x7fa50c1575d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:29.409 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.416+0000 7fa510f4f640 1 --2- 172.21.15.116:0/2333024594 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa50c0d1c30 0x7fa50c1575d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:29.409 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.416+0000 7fa510f4f640 1 -- 172.21.15.116:0/2333024594 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa50c1597d0 con 0x7fa50c0d0510 2024-02-21T22:53:29.409 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.416+0000 7fa511f51640 1 --2- 172.21.15.116:0/2333024594 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa50c0d1c30 0x7fa50c1575d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T22:53:29.409 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.416+0000 7fa511750640 1 --2- 172.21.15.116:0/2333024594 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa50c0cb930 0x7fa50c158d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T22:53:29.409 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.416+0000 7fa510f4f640 1 --2- 172.21.15.116:0/2333024594 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa50c0d0510 0x7fa50c159290 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fa4fc00c3c0 tx=0x7fa4fc00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:29.409 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.416+0000 7fa501ffb640 1 -- 172.21.15.116:0/2333024594 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4fc0052d0 con 0x7fa50c0d0510 2024-02-21T22:53:29.409 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.416+0000 7fa501ffb640 1 -- 172.21.15.116:0/2333024594 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4fc005490 con 0x7fa50c0d0510 2024-02-21T22:53:29.409 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.416+0000 7fa5139b4640 1 -- 172.21.15.116:0/2333024594 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa50c159a40 con 0x7fa50c0d0510 2024-02-21T22:53:29.409 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.416+0000 7fa501ffb640 1 -- 172.21.15.116:0/2333024594 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4fc007260 con 0x7fa50c0d0510 2024-02-21T22:53:29.409 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.416+0000 7fa5139b4640 1 -- 172.21.15.116:0/2333024594 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa50c15a000 con 0x7fa50c0d0510 2024-02-21T22:53:29.410 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.417+0000 7fa5139b4640 1 -- 172.21.15.116:0/2333024594 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa50c0752f0 con 0x7fa50c0d0510 2024-02-21T22:53:29.410 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.418+0000 7fa501ffb640 1 -- 172.21.15.116:0/2333024594 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fa4fc007400 con 0x7fa50c0d0510 2024-02-21T22:53:29.410 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.418+0000 7fa501ffb640 1 --2- 172.21.15.116:0/2333024594 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fa4f006b4d0 0x7fa4f006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:29.410 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.418+0000 7fa501ffb640 1 -- 172.21.15.116:0/2333024594 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa4fc0896a0 con 0x7fa50c0d0510 2024-02-21T22:53:29.411 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.419+0000 7fa511750640 1 --2- 172.21.15.116:0/2333024594 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fa4f006b4d0 0x7fa4f006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:29.411 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.419+0000 7fa511750640 1 --2- 172.21.15.116:0/2333024594 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fa4f006b4d0 0x7fa4f006d990 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fa508036000 tx=0x7fa50803c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:29.413 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.423+0000 7fa501ffb640 1 -- 172.21.15.116:0/2333024594 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7fa4fc058520 con 0x7fa50c0d0510 2024-02-21T22:53:29.625 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.635+0000 7fa5139b4640 1 -- 172.21.15.116:0/2333024594 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa50c0d2210 con 0x7fa50c0d0510 2024-02-21T22:53:29.626 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.635+0000 7fa501ffb640 1 -- 172.21.15.116:0/2333024594 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4941 (secure 0 0 0) 0x7fa4fc057e20 con 0x7fa50c0d0510 2024-02-21T22:53:29.626 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-02-21T22:53:29.626 INFO:teuthology.orchestra.run.smithi116.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6834/1717961923","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":1717961923},{"type":"v1","addr":"172.21.15.116:6834","nonce":1717961923}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6835/2228298220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6833","nonce":2228298220},{"type":"v1","addr":"172.21.15.116:6835","nonce":2228298220}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4285,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/1675920719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":1675920719},{"type":"v1","addr":"172.21.15.142:6837","nonce":1675920719}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-21T22:52:50.128732+0000","modified":"2024-02-21T22:52:52.125495+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6836/939436511","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":939436511},{"type":"v1","addr":"172.21.15.142:6836","nonce":939436511}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-02-21T22:53:29.626 INFO:teuthology.orchestra.run.smithi116.stderr:dumped fsmap epoch 6 2024-02-21T22:53:29.628 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.637+0000 7fa5139b4640 1 -- 172.21.15.116:0/2333024594 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fa4f006b4d0 msgr2=0x7fa4f006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:29.628 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.637+0000 7fa5139b4640 1 --2- 172.21.15.116:0/2333024594 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fa4f006b4d0 0x7fa4f006d990 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fa508036000 tx=0x7fa50803c040 comp rx=0 tx=0).stop 2024-02-21T22:53:29.628 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.637+0000 7fa5139b4640 1 -- 172.21.15.116:0/2333024594 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa50c0d0510 msgr2=0x7fa50c159290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:29.628 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.637+0000 7fa5139b4640 1 --2- 172.21.15.116:0/2333024594 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa50c0d0510 0x7fa50c159290 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fa4fc00c3c0 tx=0x7fa4fc00c880 comp rx=0 tx=0).stop 2024-02-21T22:53:29.628 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.637+0000 7fa5139b4640 1 -- 172.21.15.116:0/2333024594 shutdown_connections 2024-02-21T22:53:29.628 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.637+0000 7fa5139b4640 1 --2- 172.21.15.116:0/2333024594 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa50c0d1c30 0x7fa50c1575d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:29.628 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.637+0000 7fa5139b4640 1 --2- 172.21.15.116:0/2333024594 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa50c0d0510 0x7fa50c159290 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:29.628 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.637+0000 7fa5139b4640 1 --2- 172.21.15.116:0/2333024594 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fa4f006b4d0 0x7fa4f006d990 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:29.628 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.637+0000 7fa5139b4640 1 --2- 172.21.15.116:0/2333024594 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa50c0cb930 0x7fa50c158d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:29.628 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.637+0000 7fa5139b4640 1 -- 172.21.15.116:0/2333024594 >> 172.21.15.116:0/2333024594 conn(0x7fa50c0d3e50 msgr2=0x7fa50c0ca210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:29.628 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.637+0000 7fa5139b4640 1 -- 172.21.15.116:0/2333024594 shutdown_connections 2024-02-21T22:53:29.629 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.637+0000 7fa5139b4640 1 -- 172.21.15.116:0/2333024594 wait complete. 2024-02-21T22:53:29.639 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-21T22:53:29.740 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.749+0000 7fdaec095640 1 Processor -- start 2024-02-21T22:53:29.740 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.749+0000 7fdaec095640 1 -- start start 2024-02-21T22:53:29.742 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.750+0000 7fdaec095640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdae40afa80 0x7fdae40b5990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:29.743 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.750+0000 7fdaec095640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fdae40b5ed0 0x7fdae406ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:29.743 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.750+0000 7fdaec095640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdae40afe60 con 0x7fdae406b380 2024-02-21T22:53:29.743 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.750+0000 7fdaec095640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdae40b5500 con 0x7fdae40b5ed0 2024-02-21T22:53:29.743 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.750+0000 7fdaec095640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdae415f510 con 0x7fdae40afa80 2024-02-21T22:53:29.743 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.750+0000 7fdae9630640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fdae40b5ed0 0x7fdae406ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:29.743 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.750+0000 7fdae9630640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fdae40b5ed0 0x7fdae406ae40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:36172/0 (socket says 172.21.15.116:36172) 2024-02-21T22:53:29.743 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.750+0000 7fdae9630640 1 -- 172.21.15.116:0/1681533970 learned_addr learned my addr 172.21.15.116:0/1681533970 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:29.743 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.750+0000 7fdae9e31640 1 --2- 172.21.15.116:0/1681533970 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdae40afa80 0x7fdae40b5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:29.743 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.750+0000 7fdae9630640 1 -- 172.21.15.116:0/1681533970 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdae40afa80 msgr2=0x7fdae40b5990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:53:29.743 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.750+0000 7fdae9630640 1 --2- 172.21.15.116:0/1681533970 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdae40afa80 0x7fdae40b5990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:29.743 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.750+0000 7fdae9630640 1 -- 172.21.15.116:0/1681533970 >> v1:172.21.15.142:6789/0 conn(0x7fdae406b380 legacy=0x7fdae40b0220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:29.743 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.750+0000 7fdae9630640 1 -- 172.21.15.116:0/1681533970 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdae415f7f0 con 0x7fdae40b5ed0 2024-02-21T22:53:29.743 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.751+0000 7fdae9630640 1 --2- 172.21.15.116:0/1681533970 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdae40b5ed0 0x7fdae406ae40 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fdad4009870 tx=0x7fdad402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d159c000713528e0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:29.744 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.751+0000 7fdae8e2f640 1 -- 172.21.15.116:0/1681533970 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdad4034070 con 0x7fdae40b5ed0 2024-02-21T22:53:29.744 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.751+0000 7fdae8e2f640 1 -- 172.21.15.116:0/1681533970 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdad4030840 con 0x7fdae40b5ed0 2024-02-21T22:53:29.744 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.751+0000 7fdae8e2f640 1 -- 172.21.15.116:0/1681533970 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdad4030c10 con 0x7fdae40b5ed0 2024-02-21T22:53:29.744 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.752+0000 7fdaec095640 1 -- 172.21.15.116:0/1681533970 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdae40b5ed0 msgr2=0x7fdae406ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:29.744 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.752+0000 7fdaec095640 1 --2- 172.21.15.116:0/1681533970 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdae40b5ed0 0x7fdae406ae40 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fdad4009870 tx=0x7fdad402b980 comp rx=0 tx=0).stop 2024-02-21T22:53:29.744 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.752+0000 7fdaec095640 1 -- 172.21.15.116:0/1681533970 shutdown_connections 2024-02-21T22:53:29.744 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.752+0000 7fdaec095640 1 --2- 172.21.15.116:0/1681533970 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdae40b5ed0 0x7fdae406ae40 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:29.744 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.752+0000 7fdaec095640 1 --2- 172.21.15.116:0/1681533970 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdae40afa80 0x7fdae40b5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:29.744 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.752+0000 7fdaec095640 1 -- 172.21.15.116:0/1681533970 >> 172.21.15.116:0/1681533970 conn(0x7fdae40724f0 msgr2=0x7fdae4072900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:29.744 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.752+0000 7fdaec095640 1 -- 172.21.15.116:0/1681533970 shutdown_connections 2024-02-21T22:53:29.744 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.752+0000 7fdaec095640 1 -- 172.21.15.116:0/1681533970 wait complete. 2024-02-21T22:53:29.747 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.753+0000 7fdaec095640 1 Processor -- start 2024-02-21T22:53:29.747 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.753+0000 7fdaec095640 1 -- start start 2024-02-21T22:53:29.747 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.754+0000 7fdaec095640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdae406b380 0x7fdae414e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:29.747 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.754+0000 7fdaec095640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdae40afa80 0x7fdae409d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:29.747 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.754+0000 7fdaec095640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdae40b5ed0 0x7fdae409db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:29.748 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.754+0000 7fdaec095640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdae40b0ab0 con 0x7fdae40afa80 2024-02-21T22:53:29.748 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.754+0000 7fdaec095640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdae40b0930 con 0x7fdae406b380 2024-02-21T22:53:29.748 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.754+0000 7fdaec095640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdae40b0c30 con 0x7fdae40b5ed0 2024-02-21T22:53:29.748 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.754+0000 7fdae9630640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdae40afa80 0x7fdae409d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:29.748 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.754+0000 7fdae9630640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdae40afa80 0x7fdae409d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:36176/0 (socket says 172.21.15.116:36176) 2024-02-21T22:53:29.748 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.754+0000 7fdae9630640 1 -- 172.21.15.116:0/2042638825 learned_addr learned my addr 172.21.15.116:0/2042638825 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:29.748 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.754+0000 7fdae9e31640 1 --2- 172.21.15.116:0/2042638825 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdae406b380 0x7fdae414e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:29.748 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.754+0000 7fdaea632640 1 --2- 172.21.15.116:0/2042638825 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdae40b5ed0 0x7fdae409db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:29.748 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.754+0000 7fdae9630640 1 -- 172.21.15.116:0/2042638825 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdae40b5ed0 msgr2=0x7fdae409db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:29.748 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.754+0000 7fdae9630640 1 --2- 172.21.15.116:0/2042638825 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdae40b5ed0 0x7fdae409db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:29.748 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.754+0000 7fdae9630640 1 -- 172.21.15.116:0/2042638825 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdae406b380 msgr2=0x7fdae414e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:29.748 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.754+0000 7fdae9630640 1 --2- 172.21.15.116:0/2042638825 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdae406b380 0x7fdae414e170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:29.748 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.754+0000 7fdae9630640 1 -- 172.21.15.116:0/2042638825 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdae41f3d40 con 0x7fdae40afa80 2024-02-21T22:53:29.749 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.754+0000 7fdae9630640 1 --2- 172.21.15.116:0/2042638825 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdae40afa80 0x7fdae409d630 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fdad4000c00 tx=0x7fdad40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:29.749 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.755+0000 7fdada7fc640 1 -- 172.21.15.116:0/2042638825 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdad4034040 con 0x7fdae40afa80 2024-02-21T22:53:29.749 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.755+0000 7fdada7fc640 1 -- 172.21.15.116:0/2042638825 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdad4039d90 con 0x7fdae40afa80 2024-02-21T22:53:29.749 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.755+0000 7fdaec095640 1 -- 172.21.15.116:0/2042638825 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdae414ec10 con 0x7fdae40afa80 2024-02-21T22:53:29.749 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.755+0000 7fdada7fc640 1 -- 172.21.15.116:0/2042638825 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdad4043630 con 0x7fdae40afa80 2024-02-21T22:53:29.749 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.755+0000 7fdaec095640 1 -- 172.21.15.116:0/2042638825 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdae414f1d0 con 0x7fdae40afa80 2024-02-21T22:53:29.749 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.756+0000 7fdaec095640 1 -- 172.21.15.116:0/2042638825 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdae4066e90 con 0x7fdae40afa80 2024-02-21T22:53:29.749 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.756+0000 7fdada7fc640 1 -- 172.21.15.116:0/2042638825 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fdad404a060 con 0x7fdae40afa80 2024-02-21T22:53:29.749 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.756+0000 7fdada7fc640 1 --2- 172.21.15.116:0/2042638825 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fdac806b4d0 0x7fdac806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:29.749 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.757+0000 7fdada7fc640 1 -- 172.21.15.116:0/2042638825 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdad40ac000 con 0x7fdae40afa80 2024-02-21T22:53:29.749 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.757+0000 7fdae9e31640 1 --2- 172.21.15.116:0/2042638825 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fdac806b4d0 0x7fdac806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:29.749 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.757+0000 7fdae9e31640 1 --2- 172.21.15.116:0/2042638825 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fdac806b4d0 0x7fdac806d990 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fdae414e040 tx=0x7fdadc00b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:29.751 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.761+0000 7fdada7fc640 1 -- 172.21.15.116:0/2042638825 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7fdae4066e90 con 0x7fdae40afa80 2024-02-21T22:53:29.927 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.937+0000 7fdaec095640 1 -- 172.21.15.116:0/2042638825 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdae40752f0 con 0x7fdae40afa80 2024-02-21T22:53:29.928 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.938+0000 7fdada7fc640 1 -- 172.21.15.116:0/2042638825 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16653 (secure 0 0 0) 0x7fdad403e070 con 0x7fdae40afa80 2024-02-21T22:53:29.929 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-02-21T22:53:29.929 INFO:teuthology.orchestra.run.smithi116.stdout:{"epoch":20,"fsid":"7c298660-5f63-4b5c-a800-58c5be9a8445","created":"2024-02-21T22:52:25.994613+0000","modified":"2024-02-21T22:52:51.786454+0000","last_up_change":"2024-02-21T22:52:37.313595+0000","last_in_change":"2024-02-21T22:52:28.176031+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-21T22:52:38.328796+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-21T22:52:48.145152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-21T22:52:49.096955+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4f09126b-b5e4-4876-8b08-f5cbb967388a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":1613202231},{"type":"v1","addr":"172.21.15.116:6809","nonce":1613202231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":1613202231},{"type":"v1","addr":"172.21.15.116:6811","nonce":1613202231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":1613202231},{"type":"v1","addr":"172.21.15.116:6815","nonce":1613202231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":1613202231},{"type":"v1","addr":"172.21.15.116:6813","nonce":1613202231}]},"public_addr":"172.21.15.116:6809/1613202231","cluster_addr":"172.21.15.116:6811/1613202231","heartbeat_back_addr":"172.21.15.116:6815/1613202231","heartbeat_front_addr":"172.21.15.116:6813/1613202231","state":["exists","up"]},{"osd":1,"uuid":"7272c51d-51f9-4536-931d-33ad7a4b377e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6816","nonce":172614746},{"type":"v1","addr":"172.21.15.116:6817","nonce":172614746}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":172614746},{"type":"v1","addr":"172.21.15.116:6819","nonce":172614746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":172614746},{"type":"v1","addr":"172.21.15.116:6823","nonce":172614746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":172614746},{"type":"v1","addr":"172.21.15.116:6821","nonce":172614746}]},"public_addr":"172.21.15.116:6817/172614746","cluster_addr":"172.21.15.116:6819/172614746","heartbeat_back_addr":"172.21.15.116:6823/172614746","heartbeat_front_addr":"172.21.15.116:6821/172614746","state":["exists","up"]},{"osd":2,"uuid":"2589616c-adf1-4187-aac3-735256cf624b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":1029280577},{"type":"v1","addr":"172.21.15.116:6825","nonce":1029280577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":1029280577},{"type":"v1","addr":"172.21.15.116:6827","nonce":1029280577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":1029280577},{"type":"v1","addr":"172.21.15.116:6831","nonce":1029280577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":1029280577},{"type":"v1","addr":"172.21.15.116:6829","nonce":1029280577}]},"public_addr":"172.21.15.116:6825/1029280577","cluster_addr":"172.21.15.116:6827/1029280577","heartbeat_back_addr":"172.21.15.116:6831/1029280577","heartbeat_front_addr":"172.21.15.116:6829/1029280577","state":["exists","up"]},{"osd":3,"uuid":"0fd2e563-7c5b-46f6-82c2-b60c86072c93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":3106627557},{"type":"v1","addr":"172.21.15.116:6801","nonce":3106627557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":3106627557},{"type":"v1","addr":"172.21.15.116:6803","nonce":3106627557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":3106627557},{"type":"v1","addr":"172.21.15.116:6807","nonce":3106627557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":3106627557},{"type":"v1","addr":"172.21.15.116:6805","nonce":3106627557}]},"public_addr":"172.21.15.116:6801/3106627557","cluster_addr":"172.21.15.116:6803/3106627557","heartbeat_back_addr":"172.21.15.116:6807/3106627557","heartbeat_front_addr":"172.21.15.116:6805/3106627557","state":["exists","up"]},{"osd":4,"uuid":"79ae35b7-dda8-4ab8-96ce-47515afde082","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":3231407772},{"type":"v1","addr":"172.21.15.142:6825","nonce":3231407772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":3231407772},{"type":"v1","addr":"172.21.15.142:6827","nonce":3231407772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":3231407772},{"type":"v1","addr":"172.21.15.142:6831","nonce":3231407772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":3231407772},{"type":"v1","addr":"172.21.15.142:6829","nonce":3231407772}]},"public_addr":"172.21.15.142:6825/3231407772","cluster_addr":"172.21.15.142:6827/3231407772","heartbeat_back_addr":"172.21.15.142:6831/3231407772","heartbeat_front_addr":"172.21.15.142:6829/3231407772","state":["exists","up"]},{"osd":5,"uuid":"3166eb2c-3fcf-41c8-9362-45bafaabaa39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":1184158716},{"type":"v1","addr":"172.21.15.142:6817","nonce":1184158716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":1184158716},{"type":"v1","addr":"172.21.15.142:6819","nonce":1184158716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":1184158716},{"type":"v1","addr":"172.21.15.142:6823","nonce":1184158716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":1184158716},{"type":"v1","addr":"172.21.15.142:6821","nonce":1184158716}]},"public_addr":"172.21.15.142:6817/1184158716","cluster_addr":"172.21.15.142:6819/1184158716","heartbeat_back_addr":"172.21.15.142:6823/1184158716","heartbeat_front_addr":"172.21.15.142:6821/1184158716","state":["exists","up"]},{"osd":6,"uuid":"f9aa9672-7527-43e2-963e-b61868e5e63f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":1987868911},{"type":"v1","addr":"172.21.15.142:6801","nonce":1987868911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":1987868911},{"type":"v1","addr":"172.21.15.142:6803","nonce":1987868911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":1987868911},{"type":"v1","addr":"172.21.15.142:6807","nonce":1987868911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":1987868911},{"type":"v1","addr":"172.21.15.142:6805","nonce":1987868911}]},"public_addr":"172.21.15.142:6801/1987868911","cluster_addr":"172.21.15.142:6803/1987868911","heartbeat_back_addr":"172.21.15.142:6807/1987868911","heartbeat_front_addr":"172.21.15.142:6805/1987868911","state":["exists","up"]},{"osd":7,"uuid":"7ed29226-fc42-4382-a91a-fa50f7ec5426","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":1272081937},{"type":"v1","addr":"172.21.15.142:6809","nonce":1272081937}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":1272081937},{"type":"v1","addr":"172.21.15.142:6811","nonce":1272081937}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":1272081937},{"type":"v1","addr":"172.21.15.142:6815","nonce":1272081937}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":1272081937},{"type":"v1","addr":"172.21.15.142:6813","nonce":1272081937}]},"public_addr":"172.21.15.142:6809/1272081937","cluster_addr":"172.21.15.142:6811/1272081937","heartbeat_back_addr":"172.21.15.142:6815/1272081937","heartbeat_front_addr":"172.21.15.142:6813/1272081937","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.350998+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.307201+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.289112+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.243888+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.312091+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.370472+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.275659+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.289297+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-21T22:53:29.931 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.940+0000 7fdaec095640 1 -- 172.21.15.116:0/2042638825 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fdac806b4d0 msgr2=0x7fdac806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:29.931 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.940+0000 7fdaec095640 1 --2- 172.21.15.116:0/2042638825 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fdac806b4d0 0x7fdac806d990 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fdae414e040 tx=0x7fdadc00b040 comp rx=0 tx=0).stop 2024-02-21T22:53:29.931 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.940+0000 7fdaec095640 1 -- 172.21.15.116:0/2042638825 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdae40afa80 msgr2=0x7fdae409d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:29.931 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.940+0000 7fdaec095640 1 --2- 172.21.15.116:0/2042638825 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdae40afa80 0x7fdae409d630 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fdad4000c00 tx=0x7fdad40046c0 comp rx=0 tx=0).stop 2024-02-21T22:53:29.931 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.940+0000 7fdaec095640 1 -- 172.21.15.116:0/2042638825 shutdown_connections 2024-02-21T22:53:29.931 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.940+0000 7fdaec095640 1 --2- 172.21.15.116:0/2042638825 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fdac806b4d0 0x7fdac806d990 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:29.931 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.940+0000 7fdaec095640 1 --2- 172.21.15.116:0/2042638825 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdae40b5ed0 0x7fdae409db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:29.931 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.940+0000 7fdaec095640 1 --2- 172.21.15.116:0/2042638825 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdae40afa80 0x7fdae409d630 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:29.931 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.940+0000 7fdaec095640 1 --2- 172.21.15.116:0/2042638825 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdae406b380 0x7fdae414e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:29.931 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.940+0000 7fdaec095640 1 -- 172.21.15.116:0/2042638825 >> 172.21.15.116:0/2042638825 conn(0x7fdae40724f0 msgr2=0x7fdae40b01e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:29.931 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.940+0000 7fdaec095640 1 -- 172.21.15.116:0/2042638825 shutdown_connections 2024-02-21T22:53:29.931 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:29.940+0000 7fdaec095640 1 -- 172.21.15.116:0/2042638825 wait complete. 2024-02-21T22:53:29.941 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-21T22:52:38.328796+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-02-21T22:52:48.145152+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-02-21T22:52:49.096955+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-21T22:53:29.941 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-21T22:53:30.044 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.053+0000 7f97bd891640 1 Processor -- start 2024-02-21T22:53:30.044 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.053+0000 7f97bd891640 1 -- start start 2024-02-21T22:53:30.046 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.054+0000 7f97bd891640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f97b815ae80 0x7f97b80b2dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:30.046 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.054+0000 7f97bd891640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f97b806e310 0x7f97b80b3300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:30.046 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.054+0000 7f97bd891640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f97b80b4490 0x7f97b8070910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:30.046 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.054+0000 7f97bd891640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97b8071d90 con 0x7f97b80b4490 2024-02-21T22:53:30.046 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.054+0000 7f97bd891640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97b8072070 con 0x7f97b815ae80 2024-02-21T22:53:30.046 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.054+0000 7f97bd891640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97b8072350 con 0x7f97b806e310 2024-02-21T22:53:30.046 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.054+0000 7f97b77fe640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f97b80b4490 0x7f97b8070910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:30.046 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.054+0000 7f97b77fe640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f97b80b4490 0x7f97b8070910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:36192/0 (socket says 172.21.15.116:36192) 2024-02-21T22:53:30.046 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.054+0000 7f97affff640 1 --2- 172.21.15.116:0/2311270563 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f97b806e310 0x7f97b80b3300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:30.046 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.054+0000 7f97b77fe640 1 -- 172.21.15.116:0/2311270563 learned_addr learned my addr 172.21.15.116:0/2311270563 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:30.046 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.054+0000 7f97b6ffd640 1 --2- 172.21.15.116:0/2311270563 >> v2:172.21.15.142:3300/0 conn(0x7f97b815ae80 0x7f97b80b2dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:30.047 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.054+0000 7f97b77fe640 1 -- 172.21.15.116:0/2311270563 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f97b806e310 msgr2=0x7f97b80b3300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:53:30.047 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.054+0000 7f97b77fe640 1 --2- 172.21.15.116:0/2311270563 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f97b806e310 0x7f97b80b3300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:30.047 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.054+0000 7f97b77fe640 1 -- 172.21.15.116:0/2311270563 >> v2:172.21.15.142:3300/0 conn(0x7f97b815ae80 msgr2=0x7f97b80b2dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:53:30.047 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.054+0000 7f97b77fe640 1 --2- 172.21.15.116:0/2311270563 >> v2:172.21.15.142:3300/0 conn(0x7f97b815ae80 0x7f97b80b2dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:30.047 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.054+0000 7f97b77fe640 1 -- 172.21.15.116:0/2311270563 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97b8072630 con 0x7f97b80b4490 2024-02-21T22:53:30.047 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.055+0000 7f97b77fe640 1 --2- 172.21.15.116:0/2311270563 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f97b80b4490 0x7f97b8070910 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f97b80b2800 tx=0x7f97b002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e1dc63d310d894b server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:30.047 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.055+0000 7f97b67fc640 1 -- 172.21.15.116:0/2311270563 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97b002ca70 con 0x7f97b80b4490 2024-02-21T22:53:30.047 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.055+0000 7f97b67fc640 1 -- 172.21.15.116:0/2311270563 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97b002cc10 con 0x7f97b80b4490 2024-02-21T22:53:30.047 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.055+0000 7f97b67fc640 1 -- 172.21.15.116:0/2311270563 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97b00343f0 con 0x7f97b80b4490 2024-02-21T22:53:30.050 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.056+0000 7f97bd891640 1 -- 172.21.15.116:0/2311270563 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f97b80b4490 msgr2=0x7f97b8070910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:30.050 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.056+0000 7f97bd891640 1 --2- 172.21.15.116:0/2311270563 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f97b80b4490 0x7f97b8070910 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f97b80b2800 tx=0x7f97b002bed0 comp rx=0 tx=0).stop 2024-02-21T22:53:30.050 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.056+0000 7f97bd891640 1 -- 172.21.15.116:0/2311270563 shutdown_connections 2024-02-21T22:53:30.050 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.056+0000 7f97bd891640 1 --2- 172.21.15.116:0/2311270563 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f97b80b4490 0x7f97b8070910 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:30.050 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.056+0000 7f97bd891640 1 --2- 172.21.15.116:0/2311270563 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f97b806e310 0x7f97b80b3300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:30.050 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.056+0000 7f97bd891640 1 --2- 172.21.15.116:0/2311270563 >> v2:172.21.15.142:3300/0 conn(0x7f97b815ae80 0x7f97b80b2dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:30.050 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.056+0000 7f97bd891640 1 -- 172.21.15.116:0/2311270563 >> 172.21.15.116:0/2311270563 conn(0x7f97b80b1740 msgr2=0x7f97b80b1b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:30.050 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.056+0000 7f97bd891640 1 -- 172.21.15.116:0/2311270563 shutdown_connections 2024-02-21T22:53:30.050 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.056+0000 7f97bd891640 1 -- 172.21.15.116:0/2311270563 wait complete. 2024-02-21T22:53:30.050 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.057+0000 7f97bd891640 1 Processor -- start 2024-02-21T22:53:30.051 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.057+0000 7f97bd891640 1 -- start start 2024-02-21T22:53:30.051 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.058+0000 7f97bd891640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f97b806e310 0x7f97b815dca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:30.051 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.058+0000 7f97bd891640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f97b80b4490 0x7f97b81f3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:30.051 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.058+0000 7f97bd891640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f97b81f3c90 0x7f97b80ae840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:30.051 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.058+0000 7f97bd891640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97b8070fd0 con 0x7f97b81f3c90 2024-02-21T22:53:30.051 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.058+0000 7f97bd891640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97b8070e50 con 0x7f97b80b4490 2024-02-21T22:53:30.051 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.058+0000 7f97bd891640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97b8071150 con 0x7f97b806e310 2024-02-21T22:53:30.051 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.058+0000 7f97b77fe640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f97b81f3c90 0x7f97b80ae840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:30.051 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.058+0000 7f97b77fe640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f97b81f3c90 0x7f97b80ae840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:36200/0 (socket says 172.21.15.116:36200) 2024-02-21T22:53:30.051 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.058+0000 7f97b77fe640 1 -- 172.21.15.116:0/1494744283 learned_addr learned my addr 172.21.15.116:0/1494744283 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:30.051 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.058+0000 7f97affff640 1 --2- 172.21.15.116:0/1494744283 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f97b80b4490 0x7f97b81f3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:30.051 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.058+0000 7f97b6ffd640 1 --2- 172.21.15.116:0/1494744283 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f97b806e310 0x7f97b815dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:30.051 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.058+0000 7f97b77fe640 1 -- 172.21.15.116:0/1494744283 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f97b806e310 msgr2=0x7f97b815dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:30.051 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.058+0000 7f97b77fe640 1 --2- 172.21.15.116:0/1494744283 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f97b806e310 0x7f97b815dca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:30.051 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.058+0000 7f97b77fe640 1 -- 172.21.15.116:0/1494744283 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f97b80b4490 msgr2=0x7f97b81f3750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:30.052 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.058+0000 7f97b77fe640 1 --2- 172.21.15.116:0/1494744283 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f97b80b4490 0x7f97b81f3750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:30.052 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.058+0000 7f97b77fe640 1 -- 172.21.15.116:0/1494744283 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97b815d450 con 0x7f97b81f3c90 2024-02-21T22:53:30.052 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.058+0000 7f97b77fe640 1 --2- 172.21.15.116:0/1494744283 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f97b81f3c90 0x7f97b80ae840 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f97b0036040 tx=0x7f97b0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:30.052 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.059+0000 7f97b4ff9640 1 -- 172.21.15.116:0/1494744283 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97b0043020 con 0x7f97b81f3c90 2024-02-21T22:53:30.052 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.059+0000 7f97b4ff9640 1 -- 172.21.15.116:0/1494744283 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97b003e450 con 0x7f97b81f3c90 2024-02-21T22:53:30.052 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.059+0000 7f97bd891640 1 -- 172.21.15.116:0/1494744283 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97b815d730 con 0x7f97b81f3c90 2024-02-21T22:53:30.052 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.059+0000 7f97b4ff9640 1 -- 172.21.15.116:0/1494744283 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97b0009510 con 0x7f97b81f3c90 2024-02-21T22:53:30.052 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.059+0000 7f97bd891640 1 -- 172.21.15.116:0/1494744283 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97b80c57d0 con 0x7f97b81f3c90 2024-02-21T22:53:30.052 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.060+0000 7f97bd891640 1 -- 172.21.15.116:0/1494744283 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97b80752f0 con 0x7f97b81f3c90 2024-02-21T22:53:30.053 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.060+0000 7f97b4ff9640 1 -- 172.21.15.116:0/1494744283 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f97b0046020 con 0x7f97b81f3c90 2024-02-21T22:53:30.053 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.061+0000 7f97b4ff9640 1 --2- 172.21.15.116:0/1494744283 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f979806b500 0x7f979806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:30.053 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.061+0000 7f97b4ff9640 1 -- 172.21.15.116:0/1494744283 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f97b00ac480 con 0x7f97b81f3c90 2024-02-21T22:53:30.053 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.061+0000 7f97b6ffd640 1 --2- 172.21.15.116:0/1494744283 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f979806b500 0x7f979806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:30.053 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.061+0000 7f97b6ffd640 1 --2- 172.21.15.116:0/1494744283 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f979806b500 0x7f979806d9c0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f97a8005c00 tx=0x7f97a800b750 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:30.055 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.065+0000 7f97b4ff9640 1 -- 172.21.15.116:0/1494744283 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f97b004d070 con 0x7f97b81f3c90 2024-02-21T22:53:30.225 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.235+0000 7f97bd891640 1 -- 172.21.15.116:0/1494744283 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f97b806dbf0 con 0x7f97b81f3c90 2024-02-21T22:53:30.226 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.235+0000 7f97b4ff9640 1 -- 172.21.15.116:0/1494744283 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f97b007acb0 con 0x7f97b81f3c90 2024-02-21T22:53:30.226 INFO:teuthology.orchestra.run.smithi116.stdout:pg_num: 1 2024-02-21T22:53:30.228 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.237+0000 7f97bd891640 1 -- 172.21.15.116:0/1494744283 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f979806b500 msgr2=0x7f979806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:30.228 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.237+0000 7f97bd891640 1 --2- 172.21.15.116:0/1494744283 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f979806b500 0x7f979806d9c0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f97a8005c00 tx=0x7f97a800b750 comp rx=0 tx=0).stop 2024-02-21T22:53:30.228 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.237+0000 7f97bd891640 1 -- 172.21.15.116:0/1494744283 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f97b81f3c90 msgr2=0x7f97b80ae840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:30.228 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.237+0000 7f97bd891640 1 --2- 172.21.15.116:0/1494744283 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f97b81f3c90 0x7f97b80ae840 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f97b0036040 tx=0x7f97b0004a40 comp rx=0 tx=0).stop 2024-02-21T22:53:30.228 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.237+0000 7f97bd891640 1 -- 172.21.15.116:0/1494744283 shutdown_connections 2024-02-21T22:53:30.228 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.237+0000 7f97bd891640 1 --2- 172.21.15.116:0/1494744283 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f97b81f3c90 0x7f97b80ae840 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:30.228 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.237+0000 7f97bd891640 1 --2- 172.21.15.116:0/1494744283 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f97b80b4490 0x7f97b81f3750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:30.228 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.237+0000 7f97bd891640 1 --2- 172.21.15.116:0/1494744283 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f979806b500 0x7f979806d9c0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:30.229 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.237+0000 7f97bd891640 1 --2- 172.21.15.116:0/1494744283 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f97b806e310 0x7f97b815dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:30.229 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.237+0000 7f97bd891640 1 -- 172.21.15.116:0/1494744283 >> 172.21.15.116:0/1494744283 conn(0x7f97b80b1740 msgr2=0x7f97b80cded0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:30.229 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.237+0000 7f97bd891640 1 -- 172.21.15.116:0/1494744283 shutdown_connections 2024-02-21T22:53:30.229 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.237+0000 7f97bd891640 1 -- 172.21.15.116:0/1494744283 wait complete. 2024-02-21T22:53:30.239 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-02-21T22:53:30.345 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.352+0000 7fef20b1e640 1 Processor -- start 2024-02-21T22:53:30.346 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.352+0000 7fef20b1e640 1 -- start start 2024-02-21T22:53:30.346 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.352+0000 7fef20b1e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fef1c06d200 0x7fef1c06d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:30.346 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.352+0000 7fef20b1e640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fef1c0b2c70 0x7fef1c0cf240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:30.346 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.353+0000 7fef20b1e640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef1c06db20 con 0x7fef1c15ba50 2024-02-21T22:53:30.346 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.353+0000 7fef20b1e640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef1c15a9a0 con 0x7fef1c0b2c70 2024-02-21T22:53:30.346 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.353+0000 7fef20b1e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef1c15ac80 con 0x7fef1c06d200 2024-02-21T22:53:30.346 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.353+0000 7fef1ad9d640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7fef1c15ba50 0x7fef1c15bec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:36890/0 (socket says 172.21.15.116:36890) 2024-02-21T22:53:30.346 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.353+0000 7fef1ad9d640 1 -- 172.21.15.116:0/83724087 learned_addr learned my addr 172.21.15.116:0/83724087 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-02-21T22:53:30.346 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.353+0000 7fef13fff640 1 --2- 172.21.15.116:0/83724087 >> v2:172.21.15.142:3300/0 conn(0x7fef1c0b2c70 0x7fef1c0cf240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:30.346 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.353+0000 7fef1a59c640 1 --2- 172.21.15.116:0/83724087 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fef1c06d200 0x7fef1c06d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:30.347 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.353+0000 7fef19d9b640 1 -- 172.21.15.116:0/83724087 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1262510008 0 0) 0x7fef1c06db20 con 0x7fef1c15ba50 2024-02-21T22:53:30.347 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.353+0000 7fef19d9b640 1 -- 172.21.15.116:0/83724087 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef08003520 con 0x7fef1c15ba50 2024-02-21T22:53:30.347 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.353+0000 7fef13fff640 1 -- 172.21.15.116:0/83724087 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fef1c06d200 msgr2=0x7fef1c06d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:53:30.347 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.353+0000 7fef13fff640 1 --2- 172.21.15.116:0/83724087 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fef1c06d200 0x7fef1c06d5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:30.347 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.353+0000 7fef13fff640 1 -- 172.21.15.116:0/83724087 >> v1:172.21.15.116:6789/0 conn(0x7fef1c15ba50 legacy=0x7fef1c15bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:30.347 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.353+0000 7fef13fff640 1 -- 172.21.15.116:0/83724087 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef1c15af60 con 0x7fef1c0b2c70 2024-02-21T22:53:30.347 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.353+0000 7fef1a59c640 1 --2- 172.21.15.116:0/83724087 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fef1c06d200 0x7fef1c06d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T22:53:30.347 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.354+0000 7fef13fff640 1 --2- 172.21.15.116:0/83724087 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fef1c0b2c70 0x7fef1c0cf240 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fef040097a0 tx=0x7fef0402b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cc89c4341f3cb553 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:30.348 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.354+0000 7fef19d9b640 1 -- 172.21.15.116:0/83724087 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef04035020 con 0x7fef1c0b2c70 2024-02-21T22:53:30.348 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.354+0000 7fef19d9b640 1 -- 172.21.15.116:0/83724087 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef04031830 con 0x7fef1c0b2c70 2024-02-21T22:53:30.348 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.354+0000 7fef19d9b640 1 -- 172.21.15.116:0/83724087 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef04031c00 con 0x7fef1c0b2c70 2024-02-21T22:53:30.348 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.354+0000 7fef20b1e640 1 -- 172.21.15.116:0/83724087 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fef1c0b2c70 msgr2=0x7fef1c0cf240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:30.348 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.354+0000 7fef20b1e640 1 --2- 172.21.15.116:0/83724087 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fef1c0b2c70 0x7fef1c0cf240 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fef040097a0 tx=0x7fef0402b8d0 comp rx=0 tx=0).stop 2024-02-21T22:53:30.348 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.355+0000 7fef20b1e640 1 -- 172.21.15.116:0/83724087 shutdown_connections 2024-02-21T22:53:30.348 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.355+0000 7fef20b1e640 1 --2- 172.21.15.116:0/83724087 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fef1c0b2c70 0x7fef1c0cf240 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:30.348 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.355+0000 7fef20b1e640 1 --2- 172.21.15.116:0/83724087 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fef1c06d200 0x7fef1c06d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:30.348 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.355+0000 7fef20b1e640 1 -- 172.21.15.116:0/83724087 >> 172.21.15.116:0/83724087 conn(0x7fef1c0b1740 msgr2=0x7fef1c0b1b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:30.348 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.355+0000 7fef20b1e640 1 -- 172.21.15.116:0/83724087 shutdown_connections 2024-02-21T22:53:30.348 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.355+0000 7fef20b1e640 1 -- 172.21.15.116:0/83724087 wait complete. 2024-02-21T22:53:30.352 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.356+0000 7fef20b1e640 1 Processor -- start 2024-02-21T22:53:30.352 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.356+0000 7fef20b1e640 1 -- start start 2024-02-21T22:53:30.352 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.357+0000 7fef20b1e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fef1c06d200 0x7fef1c1e6510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:30.352 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.357+0000 7fef20b1e640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fef1c0b2c70 0x7fef1c1f7140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:30.352 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.357+0000 7fef20b1e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fef1c15ba50 0x7fef1c1f7680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:30.352 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.357+0000 7fef20b1e640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef1c158130 con 0x7fef1c0b2c70 2024-02-21T22:53:30.352 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.357+0000 7fef20b1e640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef1c0cf780 con 0x7fef1c06d200 2024-02-21T22:53:30.352 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.357+0000 7fef20b1e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef1c1582b0 con 0x7fef1c15ba50 2024-02-21T22:53:30.352 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.357+0000 7fef13fff640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fef1c0b2c70 0x7fef1c1f7140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:30.352 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.357+0000 7fef13fff640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fef1c0b2c70 0x7fef1c1f7140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:36204/0 (socket says 172.21.15.116:36204) 2024-02-21T22:53:30.352 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.357+0000 7fef13fff640 1 -- 172.21.15.116:0/4102232380 learned_addr learned my addr 172.21.15.116:0/4102232380 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:30.353 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.357+0000 7fef1ad9d640 1 --2- 172.21.15.116:0/4102232380 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fef1c15ba50 0x7fef1c1f7680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:30.353 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.357+0000 7fef1a59c640 1 --2- 172.21.15.116:0/4102232380 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fef1c06d200 0x7fef1c1e6510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:30.353 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.357+0000 7fef13fff640 1 -- 172.21.15.116:0/4102232380 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fef1c15ba50 msgr2=0x7fef1c1f7680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:30.353 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.357+0000 7fef13fff640 1 --2- 172.21.15.116:0/4102232380 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fef1c15ba50 0x7fef1c1f7680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:30.353 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.357+0000 7fef13fff640 1 -- 172.21.15.116:0/4102232380 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fef1c06d200 msgr2=0x7fef1c1e6510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:30.353 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.357+0000 7fef13fff640 1 --2- 172.21.15.116:0/4102232380 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fef1c06d200 0x7fef1c1e6510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:30.353 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.357+0000 7fef13fff640 1 -- 172.21.15.116:0/4102232380 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef1c158da0 con 0x7fef1c0b2c70 2024-02-21T22:53:30.353 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.357+0000 7fef13fff640 1 --2- 172.21.15.116:0/4102232380 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fef1c0b2c70 0x7fef1c1f7140 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fef0402bee0 tx=0x7fef040046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:30.353 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.357+0000 7fef12ffd640 1 -- 172.21.15.116:0/4102232380 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef04035040 con 0x7fef1c0b2c70 2024-02-21T22:53:30.353 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.357+0000 7fef12ffd640 1 -- 172.21.15.116:0/4102232380 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef0403b920 con 0x7fef1c0b2c70 2024-02-21T22:53:30.353 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.357+0000 7fef12ffd640 1 -- 172.21.15.116:0/4102232380 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef0403bd10 con 0x7fef1c0b2c70 2024-02-21T22:53:30.354 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.357+0000 7fef20b1e640 1 -- 172.21.15.116:0/4102232380 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef1c159040 con 0x7fef1c0b2c70 2024-02-21T22:53:30.354 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.357+0000 7fef20b1e640 1 -- 172.21.15.116:0/4102232380 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef1c159600 con 0x7fef1c0b2c70 2024-02-21T22:53:30.354 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.359+0000 7fef20b1e640 1 -- 172.21.15.116:0/4102232380 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef1c0752f0 con 0x7fef1c0b2c70 2024-02-21T22:53:30.354 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.359+0000 7fef12ffd640 1 -- 172.21.15.116:0/4102232380 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fef04038020 con 0x7fef1c0b2c70 2024-02-21T22:53:30.354 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.359+0000 7fef12ffd640 1 --2- 172.21.15.116:0/4102232380 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7feefc06b4d0 0x7feefc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:30.354 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.359+0000 7fef12ffd640 1 -- 172.21.15.116:0/4102232380 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fef040ac150 con 0x7fef1c0b2c70 2024-02-21T22:53:30.354 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.359+0000 7fef1a59c640 1 --2- 172.21.15.116:0/4102232380 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7feefc06b4d0 0x7feefc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:30.354 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.360+0000 7fef1a59c640 1 --2- 172.21.15.116:0/4102232380 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7feefc06b4d0 0x7feefc06d990 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fef0c009560 tx=0x7fef0c009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:30.355 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.363+0000 7fef12ffd640 1 -- 172.21.15.116:0/4102232380 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7fef0407a980 con 0x7fef1c0b2c70 2024-02-21T22:53:30.525 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.534+0000 7fef20b1e640 1 -- 172.21.15.116:0/4102232380 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fef1c0cf4e0 con 0x7fef1c0b2c70 2024-02-21T22:53:30.525 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.535+0000 7fef12ffd640 1 -- 172.21.15.116:0/4102232380 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fef0407ea20 con 0x7fef1c0b2c70 2024-02-21T22:53:30.525 INFO:teuthology.orchestra.run.smithi116.stdout:pg_num: 32 2024-02-21T22:53:30.527 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.536+0000 7fef20b1e640 1 -- 172.21.15.116:0/4102232380 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7feefc06b4d0 msgr2=0x7feefc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:30.527 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.536+0000 7fef20b1e640 1 --2- 172.21.15.116:0/4102232380 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7feefc06b4d0 0x7feefc06d990 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fef0c009560 tx=0x7fef0c009190 comp rx=0 tx=0).stop 2024-02-21T22:53:30.528 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.537+0000 7fef20b1e640 1 -- 172.21.15.116:0/4102232380 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fef1c0b2c70 msgr2=0x7fef1c1f7140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:30.528 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.537+0000 7fef20b1e640 1 --2- 172.21.15.116:0/4102232380 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fef1c0b2c70 0x7fef1c1f7140 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fef0402bee0 tx=0x7fef040046c0 comp rx=0 tx=0).stop 2024-02-21T22:53:30.528 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.537+0000 7fef20b1e640 1 -- 172.21.15.116:0/4102232380 shutdown_connections 2024-02-21T22:53:30.528 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.537+0000 7fef20b1e640 1 --2- 172.21.15.116:0/4102232380 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7feefc06b4d0 0x7feefc06d990 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:30.528 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.537+0000 7fef20b1e640 1 --2- 172.21.15.116:0/4102232380 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fef1c15ba50 0x7fef1c1f7680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:30.528 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.537+0000 7fef20b1e640 1 --2- 172.21.15.116:0/4102232380 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fef1c0b2c70 0x7fef1c1f7140 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:30.528 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.537+0000 7fef20b1e640 1 --2- 172.21.15.116:0/4102232380 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fef1c06d200 0x7fef1c1e6510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:30.528 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.537+0000 7fef20b1e640 1 -- 172.21.15.116:0/4102232380 >> 172.21.15.116:0/4102232380 conn(0x7fef1c0b1740 msgr2=0x7fef1c070d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:30.528 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.537+0000 7fef20b1e640 1 -- 172.21.15.116:0/4102232380 shutdown_connections 2024-02-21T22:53:30.528 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.537+0000 7fef20b1e640 1 -- 172.21.15.116:0/4102232380 wait complete. 2024-02-21T22:53:30.538 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-02-21T22:53:30.640 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.650+0000 7ff903e9d640 1 Processor -- start 2024-02-21T22:53:30.640 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.650+0000 7ff903e9d640 1 -- start start 2024-02-21T22:53:30.642 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.651+0000 7ff903e9d640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7ff8fc06d200 0x7ff8fc06d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:30.642 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.651+0000 7ff903e9d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff8fc0b2c70 0x7ff8fc0cf240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:30.643 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.651+0000 7ff903e9d640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff8fc15ba50 0x7ff8fc15bec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:30.643 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.651+0000 7ff903e9d640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8fc06db20 con 0x7ff8fc06d200 2024-02-21T22:53:30.643 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.651+0000 7ff903e9d640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8fc15a9a0 con 0x7ff8fc15ba50 2024-02-21T22:53:30.643 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.651+0000 7ff903e9d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8fc15ac80 con 0x7ff8fc0b2c70 2024-02-21T22:53:30.643 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.651+0000 7ff901c39640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7ff8fc06d200 0x7ff8fc06d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:30.643 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.651+0000 7ff901c39640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7ff8fc06d200 0x7ff8fc06d5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:36208/0 (socket says 172.21.15.116:36208) 2024-02-21T22:53:30.643 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.651+0000 7ff901c39640 1 -- 172.21.15.116:0/3916348946 learned_addr learned my addr 172.21.15.116:0/3916348946 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:30.643 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.651+0000 7ff90243a640 1 --2- 172.21.15.116:0/3916348946 >> v2:172.21.15.142:3300/0 conn(0x7ff8fc15ba50 0x7ff8fc15bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:30.643 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.651+0000 7ff901438640 1 --2- 172.21.15.116:0/3916348946 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff8fc0b2c70 0x7ff8fc0cf240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:30.643 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.651+0000 7ff901c39640 1 -- 172.21.15.116:0/3916348946 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff8fc0b2c70 msgr2=0x7ff8fc0cf240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:53:30.643 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.651+0000 7ff901c39640 1 --2- 172.21.15.116:0/3916348946 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff8fc0b2c70 0x7ff8fc0cf240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:30.643 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.651+0000 7ff901c39640 1 -- 172.21.15.116:0/3916348946 >> v2:172.21.15.142:3300/0 conn(0x7ff8fc15ba50 msgr2=0x7ff8fc15bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:53:30.644 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.651+0000 7ff901c39640 1 --2- 172.21.15.116:0/3916348946 >> v2:172.21.15.142:3300/0 conn(0x7ff8fc15ba50 0x7ff8fc15bec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:30.644 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.651+0000 7ff901c39640 1 -- 172.21.15.116:0/3916348946 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8fc15af60 con 0x7ff8fc06d200 2024-02-21T22:53:30.644 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.652+0000 7ff901c39640 1 --2- 172.21.15.116:0/3916348946 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff8fc06d200 0x7ff8fc06d5e0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7ff8fc0b27e0 tx=0x7ff8f802ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80039f3e5b8b10c6 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:30.644 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.652+0000 7ff900c37640 1 -- 172.21.15.116:0/3916348946 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8f8030840 con 0x7ff8fc06d200 2024-02-21T22:53:30.644 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.652+0000 7ff900c37640 1 -- 172.21.15.116:0/3916348946 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8f80309e0 con 0x7ff8fc06d200 2024-02-21T22:53:30.644 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.652+0000 7ff900c37640 1 -- 172.21.15.116:0/3916348946 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8f8030db0 con 0x7ff8fc06d200 2024-02-21T22:53:30.648 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.652+0000 7ff903e9d640 1 -- 172.21.15.116:0/3916348946 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff8fc06d200 msgr2=0x7ff8fc06d5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:30.648 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.652+0000 7ff903e9d640 1 --2- 172.21.15.116:0/3916348946 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff8fc06d200 0x7ff8fc06d5e0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7ff8fc0b27e0 tx=0x7ff8f802ca20 comp rx=0 tx=0).stop 2024-02-21T22:53:30.648 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.652+0000 7ff903e9d640 1 -- 172.21.15.116:0/3916348946 shutdown_connections 2024-02-21T22:53:30.648 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.652+0000 7ff903e9d640 1 --2- 172.21.15.116:0/3916348946 >> v2:172.21.15.142:3300/0 conn(0x7ff8fc15ba50 0x7ff8fc15bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:30.648 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.653+0000 7ff903e9d640 1 --2- 172.21.15.116:0/3916348946 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff8fc0b2c70 0x7ff8fc0cf240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:30.648 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.653+0000 7ff903e9d640 1 --2- 172.21.15.116:0/3916348946 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff8fc06d200 0x7ff8fc06d5e0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:30.648 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.653+0000 7ff903e9d640 1 -- 172.21.15.116:0/3916348946 >> 172.21.15.116:0/3916348946 conn(0x7ff8fc0b1740 msgr2=0x7ff8fc0b1b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:30.648 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.653+0000 7ff903e9d640 1 -- 172.21.15.116:0/3916348946 shutdown_connections 2024-02-21T22:53:30.648 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.653+0000 7ff903e9d640 1 -- 172.21.15.116:0/3916348946 wait complete. 2024-02-21T22:53:30.649 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.654+0000 7ff903e9d640 1 Processor -- start 2024-02-21T22:53:30.649 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.654+0000 7ff903e9d640 1 -- start start 2024-02-21T22:53:30.649 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.654+0000 7ff903e9d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff8fc06d200 0x7ff8fc1474e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:30.649 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.654+0000 7ff903e9d640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff8fc0b2c70 0x7ff8fc1e3c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:30.649 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.654+0000 7ff903e9d640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff8fc15ba50 0x7ff8fc0cace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:30.649 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.654+0000 7ff903e9d640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8fc158130 con 0x7ff8fc15ba50 2024-02-21T22:53:30.649 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.655+0000 7ff903e9d640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8fc0cf780 con 0x7ff8fc0b2c70 2024-02-21T22:53:30.649 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.655+0000 7ff903e9d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8fc1582b0 con 0x7ff8fc06d200 2024-02-21T22:53:30.649 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.655+0000 7ff90243a640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff8fc15ba50 0x7ff8fc0cace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:30.649 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.655+0000 7ff90243a640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff8fc15ba50 0x7ff8fc0cace0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:36210/0 (socket says 172.21.15.116:36210) 2024-02-21T22:53:30.649 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.655+0000 7ff90243a640 1 -- 172.21.15.116:0/2417349785 learned_addr learned my addr 172.21.15.116:0/2417349785 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:30.649 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.655+0000 7ff901c39640 1 --2- 172.21.15.116:0/2417349785 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff8fc06d200 0x7ff8fc1474e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:30.649 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.655+0000 7ff901438640 1 --2- 172.21.15.116:0/2417349785 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff8fc0b2c70 0x7ff8fc1e3c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:30.650 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.655+0000 7ff90243a640 1 -- 172.21.15.116:0/2417349785 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff8fc06d200 msgr2=0x7ff8fc1474e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:30.650 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.655+0000 7ff90243a640 1 --2- 172.21.15.116:0/2417349785 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff8fc06d200 0x7ff8fc1474e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:30.650 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.655+0000 7ff90243a640 1 -- 172.21.15.116:0/2417349785 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff8fc0b2c70 msgr2=0x7ff8fc1e3c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:30.650 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.655+0000 7ff90243a640 1 --2- 172.21.15.116:0/2417349785 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff8fc0b2c70 0x7ff8fc1e3c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:30.650 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.655+0000 7ff90243a640 1 -- 172.21.15.116:0/2417349785 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8fc1e2bd0 con 0x7ff8fc15ba50 2024-02-21T22:53:30.650 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.655+0000 7ff90243a640 1 --2- 172.21.15.116:0/2417349785 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff8fc15ba50 0x7ff8fc0cace0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7ff8f400efc0 tx=0x7ff8f400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:30.650 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.655+0000 7ff8f27fc640 1 -- 172.21.15.116:0/2417349785 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8f4018020 con 0x7ff8fc15ba50 2024-02-21T22:53:30.650 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.655+0000 7ff8f27fc640 1 -- 172.21.15.116:0/2417349785 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8f4014480 con 0x7ff8fc15ba50 2024-02-21T22:53:30.650 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.655+0000 7ff903e9d640 1 -- 172.21.15.116:0/2417349785 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8fc1e2eb0 con 0x7ff8fc15ba50 2024-02-21T22:53:30.650 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.655+0000 7ff8f27fc640 1 -- 172.21.15.116:0/2417349785 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8f4014870 con 0x7ff8fc15ba50 2024-02-21T22:53:30.650 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.655+0000 7ff903e9d640 1 -- 172.21.15.116:0/2417349785 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8fc1e3470 con 0x7ff8fc15ba50 2024-02-21T22:53:30.650 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.656+0000 7ff903e9d640 1 -- 172.21.15.116:0/2417349785 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8fc0752f0 con 0x7ff8fc15ba50 2024-02-21T22:53:30.650 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.657+0000 7ff8f27fc640 1 -- 172.21.15.116:0/2417349785 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ff8f401b020 con 0x7ff8fc15ba50 2024-02-21T22:53:30.650 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.657+0000 7ff8f27fc640 1 --2- 172.21.15.116:0/2417349785 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7ff8e006b4d0 0x7ff8e006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:30.651 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.657+0000 7ff8f27fc640 1 -- 172.21.15.116:0/2417349785 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff8f408ab10 con 0x7ff8fc15ba50 2024-02-21T22:53:30.651 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.657+0000 7ff901c39640 1 --2- 172.21.15.116:0/2417349785 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7ff8e006b4d0 0x7ff8e006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:30.651 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.658+0000 7ff901c39640 1 --2- 172.21.15.116:0/2417349785 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7ff8e006b4d0 0x7ff8e006d990 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ff8f8037000 tx=0x7ff8f8008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:30.651 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.661+0000 7ff8f27fc640 1 -- 172.21.15.116:0/2417349785 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7ff8f4022030 con 0x7ff8fc15ba50 2024-02-21T22:53:30.827 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.836+0000 7ff903e9d640 1 -- 172.21.15.116:0/2417349785 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff8fc0afb30 con 0x7ff8fc15ba50 2024-02-21T22:53:30.827 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.837+0000 7ff8f27fc640 1 -- 172.21.15.116:0/2417349785 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff8f4010040 con 0x7ff8fc15ba50 2024-02-21T22:53:30.827 INFO:teuthology.orchestra.run.smithi116.stdout:pg_num: 64 2024-02-21T22:53:30.829 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.839+0000 7ff903e9d640 1 -- 172.21.15.116:0/2417349785 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7ff8e006b4d0 msgr2=0x7ff8e006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:30.830 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.839+0000 7ff903e9d640 1 --2- 172.21.15.116:0/2417349785 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7ff8e006b4d0 0x7ff8e006d990 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ff8f8037000 tx=0x7ff8f8008030 comp rx=0 tx=0).stop 2024-02-21T22:53:30.830 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.839+0000 7ff903e9d640 1 -- 172.21.15.116:0/2417349785 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff8fc15ba50 msgr2=0x7ff8fc0cace0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:30.830 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.839+0000 7ff903e9d640 1 --2- 172.21.15.116:0/2417349785 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff8fc15ba50 0x7ff8fc0cace0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7ff8f400efc0 tx=0x7ff8f400c490 comp rx=0 tx=0).stop 2024-02-21T22:53:30.830 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.839+0000 7ff903e9d640 1 -- 172.21.15.116:0/2417349785 shutdown_connections 2024-02-21T22:53:30.830 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.839+0000 7ff903e9d640 1 --2- 172.21.15.116:0/2417349785 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff8fc15ba50 0x7ff8fc0cace0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:30.830 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.839+0000 7ff903e9d640 1 --2- 172.21.15.116:0/2417349785 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff8fc0b2c70 0x7ff8fc1e3c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:30.830 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.839+0000 7ff903e9d640 1 --2- 172.21.15.116:0/2417349785 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7ff8e006b4d0 0x7ff8e006d990 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:30.830 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.839+0000 7ff903e9d640 1 --2- 172.21.15.116:0/2417349785 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff8fc06d200 0x7ff8fc1474e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:30.830 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.839+0000 7ff903e9d640 1 -- 172.21.15.116:0/2417349785 >> 172.21.15.116:0/2417349785 conn(0x7ff8fc0b1740 msgr2=0x7ff8fc0ce680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:30.830 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.839+0000 7ff903e9d640 1 -- 172.21.15.116:0/2417349785 shutdown_connections 2024-02-21T22:53:30.830 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.839+0000 7ff903e9d640 1 -- 172.21.15.116:0/2417349785 wait complete. 2024-02-21T22:53:30.840 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-21T22:53:30.943 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.952+0000 7f9ac92b0640 1 Processor -- start 2024-02-21T22:53:30.943 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.952+0000 7f9ac92b0640 1 -- start start 2024-02-21T22:53:30.945 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.953+0000 7f9ac92b0640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9ac406d1c0 0x7f9ac415df60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:30.945 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.953+0000 7f9ac92b0640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f9ac41626a0 0x7f9ac415e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:30.945 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.953+0000 7f9ac92b0640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ac406df90 con 0x7f9ac41622c0 2024-02-21T22:53:30.945 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.953+0000 7f9ac92b0640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ac406d6f0 con 0x7f9ac41626a0 2024-02-21T22:53:30.945 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.953+0000 7f9ac92b0640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac406d9d0 con 0x7f9ac406d1c0 2024-02-21T22:53:30.945 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.953+0000 7f9ac37fe640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f9ac41626a0 0x7f9ac415e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:30.945 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.953+0000 7f9ac37fe640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f9ac41626a0 0x7f9ac415e4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:36220/0 (socket says 172.21.15.116:36220) 2024-02-21T22:53:30.946 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.953+0000 7f9ac37fe640 1 -- 172.21.15.116:0/1533477734 learned_addr learned my addr 172.21.15.116:0/1533477734 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:30.946 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.953+0000 7f9ac27fc640 1 --2- 172.21.15.116:0/1533477734 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9ac406d1c0 0x7f9ac415df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:30.946 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.954+0000 7f9ac37fe640 1 -- 172.21.15.116:0/1533477734 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9ac406d1c0 msgr2=0x7f9ac415df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:53:30.946 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.954+0000 7f9ac37fe640 1 --2- 172.21.15.116:0/1533477734 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9ac406d1c0 0x7f9ac415df60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:30.946 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.954+0000 7f9ac37fe640 1 -- 172.21.15.116:0/1533477734 >> v1:172.21.15.142:6789/0 conn(0x7f9ac41622c0 legacy=0x7f9ac40b2f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:30.946 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.954+0000 7f9ac37fe640 1 -- 172.21.15.116:0/1533477734 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ac406dcb0 con 0x7f9ac41626a0 2024-02-21T22:53:30.946 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.954+0000 7f9ac37fe640 1 --2- 172.21.15.116:0/1533477734 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9ac41626a0 0x7f9ac415e4a0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f9abc0098a0 tx=0x7f9abc02ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29d08add4d57e912 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:30.946 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.954+0000 7f9ac1ffb640 1 -- 172.21.15.116:0/1533477734 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9abc02f830 con 0x7f9ac41626a0 2024-02-21T22:53:30.946 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.954+0000 7f9ac1ffb640 1 -- 172.21.15.116:0/1533477734 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9abc02f9d0 con 0x7f9ac41626a0 2024-02-21T22:53:30.946 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.954+0000 7f9ac1ffb640 1 -- 172.21.15.116:0/1533477734 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9abc02fda0 con 0x7f9ac41626a0 2024-02-21T22:53:30.949 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.955+0000 7f9ac92b0640 1 -- 172.21.15.116:0/1533477734 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9ac41626a0 msgr2=0x7f9ac415e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:30.949 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.955+0000 7f9ac92b0640 1 --2- 172.21.15.116:0/1533477734 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9ac41626a0 0x7f9ac415e4a0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f9abc0098a0 tx=0x7f9abc02ba10 comp rx=0 tx=0).stop 2024-02-21T22:53:30.949 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.955+0000 7f9ac92b0640 1 -- 172.21.15.116:0/1533477734 shutdown_connections 2024-02-21T22:53:30.949 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.955+0000 7f9ac92b0640 1 --2- 172.21.15.116:0/1533477734 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9ac41626a0 0x7f9ac415e4a0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:30.949 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.955+0000 7f9ac92b0640 1 --2- 172.21.15.116:0/1533477734 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9ac406d1c0 0x7f9ac415df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:30.949 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.955+0000 7f9ac92b0640 1 -- 172.21.15.116:0/1533477734 >> 172.21.15.116:0/1533477734 conn(0x7f9ac40d1be0 msgr2=0x7f9ac40d1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:30.949 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.955+0000 7f9ac92b0640 1 -- 172.21.15.116:0/1533477734 shutdown_connections 2024-02-21T22:53:30.949 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.955+0000 7f9ac92b0640 1 -- 172.21.15.116:0/1533477734 wait complete. 2024-02-21T22:53:30.949 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.956+0000 7f9ac92b0640 1 Processor -- start 2024-02-21T22:53:30.950 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.956+0000 7f9ac92b0640 1 -- start start 2024-02-21T22:53:30.950 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.957+0000 7f9ac92b0640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9ac406d1c0 0x7f9ac4150ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:30.950 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.957+0000 7f9ac92b0640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9ac41622c0 0x7f9ac40c5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:30.950 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.957+0000 7f9ac92b0640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9ac41626a0 0x7f9ac40c5d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:30.950 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.957+0000 7f9ac92b0640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac40b51e0 con 0x7f9ac41622c0 2024-02-21T22:53:30.950 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.957+0000 7f9ac92b0640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac40b5060 con 0x7f9ac41626a0 2024-02-21T22:53:30.950 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.957+0000 7f9ac92b0640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac40b5360 con 0x7f9ac406d1c0 2024-02-21T22:53:30.950 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.957+0000 7f9ac27fc640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9ac41622c0 0x7f9ac40c5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:30.950 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.957+0000 7f9ac27fc640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9ac41622c0 0x7f9ac40c5810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:36234/0 (socket says 172.21.15.116:36234) 2024-02-21T22:53:30.950 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.957+0000 7f9ac27fc640 1 -- 172.21.15.116:0/3794107148 learned_addr learned my addr 172.21.15.116:0/3794107148 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:30.950 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.957+0000 7f9ac37fe640 1 --2- 172.21.15.116:0/3794107148 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9ac41626a0 0x7f9ac40c5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:30.950 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.957+0000 7f9ac2ffd640 1 --2- 172.21.15.116:0/3794107148 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9ac406d1c0 0x7f9ac4150ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:30.950 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.958+0000 7f9ac27fc640 1 -- 172.21.15.116:0/3794107148 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9ac406d1c0 msgr2=0x7f9ac4150ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:30.950 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.958+0000 7f9ac27fc640 1 --2- 172.21.15.116:0/3794107148 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9ac406d1c0 0x7f9ac4150ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:30.950 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.958+0000 7f9ac27fc640 1 -- 172.21.15.116:0/3794107148 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9ac41626a0 msgr2=0x7f9ac40c5d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:30.951 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.958+0000 7f9ac27fc640 1 --2- 172.21.15.116:0/3794107148 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9ac41626a0 0x7f9ac40c5d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:30.951 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.958+0000 7f9ac27fc640 1 -- 172.21.15.116:0/3794107148 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ac40c7c30 con 0x7f9ac41622c0 2024-02-21T22:53:30.951 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.958+0000 7f9ac27fc640 1 --2- 172.21.15.116:0/3794107148 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9ac41622c0 0x7f9ac40c5810 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f9ab800e9e0 tx=0x7f9ab800eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:30.951 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.958+0000 7f9aab7fe640 1 -- 172.21.15.116:0/3794107148 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ab8017070 con 0x7f9ac41622c0 2024-02-21T22:53:30.951 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.958+0000 7f9aab7fe640 1 -- 172.21.15.116:0/3794107148 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ab800c970 con 0x7f9ac41622c0 2024-02-21T22:53:30.951 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.958+0000 7f9ac92b0640 1 -- 172.21.15.116:0/3794107148 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ac40c8520 con 0x7f9ac41622c0 2024-02-21T22:53:30.951 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.958+0000 7f9aab7fe640 1 -- 172.21.15.116:0/3794107148 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ab800cd60 con 0x7f9ac41622c0 2024-02-21T22:53:30.951 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.958+0000 7f9ac92b0640 1 -- 172.21.15.116:0/3794107148 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ac40c7ed0 con 0x7f9ac41622c0 2024-02-21T22:53:30.952 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.959+0000 7f9ac92b0640 1 -- 172.21.15.116:0/3794107148 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ac40752f0 con 0x7f9ac41622c0 2024-02-21T22:53:30.952 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.959+0000 7f9aab7fe640 1 -- 172.21.15.116:0/3794107148 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f9ab801a070 con 0x7f9ac41622c0 2024-02-21T22:53:30.952 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.960+0000 7f9aab7fe640 1 --2- 172.21.15.116:0/3794107148 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f9ab006b500 0x7f9ab006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:30.952 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.960+0000 7f9aab7fe640 1 -- 172.21.15.116:0/3794107148 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f9ab808a160 con 0x7f9ac41622c0 2024-02-21T22:53:30.952 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.960+0000 7f9ac2ffd640 1 --2- 172.21.15.116:0/3794107148 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f9ab006b500 0x7f9ab006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:30.952 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.960+0000 7f9ac2ffd640 1 --2- 172.21.15.116:0/3794107148 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f9ab006b500 0x7f9ab006d9c0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f9ac40cbc20 tx=0x7f9ab4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:30.954 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:30.964+0000 7f9aab7fe640 1 -- 172.21.15.116:0/3794107148 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f9ab8058910 con 0x7f9ac41622c0 2024-02-21T22:53:31.159 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.168+0000 7f9ac92b0640 1 -- 172.21.15.116:0/3794107148 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9ac40b3090 con 0x7f9ac41622c0 2024-02-21T22:53:31.159 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.169+0000 7f9aab7fe640 1 -- 172.21.15.116:0/3794107148 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4941 (secure 0 0 0) 0x7f9ab805c9b0 con 0x7f9ac41622c0 2024-02-21T22:53:31.160 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-02-21T22:53:31.160 INFO:teuthology.orchestra.run.smithi116.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6834/1717961923","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":1717961923},{"type":"v1","addr":"172.21.15.116:6834","nonce":1717961923}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6835/2228298220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6833","nonce":2228298220},{"type":"v1","addr":"172.21.15.116:6835","nonce":2228298220}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4285,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/1675920719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":1675920719},{"type":"v1","addr":"172.21.15.142:6837","nonce":1675920719}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-21T22:52:50.128732+0000","modified":"2024-02-21T22:52:52.125495+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6836/939436511","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":939436511},{"type":"v1","addr":"172.21.15.142:6836","nonce":939436511}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-02-21T22:53:31.160 INFO:teuthology.orchestra.run.smithi116.stderr:dumped fsmap epoch 6 2024-02-21T22:53:31.161 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.171+0000 7f9ac92b0640 1 -- 172.21.15.116:0/3794107148 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f9ab006b500 msgr2=0x7f9ab006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:31.162 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.171+0000 7f9ac92b0640 1 --2- 172.21.15.116:0/3794107148 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f9ab006b500 0x7f9ab006d9c0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f9ac40cbc20 tx=0x7f9ab4009040 comp rx=0 tx=0).stop 2024-02-21T22:53:31.162 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.171+0000 7f9ac92b0640 1 -- 172.21.15.116:0/3794107148 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9ac41622c0 msgr2=0x7f9ac40c5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:31.162 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.171+0000 7f9ac92b0640 1 --2- 172.21.15.116:0/3794107148 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9ac41622c0 0x7f9ac40c5810 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f9ab800e9e0 tx=0x7f9ab800eea0 comp rx=0 tx=0).stop 2024-02-21T22:53:31.162 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.171+0000 7f9ac92b0640 1 -- 172.21.15.116:0/3794107148 shutdown_connections 2024-02-21T22:53:31.162 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.171+0000 7f9ac92b0640 1 --2- 172.21.15.116:0/3794107148 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9ac41626a0 0x7f9ac40c5d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:31.162 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.171+0000 7f9ac92b0640 1 --2- 172.21.15.116:0/3794107148 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9ac41622c0 0x7f9ac40c5810 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:31.162 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.171+0000 7f9ac92b0640 1 --2- 172.21.15.116:0/3794107148 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f9ab006b500 0x7f9ab006d9c0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:31.162 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.171+0000 7f9ac92b0640 1 --2- 172.21.15.116:0/3794107148 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9ac406d1c0 0x7f9ac4150ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:31.162 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.171+0000 7f9ac92b0640 1 -- 172.21.15.116:0/3794107148 >> 172.21.15.116:0/3794107148 conn(0x7f9ac40d1be0 msgr2=0x7f9ac415d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:31.162 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.171+0000 7f9ac92b0640 1 -- 172.21.15.116:0/3794107148 shutdown_connections 2024-02-21T22:53:31.162 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.171+0000 7f9ac92b0640 1 -- 172.21.15.116:0/3794107148 wait complete. 2024-02-21T22:53:31.172 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-21T22:53:31.273 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.282+0000 7fe87c260640 1 Processor -- start 2024-02-21T22:53:31.273 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.282+0000 7fe87c260640 1 -- start start 2024-02-21T22:53:31.275 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.283+0000 7fe87c260640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe8740acd30 0x7fe8740ad1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:31.275 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.283+0000 7fe87c260640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8740b3690 con 0x7fe874071580 2024-02-21T22:53:31.275 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.283+0000 7fe87c260640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8740b3930 con 0x7fe87415a680 2024-02-21T22:53:31.275 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.283+0000 7fe87c260640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8740b3c10 con 0x7fe8740acd30 2024-02-21T22:53:31.275 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.283+0000 7fe8797fb640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7fe874071580 0x7fe8740b46f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:36894/0 (socket says 172.21.15.116:36894) 2024-02-21T22:53:31.275 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.283+0000 7fe8797fb640 1 -- 172.21.15.116:0/385420389 learned_addr learned my addr 172.21.15.116:0/385420389 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-02-21T22:53:31.275 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.283+0000 7fe87a7fd640 1 --2- 172.21.15.116:0/385420389 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe8740acd30 0x7fe8740ad1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:31.275 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.284+0000 7fe878ffa640 1 -- 172.21.15.116:0/385420389 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2694079594 0 0) 0x7fe8740b3690 con 0x7fe874071580 2024-02-21T22:53:31.275 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.284+0000 7fe878ffa640 1 -- 172.21.15.116:0/385420389 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe860003520 con 0x7fe874071580 2024-02-21T22:53:31.276 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.284+0000 7fe878ffa640 1 -- 172.21.15.116:0/385420389 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2670471284 0 0) 0x7fe8740b3930 con 0x7fe87415a680 2024-02-21T22:53:31.276 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.284+0000 7fe878ffa640 1 -- 172.21.15.116:0/385420389 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe8740b3690 con 0x7fe87415a680 2024-02-21T22:53:31.276 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.284+0000 7fe87a7fd640 1 -- 172.21.15.116:0/385420389 >> v1:172.21.15.142:6789/0 conn(0x7fe87415a680 legacy=0x7fe87406e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:31.276 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.284+0000 7fe87a7fd640 1 -- 172.21.15.116:0/385420389 >> v1:172.21.15.116:6789/0 conn(0x7fe874071580 legacy=0x7fe8740b46f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:31.276 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.284+0000 7fe87a7fd640 1 -- 172.21.15.116:0/385420389 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8740b3ef0 con 0x7fe8740acd30 2024-02-21T22:53:31.276 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.284+0000 7fe87a7fd640 1 --2- 172.21.15.116:0/385420389 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe8740acd30 0x7fe8740ad1e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe86c0097d0 tx=0x7fe86c02b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=80228d21b8373f29 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:31.276 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.285+0000 7fe878ffa640 1 -- 172.21.15.116:0/385420389 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe86c035020 con 0x7fe8740acd30 2024-02-21T22:53:31.276 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.285+0000 7fe878ffa640 1 -- 172.21.15.116:0/385420389 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe86c031890 con 0x7fe8740acd30 2024-02-21T22:53:31.276 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.285+0000 7fe878ffa640 1 -- 172.21.15.116:0/385420389 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe86c031c40 con 0x7fe8740acd30 2024-02-21T22:53:31.279 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.285+0000 7fe87c260640 1 -- 172.21.15.116:0/385420389 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe8740acd30 msgr2=0x7fe8740ad1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:31.279 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.285+0000 7fe87c260640 1 --2- 172.21.15.116:0/385420389 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe8740acd30 0x7fe8740ad1e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe86c0097d0 tx=0x7fe86c02b930 comp rx=0 tx=0).stop 2024-02-21T22:53:31.279 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.285+0000 7fe87c260640 1 -- 172.21.15.116:0/385420389 shutdown_connections 2024-02-21T22:53:31.279 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.285+0000 7fe87c260640 1 --2- 172.21.15.116:0/385420389 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe8740acd30 0x7fe8740ad1e0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:31.280 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.285+0000 7fe87c260640 1 -- 172.21.15.116:0/385420389 >> 172.21.15.116:0/385420389 conn(0x7fe8740b18e0 msgr2=0x7fe8740b1cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:31.280 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.285+0000 7fe87c260640 1 -- 172.21.15.116:0/385420389 shutdown_connections 2024-02-21T22:53:31.280 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.285+0000 7fe87c260640 1 -- 172.21.15.116:0/385420389 wait complete. 2024-02-21T22:53:31.280 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.286+0000 7fe87c260640 1 Processor -- start 2024-02-21T22:53:31.280 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.286+0000 7fe87c260640 1 -- start start 2024-02-21T22:53:31.280 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.287+0000 7fe87c260640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe874071580 0x7fe87409d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:31.280 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.287+0000 7fe87c260640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe8740acd30 0x7fe87415c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:31.280 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.287+0000 7fe87c260640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe87415b480 0x7fe874148920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:31.280 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.287+0000 7fe87c260640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe87406c8f0 con 0x7fe874071580 2024-02-21T22:53:31.280 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.287+0000 7fe87c260640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8740b4e00 con 0x7fe87415b480 2024-02-21T22:53:31.280 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.287+0000 7fe87c260640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe87406ca70 con 0x7fe8740acd30 2024-02-21T22:53:31.280 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.287+0000 7fe879ffc640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe874071580 0x7fe87409d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:31.280 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.287+0000 7fe879ffc640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe874071580 0x7fe87409d5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:36238/0 (socket says 172.21.15.116:36238) 2024-02-21T22:53:31.281 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.287+0000 7fe879ffc640 1 -- 172.21.15.116:0/925806607 learned_addr learned my addr 172.21.15.116:0/925806607 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:31.281 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.287+0000 7fe87a7fd640 1 --2- 172.21.15.116:0/925806607 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe87415b480 0x7fe874148920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:31.281 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.287+0000 7fe8797fb640 1 --2- 172.21.15.116:0/925806607 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe8740acd30 0x7fe87415c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:31.281 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.287+0000 7fe879ffc640 1 -- 172.21.15.116:0/925806607 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe8740acd30 msgr2=0x7fe87415c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:31.281 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.287+0000 7fe879ffc640 1 --2- 172.21.15.116:0/925806607 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe8740acd30 0x7fe87415c490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:31.281 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.287+0000 7fe879ffc640 1 -- 172.21.15.116:0/925806607 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe87415b480 msgr2=0x7fe874148920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:31.281 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.287+0000 7fe879ffc640 1 --2- 172.21.15.116:0/925806607 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe87415b480 0x7fe874148920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:31.281 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.287+0000 7fe879ffc640 1 -- 172.21.15.116:0/925806607 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe87409c7e0 con 0x7fe874071580 2024-02-21T22:53:31.281 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.287+0000 7fe8797fb640 1 --2- 172.21.15.116:0/925806607 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe8740acd30 0x7fe87415c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T22:53:31.281 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.288+0000 7fe879ffc640 1 --2- 172.21.15.116:0/925806607 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe874071580 0x7fe87409d5a0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fe87000c7a0 tx=0x7fe87000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:31.281 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.288+0000 7fe86a7fc640 1 -- 172.21.15.116:0/925806607 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe870003b70 con 0x7fe874071580 2024-02-21T22:53:31.281 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.288+0000 7fe86a7fc640 1 -- 172.21.15.116:0/925806607 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe870003d30 con 0x7fe874071580 2024-02-21T22:53:31.281 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.288+0000 7fe87c260640 1 -- 172.21.15.116:0/925806607 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe87409cac0 con 0x7fe874071580 2024-02-21T22:53:31.281 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.288+0000 7fe86a7fc640 1 -- 172.21.15.116:0/925806607 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe87000aa30 con 0x7fe874071580 2024-02-21T22:53:31.281 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.288+0000 7fe87c260640 1 -- 172.21.15.116:0/925806607 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe87415b910 con 0x7fe874071580 2024-02-21T22:53:31.282 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.289+0000 7fe87c260640 1 -- 172.21.15.116:0/925806607 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8740752f0 con 0x7fe874071580 2024-02-21T22:53:31.282 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.289+0000 7fe86a7fc640 1 -- 172.21.15.116:0/925806607 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fe87000abd0 con 0x7fe874071580 2024-02-21T22:53:31.282 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.290+0000 7fe86a7fc640 1 --2- 172.21.15.116:0/925806607 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fe85806b4d0 0x7fe85806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:31.282 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.290+0000 7fe86a7fc640 1 -- 172.21.15.116:0/925806607 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fe87008a160 con 0x7fe874071580 2024-02-21T22:53:31.283 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.290+0000 7fe8797fb640 1 --2- 172.21.15.116:0/925806607 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fe85806b4d0 0x7fe85806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:31.283 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.291+0000 7fe8797fb640 1 --2- 172.21.15.116:0/925806607 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fe85806b4d0 0x7fe85806d990 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fe8741f5600 tx=0x7fe864009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:31.287 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.296+0000 7fe86a7fc640 1 -- 172.21.15.116:0/925806607 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7fe870058f60 con 0x7fe874071580 2024-02-21T22:53:31.459 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.468+0000 7fe87c260640 1 -- 172.21.15.116:0/925806607 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe874070d80 con 0x7fe874071580 2024-02-21T22:53:31.460 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.470+0000 7fe86a7fc640 1 -- 172.21.15.116:0/925806607 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16902 (secure 0 0 0) 0x7fe870058860 con 0x7fe874071580 2024-02-21T22:53:31.460 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-02-21T22:53:31.460 INFO:teuthology.orchestra.run.smithi116.stdout:{"epoch":21,"fsid":"7c298660-5f63-4b5c-a800-58c5be9a8445","created":"2024-02-21T22:52:25.994613+0000","modified":"2024-02-21T22:53:30.914649+0000","last_up_change":"2024-02-21T22:52:37.313595+0000","last_in_change":"2024-02-21T22:52:28.176031+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-21T22:52:38.328796+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-21T22:52:48.145152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-21T22:52:49.096955+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4f09126b-b5e4-4876-8b08-f5cbb967388a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":1613202231},{"type":"v1","addr":"172.21.15.116:6809","nonce":1613202231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":1613202231},{"type":"v1","addr":"172.21.15.116:6811","nonce":1613202231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":1613202231},{"type":"v1","addr":"172.21.15.116:6815","nonce":1613202231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":1613202231},{"type":"v1","addr":"172.21.15.116:6813","nonce":1613202231}]},"public_addr":"172.21.15.116:6809/1613202231","cluster_addr":"172.21.15.116:6811/1613202231","heartbeat_back_addr":"172.21.15.116:6815/1613202231","heartbeat_front_addr":"172.21.15.116:6813/1613202231","state":["exists","up"]},{"osd":1,"uuid":"7272c51d-51f9-4536-931d-33ad7a4b377e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6816","nonce":172614746},{"type":"v1","addr":"172.21.15.116:6817","nonce":172614746}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":172614746},{"type":"v1","addr":"172.21.15.116:6819","nonce":172614746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":172614746},{"type":"v1","addr":"172.21.15.116:6823","nonce":172614746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":172614746},{"type":"v1","addr":"172.21.15.116:6821","nonce":172614746}]},"public_addr":"172.21.15.116:6817/172614746","cluster_addr":"172.21.15.116:6819/172614746","heartbeat_back_addr":"172.21.15.116:6823/172614746","heartbeat_front_addr":"172.21.15.116:6821/172614746","state":["exists","up"]},{"osd":2,"uuid":"2589616c-adf1-4187-aac3-735256cf624b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":1029280577},{"type":"v1","addr":"172.21.15.116:6825","nonce":1029280577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":1029280577},{"type":"v1","addr":"172.21.15.116:6827","nonce":1029280577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":1029280577},{"type":"v1","addr":"172.21.15.116:6831","nonce":1029280577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":1029280577},{"type":"v1","addr":"172.21.15.116:6829","nonce":1029280577}]},"public_addr":"172.21.15.116:6825/1029280577","cluster_addr":"172.21.15.116:6827/1029280577","heartbeat_back_addr":"172.21.15.116:6831/1029280577","heartbeat_front_addr":"172.21.15.116:6829/1029280577","state":["exists","up"]},{"osd":3,"uuid":"0fd2e563-7c5b-46f6-82c2-b60c86072c93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":3106627557},{"type":"v1","addr":"172.21.15.116:6801","nonce":3106627557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":3106627557},{"type":"v1","addr":"172.21.15.116:6803","nonce":3106627557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":3106627557},{"type":"v1","addr":"172.21.15.116:6807","nonce":3106627557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":3106627557},{"type":"v1","addr":"172.21.15.116:6805","nonce":3106627557}]},"public_addr":"172.21.15.116:6801/3106627557","cluster_addr":"172.21.15.116:6803/3106627557","heartbeat_back_addr":"172.21.15.116:6807/3106627557","heartbeat_front_addr":"172.21.15.116:6805/3106627557","state":["exists","up"]},{"osd":4,"uuid":"79ae35b7-dda8-4ab8-96ce-47515afde082","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":3231407772},{"type":"v1","addr":"172.21.15.142:6825","nonce":3231407772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":3231407772},{"type":"v1","addr":"172.21.15.142:6827","nonce":3231407772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":3231407772},{"type":"v1","addr":"172.21.15.142:6831","nonce":3231407772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":3231407772},{"type":"v1","addr":"172.21.15.142:6829","nonce":3231407772}]},"public_addr":"172.21.15.142:6825/3231407772","cluster_addr":"172.21.15.142:6827/3231407772","heartbeat_back_addr":"172.21.15.142:6831/3231407772","heartbeat_front_addr":"172.21.15.142:6829/3231407772","state":["exists","up"]},{"osd":5,"uuid":"3166eb2c-3fcf-41c8-9362-45bafaabaa39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":1184158716},{"type":"v1","addr":"172.21.15.142:6817","nonce":1184158716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":1184158716},{"type":"v1","addr":"172.21.15.142:6819","nonce":1184158716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":1184158716},{"type":"v1","addr":"172.21.15.142:6823","nonce":1184158716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":1184158716},{"type":"v1","addr":"172.21.15.142:6821","nonce":1184158716}]},"public_addr":"172.21.15.142:6817/1184158716","cluster_addr":"172.21.15.142:6819/1184158716","heartbeat_back_addr":"172.21.15.142:6823/1184158716","heartbeat_front_addr":"172.21.15.142:6821/1184158716","state":["exists","up"]},{"osd":6,"uuid":"f9aa9672-7527-43e2-963e-b61868e5e63f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":1987868911},{"type":"v1","addr":"172.21.15.142:6801","nonce":1987868911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":1987868911},{"type":"v1","addr":"172.21.15.142:6803","nonce":1987868911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":1987868911},{"type":"v1","addr":"172.21.15.142:6807","nonce":1987868911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":1987868911},{"type":"v1","addr":"172.21.15.142:6805","nonce":1987868911}]},"public_addr":"172.21.15.142:6801/1987868911","cluster_addr":"172.21.15.142:6803/1987868911","heartbeat_back_addr":"172.21.15.142:6807/1987868911","heartbeat_front_addr":"172.21.15.142:6805/1987868911","state":["exists","up"]},{"osd":7,"uuid":"7ed29226-fc42-4382-a91a-fa50f7ec5426","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":1272081937},{"type":"v1","addr":"172.21.15.142:6809","nonce":1272081937}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":1272081937},{"type":"v1","addr":"172.21.15.142:6811","nonce":1272081937}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":1272081937},{"type":"v1","addr":"172.21.15.142:6815","nonce":1272081937}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":1272081937},{"type":"v1","addr":"172.21.15.142:6813","nonce":1272081937}]},"public_addr":"172.21.15.142:6809/1272081937","cluster_addr":"172.21.15.142:6811/1272081937","heartbeat_back_addr":"172.21.15.142:6815/1272081937","heartbeat_front_addr":"172.21.15.142:6813/1272081937","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.350998+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.307201+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.289112+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.243888+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.312091+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.370472+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.275659+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.289297+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.d","mappings":[{"from":7,"to":1}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.30","mappings":[{"from":5,"to":2}]},{"pgid":"3.3c","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-21T22:53:31.462 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.471+0000 7fe87c260640 1 -- 172.21.15.116:0/925806607 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fe85806b4d0 msgr2=0x7fe85806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:31.462 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.471+0000 7fe87c260640 1 --2- 172.21.15.116:0/925806607 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fe85806b4d0 0x7fe85806d990 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fe8741f5600 tx=0x7fe864009040 comp rx=0 tx=0).stop 2024-02-21T22:53:31.462 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.471+0000 7fe87c260640 1 -- 172.21.15.116:0/925806607 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe874071580 msgr2=0x7fe87409d5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:31.462 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.471+0000 7fe87c260640 1 --2- 172.21.15.116:0/925806607 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe874071580 0x7fe87409d5a0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fe87000c7a0 tx=0x7fe87000cc60 comp rx=0 tx=0).stop 2024-02-21T22:53:31.463 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.472+0000 7fe87c260640 1 -- 172.21.15.116:0/925806607 shutdown_connections 2024-02-21T22:53:31.463 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.472+0000 7fe87c260640 1 --2- 172.21.15.116:0/925806607 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe87415b480 0x7fe874148920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:31.463 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.472+0000 7fe87c260640 1 --2- 172.21.15.116:0/925806607 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fe85806b4d0 0x7fe85806d990 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:31.463 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.472+0000 7fe87c260640 1 --2- 172.21.15.116:0/925806607 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe8740acd30 0x7fe87415c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:31.463 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.472+0000 7fe87c260640 1 --2- 172.21.15.116:0/925806607 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe874071580 0x7fe87409d5a0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:31.463 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.472+0000 7fe87c260640 1 -- 172.21.15.116:0/925806607 >> 172.21.15.116:0/925806607 conn(0x7fe8740b18e0 msgr2=0x7fe874157fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:31.463 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.472+0000 7fe87c260640 1 -- 172.21.15.116:0/925806607 shutdown_connections 2024-02-21T22:53:31.463 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.472+0000 7fe87c260640 1 -- 172.21.15.116:0/925806607 wait complete. 2024-02-21T22:53:31.473 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-02-21T22:53:31.474 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-21T22:53:31.578 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.583+0000 7f8afa3aa640 1 Processor -- start 2024-02-21T22:53:31.578 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.584+0000 7f8afa3aa640 1 -- start start 2024-02-21T22:53:31.578 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.584+0000 7f8afa3aa640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f8af4160530 0x7f8af40cfcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:31.578 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.584+0000 7f8afa3aa640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f8af40cc990 0x7f8af40ce520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:31.578 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.584+0000 7f8afa3aa640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8af40b26d0 con 0x7f8af415c190 2024-02-21T22:53:31.578 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.584+0000 7f8afa3aa640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8af40b2d50 con 0x7f8af4160530 2024-02-21T22:53:31.579 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.584+0000 7f8afa3aa640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8af40b3310 con 0x7f8af40cc990 2024-02-21T22:53:31.579 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.584+0000 7f8af37fe640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f8af4160530 0x7f8af40cfcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:31.579 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.584+0000 7f8af3fff640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f8af415c190 0x7f8af415fe20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:36906/0 (socket says 172.21.15.116:36906) 2024-02-21T22:53:31.580 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.584+0000 7f8af3fff640 1 -- 172.21.15.116:0/4232741926 learned_addr learned my addr 172.21.15.116:0/4232741926 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-02-21T22:53:31.580 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.584+0000 7f8af8947640 1 --2- 172.21.15.116:0/4232741926 >> v2:172.21.15.142:3300/0 conn(0x7f8af40cc990 0x7f8af40ce520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:31.580 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.585+0000 7f8af37fe640 1 -- 172.21.15.116:0/4232741926 >> v2:172.21.15.142:3300/0 conn(0x7f8af40cc990 msgr2=0x7f8af40ce520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:53:31.580 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.585+0000 7f8af37fe640 1 --2- 172.21.15.116:0/4232741926 >> v2:172.21.15.142:3300/0 conn(0x7f8af40cc990 0x7f8af40ce520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:31.580 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.585+0000 7f8af37fe640 1 -- 172.21.15.116:0/4232741926 >> v1:172.21.15.116:6789/0 conn(0x7f8af415c190 legacy=0x7f8af415fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:31.581 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.585+0000 7f8af2ffd640 1 -- 172.21.15.116:0/4232741926 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3988956634 0 0) 0x7f8af40b26d0 con 0x7f8af415c190 2024-02-21T22:53:31.581 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.585+0000 7f8af37fe640 1 -- 172.21.15.116:0/4232741926 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8af40b29b0 con 0x7f8af4160530 2024-02-21T22:53:31.581 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.585+0000 7f8af37fe640 1 --2- 172.21.15.116:0/4232741926 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8af4160530 0x7f8af40cfcf0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f8af4071f90 tx=0x7f8ae802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64d55c6f53fb34c2 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:31.581 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.586+0000 7f8af2ffd640 1 -- 172.21.15.116:0/4232741926 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ae8035020 con 0x7f8af4160530 2024-02-21T22:53:31.581 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.586+0000 7f8af2ffd640 1 -- 172.21.15.116:0/4232741926 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ae8031830 con 0x7f8af4160530 2024-02-21T22:53:31.581 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.586+0000 7f8af2ffd640 1 -- 172.21.15.116:0/4232741926 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ae8031c00 con 0x7f8af4160530 2024-02-21T22:53:31.582 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.586+0000 7f8afa3aa640 1 -- 172.21.15.116:0/4232741926 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8af4160530 msgr2=0x7f8af40cfcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:31.582 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.586+0000 7f8afa3aa640 1 --2- 172.21.15.116:0/4232741926 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8af4160530 0x7f8af40cfcf0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f8af4071f90 tx=0x7f8ae802b8d0 comp rx=0 tx=0).stop 2024-02-21T22:53:31.582 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.586+0000 7f8afa3aa640 1 -- 172.21.15.116:0/4232741926 shutdown_connections 2024-02-21T22:53:31.582 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.586+0000 7f8afa3aa640 1 --2- 172.21.15.116:0/4232741926 >> v2:172.21.15.142:3300/0 conn(0x7f8af40cc990 0x7f8af40ce520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:31.582 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.586+0000 7f8afa3aa640 1 --2- 172.21.15.116:0/4232741926 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8af4160530 0x7f8af40cfcf0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:31.582 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.586+0000 7f8afa3aa640 1 -- 172.21.15.116:0/4232741926 >> 172.21.15.116:0/4232741926 conn(0x7f8af40d1be0 msgr2=0x7f8af40d1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:31.582 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.586+0000 7f8afa3aa640 1 -- 172.21.15.116:0/4232741926 shutdown_connections 2024-02-21T22:53:31.583 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.586+0000 7f8afa3aa640 1 -- 172.21.15.116:0/4232741926 wait complete. 2024-02-21T22:53:31.583 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.587+0000 7f8afa3aa640 1 Processor -- start 2024-02-21T22:53:31.583 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.588+0000 7f8afa3aa640 1 -- start start 2024-02-21T22:53:31.586 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.588+0000 7f8afa3aa640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8af40cc990 0x7f8af41574f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:31.587 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.588+0000 7f8afa3aa640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8af415c190 0x7f8af40b6000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:31.587 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.588+0000 7f8afa3aa640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8af4160530 0x7f8af40ce6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:31.587 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.588+0000 7f8afa3aa640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8af415c570 con 0x7f8af40cc990 2024-02-21T22:53:31.587 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.588+0000 7f8afa3aa640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8af40d0230 con 0x7f8af415c190 2024-02-21T22:53:31.587 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.588+0000 7f8afa3aa640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8af415c6f0 con 0x7f8af4160530 2024-02-21T22:53:31.587 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.588+0000 7f8af3fff640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8af40cc990 0x7f8af41574f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:31.587 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.588+0000 7f8af3fff640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8af40cc990 0x7f8af41574f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:36262/0 (socket says 172.21.15.116:36262) 2024-02-21T22:53:31.587 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.588+0000 7f8af3fff640 1 -- 172.21.15.116:0/3214438401 learned_addr learned my addr 172.21.15.116:0/3214438401 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:31.587 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.588+0000 7f8af8947640 1 --2- 172.21.15.116:0/3214438401 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8af4160530 0x7f8af40ce6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:31.587 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.588+0000 7f8af37fe640 1 --2- 172.21.15.116:0/3214438401 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8af415c190 0x7f8af40b6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:31.587 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.589+0000 7f8af3fff640 1 -- 172.21.15.116:0/3214438401 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8af4160530 msgr2=0x7f8af40ce6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:31.587 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.589+0000 7f8af3fff640 1 --2- 172.21.15.116:0/3214438401 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8af4160530 0x7f8af40ce6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:31.588 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.589+0000 7f8af3fff640 1 -- 172.21.15.116:0/3214438401 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8af415c190 msgr2=0x7f8af40b6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:31.588 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.589+0000 7f8af3fff640 1 --2- 172.21.15.116:0/3214438401 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8af415c190 0x7f8af40b6000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:31.588 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.589+0000 7f8af3fff640 1 -- 172.21.15.116:0/3214438401 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8af415d2e0 con 0x7f8af40cc990 2024-02-21T22:53:31.588 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.589+0000 7f8af3fff640 1 --2- 172.21.15.116:0/3214438401 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8af40cc990 0x7f8af41574f0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f8ae400c4d0 tx=0x7f8ae400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:31.588 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.589+0000 7f8af0ff9640 1 -- 172.21.15.116:0/3214438401 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ae4018070 con 0x7f8af40cc990 2024-02-21T22:53:31.588 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.589+0000 7f8af0ff9640 1 -- 172.21.15.116:0/3214438401 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ae4007500 con 0x7f8af40cc990 2024-02-21T22:53:31.588 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.589+0000 7f8afa3aa640 1 -- 172.21.15.116:0/3214438401 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8af415d5c0 con 0x7f8af40cc990 2024-02-21T22:53:31.588 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.589+0000 7f8af0ff9640 1 -- 172.21.15.116:0/3214438401 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ae4004a20 con 0x7f8af40cc990 2024-02-21T22:53:31.588 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.589+0000 7f8afa3aa640 1 -- 172.21.15.116:0/3214438401 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8af415db80 con 0x7f8af40cc990 2024-02-21T22:53:31.588 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.590+0000 7f8afa3aa640 1 -- 172.21.15.116:0/3214438401 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8af40752f0 con 0x7f8af40cc990 2024-02-21T22:53:31.588 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.590+0000 7f8af0ff9640 1 -- 172.21.15.116:0/3214438401 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f8ae401b070 con 0x7f8af40cc990 2024-02-21T22:53:31.588 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.591+0000 7f8af0ff9640 1 --2- 172.21.15.116:0/3214438401 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f8ae006b4d0 0x7f8ae006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:31.589 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.591+0000 7f8af0ff9640 1 -- 172.21.15.116:0/3214438401 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f8ae4089510 con 0x7f8af40cc990 2024-02-21T22:53:31.589 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.591+0000 7f8af37fe640 1 --2- 172.21.15.116:0/3214438401 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f8ae006b4d0 0x7f8ae006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:31.589 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.591+0000 7f8af37fe640 1 --2- 172.21.15.116:0/3214438401 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f8ae006b4d0 0x7f8ae006d990 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f8ae8036000 tx=0x7f8ae8008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:31.589 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.595+0000 7f8af0ff9640 1 -- 172.21.15.116:0/3214438401 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f8ae4057cc0 con 0x7f8af40cc990 2024-02-21T22:53:31.792 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.801+0000 7f8afa3aa640 1 -- 172.21.15.116:0/3214438401 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8af40c5170 con 0x7f8af40cc990 2024-02-21T22:53:31.792 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.802+0000 7f8af0ff9640 1 -- 172.21.15.116:0/3214438401 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4941 (secure 0 0 0) 0x7f8ae405bd60 con 0x7f8af40cc990 2024-02-21T22:53:31.793 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-02-21T22:53:31.793 INFO:teuthology.orchestra.run.smithi116.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6834/1717961923","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":1717961923},{"type":"v1","addr":"172.21.15.116:6834","nonce":1717961923}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6835/2228298220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6833","nonce":2228298220},{"type":"v1","addr":"172.21.15.116:6835","nonce":2228298220}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4285,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/1675920719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":1675920719},{"type":"v1","addr":"172.21.15.142:6837","nonce":1675920719}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-21T22:52:50.128732+0000","modified":"2024-02-21T22:52:52.125495+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6836/939436511","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":939436511},{"type":"v1","addr":"172.21.15.142:6836","nonce":939436511}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-02-21T22:53:31.793 INFO:teuthology.orchestra.run.smithi116.stderr:dumped fsmap epoch 6 2024-02-21T22:53:31.794 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.804+0000 7f8afa3aa640 1 -- 172.21.15.116:0/3214438401 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f8ae006b4d0 msgr2=0x7f8ae006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:31.794 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.804+0000 7f8afa3aa640 1 --2- 172.21.15.116:0/3214438401 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f8ae006b4d0 0x7f8ae006d990 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f8ae8036000 tx=0x7f8ae8008030 comp rx=0 tx=0).stop 2024-02-21T22:53:31.795 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.804+0000 7f8afa3aa640 1 -- 172.21.15.116:0/3214438401 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8af40cc990 msgr2=0x7f8af41574f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:31.795 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.804+0000 7f8afa3aa640 1 --2- 172.21.15.116:0/3214438401 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8af40cc990 0x7f8af41574f0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f8ae400c4d0 tx=0x7f8ae400c990 comp rx=0 tx=0).stop 2024-02-21T22:53:31.795 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.804+0000 7f8afa3aa640 1 -- 172.21.15.116:0/3214438401 shutdown_connections 2024-02-21T22:53:31.795 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.804+0000 7f8afa3aa640 1 --2- 172.21.15.116:0/3214438401 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f8ae006b4d0 0x7f8ae006d990 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:31.795 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.804+0000 7f8afa3aa640 1 --2- 172.21.15.116:0/3214438401 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8af4160530 0x7f8af40ce6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:31.795 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.804+0000 7f8afa3aa640 1 --2- 172.21.15.116:0/3214438401 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8af415c190 0x7f8af40b6000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:31.795 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.804+0000 7f8afa3aa640 1 --2- 172.21.15.116:0/3214438401 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8af40cc990 0x7f8af41574f0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:31.795 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.804+0000 7f8afa3aa640 1 -- 172.21.15.116:0/3214438401 >> 172.21.15.116:0/3214438401 conn(0x7f8af40d1be0 msgr2=0x7f8af406eb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:31.795 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.804+0000 7f8afa3aa640 1 -- 172.21.15.116:0/3214438401 shutdown_connections 2024-02-21T22:53:31.795 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.804+0000 7f8afa3aa640 1 -- 172.21.15.116:0/3214438401 wait complete. 2024-02-21T22:53:31.806 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-21T22:53:31.906 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.915+0000 7f78ecd1e640 1 Processor -- start 2024-02-21T22:53:31.906 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.915+0000 7f78ecd1e640 1 -- start start 2024-02-21T22:53:31.907 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.916+0000 7f78ecd1e640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f78e80d0510 0x7f78e80d08f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:31.907 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.916+0000 7f78ecd1e640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f78e80d1c30 0x7f78e80d2430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:31.907 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.916+0000 7f78ecd1e640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78e80cfa50 con 0x7f78e80ce8c0 2024-02-21T22:53:31.908 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.916+0000 7f78ecd1e640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78e80d1450 con 0x7f78e80d0510 2024-02-21T22:53:31.908 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.916+0000 7f78ecd1e640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78e80d0e30 con 0x7f78e80d1c30 2024-02-21T22:53:31.908 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.917+0000 7f78e659c640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f78e80d0510 0x7f78e80d08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:31.908 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.917+0000 7f78e659c640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f78e80d0510 0x7f78e80d08f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:36264/0 (socket says 172.21.15.116:36264) 2024-02-21T22:53:31.908 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.917+0000 7f78e659c640 1 -- 172.21.15.116:0/3732281394 learned_addr learned my addr 172.21.15.116:0/3732281394 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:31.908 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.917+0000 7f78e5d9b640 1 --2- 172.21.15.116:0/3732281394 >> v2:172.21.15.142:3300/0 conn(0x7f78e80d1c30 0x7f78e80d2430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:31.908 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.917+0000 7f78e659c640 1 -- 172.21.15.116:0/3732281394 >> v2:172.21.15.142:3300/0 conn(0x7f78e80d1c30 msgr2=0x7f78e80d2430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:53:31.908 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.917+0000 7f78e659c640 1 --2- 172.21.15.116:0/3732281394 >> v2:172.21.15.142:3300/0 conn(0x7f78e80d1c30 0x7f78e80d2430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:31.908 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.917+0000 7f78e659c640 1 -- 172.21.15.116:0/3732281394 >> v1:172.21.15.142:6789/0 conn(0x7f78e80ce8c0 legacy=0x7f78e80ced10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:31.908 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.917+0000 7f78e659c640 1 -- 172.21.15.116:0/3732281394 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78e80cfcc0 con 0x7f78e80d0510 2024-02-21T22:53:31.909 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.918+0000 7f78e659c640 1 --2- 172.21.15.116:0/3732281394 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f78e80d0510 0x7f78e80d08f0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f78e80d15d0 tx=0x7f78dc02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ee05e367d11e30c server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:31.909 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.918+0000 7f78e559a640 1 -- 172.21.15.116:0/3732281394 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78dc035020 con 0x7f78e80d0510 2024-02-21T22:53:31.909 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.918+0000 7f78e559a640 1 -- 172.21.15.116:0/3732281394 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78dc031870 con 0x7f78e80d0510 2024-02-21T22:53:31.910 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.918+0000 7f78e559a640 1 -- 172.21.15.116:0/3732281394 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78dc031c40 con 0x7f78e80d0510 2024-02-21T22:53:31.910 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.918+0000 7f78ecd1e640 1 -- 172.21.15.116:0/3732281394 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f78e80d0510 msgr2=0x7f78e80d08f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:31.910 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.918+0000 7f78ecd1e640 1 --2- 172.21.15.116:0/3732281394 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f78e80d0510 0x7f78e80d08f0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f78e80d15d0 tx=0x7f78dc02b910 comp rx=0 tx=0).stop 2024-02-21T22:53:31.910 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.918+0000 7f78ecd1e640 1 -- 172.21.15.116:0/3732281394 shutdown_connections 2024-02-21T22:53:31.910 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.918+0000 7f78ecd1e640 1 --2- 172.21.15.116:0/3732281394 >> v2:172.21.15.142:3300/0 conn(0x7f78e80d1c30 0x7f78e80d2430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:31.910 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.918+0000 7f78ecd1e640 1 --2- 172.21.15.116:0/3732281394 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f78e80d0510 0x7f78e80d08f0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:31.910 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.918+0000 7f78ecd1e640 1 -- 172.21.15.116:0/3732281394 >> 172.21.15.116:0/3732281394 conn(0x7f78e80d3e50 msgr2=0x7f78e80d4260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:31.910 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.918+0000 7f78ecd1e640 1 -- 172.21.15.116:0/3732281394 shutdown_connections 2024-02-21T22:53:31.910 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.918+0000 7f78ecd1e640 1 -- 172.21.15.116:0/3732281394 wait complete. 2024-02-21T22:53:31.912 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.920+0000 7f78ecd1e640 1 Processor -- start 2024-02-21T22:53:31.912 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.920+0000 7f78ecd1e640 1 -- start start 2024-02-21T22:53:31.912 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.920+0000 7f78ecd1e640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f78e80ce8c0 0x7f78e814f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:31.912 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.920+0000 7f78ecd1e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f78e80d0510 0x7f78e8156280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:31.912 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.920+0000 7f78ecd1e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f78e80d1c30 0x7f78e815c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:31.912 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.920+0000 7f78ecd1e640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78e815e640 con 0x7f78e80ce8c0 2024-02-21T22:53:31.912 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.920+0000 7f78ecd1e640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78e80d10e0 con 0x7f78e80d1c30 2024-02-21T22:53:31.912 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.921+0000 7f78ecd1e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78e80d2970 con 0x7f78e80d0510 2024-02-21T22:53:31.912 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.921+0000 7f78e659c640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f78e80ce8c0 0x7f78e814f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:31.912 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.921+0000 7f78e659c640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f78e80ce8c0 0x7f78e814f9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:36272/0 (socket says 172.21.15.116:36272) 2024-02-21T22:53:31.912 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.921+0000 7f78e659c640 1 -- 172.21.15.116:0/3655588015 learned_addr learned my addr 172.21.15.116:0/3655588015 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:31.912 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.921+0000 7f78e5d9b640 1 --2- 172.21.15.116:0/3655588015 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f78e80d0510 0x7f78e8156280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:31.913 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.921+0000 7f78e6d9d640 1 --2- 172.21.15.116:0/3655588015 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f78e80d1c30 0x7f78e815c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:31.913 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.921+0000 7f78e659c640 1 -- 172.21.15.116:0/3655588015 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f78e80d0510 msgr2=0x7f78e8156280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:31.913 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.921+0000 7f78e659c640 1 --2- 172.21.15.116:0/3655588015 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f78e80d0510 0x7f78e8156280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:31.913 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.921+0000 7f78e659c640 1 -- 172.21.15.116:0/3655588015 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f78e80d1c30 msgr2=0x7f78e815c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:31.913 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.921+0000 7f78e659c640 1 --2- 172.21.15.116:0/3655588015 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f78e80d1c30 0x7f78e815c710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:31.913 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.921+0000 7f78e659c640 1 -- 172.21.15.116:0/3655588015 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78e81567c0 con 0x7f78e80ce8c0 2024-02-21T22:53:31.913 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.921+0000 7f78e659c640 1 --2- 172.21.15.116:0/3655588015 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f78e80ce8c0 0x7f78e814f9c0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f78dc02b950 tx=0x7f78dc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:31.914 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.923+0000 7f78d6ffd640 1 -- 172.21.15.116:0/3655588015 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78dc035040 con 0x7f78e80ce8c0 2024-02-21T22:53:31.914 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.923+0000 7f78d6ffd640 1 -- 172.21.15.116:0/3655588015 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78dc030d00 con 0x7f78e80ce8c0 2024-02-21T22:53:31.914 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.923+0000 7f78d6ffd640 1 -- 172.21.15.116:0/3655588015 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78dc0456a0 con 0x7f78e80ce8c0 2024-02-21T22:53:31.914 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.923+0000 7f78ecd1e640 1 -- 172.21.15.116:0/3655588015 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78e8155d70 con 0x7f78e80ce8c0 2024-02-21T22:53:31.914 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.923+0000 7f78ecd1e640 1 -- 172.21.15.116:0/3655588015 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78e8151000 con 0x7f78e80ce8c0 2024-02-21T22:53:31.914 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.924+0000 7f78ecd1e640 1 -- 172.21.15.116:0/3655588015 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78e80752f0 con 0x7f78e80ce8c0 2024-02-21T22:53:31.915 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.924+0000 7f78d6ffd640 1 -- 172.21.15.116:0/3655588015 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f78dc038020 con 0x7f78e80ce8c0 2024-02-21T22:53:31.915 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.925+0000 7f78d6ffd640 1 --2- 172.21.15.116:0/3655588015 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f78c806b4d0 0x7f78c806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:31.915 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.925+0000 7f78d6ffd640 1 -- 172.21.15.116:0/3655588015 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f78dc0ac2c0 con 0x7f78e80ce8c0 2024-02-21T22:53:31.915 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.925+0000 7f78e5d9b640 1 --2- 172.21.15.116:0/3655588015 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f78c806b4d0 0x7f78c806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:31.916 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.925+0000 7f78e5d9b640 1 --2- 172.21.15.116:0/3655588015 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f78c806b4d0 0x7f78c806d990 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f78e80cb370 tx=0x7f78d8009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:31.922 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:31.932+0000 7f78d6ffd640 1 -- 172.21.15.116:0/3655588015 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f78dc07ab00 con 0x7f78e80ce8c0 2024-02-21T22:53:32.132 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.141+0000 7f78ecd1e640 1 -- 172.21.15.116:0/3655588015 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f78e80d2210 con 0x7f78e80ce8c0 2024-02-21T22:53:32.132 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.141+0000 7f78d6ffd640 1 -- 172.21.15.116:0/3655588015 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4941 (secure 0 0 0) 0x7f78dc07eba0 con 0x7f78e80ce8c0 2024-02-21T22:53:32.133 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-02-21T22:53:32.133 INFO:teuthology.orchestra.run.smithi116.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6834/1717961923","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":1717961923},{"type":"v1","addr":"172.21.15.116:6834","nonce":1717961923}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6835/2228298220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6833","nonce":2228298220},{"type":"v1","addr":"172.21.15.116:6835","nonce":2228298220}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4285,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/1675920719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":1675920719},{"type":"v1","addr":"172.21.15.142:6837","nonce":1675920719}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-21T22:52:50.128732+0000","modified":"2024-02-21T22:52:52.125495+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6836/939436511","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":939436511},{"type":"v1","addr":"172.21.15.142:6836","nonce":939436511}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-02-21T22:53:32.134 INFO:teuthology.orchestra.run.smithi116.stderr:dumped fsmap epoch 6 2024-02-21T22:53:32.135 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.144+0000 7f78ecd1e640 1 -- 172.21.15.116:0/3655588015 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f78c806b4d0 msgr2=0x7f78c806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:32.136 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.144+0000 7f78ecd1e640 1 --2- 172.21.15.116:0/3655588015 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f78c806b4d0 0x7f78c806d990 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f78e80cb370 tx=0x7f78d8009190 comp rx=0 tx=0).stop 2024-02-21T22:53:32.136 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.144+0000 7f78ecd1e640 1 -- 172.21.15.116:0/3655588015 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f78e80ce8c0 msgr2=0x7f78e814f9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:32.136 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.144+0000 7f78ecd1e640 1 --2- 172.21.15.116:0/3655588015 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f78e80ce8c0 0x7f78e814f9c0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f78dc02b950 tx=0x7f78dc0046c0 comp rx=0 tx=0).stop 2024-02-21T22:53:32.136 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.144+0000 7f78ecd1e640 1 -- 172.21.15.116:0/3655588015 shutdown_connections 2024-02-21T22:53:32.137 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.144+0000 7f78ecd1e640 1 --2- 172.21.15.116:0/3655588015 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f78e80d1c30 0x7f78e815c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:32.137 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.144+0000 7f78ecd1e640 1 --2- 172.21.15.116:0/3655588015 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f78c806b4d0 0x7f78c806d990 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:32.137 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.144+0000 7f78ecd1e640 1 --2- 172.21.15.116:0/3655588015 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f78e80d0510 0x7f78e8156280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:32.137 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.144+0000 7f78ecd1e640 1 --2- 172.21.15.116:0/3655588015 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f78e80ce8c0 0x7f78e814f9c0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:32.137 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.144+0000 7f78ecd1e640 1 -- 172.21.15.116:0/3655588015 >> 172.21.15.116:0/3655588015 conn(0x7f78e80d3e50 msgr2=0x7f78e815ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:32.138 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.144+0000 7f78ecd1e640 1 -- 172.21.15.116:0/3655588015 shutdown_connections 2024-02-21T22:53:32.138 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.144+0000 7f78ecd1e640 1 -- 172.21.15.116:0/3655588015 wait complete. 2024-02-21T22:53:32.145 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-21T22:53:32.249 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.255+0000 7f6931fcc640 1 Processor -- start 2024-02-21T22:53:32.249 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.255+0000 7f6931fcc640 1 -- start start 2024-02-21T22:53:32.249 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.256+0000 7f6931fcc640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f692c145210 0x7f692c070fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:32.249 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.256+0000 7f6931fcc640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f692c06c8f0 0x7f692c071500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:32.249 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.256+0000 7f6931fcc640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f692c15feb0 con 0x7f692c15f9b0 2024-02-21T22:53:32.249 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.256+0000 7f6931fcc640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f692c160190 con 0x7f692c06c8f0 2024-02-21T22:53:32.249 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.256+0000 7f6931fcc640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f692c160470 con 0x7f692c145210 2024-02-21T22:53:32.249 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.256+0000 7f692b7fe640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f692c145210 0x7f692c070fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:32.249 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.256+0000 7f692affd640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f692c06c8f0 0x7f692c071500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:32.249 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.256+0000 7f692bfff640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f692c15f9b0 0x7f692c0ae620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.116:45790/0 (socket says 172.21.15.116:45790) 2024-02-21T22:53:32.249 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.256+0000 7f692bfff640 1 -- 172.21.15.116:0/4014093475 learned_addr learned my addr 172.21.15.116:0/4014093475 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-02-21T22:53:32.250 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.256+0000 7f692b7fe640 1 -- 172.21.15.116:0/4014093475 >> v2:172.21.15.142:3300/0 conn(0x7f692c06c8f0 msgr2=0x7f692c071500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:53:32.250 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.256+0000 7f692b7fe640 1 --2- 172.21.15.116:0/4014093475 >> v2:172.21.15.142:3300/0 conn(0x7f692c06c8f0 0x7f692c071500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:32.250 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.256+0000 7f692b7fe640 1 -- 172.21.15.116:0/4014093475 >> v1:172.21.15.142:6789/0 conn(0x7f692c15f9b0 legacy=0x7f692c0ae620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:32.250 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.256+0000 7f692b7fe640 1 -- 172.21.15.116:0/4014093475 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f692c160750 con 0x7f692c145210 2024-02-21T22:53:32.250 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.256+0000 7f692a7fc640 1 -- 172.21.15.116:0/4014093475 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 514117804 0 0) 0x7f692c15feb0 con 0x7f692c15f9b0 2024-02-21T22:53:32.250 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.256+0000 7f692affd640 1 --2- 172.21.15.116:0/4014093475 >> v2:172.21.15.142:3300/0 conn(0x7f692c06c8f0 0x7f692c071500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T22:53:32.250 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.257+0000 7f692b7fe640 1 --2- 172.21.15.116:0/4014093475 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f692c145210 0x7f692c070fc0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f691c0097a0 tx=0x7f691c02b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=418127aa86a30093 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:32.250 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.257+0000 7f692a7fc640 1 -- 172.21.15.116:0/4014093475 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f691c035020 con 0x7f692c145210 2024-02-21T22:53:32.250 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.257+0000 7f692a7fc640 1 -- 172.21.15.116:0/4014093475 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f691c031830 con 0x7f692c145210 2024-02-21T22:53:32.250 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.257+0000 7f692a7fc640 1 -- 172.21.15.116:0/4014093475 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f691c031c00 con 0x7f692c145210 2024-02-21T22:53:32.250 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.258+0000 7f6931fcc640 1 -- 172.21.15.116:0/4014093475 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f692c145210 msgr2=0x7f692c070fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:32.250 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.258+0000 7f6931fcc640 1 --2- 172.21.15.116:0/4014093475 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f692c145210 0x7f692c070fc0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f691c0097a0 tx=0x7f691c02b8d0 comp rx=0 tx=0).stop 2024-02-21T22:53:32.250 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.258+0000 7f6931fcc640 1 -- 172.21.15.116:0/4014093475 shutdown_connections 2024-02-21T22:53:32.250 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.258+0000 7f6931fcc640 1 --2- 172.21.15.116:0/4014093475 >> v2:172.21.15.142:3300/0 conn(0x7f692c06c8f0 0x7f692c071500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:32.250 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.258+0000 7f6931fcc640 1 --2- 172.21.15.116:0/4014093475 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f692c145210 0x7f692c070fc0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:32.251 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.258+0000 7f6931fcc640 1 -- 172.21.15.116:0/4014093475 >> 172.21.15.116:0/4014093475 conn(0x7f692c0b18e0 msgr2=0x7f692c0b1cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:32.251 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.258+0000 7f6931fcc640 1 -- 172.21.15.116:0/4014093475 shutdown_connections 2024-02-21T22:53:32.251 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.258+0000 7f6931fcc640 1 -- 172.21.15.116:0/4014093475 wait complete. 2024-02-21T22:53:32.254 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.259+0000 7f6931fcc640 1 Processor -- start 2024-02-21T22:53:32.254 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.259+0000 7f6931fcc640 1 -- start start 2024-02-21T22:53:32.254 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.260+0000 7f6931fcc640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f692c06c8f0 0x7f692c09baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:32.254 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.260+0000 7f6931fcc640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f692c145210 0x7f692c0ce880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:32.254 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.260+0000 7f6931fcc640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f692c15f9b0 0x7f692c15b590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:32.254 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.260+0000 7f6931fcc640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f692c071bc0 con 0x7f692c145210 2024-02-21T22:53:32.254 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.260+0000 7f6931fcc640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f692c071a40 con 0x7f692c06c8f0 2024-02-21T22:53:32.254 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.260+0000 7f6931fcc640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f692c071d40 con 0x7f692c15f9b0 2024-02-21T22:53:32.254 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.260+0000 7f692affd640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f692c145210 0x7f692c0ce880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:32.254 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.260+0000 7f692affd640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f692c145210 0x7f692c0ce880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:36278/0 (socket says 172.21.15.116:36278) 2024-02-21T22:53:32.254 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.260+0000 7f692affd640 1 -- 172.21.15.116:0/274505223 learned_addr learned my addr 172.21.15.116:0/274505223 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:32.254 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.260+0000 7f692b7fe640 1 --2- 172.21.15.116:0/274505223 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f692c06c8f0 0x7f692c09baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:32.254 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.260+0000 7f692bfff640 1 --2- 172.21.15.116:0/274505223 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f692c15f9b0 0x7f692c15b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:32.254 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.260+0000 7f692affd640 1 -- 172.21.15.116:0/274505223 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f692c15f9b0 msgr2=0x7f692c15b590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:32.255 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.260+0000 7f692affd640 1 --2- 172.21.15.116:0/274505223 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f692c15f9b0 0x7f692c15b590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:32.255 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.260+0000 7f692affd640 1 -- 172.21.15.116:0/274505223 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f692c06c8f0 msgr2=0x7f692c09baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:32.255 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.260+0000 7f692affd640 1 --2- 172.21.15.116:0/274505223 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f692c06c8f0 0x7f692c09baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:32.255 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.260+0000 7f692affd640 1 -- 172.21.15.116:0/274505223 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f692c09aa00 con 0x7f692c145210 2024-02-21T22:53:32.255 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.260+0000 7f692affd640 1 --2- 172.21.15.116:0/274505223 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f692c145210 0x7f692c0ce880 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f692000e930 tx=0x7f692000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:32.255 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.261+0000 7f6913fff640 1 -- 172.21.15.116:0/274505223 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6920017070 con 0x7f692c145210 2024-02-21T22:53:32.255 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.261+0000 7f6913fff640 1 -- 172.21.15.116:0/274505223 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f692000ca00 con 0x7f692c145210 2024-02-21T22:53:32.255 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.261+0000 7f6931fcc640 1 -- 172.21.15.116:0/274505223 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f692c09ace0 con 0x7f692c145210 2024-02-21T22:53:32.255 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.261+0000 7f6913fff640 1 -- 172.21.15.116:0/274505223 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f692000cdf0 con 0x7f692c145210 2024-02-21T22:53:32.255 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.261+0000 7f6931fcc640 1 -- 172.21.15.116:0/274505223 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f692c09b2a0 con 0x7f692c145210 2024-02-21T22:53:32.255 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.262+0000 7f6931fcc640 1 -- 172.21.15.116:0/274505223 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f692c0752f0 con 0x7f692c145210 2024-02-21T22:53:32.255 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.262+0000 7f6913fff640 1 -- 172.21.15.116:0/274505223 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f692001a070 con 0x7f692c145210 2024-02-21T22:53:32.255 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.262+0000 7f6913fff640 1 --2- 172.21.15.116:0/274505223 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f691806b4d0 0x7f691806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:32.255 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.262+0000 7f6913fff640 1 -- 172.21.15.116:0/274505223 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f692008a110 con 0x7f692c145210 2024-02-21T22:53:32.255 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.263+0000 7f692b7fe640 1 --2- 172.21.15.116:0/274505223 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f691806b4d0 0x7f691806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:32.256 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.263+0000 7f692b7fe640 1 --2- 172.21.15.116:0/274505223 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f691806b4d0 0x7f691806d990 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f691c036000 tx=0x7f691c008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:32.257 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.267+0000 7f6913fff640 1 -- 172.21.15.116:0/274505223 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f69200588c0 con 0x7f692c145210 2024-02-21T22:53:32.429 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.439+0000 7f6931fcc640 1 -- 172.21.15.116:0/274505223 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f692c0afb90 con 0x7f692c145210 2024-02-21T22:53:32.430 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.440+0000 7f6913fff640 1 -- 172.21.15.116:0/274505223 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16902 (secure 0 0 0) 0x7f692005c960 con 0x7f692c145210 2024-02-21T22:53:32.431 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-02-21T22:53:32.431 INFO:teuthology.orchestra.run.smithi116.stdout:{"epoch":22,"fsid":"7c298660-5f63-4b5c-a800-58c5be9a8445","created":"2024-02-21T22:52:25.994613+0000","modified":"2024-02-21T22:53:31.921274+0000","last_up_change":"2024-02-21T22:52:37.313595+0000","last_in_change":"2024-02-21T22:52:28.176031+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-21T22:52:38.328796+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-21T22:52:48.145152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-21T22:52:49.096955+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4f09126b-b5e4-4876-8b08-f5cbb967388a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":1613202231},{"type":"v1","addr":"172.21.15.116:6809","nonce":1613202231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":1613202231},{"type":"v1","addr":"172.21.15.116:6811","nonce":1613202231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":1613202231},{"type":"v1","addr":"172.21.15.116:6815","nonce":1613202231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":1613202231},{"type":"v1","addr":"172.21.15.116:6813","nonce":1613202231}]},"public_addr":"172.21.15.116:6809/1613202231","cluster_addr":"172.21.15.116:6811/1613202231","heartbeat_back_addr":"172.21.15.116:6815/1613202231","heartbeat_front_addr":"172.21.15.116:6813/1613202231","state":["exists","up"]},{"osd":1,"uuid":"7272c51d-51f9-4536-931d-33ad7a4b377e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6816","nonce":172614746},{"type":"v1","addr":"172.21.15.116:6817","nonce":172614746}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":172614746},{"type":"v1","addr":"172.21.15.116:6819","nonce":172614746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":172614746},{"type":"v1","addr":"172.21.15.116:6823","nonce":172614746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":172614746},{"type":"v1","addr":"172.21.15.116:6821","nonce":172614746}]},"public_addr":"172.21.15.116:6817/172614746","cluster_addr":"172.21.15.116:6819/172614746","heartbeat_back_addr":"172.21.15.116:6823/172614746","heartbeat_front_addr":"172.21.15.116:6821/172614746","state":["exists","up"]},{"osd":2,"uuid":"2589616c-adf1-4187-aac3-735256cf624b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":1029280577},{"type":"v1","addr":"172.21.15.116:6825","nonce":1029280577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":1029280577},{"type":"v1","addr":"172.21.15.116:6827","nonce":1029280577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":1029280577},{"type":"v1","addr":"172.21.15.116:6831","nonce":1029280577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":1029280577},{"type":"v1","addr":"172.21.15.116:6829","nonce":1029280577}]},"public_addr":"172.21.15.116:6825/1029280577","cluster_addr":"172.21.15.116:6827/1029280577","heartbeat_back_addr":"172.21.15.116:6831/1029280577","heartbeat_front_addr":"172.21.15.116:6829/1029280577","state":["exists","up"]},{"osd":3,"uuid":"0fd2e563-7c5b-46f6-82c2-b60c86072c93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":3106627557},{"type":"v1","addr":"172.21.15.116:6801","nonce":3106627557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":3106627557},{"type":"v1","addr":"172.21.15.116:6803","nonce":3106627557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":3106627557},{"type":"v1","addr":"172.21.15.116:6807","nonce":3106627557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":3106627557},{"type":"v1","addr":"172.21.15.116:6805","nonce":3106627557}]},"public_addr":"172.21.15.116:6801/3106627557","cluster_addr":"172.21.15.116:6803/3106627557","heartbeat_back_addr":"172.21.15.116:6807/3106627557","heartbeat_front_addr":"172.21.15.116:6805/3106627557","state":["exists","up"]},{"osd":4,"uuid":"79ae35b7-dda8-4ab8-96ce-47515afde082","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":3231407772},{"type":"v1","addr":"172.21.15.142:6825","nonce":3231407772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":3231407772},{"type":"v1","addr":"172.21.15.142:6827","nonce":3231407772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":3231407772},{"type":"v1","addr":"172.21.15.142:6831","nonce":3231407772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":3231407772},{"type":"v1","addr":"172.21.15.142:6829","nonce":3231407772}]},"public_addr":"172.21.15.142:6825/3231407772","cluster_addr":"172.21.15.142:6827/3231407772","heartbeat_back_addr":"172.21.15.142:6831/3231407772","heartbeat_front_addr":"172.21.15.142:6829/3231407772","state":["exists","up"]},{"osd":5,"uuid":"3166eb2c-3fcf-41c8-9362-45bafaabaa39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":1184158716},{"type":"v1","addr":"172.21.15.142:6817","nonce":1184158716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":1184158716},{"type":"v1","addr":"172.21.15.142:6819","nonce":1184158716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":1184158716},{"type":"v1","addr":"172.21.15.142:6823","nonce":1184158716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":1184158716},{"type":"v1","addr":"172.21.15.142:6821","nonce":1184158716}]},"public_addr":"172.21.15.142:6817/1184158716","cluster_addr":"172.21.15.142:6819/1184158716","heartbeat_back_addr":"172.21.15.142:6823/1184158716","heartbeat_front_addr":"172.21.15.142:6821/1184158716","state":["exists","up"]},{"osd":6,"uuid":"f9aa9672-7527-43e2-963e-b61868e5e63f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":1987868911},{"type":"v1","addr":"172.21.15.142:6801","nonce":1987868911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":1987868911},{"type":"v1","addr":"172.21.15.142:6803","nonce":1987868911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":1987868911},{"type":"v1","addr":"172.21.15.142:6807","nonce":1987868911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":1987868911},{"type":"v1","addr":"172.21.15.142:6805","nonce":1987868911}]},"public_addr":"172.21.15.142:6801/1987868911","cluster_addr":"172.21.15.142:6803/1987868911","heartbeat_back_addr":"172.21.15.142:6807/1987868911","heartbeat_front_addr":"172.21.15.142:6805/1987868911","state":["exists","up"]},{"osd":7,"uuid":"7ed29226-fc42-4382-a91a-fa50f7ec5426","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":1272081937},{"type":"v1","addr":"172.21.15.142:6809","nonce":1272081937}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":1272081937},{"type":"v1","addr":"172.21.15.142:6811","nonce":1272081937}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":1272081937},{"type":"v1","addr":"172.21.15.142:6815","nonce":1272081937}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":1272081937},{"type":"v1","addr":"172.21.15.142:6813","nonce":1272081937}]},"public_addr":"172.21.15.142:6809/1272081937","cluster_addr":"172.21.15.142:6811/1272081937","heartbeat_back_addr":"172.21.15.142:6815/1272081937","heartbeat_front_addr":"172.21.15.142:6813/1272081937","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.350998+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.307201+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.289112+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.243888+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.312091+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.370472+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.275659+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.289297+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.d","mappings":[{"from":7,"to":1}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.30","mappings":[{"from":5,"to":2}]},{"pgid":"3.3c","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-21T22:53:32.433 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.442+0000 7f6931fcc640 1 -- 172.21.15.116:0/274505223 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f691806b4d0 msgr2=0x7f691806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:32.433 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.442+0000 7f6931fcc640 1 --2- 172.21.15.116:0/274505223 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f691806b4d0 0x7f691806d990 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f691c036000 tx=0x7f691c008030 comp rx=0 tx=0).stop 2024-02-21T22:53:32.433 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.442+0000 7f6931fcc640 1 -- 172.21.15.116:0/274505223 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f692c145210 msgr2=0x7f692c0ce880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:32.433 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.442+0000 7f6931fcc640 1 --2- 172.21.15.116:0/274505223 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f692c145210 0x7f692c0ce880 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f692000e930 tx=0x7f692000edf0 comp rx=0 tx=0).stop 2024-02-21T22:53:32.433 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.442+0000 7f6931fcc640 1 -- 172.21.15.116:0/274505223 shutdown_connections 2024-02-21T22:53:32.433 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.442+0000 7f6931fcc640 1 --2- 172.21.15.116:0/274505223 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f691806b4d0 0x7f691806d990 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:32.433 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.442+0000 7f6931fcc640 1 --2- 172.21.15.116:0/274505223 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f692c15f9b0 0x7f692c15b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:32.433 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.442+0000 7f6931fcc640 1 --2- 172.21.15.116:0/274505223 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f692c145210 0x7f692c0ce880 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:32.433 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.442+0000 7f6931fcc640 1 --2- 172.21.15.116:0/274505223 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f692c06c8f0 0x7f692c09baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:32.433 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.442+0000 7f6931fcc640 1 -- 172.21.15.116:0/274505223 >> 172.21.15.116:0/274505223 conn(0x7f692c0b18e0 msgr2=0x7f692c144850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:32.433 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.442+0000 7f6931fcc640 1 -- 172.21.15.116:0/274505223 shutdown_connections 2024-02-21T22:53:32.433 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.442+0000 7f6931fcc640 1 -- 172.21.15.116:0/274505223 wait complete. 2024-02-21T22:53:32.443 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-02-21T22:53:32.545 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.554+0000 7f665d9aa640 1 Processor -- start 2024-02-21T22:53:32.545 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.554+0000 7f665d9aa640 1 -- start start 2024-02-21T22:53:32.547 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.555+0000 7f665d9aa640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f665815c190 0x7f66580cfcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:32.547 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.555+0000 7f665d9aa640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6658160530 0x7f66580ce520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:32.547 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.555+0000 7f665d9aa640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66580b26d0 con 0x7f66580cc990 2024-02-21T22:53:32.547 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.555+0000 7f665d9aa640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66580b2d50 con 0x7f665815c190 2024-02-21T22:53:32.547 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.555+0000 7f665d9aa640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66580b3310 con 0x7f6658160530 2024-02-21T22:53:32.547 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.555+0000 7f6656ffd640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f665815c190 0x7f66580cfcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:32.547 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.555+0000 7f6656ffd640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f665815c190 0x7f66580cfcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:36282/0 (socket says 172.21.15.116:36282) 2024-02-21T22:53:32.547 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.555+0000 7f6656ffd640 1 -- 172.21.15.116:0/3576398756 learned_addr learned my addr 172.21.15.116:0/3576398756 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:32.547 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.555+0000 7f66577fe640 1 --2- 172.21.15.116:0/3576398756 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6658160530 0x7f66580ce520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:32.547 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.556+0000 7f6656ffd640 1 -- 172.21.15.116:0/3576398756 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6658160530 msgr2=0x7f66580ce520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:53:32.547 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.556+0000 7f6656ffd640 1 --2- 172.21.15.116:0/3576398756 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6658160530 0x7f66580ce520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:32.547 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.556+0000 7f6656ffd640 1 -- 172.21.15.116:0/3576398756 >> v1:172.21.15.142:6789/0 conn(0x7f66580cc990 legacy=0x7f665815fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:32.547 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.556+0000 7f6656ffd640 1 -- 172.21.15.116:0/3576398756 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66580b29b0 con 0x7f665815c190 2024-02-21T22:53:32.548 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.556+0000 7f6655ffb640 1 -- 172.21.15.116:0/3576398756 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1058038803 0 0) 0x7f66580b26d0 con 0x7f66580cc990 2024-02-21T22:53:32.548 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.556+0000 7f6656ffd640 1 --2- 172.21.15.116:0/3576398756 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f665815c190 0x7f66580cfcf0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f6648009e50 tx=0x7f664802bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d7c9d37ca7b8746 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:32.548 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.556+0000 7f6655ffb640 1 -- 172.21.15.116:0/3576398756 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f664802cb00 con 0x7f665815c190 2024-02-21T22:53:32.548 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.556+0000 7f6655ffb640 1 -- 172.21.15.116:0/3576398756 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f664802cca0 con 0x7f665815c190 2024-02-21T22:53:32.548 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.556+0000 7f6655ffb640 1 -- 172.21.15.116:0/3576398756 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6648034610 con 0x7f665815c190 2024-02-21T22:53:32.549 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.557+0000 7f665d9aa640 1 -- 172.21.15.116:0/3576398756 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f665815c190 msgr2=0x7f66580cfcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:32.549 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.557+0000 7f665d9aa640 1 --2- 172.21.15.116:0/3576398756 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f665815c190 0x7f66580cfcf0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f6648009e50 tx=0x7f664802bf60 comp rx=0 tx=0).stop 2024-02-21T22:53:32.549 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.557+0000 7f665d9aa640 1 -- 172.21.15.116:0/3576398756 shutdown_connections 2024-02-21T22:53:32.549 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.557+0000 7f665d9aa640 1 --2- 172.21.15.116:0/3576398756 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6658160530 0x7f66580ce520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:32.549 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.557+0000 7f665d9aa640 1 --2- 172.21.15.116:0/3576398756 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f665815c190 0x7f66580cfcf0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:32.549 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.557+0000 7f665d9aa640 1 -- 172.21.15.116:0/3576398756 >> 172.21.15.116:0/3576398756 conn(0x7f66580d1be0 msgr2=0x7f66580d1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:32.549 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.557+0000 7f665d9aa640 1 -- 172.21.15.116:0/3576398756 shutdown_connections 2024-02-21T22:53:32.549 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.557+0000 7f665d9aa640 1 -- 172.21.15.116:0/3576398756 wait complete. 2024-02-21T22:53:32.549 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.558+0000 7f665d9aa640 1 Processor -- start 2024-02-21T22:53:32.550 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.558+0000 7f665d9aa640 1 -- start start 2024-02-21T22:53:32.552 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.559+0000 7f665d9aa640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f66580cc990 0x7f6658150380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:32.552 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.559+0000 7f665d9aa640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f665815c190 0x7f665806d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:32.552 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.559+0000 7f665d9aa640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6658160530 0x7f665815eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:32.552 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.559+0000 7f665d9aa640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f665815c570 con 0x7f66580cc990 2024-02-21T22:53:32.552 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.559+0000 7f665d9aa640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66580d0230 con 0x7f6658160530 2024-02-21T22:53:32.552 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.559+0000 7f665d9aa640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f665815c6f0 con 0x7f665815c190 2024-02-21T22:53:32.552 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.559+0000 7f6656ffd640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f66580cc990 0x7f6658150380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:32.553 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.559+0000 7f6656ffd640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f66580cc990 0x7f6658150380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:36288/0 (socket says 172.21.15.116:36288) 2024-02-21T22:53:32.553 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.559+0000 7f6656ffd640 1 -- 172.21.15.116:0/3847569337 learned_addr learned my addr 172.21.15.116:0/3847569337 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:32.553 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.559+0000 7f66577fe640 1 --2- 172.21.15.116:0/3847569337 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6658160530 0x7f665815eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:32.553 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.559+0000 7f66567fc640 1 --2- 172.21.15.116:0/3847569337 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f665815c190 0x7f665806d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:32.553 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.560+0000 7f6656ffd640 1 -- 172.21.15.116:0/3847569337 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f665815c190 msgr2=0x7f665806d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:32.553 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.560+0000 7f6656ffd640 1 --2- 172.21.15.116:0/3847569337 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f665815c190 0x7f665806d830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:32.553 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.560+0000 7f6656ffd640 1 -- 172.21.15.116:0/3847569337 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6658160530 msgr2=0x7f665815eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:32.553 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.560+0000 7f6656ffd640 1 --2- 172.21.15.116:0/3847569337 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6658160530 0x7f665815eaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:32.553 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.560+0000 7f6656ffd640 1 -- 172.21.15.116:0/3847569337 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66580caaa0 con 0x7f66580cc990 2024-02-21T22:53:32.553 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.560+0000 7f6656ffd640 1 --2- 172.21.15.116:0/3847569337 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f66580cc990 0x7f6658150380 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f6648036040 tx=0x7f6648004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:32.553 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.560+0000 7f663ffff640 1 -- 172.21.15.116:0/3847569337 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6648043020 con 0x7f66580cc990 2024-02-21T22:53:32.553 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.560+0000 7f663ffff640 1 -- 172.21.15.116:0/3847569337 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f664802ce50 con 0x7f66580cc990 2024-02-21T22:53:32.553 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.560+0000 7f663ffff640 1 -- 172.21.15.116:0/3847569337 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6648009510 con 0x7f66580cc990 2024-02-21T22:53:32.553 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.560+0000 7f665d9aa640 1 -- 172.21.15.116:0/3847569337 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66580cad80 con 0x7f66580cc990 2024-02-21T22:53:32.553 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.560+0000 7f665d9aa640 1 -- 172.21.15.116:0/3847569337 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f665806dd70 con 0x7f66580cc990 2024-02-21T22:53:32.554 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.561+0000 7f665d9aa640 1 -- 172.21.15.116:0/3847569337 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66580ca890 con 0x7f66580cc990 2024-02-21T22:53:32.554 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.561+0000 7f663ffff640 1 -- 172.21.15.116:0/3847569337 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f6648046020 con 0x7f66580cc990 2024-02-21T22:53:32.554 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.562+0000 7f663ffff640 1 --2- 172.21.15.116:0/3847569337 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f664406b4d0 0x7f664406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:32.554 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.562+0000 7f663ffff640 1 -- 172.21.15.116:0/3847569337 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f66480ac760 con 0x7f66580cc990 2024-02-21T22:53:32.554 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.562+0000 7f66567fc640 1 --2- 172.21.15.116:0/3847569337 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f664406b4d0 0x7f664406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:32.554 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.562+0000 7f66567fc640 1 --2- 172.21.15.116:0/3847569337 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f664406b4d0 0x7f664406d990 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f665806fd80 tx=0x7f664c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:32.556 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.566+0000 7f663ffff640 1 -- 172.21.15.116:0/3847569337 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f664804d030 con 0x7f66580cc990 2024-02-21T22:53:32.764 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.773+0000 7f665d9aa640 1 -- 172.21.15.116:0/3847569337 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f66580752f0 con 0x7f66580cc990 2024-02-21T22:53:32.764 INFO:tasks.ceph.mon.a.smithi116.stderr:2024-02-21T22:53:32.774+0000 7f5059c32640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-02-21T22:53:32.766 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.775+0000 7f663ffff640 1 -- 172.21.15.116:0/3847569337 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v7) v1 ==== 161+0+0 (secure 0 0 0) 0x7f664807af20 con 0x7f66580cc990 2024-02-21T22:53:32.766 INFO:teuthology.orchestra.run.smithi116.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-02-21T22:53:32.769 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.778+0000 7f665d9aa640 1 -- 172.21.15.116:0/3847569337 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f664406b4d0 msgr2=0x7f664406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:32.769 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.778+0000 7f665d9aa640 1 --2- 172.21.15.116:0/3847569337 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f664406b4d0 0x7f664406d990 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f665806fd80 tx=0x7f664c009040 comp rx=0 tx=0).stop 2024-02-21T22:53:32.769 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.778+0000 7f665d9aa640 1 -- 172.21.15.116:0/3847569337 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f66580cc990 msgr2=0x7f6658150380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:32.769 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.778+0000 7f665d9aa640 1 --2- 172.21.15.116:0/3847569337 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f66580cc990 0x7f6658150380 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f6648036040 tx=0x7f6648004a40 comp rx=0 tx=0).stop 2024-02-21T22:53:32.769 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.778+0000 7f665d9aa640 1 -- 172.21.15.116:0/3847569337 shutdown_connections 2024-02-21T22:53:32.769 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.778+0000 7f665d9aa640 1 --2- 172.21.15.116:0/3847569337 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6658160530 0x7f665815eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:32.769 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.778+0000 7f665d9aa640 1 --2- 172.21.15.116:0/3847569337 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f664406b4d0 0x7f664406d990 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:32.769 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.778+0000 7f665d9aa640 1 --2- 172.21.15.116:0/3847569337 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f665815c190 0x7f665806d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:32.769 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.778+0000 7f665d9aa640 1 --2- 172.21.15.116:0/3847569337 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f66580cc990 0x7f6658150380 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:32.769 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.778+0000 7f665d9aa640 1 -- 172.21.15.116:0/3847569337 >> 172.21.15.116:0/3847569337 conn(0x7f66580d1be0 msgr2=0x7f665806ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:32.769 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.778+0000 7f665d9aa640 1 -- 172.21.15.116:0/3847569337 shutdown_connections 2024-02-21T22:53:32.769 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.778+0000 7f665d9aa640 1 -- 172.21.15.116:0/3847569337 wait complete. 2024-02-21T22:53:32.771 INFO:tasks.ceph.mds.d.smithi142.stderr: -8128> 2024-02-21T22:52:43.751+0000 7fc8a07fd640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2024-02-21T22:53:32.772 INFO:tasks.ceph.mds.d.smithi142.stderr: -6847> 2024-02-21T22:52:55.760+0000 7fc89a7f1640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-02-21T22:53:32.779 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-02-21T22:53:32.802 INFO:tasks.ceph.mds.d.smithi142.stdout:starting mds.d at 2024-02-21T22:53:32.882 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.892+0000 7f44a8e88640 1 Processor -- start 2024-02-21T22:53:32.883 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.892+0000 7f44a8e88640 1 -- start start 2024-02-21T22:53:32.885 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.893+0000 7f44a8e88640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f44a415ae80 0x7f44a40b2dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:32.886 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.893+0000 7f44a8e88640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f44a406e310 0x7f44a40b3300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:32.886 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.893+0000 7f44a8e88640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f44a40b4490 0x7f44a4070910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:32.886 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.893+0000 7f44a8e88640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44a4071d90 con 0x7f44a406e310 2024-02-21T22:53:32.886 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.893+0000 7f44a8e88640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44a4072070 con 0x7f44a40b4490 2024-02-21T22:53:32.886 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.893+0000 7f44a8e88640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44a4072350 con 0x7f44a415ae80 2024-02-21T22:53:32.886 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.893+0000 7f449bfff640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f44a406e310 0x7f44a40b3300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:32.886 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.893+0000 7f449bfff640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f44a406e310 0x7f44a40b3300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:36296/0 (socket says 172.21.15.116:36296) 2024-02-21T22:53:32.886 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.893+0000 7f449bfff640 1 -- 172.21.15.116:0/4015945604 learned_addr learned my addr 172.21.15.116:0/4015945604 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:32.886 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.893+0000 7f44a2d9d640 1 --2- 172.21.15.116:0/4015945604 >> v2:172.21.15.142:3300/0 conn(0x7f44a40b4490 0x7f44a4070910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:32.886 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.893+0000 7f44a259c640 1 --2- 172.21.15.116:0/4015945604 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f44a415ae80 0x7f44a40b2dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:32.886 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.893+0000 7f449bfff640 1 -- 172.21.15.116:0/4015945604 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f44a415ae80 msgr2=0x7f44a40b2dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:53:32.886 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.893+0000 7f449bfff640 1 --2- 172.21.15.116:0/4015945604 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f44a415ae80 0x7f44a40b2dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:32.886 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.893+0000 7f449bfff640 1 -- 172.21.15.116:0/4015945604 >> v2:172.21.15.142:3300/0 conn(0x7f44a40b4490 msgr2=0x7f44a4070910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:53:32.886 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.893+0000 7f449bfff640 1 --2- 172.21.15.116:0/4015945604 >> v2:172.21.15.142:3300/0 conn(0x7f44a40b4490 0x7f44a4070910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:32.887 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.893+0000 7f449bfff640 1 -- 172.21.15.116:0/4015945604 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44a4072630 con 0x7f44a406e310 2024-02-21T22:53:32.887 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.893+0000 7f44a259c640 1 --2- 172.21.15.116:0/4015945604 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f44a415ae80 0x7f44a40b2dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T22:53:32.887 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.894+0000 7f449bfff640 1 --2- 172.21.15.116:0/4015945604 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f44a406e310 0x7f44a40b3300 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f44a40708a0 tx=0x7f448c02e0e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=458af462353a1842 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:32.887 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.894+0000 7f44a1d9b640 1 -- 172.21.15.116:0/4015945604 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f448c03b070 con 0x7f44a406e310 2024-02-21T22:53:32.887 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.894+0000 7f44a1d9b640 1 -- 172.21.15.116:0/4015945604 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f448c036440 con 0x7f44a406e310 2024-02-21T22:53:32.887 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.894+0000 7f44a1d9b640 1 -- 172.21.15.116:0/4015945604 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f448c036810 con 0x7f44a406e310 2024-02-21T22:53:32.887 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.895+0000 7f44a8e88640 1 -- 172.21.15.116:0/4015945604 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f44a406e310 msgr2=0x7f44a40b3300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:32.887 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.895+0000 7f44a8e88640 1 --2- 172.21.15.116:0/4015945604 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f44a406e310 0x7f44a40b3300 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f44a40708a0 tx=0x7f448c02e0e0 comp rx=0 tx=0).stop 2024-02-21T22:53:32.887 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.895+0000 7f44a8e88640 1 -- 172.21.15.116:0/4015945604 shutdown_connections 2024-02-21T22:53:32.887 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.895+0000 7f44a8e88640 1 --2- 172.21.15.116:0/4015945604 >> v2:172.21.15.142:3300/0 conn(0x7f44a40b4490 0x7f44a4070910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:32.887 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.895+0000 7f44a8e88640 1 --2- 172.21.15.116:0/4015945604 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f44a406e310 0x7f44a40b3300 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:32.887 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.895+0000 7f44a8e88640 1 --2- 172.21.15.116:0/4015945604 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f44a415ae80 0x7f44a40b2dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:32.887 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.895+0000 7f44a8e88640 1 -- 172.21.15.116:0/4015945604 >> 172.21.15.116:0/4015945604 conn(0x7f44a40b1740 msgr2=0x7f44a40b1b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:32.887 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.895+0000 7f44a8e88640 1 -- 172.21.15.116:0/4015945604 shutdown_connections 2024-02-21T22:53:32.887 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.895+0000 7f44a8e88640 1 -- 172.21.15.116:0/4015945604 wait complete. 2024-02-21T22:53:32.890 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.896+0000 7f44a8e88640 1 Processor -- start 2024-02-21T22:53:32.890 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.896+0000 7f44a8e88640 1 -- start start 2024-02-21T22:53:32.890 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.897+0000 7f44a8e88640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f44a406e310 0x7f44a4159db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:32.890 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.897+0000 7f44a8e88640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f44a40b4490 0x7f44a415d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:32.890 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.897+0000 7f44a8e88640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f44a415d620 0x7f44a415b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:32.890 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.897+0000 7f44a8e88640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44a4070fd0 con 0x7f44a40b4490 2024-02-21T22:53:32.891 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.897+0000 7f44a8e88640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44a4070e50 con 0x7f44a406e310 2024-02-21T22:53:32.891 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.897+0000 7f44a8e88640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44a4071150 con 0x7f44a415d620 2024-02-21T22:53:32.891 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.897+0000 7f449bfff640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f44a40b4490 0x7f44a415d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:32.891 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.897+0000 7f449bfff640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f44a40b4490 0x7f44a415d0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:36306/0 (socket says 172.21.15.116:36306) 2024-02-21T22:53:32.891 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.897+0000 7f449bfff640 1 -- 172.21.15.116:0/3782430284 learned_addr learned my addr 172.21.15.116:0/3782430284 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:32.891 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.897+0000 7f44a2d9d640 1 --2- 172.21.15.116:0/3782430284 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f44a415d620 0x7f44a415b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:32.891 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.897+0000 7f44a259c640 1 --2- 172.21.15.116:0/3782430284 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f44a406e310 0x7f44a4159db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:32.891 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.897+0000 7f449bfff640 1 -- 172.21.15.116:0/3782430284 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f44a415d620 msgr2=0x7f44a415b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:32.891 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.897+0000 7f449bfff640 1 --2- 172.21.15.116:0/3782430284 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f44a415d620 0x7f44a415b2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:32.891 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.897+0000 7f449bfff640 1 -- 172.21.15.116:0/3782430284 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f44a406e310 msgr2=0x7f44a4159db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:32.891 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.897+0000 7f449bfff640 1 --2- 172.21.15.116:0/3782430284 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f44a406e310 0x7f44a4159db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:32.891 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.897+0000 7f449bfff640 1 -- 172.21.15.116:0/3782430284 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44a415dab0 con 0x7f44a40b4490 2024-02-21T22:53:32.891 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.897+0000 7f449bfff640 1 --2- 172.21.15.116:0/3782430284 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f44a40b4490 0x7f44a415d0e0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f448c02e120 tx=0x7f448c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:32.891 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.897+0000 7f449affd640 1 -- 172.21.15.116:0/3782430284 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f448c046070 con 0x7f44a40b4490 2024-02-21T22:53:32.892 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.897+0000 7f449affd640 1 -- 172.21.15.116:0/3782430284 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f448c034850 con 0x7f44a40b4490 2024-02-21T22:53:32.892 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.897+0000 7f44a8e88640 1 -- 172.21.15.116:0/3782430284 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44a415bfb0 con 0x7f44a40b4490 2024-02-21T22:53:32.892 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.897+0000 7f449affd640 1 -- 172.21.15.116:0/3782430284 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f448c03b070 con 0x7f44a40b4490 2024-02-21T22:53:32.892 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.897+0000 7f44a8e88640 1 -- 172.21.15.116:0/3782430284 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44a415c570 con 0x7f44a40b4490 2024-02-21T22:53:32.892 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.898+0000 7f44a8e88640 1 -- 172.21.15.116:0/3782430284 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44a40b29a0 con 0x7f44a40b4490 2024-02-21T22:53:32.892 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.899+0000 7f449affd640 1 -- 172.21.15.116:0/3782430284 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f448c049070 con 0x7f44a40b4490 2024-02-21T22:53:32.892 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.899+0000 7f449affd640 1 --2- 172.21.15.116:0/3782430284 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f448406b4d0 0x7f448406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:32.892 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.899+0000 7f449affd640 1 -- 172.21.15.116:0/3782430284 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5911+0+0 (secure 0 0 0) 0x7f448c0ac220 con 0x7f44a40b4490 2024-02-21T22:53:32.892 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.899+0000 7f44a259c640 1 --2- 172.21.15.116:0/3782430284 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f448406b4d0 0x7f448406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:32.892 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.900+0000 7f44a259c640 1 --2- 172.21.15.116:0/3782430284 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f448406b4d0 0x7f448406d990 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f4494006e80 tx=0x7f4494008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:32.894 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:32.903+0000 7f449affd640 1 -- 172.21.15.116:0/3782430284 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f44a40b29a0 con 0x7f44a40b4490 2024-02-21T22:53:33.103 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:33.113+0000 7f44a8e88640 1 -- 172.21.15.116:0/3782430284 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f44a40752f0 con 0x7f44a40b4490 2024-02-21T22:53:33.767 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:33.777+0000 7f449affd640 1 -- 172.21.15.116:0/3782430284 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v8) v1 ==== 104+0+0 (secure 0 0 0) 0x7f448c07aa10 con 0x7f44a40b4490 2024-02-21T22:53:33.770 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:33.779+0000 7f44a8e88640 1 -- 172.21.15.116:0/3782430284 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f448406b4d0 msgr2=0x7f448406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:33.770 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:33.779+0000 7f44a8e88640 1 --2- 172.21.15.116:0/3782430284 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f448406b4d0 0x7f448406d990 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f4494006e80 tx=0x7f4494008040 comp rx=0 tx=0).stop 2024-02-21T22:53:33.770 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:33.779+0000 7f44a8e88640 1 -- 172.21.15.116:0/3782430284 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f44a40b4490 msgr2=0x7f44a415d0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:33.770 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:33.779+0000 7f44a8e88640 1 --2- 172.21.15.116:0/3782430284 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f44a40b4490 0x7f44a415d0e0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f448c02e120 tx=0x7f448c004730 comp rx=0 tx=0).stop 2024-02-21T22:53:33.770 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:33.779+0000 7f44a8e88640 1 -- 172.21.15.116:0/3782430284 shutdown_connections 2024-02-21T22:53:33.770 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:33.779+0000 7f44a8e88640 1 --2- 172.21.15.116:0/3782430284 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f448406b4d0 0x7f448406d990 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:33.770 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:33.779+0000 7f44a8e88640 1 --2- 172.21.15.116:0/3782430284 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f44a415d620 0x7f44a415b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:33.770 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:33.779+0000 7f44a8e88640 1 --2- 172.21.15.116:0/3782430284 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f44a40b4490 0x7f44a415d0e0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:33.770 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:33.779+0000 7f44a8e88640 1 --2- 172.21.15.116:0/3782430284 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f44a406e310 0x7f44a4159db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:33.770 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:33.779+0000 7f44a8e88640 1 -- 172.21.15.116:0/3782430284 >> 172.21.15.116:0/3782430284 conn(0x7f44a40b1740 msgr2=0x7f44a40b3730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:33.771 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:33.779+0000 7f44a8e88640 1 -- 172.21.15.116:0/3782430284 shutdown_connections 2024-02-21T22:53:33.771 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:33.779+0000 7f44a8e88640 1 -- 172.21.15.116:0/3782430284 wait complete. 2024-02-21T22:53:33.782 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-02-21T22:53:33.888 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:33.898+0000 7f1a23677640 1 Processor -- start 2024-02-21T22:53:33.889 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:33.898+0000 7f1a23677640 1 -- start start 2024-02-21T22:53:33.892 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:33.899+0000 7f1a23677640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1a1c15f3b0 0x7f1a1c0cb240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:33.892 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:33.899+0000 7f1a23677640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a1c06d230 con 0x7f1a1c071f00 2024-02-21T22:53:33.893 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:33.899+0000 7f1a23677640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a1c06d510 con 0x7f1a1c0aee60 2024-02-21T22:53:33.893 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:33.899+0000 7f1a23677640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a1c0cb780 con 0x7f1a1c15f3b0 2024-02-21T22:53:33.893 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:33.899+0000 7f1a21c14640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f1a1c071f00 0x7f1a1c072370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:36918/0 (socket says 172.21.15.116:36918) 2024-02-21T22:53:33.893 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:33.899+0000 7f1a21c14640 1 -- 172.21.15.116:0/1621191851 learned_addr learned my addr 172.21.15.116:0/1621191851 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-02-21T22:53:33.893 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:33.899+0000 7f1a21413640 1 --2- 172.21.15.116:0/1621191851 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1a1c15f3b0 0x7f1a1c0cb240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:33.893 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:33.899+0000 7f1a13fff640 1 -- 172.21.15.116:0/1621191851 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3762174525 0 0) 0x7f1a1c06d230 con 0x7f1a1c071f00 2024-02-21T22:53:33.893 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:33.899+0000 7f1a13fff640 1 -- 172.21.15.116:0/1621191851 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1a08003520 con 0x7f1a1c071f00 2024-02-21T22:53:33.893 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:33.899+0000 7f1a13fff640 1 -- 172.21.15.116:0/1621191851 <== mon.0 v1:172.21.15.116:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3963288114 0 0) 0x7f1a08003520 con 0x7f1a1c071f00 2024-02-21T22:53:33.893 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:33.899+0000 7f1a13fff640 1 -- 172.21.15.116:0/1621191851 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1a1c15f3b0 msgr2=0x7f1a1c0cb240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:53:33.893 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:33.899+0000 7f1a13fff640 1 --2- 172.21.15.116:0/1621191851 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1a1c15f3b0 0x7f1a1c0cb240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:33.893 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:33.899+0000 7f1a13fff640 1 -- 172.21.15.116:0/1621191851 >> v1:172.21.15.142:6789/0 conn(0x7f1a1c0aee60 legacy=0x7f1a1c0b2810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:33.893 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:33.899+0000 7f1a13fff640 1 -- 172.21.15.116:0/1621191851 --> v1:172.21.15.116:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a1c0cbb70 con 0x7f1a1c071f00 2024-02-21T22:53:33.893 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:33.900+0000 7f1a13fff640 1 -- 172.21.15.116:0/1621191851 <== mon.0 v1:172.21.15.116:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1101981580 0 0) 0x7f1a140019f0 con 0x7f1a1c071f00 2024-02-21T22:53:33.894 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:33.900+0000 7f1a13fff640 1 -- 172.21.15.116:0/1621191851 >> v1:172.21.15.116:6789/0 conn(0x7f1a1c071f00 legacy=0x7f1a1c072370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:33.894 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:33.900+0000 7f1a13fff640 1 --2- 172.21.15.116:0/1621191851 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1a1c15f3b0 0x7f1a080039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:33.894 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:33.900+0000 7f1a13fff640 1 --2- 172.21.15.116:0/1621191851 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1a08003f60 0x7f1a08004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:33.894 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:33.900+0000 7f1a13fff640 1 --2- 172.21.15.116:0/1621191851 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1a08004d40 0x7f1a080051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:33.894 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:33.900+0000 7f1a13fff640 1 -- 172.21.15.116:0/1621191851 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a1c0cb780 con 0x7f1a08004d40 2024-02-21T22:53:33.894 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:33.900+0000 7f1a13fff640 1 -- 172.21.15.116:0/1621191851 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a0800bb50 con 0x7f1a08003f60 2024-02-21T22:53:33.894 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:33.900+0000 7f1a13fff640 1 -- 172.21.15.116:0/1621191851 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a0800bd50 con 0x7f1a1c15f3b0 2024-02-21T22:53:33.894 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:33.900+0000 7f1a21c14640 1 --2- 172.21.15.116:0/1621191851 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1a08004d40 0x7f1a080051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:33.894 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:33.900+0000 7f1a21413640 1 --2- 172.21.15.116:0/1621191851 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1a1c15f3b0 0x7f1a080039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:33.894 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:33.900+0000 7f1a20c12640 1 --2- 172.21.15.116:0/1621191851 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1a08003f60 0x7f1a08004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:33.894 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:33.900+0000 7f1a21c14640 1 -- 172.21.15.116:0/1621191851 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1a1c15f3b0 msgr2=0x7f1a080039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:53:33.894 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:33.900+0000 7f1a21c14640 1 --2- 172.21.15.116:0/1621191851 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1a1c15f3b0 0x7f1a080039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:33.894 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:33.900+0000 7f1a21c14640 1 -- 172.21.15.116:0/1621191851 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1a08003f60 msgr2=0x7f1a08004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:53:33.894 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:33.900+0000 7f1a21c14640 1 --2- 172.21.15.116:0/1621191851 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1a08003f60 0x7f1a08004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:33.894 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:33.900+0000 7f1a21c14640 1 -- 172.21.15.116:0/1621191851 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a08003520 con 0x7f1a08004d40 2024-02-21T22:53:33.895 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:33.901+0000 7f1a21c14640 1 --2- 172.21.15.116:0/1621191851 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1a08004d40 0x7f1a080051c0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f1a1400a840 tx=0x7f1a08005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b3bcac8380df784 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:33.895 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:33.901+0000 7f1a13fff640 1 -- 172.21.15.116:0/1621191851 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a1400a460 con 0x7f1a08004d40 2024-02-21T22:53:33.895 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:33.901+0000 7f1a13fff640 1 -- 172.21.15.116:0/1621191851 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a14034650 con 0x7f1a08004d40 2024-02-21T22:53:33.895 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:33.901+0000 7f1a13fff640 1 -- 172.21.15.116:0/1621191851 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a14034a40 con 0x7f1a08004d40 2024-02-21T22:53:33.895 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:33.901+0000 7f1a23677640 1 -- 172.21.15.116:0/1621191851 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1a08004d40 msgr2=0x7f1a080051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:33.895 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:33.901+0000 7f1a23677640 1 --2- 172.21.15.116:0/1621191851 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1a08004d40 0x7f1a080051c0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f1a1400a840 tx=0x7f1a08005830 comp rx=0 tx=0).stop 2024-02-21T22:53:33.895 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:33.901+0000 7f1a21c14640 1 -- 172.21.15.116:0/1621191851 reap_dead start 2024-02-21T22:53:33.895 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:33.901+0000 7f1a23677640 1 -- 172.21.15.116:0/1621191851 shutdown_connections 2024-02-21T22:53:33.895 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:33.901+0000 7f1a23677640 1 -- 172.21.15.116:0/1621191851 >> 172.21.15.116:0/1621191851 conn(0x7f1a1c0b1510 msgr2=0x7f1a1c0b18f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:33.895 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:33.901+0000 7f1a23677640 1 -- 172.21.15.116:0/1621191851 shutdown_connections 2024-02-21T22:53:33.895 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:33.901+0000 7f1a23677640 1 -- 172.21.15.116:0/1621191851 wait complete. 2024-02-21T22:53:33.898 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:33.903+0000 7f1a23677640 1 Processor -- start 2024-02-21T22:53:33.898 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:33.903+0000 7f1a23677640 1 -- start start 2024-02-21T22:53:33.898 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:33.903+0000 7f1a23677640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1a1c150ef0 0x7f1a1c1518c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:33.898 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:33.903+0000 7f1a23677640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1a1c1512d0 0x7f1a1c0b35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:33.898 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:33.903+0000 7f1a23677640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1a1c0b3b10 0x7f1a1c152be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:33.898 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:33.903+0000 7f1a23677640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a1c0cb240 con 0x7f1a1c150ef0 2024-02-21T22:53:33.898 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:33.903+0000 7f1a23677640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a1c0cb920 con 0x7f1a1c0b3b10 2024-02-21T22:53:33.898 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:33.903+0000 7f1a23677640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a1c0cb3c0 con 0x7f1a1c1512d0 2024-02-21T22:53:33.899 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:33.903+0000 7f1a21413640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1a1c150ef0 0x7f1a1c1518c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:33.899 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:33.903+0000 7f1a21413640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1a1c150ef0 0x7f1a1c1518c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:36322/0 (socket says 172.21.15.116:36322) 2024-02-21T22:53:33.899 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:33.903+0000 7f1a21413640 1 -- 172.21.15.116:0/341905133 learned_addr learned my addr 172.21.15.116:0/341905133 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:33.899 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:33.904+0000 7f1a21413640 1 -- 172.21.15.116:0/341905133 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1a1c1512d0 msgr2=0x7f1a1c0b35d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:33.899 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:33.904+0000 7f1a21413640 1 --2- 172.21.15.116:0/341905133 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1a1c1512d0 0x7f1a1c0b35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:33.899 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:33.904+0000 7f1a21413640 1 -- 172.21.15.116:0/341905133 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1a1c0b3b10 msgr2=0x7f1a1c152be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:33.899 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:33.904+0000 7f1a21413640 1 --2- 172.21.15.116:0/341905133 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1a1c0b3b10 0x7f1a1c152be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:33.899 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:33.904+0000 7f1a21413640 1 -- 172.21.15.116:0/341905133 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a1c0c6e80 con 0x7f1a1c150ef0 2024-02-21T22:53:33.899 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:33.904+0000 7f1a21413640 1 --2- 172.21.15.116:0/341905133 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1a1c150ef0 0x7f1a1c1518c0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f1a180119d0 tx=0x7f1a18011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:33.899 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:33.904+0000 7f1a11ffb640 1 -- 172.21.15.116:0/341905133 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a1800fad0 con 0x7f1a1c150ef0 2024-02-21T22:53:33.899 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:33.904+0000 7f1a11ffb640 1 -- 172.21.15.116:0/341905133 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a1800fc70 con 0x7f1a1c150ef0 2024-02-21T22:53:33.899 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:33.904+0000 7f1a23677640 1 -- 172.21.15.116:0/341905133 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a1c0c7160 con 0x7f1a1c150ef0 2024-02-21T22:53:33.899 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:33.904+0000 7f1a11ffb640 1 -- 172.21.15.116:0/341905133 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a18014440 con 0x7f1a1c150ef0 2024-02-21T22:53:33.899 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:33.904+0000 7f1a23677640 1 -- 172.21.15.116:0/341905133 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a1c0c7720 con 0x7f1a1c150ef0 2024-02-21T22:53:33.900 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:33.905+0000 7f1a23677640 1 -- 172.21.15.116:0/341905133 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a1c0752f0 con 0x7f1a1c150ef0 2024-02-21T22:53:33.900 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:33.905+0000 7f1a11ffb640 1 -- 172.21.15.116:0/341905133 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f1a18012040 con 0x7f1a1c150ef0 2024-02-21T22:53:33.900 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:33.906+0000 7f1a11ffb640 1 --2- 172.21.15.116:0/341905133 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f1a0006b500 0x7f1a0006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:33.900 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:33.906+0000 7f1a11ffb640 1 -- 172.21.15.116:0/341905133 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5911+0+0 (secure 0 0 0) 0x7f1a1808a970 con 0x7f1a1c150ef0 2024-02-21T22:53:33.900 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:33.906+0000 7f1a20c12640 1 --2- 172.21.15.116:0/341905133 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f1a0006b500 0x7f1a0006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:33.900 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:33.907+0000 7f1a20c12640 1 --2- 172.21.15.116:0/341905133 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f1a0006b500 0x7f1a0006d9c0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f1a0c001750 tx=0x7f1a0c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:33.900 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:33.910+0000 7f1a11ffb640 1 -- 172.21.15.116:0/341905133 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f1a18019030 con 0x7f1a1c150ef0 2024-02-21T22:53:34.073 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:34.083+0000 7f1a23677640 1 -- 172.21.15.116:0/341905133 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f1a1c15e7a0 con 0x7f1a1c150ef0 2024-02-21T22:53:34.928 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:34.937+0000 7f1a11ffb640 1 -- 172.21.15.116:0/341905133 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v24) v1 ==== 181+0+0 (secure 0 0 0) 0x7f1a18059720 con 0x7f1a1c150ef0 2024-02-21T22:53:34.928 INFO:teuthology.orchestra.run.smithi116.stderr:pool 'cephfs_metadata' removed 2024-02-21T22:53:34.931 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:34.940+0000 7f1a23677640 1 -- 172.21.15.116:0/341905133 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f1a0006b500 msgr2=0x7f1a0006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:34.931 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:34.940+0000 7f1a23677640 1 --2- 172.21.15.116:0/341905133 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f1a0006b500 0x7f1a0006d9c0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f1a0c001750 tx=0x7f1a0c009040 comp rx=0 tx=0).stop 2024-02-21T22:53:34.931 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:34.940+0000 7f1a23677640 1 -- 172.21.15.116:0/341905133 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1a1c150ef0 msgr2=0x7f1a1c1518c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:34.931 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:34.940+0000 7f1a23677640 1 --2- 172.21.15.116:0/341905133 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1a1c150ef0 0x7f1a1c1518c0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f1a180119d0 tx=0x7f1a18011e90 comp rx=0 tx=0).stop 2024-02-21T22:53:34.932 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:34.941+0000 7f1a23677640 1 -- 172.21.15.116:0/341905133 shutdown_connections 2024-02-21T22:53:34.932 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:34.941+0000 7f1a23677640 1 --2- 172.21.15.116:0/341905133 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1a1c0b3b10 0x7f1a1c152be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:34.932 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:34.941+0000 7f1a23677640 1 --2- 172.21.15.116:0/341905133 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f1a0006b500 0x7f1a0006d9c0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:34.932 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:34.941+0000 7f1a23677640 1 --2- 172.21.15.116:0/341905133 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1a1c1512d0 0x7f1a1c0b35d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:34.932 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:34.941+0000 7f1a23677640 1 --2- 172.21.15.116:0/341905133 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1a1c150ef0 0x7f1a1c1518c0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:34.932 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:34.941+0000 7f1a23677640 1 -- 172.21.15.116:0/341905133 >> 172.21.15.116:0/341905133 conn(0x7f1a1c0b1510 msgr2=0x7f1a1c15c690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:34.932 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:34.941+0000 7f1a23677640 1 -- 172.21.15.116:0/341905133 shutdown_connections 2024-02-21T22:53:34.932 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:34.941+0000 7f1a23677640 1 -- 172.21.15.116:0/341905133 wait complete. 2024-02-21T22:53:34.945 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-02-21T22:53:35.054 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:35.064+0000 7fc14851e640 1 Processor -- start 2024-02-21T22:53:35.054 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:35.064+0000 7fc14851e640 1 -- start start 2024-02-21T22:53:35.056 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:35.065+0000 7fc14851e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc1400b1ce0 0x7fc14006e710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:35.056 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:35.065+0000 7fc14851e640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc14009dc40 0x7fc1400b20c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:35.056 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:35.065+0000 7fc14851e640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc140066d00 con 0x7fc14006b850 2024-02-21T22:53:35.056 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:35.065+0000 7fc14851e640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1400b34c0 con 0x7fc14009dc40 2024-02-21T22:53:35.057 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:35.065+0000 7fc14851e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc14009e0c0 con 0x7fc1400b1ce0 2024-02-21T22:53:35.057 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:35.065+0000 7fc145ab9640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc14009dc40 0x7fc1400b20c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:35.057 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:35.065+0000 7fc1462ba640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc1400b1ce0 0x7fc14006e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:35.057 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:35.065+0000 7fc145ab9640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc14009dc40 0x7fc1400b20c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.116:36436/0 (socket says 172.21.15.116:36436) 2024-02-21T22:53:35.057 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:35.065+0000 7fc145ab9640 1 -- 172.21.15.116:0/178885561 learned_addr learned my addr 172.21.15.116:0/178885561 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:35.057 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:35.065+0000 7fc146abb640 1 --1- 172.21.15.116:0/178885561 >> v1:172.21.15.142:6789/0 conn(0x7fc14006b850 0x7fc14006cf10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.116:45818/0 (socket says 172.21.15.116:45818) 2024-02-21T22:53:35.057 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:35.065+0000 7fc1452b8640 1 -- 172.21.15.116:0/178885561 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4009774828 0 0) 0x7fc140066d00 con 0x7fc14006b850 2024-02-21T22:53:35.057 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:35.065+0000 7fc1462ba640 1 -- 172.21.15.116:0/178885561 >> v2:172.21.15.142:3300/0 conn(0x7fc14009dc40 msgr2=0x7fc1400b20c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:53:35.057 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:35.065+0000 7fc1462ba640 1 --2- 172.21.15.116:0/178885561 >> v2:172.21.15.142:3300/0 conn(0x7fc14009dc40 0x7fc1400b20c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:35.057 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:35.065+0000 7fc1462ba640 1 -- 172.21.15.116:0/178885561 >> v1:172.21.15.142:6789/0 conn(0x7fc14006b850 legacy=0x7fc14006cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:35.057 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:35.065+0000 7fc1462ba640 1 -- 172.21.15.116:0/178885561 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1400b2600 con 0x7fc1400b1ce0 2024-02-21T22:53:35.057 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:35.065+0000 7fc145ab9640 1 --2- 172.21.15.116:0/178885561 >> v2:172.21.15.142:3300/0 conn(0x7fc14009dc40 0x7fc1400b20c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T22:53:35.059 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:35.066+0000 7fc1462ba640 1 --2- 172.21.15.116:0/178885561 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc1400b1ce0 0x7fc14006e710 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fc1380097a0 tx=0x7fc13802b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e0b15e8cb6aaf2ba server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:35.059 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:35.066+0000 7fc1452b8640 1 -- 172.21.15.116:0/178885561 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc138035020 con 0x7fc1400b1ce0 2024-02-21T22:53:35.059 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:35.066+0000 7fc1452b8640 1 -- 172.21.15.116:0/178885561 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc138031830 con 0x7fc1400b1ce0 2024-02-21T22:53:35.059 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:35.066+0000 7fc1452b8640 1 -- 172.21.15.116:0/178885561 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc138031c00 con 0x7fc1400b1ce0 2024-02-21T22:53:35.059 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:35.067+0000 7fc14851e640 1 -- 172.21.15.116:0/178885561 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc1400b1ce0 msgr2=0x7fc14006e710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:35.059 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:35.067+0000 7fc14851e640 1 --2- 172.21.15.116:0/178885561 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc1400b1ce0 0x7fc14006e710 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fc1380097a0 tx=0x7fc13802b8d0 comp rx=0 tx=0).stop 2024-02-21T22:53:35.059 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:35.067+0000 7fc14851e640 1 -- 172.21.15.116:0/178885561 shutdown_connections 2024-02-21T22:53:35.059 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:35.067+0000 7fc14851e640 1 --2- 172.21.15.116:0/178885561 >> v2:172.21.15.142:3300/0 conn(0x7fc14009dc40 0x7fc1400b20c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:35.059 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:35.067+0000 7fc14851e640 1 --2- 172.21.15.116:0/178885561 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc1400b1ce0 0x7fc14006e710 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:35.059 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:35.067+0000 7fc14851e640 1 -- 172.21.15.116:0/178885561 >> 172.21.15.116:0/178885561 conn(0x7fc1400ccce0 msgr2=0x7fc1400cd0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:35.059 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:35.067+0000 7fc14851e640 1 -- 172.21.15.116:0/178885561 shutdown_connections 2024-02-21T22:53:35.059 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:35.067+0000 7fc14851e640 1 -- 172.21.15.116:0/178885561 wait complete. 2024-02-21T22:53:35.060 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:35.068+0000 7fc14851e640 1 Processor -- start 2024-02-21T22:53:35.060 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:35.068+0000 7fc14851e640 1 -- start start 2024-02-21T22:53:35.063 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:35.069+0000 7fc14851e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc14006b850 0x7fc1400adb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:35.063 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:35.069+0000 7fc14851e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc14009dc40 0x7fc14009aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:35.063 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:35.069+0000 7fc14851e640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc1400b1ce0 0x7fc14015d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:35.063 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:35.069+0000 7fc14851e640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc14006c6b0 con 0x7fc1400b1ce0 2024-02-21T22:53:35.063 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:35.069+0000 7fc14851e640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1400b3150 con 0x7fc14009dc40 2024-02-21T22:53:35.063 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:35.069+0000 7fc14851e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc140067280 con 0x7fc14006b850 2024-02-21T22:53:35.063 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:35.069+0000 7fc146abb640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc1400b1ce0 0x7fc14015d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:35.063 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:35.069+0000 7fc146abb640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc1400b1ce0 0x7fc14015d1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:36324/0 (socket says 172.21.15.116:36324) 2024-02-21T22:53:35.063 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:35.069+0000 7fc146abb640 1 -- 172.21.15.116:0/2576634531 learned_addr learned my addr 172.21.15.116:0/2576634531 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:35.063 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:35.069+0000 7fc145ab9640 1 --2- 172.21.15.116:0/2576634531 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc14009dc40 0x7fc14009aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:35.063 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:35.069+0000 7fc1462ba640 1 --2- 172.21.15.116:0/2576634531 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc14006b850 0x7fc1400adb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:35.064 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:35.069+0000 7fc146abb640 1 -- 172.21.15.116:0/2576634531 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc14006b850 msgr2=0x7fc1400adb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:35.064 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:35.069+0000 7fc146abb640 1 --2- 172.21.15.116:0/2576634531 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc14006b850 0x7fc1400adb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:35.064 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:35.069+0000 7fc146abb640 1 -- 172.21.15.116:0/2576634531 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc14009dc40 msgr2=0x7fc14009aeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:35.064 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:35.069+0000 7fc146abb640 1 --2- 172.21.15.116:0/2576634531 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc14009dc40 0x7fc14009aeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:35.064 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:35.069+0000 7fc146abb640 1 -- 172.21.15.116:0/2576634531 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc14009b930 con 0x7fc1400b1ce0 2024-02-21T22:53:35.064 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:35.070+0000 7fc146abb640 1 --2- 172.21.15.116:0/2576634531 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc1400b1ce0 0x7fc14015d1c0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fc13c00c700 tx=0x7fc13c00cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:35.064 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:35.070+0000 7fc136ffd640 1 -- 172.21.15.116:0/2576634531 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc13c018070 con 0x7fc1400b1ce0 2024-02-21T22:53:35.064 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:35.070+0000 7fc136ffd640 1 -- 172.21.15.116:0/2576634531 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc13c00ce10 con 0x7fc1400b1ce0 2024-02-21T22:53:35.064 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:35.070+0000 7fc136ffd640 1 -- 172.21.15.116:0/2576634531 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc13c00a860 con 0x7fc1400b1ce0 2024-02-21T22:53:35.064 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:35.070+0000 7fc14851e640 1 -- 172.21.15.116:0/2576634531 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc14009bc10 con 0x7fc1400b1ce0 2024-02-21T22:53:35.064 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:35.070+0000 7fc14851e640 1 -- 172.21.15.116:0/2576634531 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1400c47c0 con 0x7fc1400b1ce0 2024-02-21T22:53:35.064 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:35.071+0000 7fc14851e640 1 -- 172.21.15.116:0/2576634531 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1400752f0 con 0x7fc1400b1ce0 2024-02-21T22:53:35.064 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:35.071+0000 7fc136ffd640 1 -- 172.21.15.116:0/2576634531 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fc13c01b070 con 0x7fc1400b1ce0 2024-02-21T22:53:35.065 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:35.071+0000 7fc136ffd640 1 --2- 172.21.15.116:0/2576634531 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fc12406b4d0 0x7fc12406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:35.065 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:35.072+0000 7fc136ffd640 1 -- 172.21.15.116:0/2576634531 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5473+0+0 (secure 0 0 0) 0x7fc13c0895e0 con 0x7fc1400b1ce0 2024-02-21T22:53:35.065 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:35.072+0000 7fc1462ba640 1 --2- 172.21.15.116:0/2576634531 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fc12406b4d0 0x7fc12406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:35.065 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:35.072+0000 7fc1462ba640 1 --2- 172.21.15.116:0/2576634531 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fc12406b4d0 0x7fc12406d990 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fc138036000 tx=0x7fc138008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:35.066 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:35.076+0000 7fc136ffd640 1 -- 172.21.15.116:0/2576634531 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7fc13c057f80 con 0x7fc1400b1ce0 2024-02-21T22:53:35.239 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:35.247+0000 7fc14851e640 1 -- 172.21.15.116:0/2576634531 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fc14015bd20 con 0x7fc1400b1ce0 2024-02-21T22:53:35.929 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:35.939+0000 7fc136ffd640 1 -- 172.21.15.116:0/2576634531 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v25) v1 ==== 169+0+0 (secure 0 0 0) 0x7fc13c05c020 con 0x7fc1400b1ce0 2024-02-21T22:53:35.929 INFO:teuthology.orchestra.run.smithi116.stderr:pool 'cephfs_data' removed 2024-02-21T22:53:35.932 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:35.941+0000 7fc14851e640 1 -- 172.21.15.116:0/2576634531 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fc12406b4d0 msgr2=0x7fc12406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:35.932 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:35.941+0000 7fc14851e640 1 --2- 172.21.15.116:0/2576634531 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fc12406b4d0 0x7fc12406d990 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fc138036000 tx=0x7fc138008030 comp rx=0 tx=0).stop 2024-02-21T22:53:35.932 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:35.941+0000 7fc14851e640 1 -- 172.21.15.116:0/2576634531 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc1400b1ce0 msgr2=0x7fc14015d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:35.932 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:35.941+0000 7fc14851e640 1 --2- 172.21.15.116:0/2576634531 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc1400b1ce0 0x7fc14015d1c0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fc13c00c700 tx=0x7fc13c00cbc0 comp rx=0 tx=0).stop 2024-02-21T22:53:35.933 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:35.942+0000 7fc14851e640 1 -- 172.21.15.116:0/2576634531 shutdown_connections 2024-02-21T22:53:35.933 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:35.942+0000 7fc14851e640 1 --2- 172.21.15.116:0/2576634531 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc1400b1ce0 0x7fc14015d1c0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:35.933 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:35.942+0000 7fc14851e640 1 --2- 172.21.15.116:0/2576634531 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc14009dc40 0x7fc14009aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:35.933 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:35.942+0000 7fc14851e640 1 --2- 172.21.15.116:0/2576634531 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fc12406b4d0 0x7fc12406d990 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:35.933 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:35.942+0000 7fc14851e640 1 --2- 172.21.15.116:0/2576634531 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc14006b850 0x7fc1400adb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:35.933 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:35.942+0000 7fc14851e640 1 -- 172.21.15.116:0/2576634531 >> 172.21.15.116:0/2576634531 conn(0x7fc1400ccce0 msgr2=0x7fc14006cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:35.933 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:35.942+0000 7fc14851e640 1 -- 172.21.15.116:0/2576634531 shutdown_connections 2024-02-21T22:53:35.933 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:35.942+0000 7fc14851e640 1 -- 172.21.15.116:0/2576634531 wait complete. 2024-02-21T22:53:35.946 INFO:tasks.ceph.mds.a:Restarting daemon 2024-02-21T22:53:35.946 INFO:tasks.ceph.mds.a:Stopping old one... 2024-02-21T22:53:35.947 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-02-21T22:53:35.947 INFO:teuthology.orchestra.run:waiting for 300 2024-02-21T22:53:35.947 INFO:tasks.ceph.mds.c:Restarting daemon 2024-02-21T22:53:35.947 INFO:tasks.ceph.mds.c:Stopping old one... 2024-02-21T22:53:35.947 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-02-21T22:53:35.947 INFO:teuthology.orchestra.run:waiting for 300 2024-02-21T22:53:35.947 INFO:tasks.ceph.mds.b:Restarting daemon 2024-02-21T22:53:35.948 INFO:tasks.ceph.mds.b:Stopping old one... 2024-02-21T22:53:35.948 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-02-21T22:53:35.948 INFO:teuthology.orchestra.run:waiting for 300 2024-02-21T22:53:35.948 INFO:tasks.ceph.mds.d:Restarting daemon 2024-02-21T22:53:35.948 INFO:tasks.ceph.mds.d:Stopping old one... 2024-02-21T22:53:35.948 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-02-21T22:53:35.948 INFO:teuthology.orchestra.run:waiting for 300 2024-02-21T22:53:35.956 INFO:tasks.ceph.mds.a:Stopped 2024-02-21T22:53:35.957 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-02-21T22:53:35.957 INFO:tasks.ceph.mds.c:Stopped 2024-02-21T22:53:35.958 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-02-21T22:53:35.963 INFO:tasks.ceph.mds.b:Stopped 2024-02-21T22:53:35.963 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-02-21T22:53:35.964 INFO:tasks.ceph.mds.d:Stopped 2024-02-21T22:53:35.964 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-02-21T22:53:35.998 INFO:tasks.ceph.mds.a:Started 2024-02-21T22:53:35.999 DEBUG:teuthology.parallel:result is None 2024-02-21T22:53:35.999 INFO:tasks.ceph.mds.c:Started 2024-02-21T22:53:36.000 DEBUG:teuthology.parallel:result is None 2024-02-21T22:53:36.006 INFO:tasks.ceph.mds.b:Started 2024-02-21T22:53:36.006 DEBUG:teuthology.parallel:result is None 2024-02-21T22:53:36.007 INFO:tasks.ceph.mds.d:Started 2024-02-21T22:53:36.007 DEBUG:teuthology.parallel:result is None 2024-02-21T22:53:36.007 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-02-21T22:53:36.075 INFO:tasks.ceph.mds.a.smithi116.stdout:starting mds.a at 2024-02-21T22:53:36.075 INFO:tasks.ceph.mds.c.smithi116.stdout:starting mds.c at 2024-02-21T22:53:36.086 INFO:tasks.ceph.mds.d.smithi142.stdout:starting mds.d at 2024-02-21T22:53:36.086 INFO:tasks.ceph.mds.b.smithi142.stdout:starting mds.b at 2024-02-21T22:53:36.111 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:36.121+0000 7f64b651e640 1 Processor -- start 2024-02-21T22:53:36.112 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:36.121+0000 7f64b651e640 1 -- start start 2024-02-21T22:53:36.114 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:36.122+0000 7f64b651e640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f64b00cc940 0x7f64b0168de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:36.114 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:36.122+0000 7f64b651e640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64b00cfa50 con 0x7f64b00d0510 2024-02-21T22:53:36.114 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:36.122+0000 7f64b651e640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64b00cfcc0 con 0x7f64b00d1c30 2024-02-21T22:53:36.115 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:36.122+0000 7f64b651e640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64b00d1450 con 0x7f64b00cc940 2024-02-21T22:53:36.115 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:36.122+0000 7f64affff640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f64b00d0510 0x7f64b00d08f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:54176/0 (socket says 172.21.15.116:54176) 2024-02-21T22:53:36.115 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:36.122+0000 7f64affff640 1 -- 172.21.15.116:0/3366073508 learned_addr learned my addr 172.21.15.116:0/3366073508 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-02-21T22:53:36.115 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:36.122+0000 7f64aeffd640 1 -- 172.21.15.116:0/3366073508 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3050659031 0 0) 0x7f64b00cfa50 con 0x7f64b00d0510 2024-02-21T22:53:36.115 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:36.122+0000 7f64aeffd640 1 -- 172.21.15.116:0/3366073508 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6498003520 con 0x7f64b00d0510 2024-02-21T22:53:36.115 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:36.122+0000 7f64b4abb640 1 --2- 172.21.15.116:0/3366073508 >> v2:172.21.15.142:3300/0 conn(0x7f64b00cc940 0x7f64b0168de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:36.115 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:36.123+0000 7f64aeffd640 1 -- 172.21.15.116:0/3366073508 <== mon.0 v1:172.21.15.116:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1412203596 0 0) 0x7f6498003520 con 0x7f64b00d0510 2024-02-21T22:53:36.115 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:36.123+0000 7f64aeffd640 1 -- 172.21.15.116:0/3366073508 >> v2:172.21.15.142:3300/0 conn(0x7f64b00cc940 msgr2=0x7f64b0168de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:53:36.115 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:36.123+0000 7f64aeffd640 1 --2- 172.21.15.116:0/3366073508 >> v2:172.21.15.142:3300/0 conn(0x7f64b00cc940 0x7f64b0168de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:36.115 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:36.123+0000 7f64aeffd640 1 -- 172.21.15.116:0/3366073508 >> v1:172.21.15.142:6789/0 conn(0x7f64b00d1c30 legacy=0x7f64b00d2430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:36.115 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:36.123+0000 7f64aeffd640 1 -- 172.21.15.116:0/3366073508 --> v1:172.21.15.116:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64b00cffa0 con 0x7f64b00d0510 2024-02-21T22:53:36.115 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:36.123+0000 7f64aeffd640 1 -- 172.21.15.116:0/3366073508 <== mon.0 v1:172.21.15.116:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1101981580 0 0) 0x7f64a0001670 con 0x7f64b00d0510 2024-02-21T22:53:36.115 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:36.123+0000 7f64aeffd640 1 -- 172.21.15.116:0/3366073508 >> v1:172.21.15.116:6789/0 conn(0x7f64b00d0510 legacy=0x7f64b00d08f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:36.115 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:36.123+0000 7f64aeffd640 1 --2- 172.21.15.116:0/3366073508 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f64980039b0 0x7f6498003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:36.116 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:36.123+0000 7f64aeffd640 1 --2- 172.21.15.116:0/3366073508 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6498004800 0x7f6498004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:36.116 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:36.123+0000 7f64aeffd640 1 --2- 172.21.15.116:0/3366073508 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f64980051c0 0x7f649800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:36.116 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:36.123+0000 7f64aeffd640 1 -- 172.21.15.116:0/3366073508 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64b00d1450 con 0x7f64980051c0 2024-02-21T22:53:36.116 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:36.123+0000 7f64aeffd640 1 -- 172.21.15.116:0/3366073508 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f649800c160 con 0x7f64980039b0 2024-02-21T22:53:36.116 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:36.123+0000 7f64aeffd640 1 -- 172.21.15.116:0/3366073508 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f649800c360 con 0x7f6498004800 2024-02-21T22:53:36.116 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:36.123+0000 7f64affff640 1 --2- 172.21.15.116:0/3366073508 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f64980039b0 0x7f6498003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:36.116 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:36.123+0000 7f64af7fe640 1 --2- 172.21.15.116:0/3366073508 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6498004800 0x7f6498004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:36.116 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:36.123+0000 7f64b4abb640 1 --2- 172.21.15.116:0/3366073508 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f64980051c0 0x7f649800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:36.116 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:36.123+0000 7f64b4abb640 1 -- 172.21.15.116:0/3366073508 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6498004800 msgr2=0x7f6498004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:53:36.116 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:36.123+0000 7f64b4abb640 1 --2- 172.21.15.116:0/3366073508 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6498004800 0x7f6498004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:36.116 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:36.123+0000 7f64b4abb640 1 -- 172.21.15.116:0/3366073508 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f64980039b0 msgr2=0x7f6498003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:53:36.116 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:36.123+0000 7f64b4abb640 1 --2- 172.21.15.116:0/3366073508 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f64980039b0 0x7f6498003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:36.116 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:36.123+0000 7f64b4abb640 1 -- 172.21.15.116:0/3366073508 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6498003520 con 0x7f64980051c0 2024-02-21T22:53:36.117 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:36.124+0000 7f64b4abb640 1 -- 172.21.15.116:0/3366073508 reap_dead start 2024-02-21T22:53:36.117 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:36.124+0000 7f64b4abb640 1 --2- 172.21.15.116:0/3366073508 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f64980051c0 0x7f649800b9c0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f64b00b9ec0 tx=0x7f6498005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7fbbdde60f3498 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:36.117 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:36.124+0000 7f64aeffd640 1 -- 172.21.15.116:0/3366073508 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64a8039070 con 0x7f64980051c0 2024-02-21T22:53:36.117 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:36.124+0000 7f64aeffd640 1 -- 172.21.15.116:0/3366073508 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64a802cbd0 con 0x7f64980051c0 2024-02-21T22:53:36.117 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:36.124+0000 7f64aeffd640 1 -- 172.21.15.116:0/3366073508 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64a8009c10 con 0x7f64980051c0 2024-02-21T22:53:36.119 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:36.124+0000 7f64b651e640 1 -- 172.21.15.116:0/3366073508 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f64980051c0 msgr2=0x7f649800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:36.120 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:36.125+0000 7f64b651e640 1 --2- 172.21.15.116:0/3366073508 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f64980051c0 0x7f649800b9c0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f64b00b9ec0 tx=0x7f6498005830 comp rx=0 tx=0).stop 2024-02-21T22:53:36.120 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:36.125+0000 7f64b651e640 1 -- 172.21.15.116:0/3366073508 shutdown_connections 2024-02-21T22:53:36.120 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:36.125+0000 7f64b651e640 1 --2- 172.21.15.116:0/3366073508 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f64980051c0 0x7f649800b9c0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:36.120 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:36.125+0000 7f64b651e640 1 -- 172.21.15.116:0/3366073508 >> 172.21.15.116:0/3366073508 conn(0x7f64b00d3e50 msgr2=0x7f64b00d4260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:36.120 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:36.125+0000 7f64b651e640 1 -- 172.21.15.116:0/3366073508 shutdown_connections 2024-02-21T22:53:36.120 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:36.125+0000 7f64b651e640 1 -- 172.21.15.116:0/3366073508 wait complete. 2024-02-21T22:53:36.120 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:36.126+0000 7f64b651e640 1 Processor -- start 2024-02-21T22:53:36.120 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:36.126+0000 7f64b651e640 1 -- start start 2024-02-21T22:53:36.120 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:36.127+0000 7f64b651e640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f64980051c0 0x7f64b00b2330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:36.120 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:36.127+0000 7f64b651e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f64b006c030 0x7f64b006c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:36.120 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:36.127+0000 7f64b651e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f64b00c7930 0x7f64b00c7db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:36.120 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:36.127+0000 7f64b651e640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64b00d08f0 con 0x7f64980051c0 2024-02-21T22:53:36.121 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:36.127+0000 7f64b651e640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64b015e640 con 0x7f64b00c7930 2024-02-21T22:53:36.121 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:36.127+0000 7f64b651e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64b00d0a70 con 0x7f64b006c030 2024-02-21T22:53:36.121 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:36.127+0000 7f64affff640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f64980051c0 0x7f64b00b2330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:36.121 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:36.127+0000 7f64affff640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f64980051c0 0x7f64b00b2330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:37900/0 (socket says 172.21.15.116:37900) 2024-02-21T22:53:36.121 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:36.127+0000 7f64affff640 1 -- 172.21.15.116:0/3220502164 learned_addr learned my addr 172.21.15.116:0/3220502164 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:36.121 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:36.127+0000 7f64af7fe640 1 --2- 172.21.15.116:0/3220502164 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f64b006c030 0x7f64b006c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:36.121 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:36.127+0000 7f64b4abb640 1 --2- 172.21.15.116:0/3220502164 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f64b00c7930 0x7f64b00c7db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:36.121 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:36.127+0000 7f64affff640 1 -- 172.21.15.116:0/3220502164 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f64b006c030 msgr2=0x7f64b006c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:36.121 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:36.127+0000 7f64affff640 1 --2- 172.21.15.116:0/3220502164 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f64b006c030 0x7f64b006c4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:36.121 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:36.127+0000 7f64affff640 1 -- 172.21.15.116:0/3220502164 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f64b00c7930 msgr2=0x7f64b00c7db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:36.121 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:36.127+0000 7f64affff640 1 --2- 172.21.15.116:0/3220502164 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f64b00c7930 0x7f64b00c7db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:36.121 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:36.127+0000 7f64affff640 1 -- 172.21.15.116:0/3220502164 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64b00c86a0 con 0x7f64980051c0 2024-02-21T22:53:36.121 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:36.127+0000 7f64affff640 1 --2- 172.21.15.116:0/3220502164 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f64980051c0 0x7f64b00b2330 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f64a00072f0 tx=0x7f64a00077b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:36.122 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:36.127+0000 7f64acff9640 1 -- 172.21.15.116:0/3220502164 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64a001a070 con 0x7f64980051c0 2024-02-21T22:53:36.122 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:36.127+0000 7f64acff9640 1 -- 172.21.15.116:0/3220502164 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64a000f8e0 con 0x7f64980051c0 2024-02-21T22:53:36.122 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:36.127+0000 7f64acff9640 1 -- 172.21.15.116:0/3220502164 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64a000fcb0 con 0x7f64980051c0 2024-02-21T22:53:36.122 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:36.127+0000 7f64b651e640 1 -- 172.21.15.116:0/3220502164 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64b00c9360 con 0x7f64980051c0 2024-02-21T22:53:36.122 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:36.128+0000 7f64b651e640 1 -- 172.21.15.116:0/3220502164 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64b00c9920 con 0x7f64980051c0 2024-02-21T22:53:36.122 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:36.129+0000 7f64b651e640 1 -- 172.21.15.116:0/3220502164 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64b00752f0 con 0x7f64980051c0 2024-02-21T22:53:36.122 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:36.129+0000 7f64acff9640 1 -- 172.21.15.116:0/3220502164 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f64a001d360 con 0x7f64980051c0 2024-02-21T22:53:36.122 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:36.129+0000 7f64acff9640 1 --2- 172.21.15.116:0/3220502164 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f649c06b500 0x7f649c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:36.122 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:36.129+0000 7f64acff9640 1 -- 172.21.15.116:0/3220502164 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f64a0089700 con 0x7f64980051c0 2024-02-21T22:53:36.122 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:36.129+0000 7f64af7fe640 1 --2- 172.21.15.116:0/3220502164 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f649c06b500 0x7f649c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:36.123 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:36.130+0000 7f64af7fe640 1 --2- 172.21.15.116:0/3220502164 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f649c06b500 0x7f649c06d9c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f64a4000c00 tx=0x7f64a4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:36.124 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:36.134+0000 7f64acff9640 1 -- 172.21.15.116:0/3220502164 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f64a00582c0 con 0x7f64980051c0 2024-02-21T22:53:36.307 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:36.316+0000 7f64b651e640 1 -- 172.21.15.116:0/3220502164 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f64b00d2210 con 0x7f64980051c0 2024-02-21T22:53:36.954 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:36.963+0000 7f64acff9640 1 -- 172.21.15.116:0/3220502164 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v27) v1 ==== 97+0+0 (secure 0 0 0) 0x7f64a005c360 con 0x7f64980051c0 2024-02-21T22:53:36.954 INFO:teuthology.orchestra.run.smithi116.stderr: removed all blocklist entries 2024-02-21T22:53:36.956 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:36.965+0000 7f64b651e640 1 -- 172.21.15.116:0/3220502164 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f649c06b500 msgr2=0x7f649c06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:36.956 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:36.965+0000 7f64b651e640 1 --2- 172.21.15.116:0/3220502164 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f649c06b500 0x7f649c06d9c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f64a4000c00 tx=0x7f64a4009040 comp rx=0 tx=0).stop 2024-02-21T22:53:36.956 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:36.965+0000 7f64b651e640 1 -- 172.21.15.116:0/3220502164 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f64980051c0 msgr2=0x7f64b00b2330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:36.956 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:36.965+0000 7f64b651e640 1 --2- 172.21.15.116:0/3220502164 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f64980051c0 0x7f64b00b2330 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f64a00072f0 tx=0x7f64a00077b0 comp rx=0 tx=0).stop 2024-02-21T22:53:36.956 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:36.965+0000 7f64b651e640 1 -- 172.21.15.116:0/3220502164 shutdown_connections 2024-02-21T22:53:36.956 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:36.965+0000 7f64b651e640 1 --2- 172.21.15.116:0/3220502164 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f64b00c7930 0x7f64b00c7db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:36.956 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:36.965+0000 7f64b651e640 1 --2- 172.21.15.116:0/3220502164 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f649c06b500 0x7f649c06d9c0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:36.956 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:36.965+0000 7f64b651e640 1 --2- 172.21.15.116:0/3220502164 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f64b006c030 0x7f64b006c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:36.957 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:36.965+0000 7f64b651e640 1 --2- 172.21.15.116:0/3220502164 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f64980051c0 0x7f64b00b2330 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:36.957 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:36.965+0000 7f64b651e640 1 -- 172.21.15.116:0/3220502164 >> 172.21.15.116:0/3220502164 conn(0x7f64b00d3e50 msgr2=0x7f64b015b840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:36.957 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:36.965+0000 7f64b651e640 1 -- 172.21.15.116:0/3220502164 shutdown_connections 2024-02-21T22:53:36.957 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:36.966+0000 7f64b651e640 1 -- 172.21.15.116:0/3220502164 wait complete. 2024-02-21T22:53:36.969 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-02-21T22:53:37.069 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.078+0000 7f64b8036640 1 Processor -- start 2024-02-21T22:53:37.069 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.079+0000 7f64b8036640 1 -- start start 2024-02-21T22:53:37.071 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.079+0000 7f64b8036640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f64b006be20 0x7f64b00b0b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:37.071 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.079+0000 7f64b8036640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f64b00b5700 0x7f64b00cb110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:37.071 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.079+0000 7f64b8036640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64b006c200 con 0x7f64b00b10a0 2024-02-21T22:53:37.071 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.079+0000 7f64b8036640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64b00b15e0 con 0x7f64b006be20 2024-02-21T22:53:37.071 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.079+0000 7f64b8036640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64b00b18c0 con 0x7f64b00b5700 2024-02-21T22:53:37.071 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.080+0000 7f64b5dd2640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f64b006be20 0x7f64b00b0b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:37.071 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.080+0000 7f64b65d3640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f64b00b5700 0x7f64b00cb110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:37.071 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.080+0000 7f64b5dd2640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f64b006be20 0x7f64b00b0b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.116:39886/0 (socket says 172.21.15.116:39886) 2024-02-21T22:53:37.071 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.080+0000 7f64b55d1640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f64b00b10a0 0x7f64b00b4ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.116:37762/0 (socket says 172.21.15.116:37762) 2024-02-21T22:53:37.071 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.080+0000 7f64b65d3640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f64b00b5700 0x7f64b00cb110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.116:39948/0 (socket says 172.21.15.116:39948) 2024-02-21T22:53:37.071 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.080+0000 7f64b5dd2640 1 -- 172.21.15.116:0/3823671397 learned_addr learned my addr 172.21.15.116:0/3823671397 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:37.071 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.080+0000 7f64b65d3640 1 -- 172.21.15.116:0/3823671397 >> v2:172.21.15.142:3300/0 conn(0x7f64b006be20 msgr2=0x7f64b00b0b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:53:37.071 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.080+0000 7f64b65d3640 1 --2- 172.21.15.116:0/3823671397 >> v2:172.21.15.142:3300/0 conn(0x7f64b006be20 0x7f64b00b0b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:37.072 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.080+0000 7f64b65d3640 1 -- 172.21.15.116:0/3823671397 >> v1:172.21.15.142:6789/0 conn(0x7f64b00b10a0 legacy=0x7f64b00b4ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:37.072 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.080+0000 7f64b65d3640 1 -- 172.21.15.116:0/3823671397 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64b00b1ba0 con 0x7f64b00b5700 2024-02-21T22:53:37.072 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.080+0000 7f64b5dd2640 1 --2- 172.21.15.116:0/3823671397 >> v2:172.21.15.142:3300/0 conn(0x7f64b006be20 0x7f64b00b0b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T22:53:37.073 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.081+0000 7f64b65d3640 1 --2- 172.21.15.116:0/3823671397 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f64b00b5700 0x7f64b00cb110 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f64a8009d90 tx=0x7f64a802bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=69d9d8ac92da9c2f server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:37.073 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.081+0000 7f64b4dd0640 1 -- 172.21.15.116:0/3823671397 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64a8039070 con 0x7f64b00b5700 2024-02-21T22:53:37.073 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.081+0000 7f64b4dd0640 1 -- 172.21.15.116:0/3823671397 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64a802cc50 con 0x7f64b00b5700 2024-02-21T22:53:37.073 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.081+0000 7f64b4dd0640 1 -- 172.21.15.116:0/3823671397 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64a8034440 con 0x7f64b00b5700 2024-02-21T22:53:37.073 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.082+0000 7f64b8036640 1 -- 172.21.15.116:0/3823671397 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f64b00b5700 msgr2=0x7f64b00cb110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:37.074 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.082+0000 7f64b8036640 1 --2- 172.21.15.116:0/3823671397 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f64b00b5700 0x7f64b00cb110 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f64a8009d90 tx=0x7f64a802bea0 comp rx=0 tx=0).stop 2024-02-21T22:53:37.074 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.082+0000 7f64b8036640 1 -- 172.21.15.116:0/3823671397 shutdown_connections 2024-02-21T22:53:37.074 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.082+0000 7f64b8036640 1 --2- 172.21.15.116:0/3823671397 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f64b00b5700 0x7f64b00cb110 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:37.074 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.082+0000 7f64b8036640 1 --2- 172.21.15.116:0/3823671397 >> v2:172.21.15.142:3300/0 conn(0x7f64b006be20 0x7f64b00b0b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:37.074 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.082+0000 7f64b8036640 1 -- 172.21.15.116:0/3823671397 >> 172.21.15.116:0/3823671397 conn(0x7f64b00724f0 msgr2=0x7f64b0072900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:37.074 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.082+0000 7f64b8036640 1 -- 172.21.15.116:0/3823671397 shutdown_connections 2024-02-21T22:53:37.074 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.082+0000 7f64b8036640 1 -- 172.21.15.116:0/3823671397 wait complete. 2024-02-21T22:53:37.074 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.083+0000 7f64b8036640 1 Processor -- start 2024-02-21T22:53:37.074 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.083+0000 7f64b8036640 1 -- start start 2024-02-21T22:53:37.076 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.084+0000 7f64b8036640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f64b006be20 0x7f64b01580f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:37.077 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.084+0000 7f64b8036640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f64b00b10a0 0x7f64b00cf830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:37.077 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.084+0000 7f64b8036640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f64b00b5700 0x7f64b00c3dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:37.077 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.084+0000 7f64b8036640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64b00731d0 con 0x7f64b006be20 2024-02-21T22:53:37.077 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.084+0000 7f64b8036640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64b00cabf0 con 0x7f64b00b5700 2024-02-21T22:53:37.077 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.084+0000 7f64b8036640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64b0073350 con 0x7f64b00b10a0 2024-02-21T22:53:37.077 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.084+0000 7f64b5dd2640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f64b006be20 0x7f64b01580f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:37.077 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.084+0000 7f64b5dd2640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f64b006be20 0x7f64b01580f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:37906/0 (socket says 172.21.15.116:37906) 2024-02-21T22:53:37.077 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.084+0000 7f64b5dd2640 1 -- 172.21.15.116:0/4028027602 learned_addr learned my addr 172.21.15.116:0/4028027602 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:37.077 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.084+0000 7f64b65d3640 1 --2- 172.21.15.116:0/4028027602 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f64b00b5700 0x7f64b00c3dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:37.077 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.084+0000 7f64b55d1640 1 --2- 172.21.15.116:0/4028027602 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f64b00b10a0 0x7f64b00cf830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:37.077 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.084+0000 7f64b5dd2640 1 -- 172.21.15.116:0/4028027602 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f64b00b10a0 msgr2=0x7f64b00cf830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:37.077 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.084+0000 7f64b5dd2640 1 --2- 172.21.15.116:0/4028027602 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f64b00b10a0 0x7f64b00cf830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:37.077 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.084+0000 7f64b5dd2640 1 -- 172.21.15.116:0/4028027602 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f64b00b5700 msgr2=0x7f64b00c3dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:37.077 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.084+0000 7f64b5dd2640 1 --2- 172.21.15.116:0/4028027602 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f64b00b5700 0x7f64b00c3dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:37.078 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.084+0000 7f64b5dd2640 1 -- 172.21.15.116:0/4028027602 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64b00ad2a0 con 0x7f64b006be20 2024-02-21T22:53:37.078 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.084+0000 7f64b5dd2640 1 --2- 172.21.15.116:0/4028027602 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f64b006be20 0x7f64b01580f0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f64ac00e8e0 tx=0x7f64ac00eda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:37.078 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.084+0000 7f64a67fc640 1 -- 172.21.15.116:0/4028027602 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64ac00b040 con 0x7f64b006be20 2024-02-21T22:53:37.078 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.084+0000 7f64a67fc640 1 -- 172.21.15.116:0/4028027602 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64ac00cd00 con 0x7f64b006be20 2024-02-21T22:53:37.078 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.084+0000 7f64a67fc640 1 -- 172.21.15.116:0/4028027602 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64ac004230 con 0x7f64b006be20 2024-02-21T22:53:37.078 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.084+0000 7f64b8036640 1 -- 172.21.15.116:0/4028027602 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64b00ad580 con 0x7f64b006be20 2024-02-21T22:53:37.078 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.084+0000 7f64b8036640 1 -- 172.21.15.116:0/4028027602 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64b01f3af0 con 0x7f64b006be20 2024-02-21T22:53:37.078 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.085+0000 7f64b8036640 1 -- 172.21.15.116:0/4028027602 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64b00752f0 con 0x7f64b006be20 2024-02-21T22:53:37.078 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.086+0000 7f64a67fc640 1 -- 172.21.15.116:0/4028027602 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f64ac0043d0 con 0x7f64b006be20 2024-02-21T22:53:37.078 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.086+0000 7f64a67fc640 1 --2- 172.21.15.116:0/4028027602 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f649406b500 0x7f649406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:37.078 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.086+0000 7f64a67fc640 1 -- 172.21.15.116:0/4028027602 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f64ac089da0 con 0x7f64b006be20 2024-02-21T22:53:37.078 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.086+0000 7f64b55d1640 1 --2- 172.21.15.116:0/4028027602 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f649406b500 0x7f649406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:37.079 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.087+0000 7f64b55d1640 1 --2- 172.21.15.116:0/4028027602 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f649406b500 0x7f649406d9c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f64b00cb640 tx=0x7f64a0007e80 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:37.081 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.091+0000 7f64a67fc640 1 -- 172.21.15.116:0/4028027602 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f64ac016020 con 0x7f64b006be20 2024-02-21T22:53:37.319 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.328+0000 7f64b8036640 1 -- 172.21.15.116:0/4028027602 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f64b00adc30 con 0x7f64b006be20 2024-02-21T22:53:37.319 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.328+0000 7f64a67fc640 1 -- 172.21.15.116:0/4028027602 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v6) v1 ==== 80+0+6645 (secure 0 0 0) 0x7f64ac0589b0 con 0x7f64b006be20 2024-02-21T22:53:37.319 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-02-21T22:53:37.319 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-02-21T22:53:37.319 INFO:teuthology.orchestra.run.smithi116.stdout: "auth_dump": [ 2024-02-21T22:53:37.319 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-02-21T22:53:37.319 INFO:teuthology.orchestra.run.smithi116.stdout: "entity": "mds.a", 2024-02-21T22:53:37.320 INFO:teuthology.orchestra.run.smithi116.stdout: "key": "AQCDftZlNxhHDBAAb+gx5rwaS9GApZXg4uGIBw==", 2024-02-21T22:53:37.320 INFO:teuthology.orchestra.run.smithi116.stdout: "caps": { 2024-02-21T22:53:37.320 INFO:teuthology.orchestra.run.smithi116.stdout: "mds": "allow", 2024-02-21T22:53:37.320 INFO:teuthology.orchestra.run.smithi116.stdout: "mgr": "allow *", 2024-02-21T22:53:37.320 INFO:teuthology.orchestra.run.smithi116.stdout: "mon": "allow *", 2024-02-21T22:53:37.320 INFO:teuthology.orchestra.run.smithi116.stdout: "osd": "allow *" 2024-02-21T22:53:37.320 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-02-21T22:53:37.320 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-02-21T22:53:37.320 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-02-21T22:53:37.320 INFO:teuthology.orchestra.run.smithi116.stdout: "entity": "mds.b", 2024-02-21T22:53:37.320 INFO:teuthology.orchestra.run.smithi116.stdout: "key": "AQCDftZlzPmsGBAAyGOu7uSrW3IWtY3zHcuerw==", 2024-02-21T22:53:37.320 INFO:teuthology.orchestra.run.smithi116.stdout: "caps": { 2024-02-21T22:53:37.320 INFO:teuthology.orchestra.run.smithi116.stdout: "mds": "allow", 2024-02-21T22:53:37.320 INFO:teuthology.orchestra.run.smithi116.stdout: "mgr": "allow *", 2024-02-21T22:53:37.321 INFO:teuthology.orchestra.run.smithi116.stdout: "mon": "allow *", 2024-02-21T22:53:37.321 INFO:teuthology.orchestra.run.smithi116.stdout: "osd": "allow *" 2024-02-21T22:53:37.321 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-02-21T22:53:37.321 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-02-21T22:53:37.321 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-02-21T22:53:37.321 INFO:teuthology.orchestra.run.smithi116.stdout: "entity": "mds.c", 2024-02-21T22:53:37.321 INFO:teuthology.orchestra.run.smithi116.stdout: "key": "AQCDftZlFyyrExAA7ENxsStKJ60yhKuuQgeZug==", 2024-02-21T22:53:37.321 INFO:teuthology.orchestra.run.smithi116.stdout: "caps": { 2024-02-21T22:53:37.321 INFO:teuthology.orchestra.run.smithi116.stdout: "mds": "allow", 2024-02-21T22:53:37.321 INFO:teuthology.orchestra.run.smithi116.stdout: "mgr": "allow *", 2024-02-21T22:53:37.321 INFO:teuthology.orchestra.run.smithi116.stdout: "mon": "allow *", 2024-02-21T22:53:37.321 INFO:teuthology.orchestra.run.smithi116.stdout: "osd": "allow *" 2024-02-21T22:53:37.321 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-02-21T22:53:37.321 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-02-21T22:53:37.321 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-02-21T22:53:37.322 INFO:teuthology.orchestra.run.smithi116.stdout: "entity": "mds.d", 2024-02-21T22:53:37.322 INFO:teuthology.orchestra.run.smithi116.stdout: "key": "AQCDftZlRocPIBAAf3if/JHaj70ocZzB6jeEkA==", 2024-02-21T22:53:37.322 INFO:teuthology.orchestra.run.smithi116.stdout: "caps": { 2024-02-21T22:53:37.322 INFO:teuthology.orchestra.run.smithi116.stdout: "mds": "allow", 2024-02-21T22:53:37.322 INFO:teuthology.orchestra.run.smithi116.stdout: "mgr": "allow *", 2024-02-21T22:53:37.322 INFO:teuthology.orchestra.run.smithi116.stdout: "mon": "allow *", 2024-02-21T22:53:37.322 INFO:teuthology.orchestra.run.smithi116.stdout: "osd": "allow *" 2024-02-21T22:53:37.322 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-02-21T22:53:37.322 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-02-21T22:53:37.322 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-02-21T22:53:37.322 INFO:teuthology.orchestra.run.smithi116.stdout: "entity": "osd.0", 2024-02-21T22:53:37.322 INFO:teuthology.orchestra.run.smithi116.stdout: "key": "AQCHftZlacBzBRAAljCU45lWahy5VeLOy17Nyg==", 2024-02-21T22:53:37.322 INFO:teuthology.orchestra.run.smithi116.stdout: "caps": { 2024-02-21T22:53:37.322 INFO:teuthology.orchestra.run.smithi116.stdout: "mgr": "allow profile osd", 2024-02-21T22:53:37.323 INFO:teuthology.orchestra.run.smithi116.stdout: "mon": "allow profile osd", 2024-02-21T22:53:37.323 INFO:teuthology.orchestra.run.smithi116.stdout: "osd": "allow *" 2024-02-21T22:53:37.323 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-02-21T22:53:37.323 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-02-21T22:53:37.323 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-02-21T22:53:37.323 INFO:teuthology.orchestra.run.smithi116.stdout: "entity": "osd.1", 2024-02-21T22:53:37.323 INFO:teuthology.orchestra.run.smithi116.stdout: "key": "AQCKftZldTtdBBAAUXzIcrVJxMRmYsgkD/GtNQ==", 2024-02-21T22:53:37.323 INFO:teuthology.orchestra.run.smithi116.stdout: "caps": { 2024-02-21T22:53:37.323 INFO:teuthology.orchestra.run.smithi116.stdout: "mgr": "allow profile osd", 2024-02-21T22:53:37.323 INFO:teuthology.orchestra.run.smithi116.stdout: "mon": "allow profile osd", 2024-02-21T22:53:37.323 INFO:teuthology.orchestra.run.smithi116.stdout: "osd": "allow *" 2024-02-21T22:53:37.323 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-02-21T22:53:37.323 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-02-21T22:53:37.323 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-02-21T22:53:37.323 INFO:teuthology.orchestra.run.smithi116.stdout: "entity": "osd.2", 2024-02-21T22:53:37.323 INFO:teuthology.orchestra.run.smithi116.stdout: "key": "AQCNftZlFZOsAhAAgRqK9f+UYKCGfYzqz3mLdw==", 2024-02-21T22:53:37.324 INFO:teuthology.orchestra.run.smithi116.stdout: "caps": { 2024-02-21T22:53:37.324 INFO:teuthology.orchestra.run.smithi116.stdout: "mgr": "allow profile osd", 2024-02-21T22:53:37.324 INFO:teuthology.orchestra.run.smithi116.stdout: "mon": "allow profile osd", 2024-02-21T22:53:37.324 INFO:teuthology.orchestra.run.smithi116.stdout: "osd": "allow *" 2024-02-21T22:53:37.324 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-02-21T22:53:37.324 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-02-21T22:53:37.324 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-02-21T22:53:37.324 INFO:teuthology.orchestra.run.smithi116.stdout: "entity": "osd.3", 2024-02-21T22:53:37.324 INFO:teuthology.orchestra.run.smithi116.stdout: "key": "AQCQftZlA0t/ARAAm4AOkNWT4vIBeZ3E3YVmWA==", 2024-02-21T22:53:37.324 INFO:teuthology.orchestra.run.smithi116.stdout: "caps": { 2024-02-21T22:53:37.324 INFO:teuthology.orchestra.run.smithi116.stdout: "mgr": "allow profile osd", 2024-02-21T22:53:37.324 INFO:teuthology.orchestra.run.smithi116.stdout: "mon": "allow profile osd", 2024-02-21T22:53:37.324 INFO:teuthology.orchestra.run.smithi116.stdout: "osd": "allow *" 2024-02-21T22:53:37.324 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-02-21T22:53:37.325 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-02-21T22:53:37.325 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-02-21T22:53:37.325 INFO:teuthology.orchestra.run.smithi116.stdout: "entity": "osd.4", 2024-02-21T22:53:37.325 INFO:teuthology.orchestra.run.smithi116.stdout: "key": "AQCWftZl3cekBxAAqXBT0Jn76px1YGSfAMsN4g==", 2024-02-21T22:53:37.325 INFO:teuthology.orchestra.run.smithi116.stdout: "caps": { 2024-02-21T22:53:37.325 INFO:teuthology.orchestra.run.smithi116.stdout: "mgr": "allow profile osd", 2024-02-21T22:53:37.325 INFO:teuthology.orchestra.run.smithi116.stdout: "mon": "allow profile osd", 2024-02-21T22:53:37.325 INFO:teuthology.orchestra.run.smithi116.stdout: "osd": "allow *" 2024-02-21T22:53:37.325 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-02-21T22:53:37.325 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-02-21T22:53:37.325 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-02-21T22:53:37.325 INFO:teuthology.orchestra.run.smithi116.stdout: "entity": "osd.5", 2024-02-21T22:53:37.325 INFO:teuthology.orchestra.run.smithi116.stdout: "key": "AQCZftZlUctNBhAAr+opUNCiRLwG4MAlrUG1vw==", 2024-02-21T22:53:37.325 INFO:teuthology.orchestra.run.smithi116.stdout: "caps": { 2024-02-21T22:53:37.325 INFO:teuthology.orchestra.run.smithi116.stdout: "mgr": "allow profile osd", 2024-02-21T22:53:37.326 INFO:teuthology.orchestra.run.smithi116.stdout: "mon": "allow profile osd", 2024-02-21T22:53:37.326 INFO:teuthology.orchestra.run.smithi116.stdout: "osd": "allow *" 2024-02-21T22:53:37.326 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-02-21T22:53:37.326 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-02-21T22:53:37.326 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-02-21T22:53:37.326 INFO:teuthology.orchestra.run.smithi116.stdout: "entity": "osd.6", 2024-02-21T22:53:37.326 INFO:teuthology.orchestra.run.smithi116.stdout: "key": "AQCcftZloqI5BBAAT4ikGusIlzIB8D5lVuwgrQ==", 2024-02-21T22:53:37.326 INFO:teuthology.orchestra.run.smithi116.stdout: "caps": { 2024-02-21T22:53:37.326 INFO:teuthology.orchestra.run.smithi116.stdout: "mgr": "allow profile osd", 2024-02-21T22:53:37.326 INFO:teuthology.orchestra.run.smithi116.stdout: "mon": "allow profile osd", 2024-02-21T22:53:37.326 INFO:teuthology.orchestra.run.smithi116.stdout: "osd": "allow *" 2024-02-21T22:53:37.326 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-02-21T22:53:37.326 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-02-21T22:53:37.326 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-02-21T22:53:37.326 INFO:teuthology.orchestra.run.smithi116.stdout: "entity": "osd.7", 2024-02-21T22:53:37.327 INFO:teuthology.orchestra.run.smithi116.stdout: "key": "AQCfftZlnVhGAhAAHcmhyOZ7SHZCIRcwLTpSig==", 2024-02-21T22:53:37.327 INFO:teuthology.orchestra.run.smithi116.stdout: "caps": { 2024-02-21T22:53:37.327 INFO:teuthology.orchestra.run.smithi116.stdout: "mgr": "allow profile osd", 2024-02-21T22:53:37.327 INFO:teuthology.orchestra.run.smithi116.stdout: "mon": "allow profile osd", 2024-02-21T22:53:37.327 INFO:teuthology.orchestra.run.smithi116.stdout: "osd": "allow *" 2024-02-21T22:53:37.327 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-02-21T22:53:37.327 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-02-21T22:53:37.327 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-02-21T22:53:37.327 INFO:teuthology.orchestra.run.smithi116.stdout: "entity": "client.0", 2024-02-21T22:53:37.327 INFO:teuthology.orchestra.run.smithi116.stdout: "key": "AQCDftZlkppVJBAAGajc7P7grvYaJipfLBk5yw==", 2024-02-21T22:53:37.327 INFO:teuthology.orchestra.run.smithi116.stdout: "caps": { 2024-02-21T22:53:37.327 INFO:teuthology.orchestra.run.smithi116.stdout: "mds": "allow", 2024-02-21T22:53:37.327 INFO:teuthology.orchestra.run.smithi116.stdout: "mgr": "allow r", 2024-02-21T22:53:37.327 INFO:teuthology.orchestra.run.smithi116.stdout: "mon": "allow rw", 2024-02-21T22:53:37.328 INFO:teuthology.orchestra.run.smithi116.stdout: "osd": "allow rwx" 2024-02-21T22:53:37.328 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-02-21T22:53:37.328 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-02-21T22:53:37.328 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-02-21T22:53:37.328 INFO:teuthology.orchestra.run.smithi116.stdout: "entity": "client.1", 2024-02-21T22:53:37.328 INFO:teuthology.orchestra.run.smithi116.stdout: "key": "AQCDftZl8t+WLRAAyES1AIrsrUUUfqDMxv2I1A==", 2024-02-21T22:53:37.328 INFO:teuthology.orchestra.run.smithi116.stdout: "caps": { 2024-02-21T22:53:37.328 INFO:teuthology.orchestra.run.smithi116.stdout: "mds": "allow", 2024-02-21T22:53:37.328 INFO:teuthology.orchestra.run.smithi116.stdout: "mgr": "allow r", 2024-02-21T22:53:37.328 INFO:teuthology.orchestra.run.smithi116.stdout: "mon": "allow rw", 2024-02-21T22:53:37.328 INFO:teuthology.orchestra.run.smithi116.stdout: "osd": "allow rwx" 2024-02-21T22:53:37.328 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-02-21T22:53:37.328 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-02-21T22:53:37.328 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-02-21T22:53:37.329 INFO:teuthology.orchestra.run.smithi116.stdout: "entity": "client.2", 2024-02-21T22:53:37.329 INFO:teuthology.orchestra.run.smithi116.stdout: "key": "AQCDftZl46ErKhAAlOImCFm/uktPXT24d0ik9w==", 2024-02-21T22:53:37.329 INFO:teuthology.orchestra.run.smithi116.stdout: "caps": { 2024-02-21T22:53:37.329 INFO:teuthology.orchestra.run.smithi116.stdout: "mds": "allow", 2024-02-21T22:53:37.329 INFO:teuthology.orchestra.run.smithi116.stdout: "mgr": "allow r", 2024-02-21T22:53:37.329 INFO:teuthology.orchestra.run.smithi116.stdout: "mon": "allow rw", 2024-02-21T22:53:37.329 INFO:teuthology.orchestra.run.smithi116.stdout: "osd": "allow rwx" 2024-02-21T22:53:37.329 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-02-21T22:53:37.329 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-02-21T22:53:37.329 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-02-21T22:53:37.329 INFO:teuthology.orchestra.run.smithi116.stdout: "entity": "client.3", 2024-02-21T22:53:37.329 INFO:teuthology.orchestra.run.smithi116.stdout: "key": "AQCDftZlxYBoMxAALBfTrC854PdzZ3Ji01ZLgQ==", 2024-02-21T22:53:37.329 INFO:teuthology.orchestra.run.smithi116.stdout: "caps": { 2024-02-21T22:53:37.329 INFO:teuthology.orchestra.run.smithi116.stdout: "mds": "allow", 2024-02-21T22:53:37.329 INFO:teuthology.orchestra.run.smithi116.stdout: "mgr": "allow r", 2024-02-21T22:53:37.330 INFO:teuthology.orchestra.run.smithi116.stdout: "mon": "allow rw", 2024-02-21T22:53:37.330 INFO:teuthology.orchestra.run.smithi116.stdout: "osd": "allow rwx" 2024-02-21T22:53:37.330 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-02-21T22:53:37.330 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-02-21T22:53:37.330 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-02-21T22:53:37.330 INFO:teuthology.orchestra.run.smithi116.stdout: "entity": "client.admin", 2024-02-21T22:53:37.330 INFO:teuthology.orchestra.run.smithi116.stdout: "key": "AQCCftZllWv9KhAAZdfYa3rgvj/K0zYLBcyiFw==", 2024-02-21T22:53:37.330 INFO:teuthology.orchestra.run.smithi116.stdout: "caps": { 2024-02-21T22:53:37.330 INFO:teuthology.orchestra.run.smithi116.stdout: "mds": "allow *", 2024-02-21T22:53:37.330 INFO:teuthology.orchestra.run.smithi116.stdout: "mgr": "allow *", 2024-02-21T22:53:37.330 INFO:teuthology.orchestra.run.smithi116.stdout: "mon": "allow *", 2024-02-21T22:53:37.330 INFO:teuthology.orchestra.run.smithi116.stdout: "osd": "allow *" 2024-02-21T22:53:37.330 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-02-21T22:53:37.330 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-02-21T22:53:37.330 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-02-21T22:53:37.331 INFO:teuthology.orchestra.run.smithi116.stdout: "entity": "client.bootstrap-mds", 2024-02-21T22:53:37.331 INFO:teuthology.orchestra.run.smithi116.stdout: "key": "AQCpftZl0yxUOxAAulpuEMDaL2tXOyhbUo/evA==", 2024-02-21T22:53:37.331 INFO:teuthology.orchestra.run.smithi116.stdout: "caps": { 2024-02-21T22:53:37.331 INFO:teuthology.orchestra.run.smithi116.stdout: "mon": "allow profile bootstrap-mds" 2024-02-21T22:53:37.331 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-02-21T22:53:37.331 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-02-21T22:53:37.331 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-02-21T22:53:37.331 INFO:teuthology.orchestra.run.smithi116.stdout: "entity": "client.bootstrap-mgr", 2024-02-21T22:53:37.331 INFO:teuthology.orchestra.run.smithi116.stdout: "key": "AQCpftZl6DdUOxAA7ef7gCSRqczsnXz3xlE/ug==", 2024-02-21T22:53:37.331 INFO:teuthology.orchestra.run.smithi116.stdout: "caps": { 2024-02-21T22:53:37.331 INFO:teuthology.orchestra.run.smithi116.stdout: "mon": "allow profile bootstrap-mgr" 2024-02-21T22:53:37.331 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-02-21T22:53:37.331 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-02-21T22:53:37.331 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-02-21T22:53:37.331 INFO:teuthology.orchestra.run.smithi116.stdout: "entity": "client.bootstrap-osd", 2024-02-21T22:53:37.332 INFO:teuthology.orchestra.run.smithi116.stdout: "key": "AQCpftZlxj9UOxAAr0OydNlOrhsr/t1f1VWCrw==", 2024-02-21T22:53:37.332 INFO:teuthology.orchestra.run.smithi116.stdout: "caps": { 2024-02-21T22:53:37.332 INFO:teuthology.orchestra.run.smithi116.stdout: "mon": "allow profile bootstrap-osd" 2024-02-21T22:53:37.332 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-02-21T22:53:37.332 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-02-21T22:53:37.332 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-02-21T22:53:37.332 INFO:teuthology.orchestra.run.smithi116.stdout: "entity": "client.bootstrap-rbd", 2024-02-21T22:53:37.332 INFO:teuthology.orchestra.run.smithi116.stdout: "key": "AQCpftZlH0dUOxAAVe6dSp4a+v8JtnhptGj29g==", 2024-02-21T22:53:37.332 INFO:teuthology.orchestra.run.smithi116.stdout: "caps": { 2024-02-21T22:53:37.332 INFO:teuthology.orchestra.run.smithi116.stdout: "mon": "allow profile bootstrap-rbd" 2024-02-21T22:53:37.332 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-02-21T22:53:37.332 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-02-21T22:53:37.332 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-02-21T22:53:37.332 INFO:teuthology.orchestra.run.smithi116.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-02-21T22:53:37.333 INFO:teuthology.orchestra.run.smithi116.stdout: "key": "AQCpftZlEU5UOxAAuOw6xQSJovji2utBVRIr3A==", 2024-02-21T22:53:37.333 INFO:teuthology.orchestra.run.smithi116.stdout: "caps": { 2024-02-21T22:53:37.333 INFO:teuthology.orchestra.run.smithi116.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-02-21T22:53:37.333 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-02-21T22:53:37.333 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-02-21T22:53:37.333 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-02-21T22:53:37.333 INFO:teuthology.orchestra.run.smithi116.stdout: "entity": "client.bootstrap-rgw", 2024-02-21T22:53:37.333 INFO:teuthology.orchestra.run.smithi116.stdout: "key": "AQCpftZl5VVUOxAApWoafkDHyzzpmoJKkm3LdA==", 2024-02-21T22:53:37.333 INFO:teuthology.orchestra.run.smithi116.stdout: "caps": { 2024-02-21T22:53:37.333 INFO:teuthology.orchestra.run.smithi116.stdout: "mon": "allow profile bootstrap-rgw" 2024-02-21T22:53:37.333 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-02-21T22:53:37.333 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-02-21T22:53:37.333 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-02-21T22:53:37.333 INFO:teuthology.orchestra.run.smithi116.stdout: "entity": "mgr.x", 2024-02-21T22:53:37.333 INFO:teuthology.orchestra.run.smithi116.stdout: "key": "AQCDftZlTRLmCBAAwiPF4QFNCA7pyZV2fdbt7A==", 2024-02-21T22:53:37.334 INFO:teuthology.orchestra.run.smithi116.stdout: "caps": { 2024-02-21T22:53:37.334 INFO:teuthology.orchestra.run.smithi116.stdout: "mds": "allow *", 2024-02-21T22:53:37.334 INFO:teuthology.orchestra.run.smithi116.stdout: "mon": "allow profile mgr", 2024-02-21T22:53:37.334 INFO:teuthology.orchestra.run.smithi116.stdout: "osd": "allow *" 2024-02-21T22:53:37.334 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-02-21T22:53:37.334 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-02-21T22:53:37.334 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-02-21T22:53:37.334 INFO:teuthology.orchestra.run.smithi116.stdout: "entity": "mgr.y", 2024-02-21T22:53:37.334 INFO:teuthology.orchestra.run.smithi116.stdout: "key": "AQCDftZlHge/BBAAguW4iLZRegyPUDddvtoCPA==", 2024-02-21T22:53:37.334 INFO:teuthology.orchestra.run.smithi116.stdout: "caps": { 2024-02-21T22:53:37.334 INFO:teuthology.orchestra.run.smithi116.stdout: "mds": "allow *", 2024-02-21T22:53:37.334 INFO:teuthology.orchestra.run.smithi116.stdout: "mon": "allow profile mgr", 2024-02-21T22:53:37.334 INFO:teuthology.orchestra.run.smithi116.stdout: "osd": "allow *" 2024-02-21T22:53:37.334 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-02-21T22:53:37.334 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-02-21T22:53:37.335 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-02-21T22:53:37.335 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-02-21T22:53:37.336 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.331+0000 7f64b8036640 1 -- 172.21.15.116:0/4028027602 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f649406b500 msgr2=0x7f649406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:37.337 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.331+0000 7f64b8036640 1 --2- 172.21.15.116:0/4028027602 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f649406b500 0x7f649406d9c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f64b00cb640 tx=0x7f64a0007e80 comp rx=0 tx=0).stop 2024-02-21T22:53:37.337 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.331+0000 7f64b8036640 1 -- 172.21.15.116:0/4028027602 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f64b006be20 msgr2=0x7f64b01580f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:37.337 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.331+0000 7f64b8036640 1 --2- 172.21.15.116:0/4028027602 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f64b006be20 0x7f64b01580f0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f64ac00e8e0 tx=0x7f64ac00eda0 comp rx=0 tx=0).stop 2024-02-21T22:53:37.337 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.331+0000 7f64b8036640 1 -- 172.21.15.116:0/4028027602 shutdown_connections 2024-02-21T22:53:37.337 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.331+0000 7f64b8036640 1 --2- 172.21.15.116:0/4028027602 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f64b00b5700 0x7f64b00c3dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:37.337 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.331+0000 7f64b8036640 1 --2- 172.21.15.116:0/4028027602 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f649406b500 0x7f649406d9c0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:37.337 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.331+0000 7f64b8036640 1 --2- 172.21.15.116:0/4028027602 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f64b00b10a0 0x7f64b00cf830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:37.337 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.331+0000 7f64b8036640 1 --2- 172.21.15.116:0/4028027602 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f64b006be20 0x7f64b01580f0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:37.337 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.331+0000 7f64b8036640 1 -- 172.21.15.116:0/4028027602 >> 172.21.15.116:0/4028027602 conn(0x7f64b00724f0 msgr2=0x7f64b015a180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:37.337 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.331+0000 7f64b8036640 1 -- 172.21.15.116:0/4028027602 shutdown_connections 2024-02-21T22:53:37.337 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.331+0000 7f64b8036640 1 -- 172.21.15.116:0/4028027602 wait complete. 2024-02-21T22:53:37.338 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-02-21T22:53:37.439 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.448+0000 7f6c5011e640 1 Processor -- start 2024-02-21T22:53:37.439 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.449+0000 7f6c5011e640 1 -- start start 2024-02-21T22:53:37.440 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.449+0000 7f6c5011e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6c4815be50 0x7f6c480ceea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:37.440 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.449+0000 7f6c5011e640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f6c4815ffd0 0x7f6c48071530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:37.441 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.449+0000 7f6c5011e640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c480cfb60 con 0x7f6c4806f100 2024-02-21T22:53:37.441 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.449+0000 7f6c5011e640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c480cf5a0 con 0x7f6c4815ffd0 2024-02-21T22:53:37.441 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.449+0000 7f6c5011e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c480cf880 con 0x7f6c4815be50 2024-02-21T22:53:37.441 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.450+0000 7f6c4deba640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6c4815be50 0x7f6c480ceea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:37.441 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.450+0000 7f6c4e6bb640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f6c4815ffd0 0x7f6c48071530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:37.441 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.450+0000 7f6c4d6b9640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f6c4806f100 0x7f6c4815f8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.116:37768/0 (socket says 172.21.15.116:37768) 2024-02-21T22:53:37.441 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.450+0000 7f6c4e6bb640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f6c4815ffd0 0x7f6c48071530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.116:39916/0 (socket says 172.21.15.116:39916) 2024-02-21T22:53:37.441 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.450+0000 7f6c4d6b9640 1 -- 172.21.15.116:0/1482654565 learned_addr learned my addr 172.21.15.116:0/1482654565 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-02-21T22:53:37.441 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.450+0000 7f6c4deba640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6c4815be50 0x7f6c480ceea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.116:39962/0 (socket says 172.21.15.116:39962) 2024-02-21T22:53:37.441 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.450+0000 7f6c4deba640 1 -- 172.21.15.116:0/1482654565 >> v2:172.21.15.142:3300/0 conn(0x7f6c4815ffd0 msgr2=0x7f6c48071530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:53:37.441 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.450+0000 7f6c4deba640 1 --2- 172.21.15.116:0/1482654565 >> v2:172.21.15.142:3300/0 conn(0x7f6c4815ffd0 0x7f6c48071530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:37.441 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.450+0000 7f6c4deba640 1 -- 172.21.15.116:0/1482654565 >> v1:172.21.15.142:6789/0 conn(0x7f6c4806f100 legacy=0x7f6c4815f8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:37.441 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.450+0000 7f6c4deba640 1 -- 172.21.15.116:0/1482654565 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c48070d30 con 0x7f6c4815be50 2024-02-21T22:53:37.441 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.450+0000 7f6c4e6bb640 1 --2- 172.21.15.116:0/1482654565 >> v2:172.21.15.142:3300/0 conn(0x7f6c4815ffd0 0x7f6c48071530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T22:53:37.443 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.451+0000 7f6c4deba640 1 --2- 172.21.15.116:0/1482654565 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6c4815be50 0x7f6c480ceea0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f6c380097a0 tx=0x7f6c3802b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d28fcb1572801d30 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:37.443 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.451+0000 7f6c4ceb8640 1 -- 172.21.15.116:0/1482654565 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c38035020 con 0x7f6c4815be50 2024-02-21T22:53:37.443 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.451+0000 7f6c4ceb8640 1 -- 172.21.15.116:0/1482654565 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c38031830 con 0x7f6c4815be50 2024-02-21T22:53:37.443 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.451+0000 7f6c4ceb8640 1 -- 172.21.15.116:0/1482654565 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c38031c00 con 0x7f6c4815be50 2024-02-21T22:53:37.443 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.452+0000 7f6c5011e640 1 -- 172.21.15.116:0/1482654565 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6c4815be50 msgr2=0x7f6c480ceea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:37.443 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.452+0000 7f6c5011e640 1 --2- 172.21.15.116:0/1482654565 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6c4815be50 0x7f6c480ceea0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f6c380097a0 tx=0x7f6c3802b8d0 comp rx=0 tx=0).stop 2024-02-21T22:53:37.443 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.452+0000 7f6c5011e640 1 -- 172.21.15.116:0/1482654565 shutdown_connections 2024-02-21T22:53:37.443 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.452+0000 7f6c5011e640 1 --2- 172.21.15.116:0/1482654565 >> v2:172.21.15.142:3300/0 conn(0x7f6c4815ffd0 0x7f6c48071530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:37.444 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.452+0000 7f6c5011e640 1 --2- 172.21.15.116:0/1482654565 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6c4815be50 0x7f6c480ceea0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:37.444 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.452+0000 7f6c5011e640 1 -- 172.21.15.116:0/1482654565 >> 172.21.15.116:0/1482654565 conn(0x7f6c480b1b80 msgr2=0x7f6c480b1f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:37.444 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.452+0000 7f6c5011e640 1 -- 172.21.15.116:0/1482654565 shutdown_connections 2024-02-21T22:53:37.444 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.452+0000 7f6c5011e640 1 -- 172.21.15.116:0/1482654565 wait complete. 2024-02-21T22:53:37.444 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.453+0000 7f6c5011e640 1 Processor -- start 2024-02-21T22:53:37.444 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.453+0000 7f6c5011e640 1 -- start start 2024-02-21T22:53:37.446 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.454+0000 7f6c5011e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6c4806f100 0x7f6c4813b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:37.446 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.454+0000 7f6c5011e640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6c4815be50 0x7f6c481582a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:37.447 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.454+0000 7f6c5011e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6c4815ffd0 0x7f6c4814ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:37.447 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.454+0000 7f6c5011e640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c48071a70 con 0x7f6c4815be50 2024-02-21T22:53:37.447 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.454+0000 7f6c5011e640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c4806f560 con 0x7f6c4815ffd0 2024-02-21T22:53:37.447 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.454+0000 7f6c5011e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c48071bf0 con 0x7f6c4806f100 2024-02-21T22:53:37.447 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.454+0000 7f6c4d6b9640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6c4815be50 0x7f6c481582a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:37.447 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.454+0000 7f6c4d6b9640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6c4815be50 0x7f6c481582a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:37922/0 (socket says 172.21.15.116:37922) 2024-02-21T22:53:37.447 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.454+0000 7f6c4d6b9640 1 -- 172.21.15.116:0/71489240 learned_addr learned my addr 172.21.15.116:0/71489240 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:37.447 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.454+0000 7f6c4deba640 1 --2- 172.21.15.116:0/71489240 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6c4806f100 0x7f6c4813b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:37.447 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.454+0000 7f6c4e6bb640 1 --2- 172.21.15.116:0/71489240 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6c4815ffd0 0x7f6c4814ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:37.447 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.454+0000 7f6c4d6b9640 1 -- 172.21.15.116:0/71489240 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6c4806f100 msgr2=0x7f6c4813b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:37.447 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.454+0000 7f6c4d6b9640 1 --2- 172.21.15.116:0/71489240 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6c4806f100 0x7f6c4813b1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:37.447 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.454+0000 7f6c4d6b9640 1 -- 172.21.15.116:0/71489240 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6c4815ffd0 msgr2=0x7f6c4814ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:37.447 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.454+0000 7f6c4d6b9640 1 --2- 172.21.15.116:0/71489240 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6c4815ffd0 0x7f6c4814ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:37.447 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.454+0000 7f6c4d6b9640 1 -- 172.21.15.116:0/71489240 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c4813bb10 con 0x7f6c4815be50 2024-02-21T22:53:37.448 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.454+0000 7f6c4d6b9640 1 --2- 172.21.15.116:0/71489240 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6c4815be50 0x7f6c481582a0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f6c4400c400 tx=0x7f6c4400c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:37.448 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.454+0000 7f6c3e7fc640 1 -- 172.21.15.116:0/71489240 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c44017070 con 0x7f6c4815be50 2024-02-21T22:53:37.448 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.454+0000 7f6c3e7fc640 1 -- 172.21.15.116:0/71489240 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c44005ce0 con 0x7f6c4815be50 2024-02-21T22:53:37.448 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.454+0000 7f6c5011e640 1 -- 172.21.15.116:0/71489240 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c4813bdf0 con 0x7f6c4815be50 2024-02-21T22:53:37.448 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.454+0000 7f6c3e7fc640 1 -- 172.21.15.116:0/71489240 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c440072f0 con 0x7f6c4815be50 2024-02-21T22:53:37.448 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.454+0000 7f6c5011e640 1 -- 172.21.15.116:0/71489240 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c4813c3b0 con 0x7f6c4815be50 2024-02-21T22:53:37.448 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.455+0000 7f6c5011e640 1 -- 172.21.15.116:0/71489240 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c480752f0 con 0x7f6c4815be50 2024-02-21T22:53:37.448 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.456+0000 7f6c3e7fc640 1 -- 172.21.15.116:0/71489240 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f6c4401a070 con 0x7f6c4815be50 2024-02-21T22:53:37.448 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.456+0000 7f6c3e7fc640 1 --2- 172.21.15.116:0/71489240 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f6c2c06b4d0 0x7f6c2c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:37.448 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.456+0000 7f6c3e7fc640 1 -- 172.21.15.116:0/71489240 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f6c44089180 con 0x7f6c4815be50 2024-02-21T22:53:37.448 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.456+0000 7f6c4deba640 1 --2- 172.21.15.116:0/71489240 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f6c2c06b4d0 0x7f6c2c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:37.449 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.457+0000 7f6c4deba640 1 --2- 172.21.15.116:0/71489240 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f6c2c06b4d0 0x7f6c2c06d990 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f6c38036000 tx=0x7f6c38008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:37.450 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.460+0000 7f6c3e7fc640 1 -- 172.21.15.116:0/71489240 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f6c44057d00 con 0x7f6c4815be50 2024-02-21T22:53:37.688 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.698+0000 7f6c5011e640 1 -- 172.21.15.116:0/71489240 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f6c48072d90 con 0x7f6c4815be50 2024-02-21T22:53:37.690 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.700+0000 7f6c3e7fc640 1 -- 172.21.15.116:0/71489240 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7f6c44087e20 con 0x7f6c4815be50 2024-02-21T22:53:37.693 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.702+0000 7f6c5011e640 1 -- 172.21.15.116:0/71489240 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f6c2c06b4d0 msgr2=0x7f6c2c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:37.693 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.702+0000 7f6c5011e640 1 --2- 172.21.15.116:0/71489240 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f6c2c06b4d0 0x7f6c2c06d990 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f6c38036000 tx=0x7f6c38008030 comp rx=0 tx=0).stop 2024-02-21T22:53:37.693 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.702+0000 7f6c5011e640 1 -- 172.21.15.116:0/71489240 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6c4815be50 msgr2=0x7f6c481582a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:37.693 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.702+0000 7f6c5011e640 1 --2- 172.21.15.116:0/71489240 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6c4815be50 0x7f6c481582a0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f6c4400c400 tx=0x7f6c4400c800 comp rx=0 tx=0).stop 2024-02-21T22:53:37.693 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.702+0000 7f6c5011e640 1 -- 172.21.15.116:0/71489240 shutdown_connections 2024-02-21T22:53:37.694 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.702+0000 7f6c5011e640 1 --2- 172.21.15.116:0/71489240 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6c4815ffd0 0x7f6c4814ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:37.694 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.702+0000 7f6c5011e640 1 --2- 172.21.15.116:0/71489240 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6c4815be50 0x7f6c481582a0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:37.694 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.702+0000 7f6c5011e640 1 --2- 172.21.15.116:0/71489240 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f6c2c06b4d0 0x7f6c2c06d990 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:37.694 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.702+0000 7f6c5011e640 1 --2- 172.21.15.116:0/71489240 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6c4806f100 0x7f6c4813b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:37.694 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.702+0000 7f6c5011e640 1 -- 172.21.15.116:0/71489240 >> 172.21.15.116:0/71489240 conn(0x7f6c480b1b80 msgr2=0x7f6c480affd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:37.694 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.702+0000 7f6c5011e640 1 -- 172.21.15.116:0/71489240 shutdown_connections 2024-02-21T22:53:37.694 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.702+0000 7f6c5011e640 1 -- 172.21.15.116:0/71489240 wait complete. 2024-02-21T22:53:37.704 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-02-21T22:53:37.807 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.816+0000 7fc291974640 1 Processor -- start 2024-02-21T22:53:37.807 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.816+0000 7fc291974640 1 -- start start 2024-02-21T22:53:37.807 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.817+0000 7fc291974640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc28c0d0510 0x7fc28c0d08f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:37.808 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.817+0000 7fc291974640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc28c0d1c30 0x7fc28c0d2430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:37.808 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.817+0000 7fc291974640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc28c0cfa50 con 0x7fc28c0ce8c0 2024-02-21T22:53:37.808 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.817+0000 7fc291974640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc28c0d1450 con 0x7fc28c0d0510 2024-02-21T22:53:37.808 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.817+0000 7fc291974640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc28c0d0e30 con 0x7fc28c0d1c30 2024-02-21T22:53:37.808 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.817+0000 7fc28a7fc640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc28c0d1c30 0x7fc28c0d2430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:37.808 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.817+0000 7fc28affd640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc28c0d0510 0x7fc28c0d08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:37.808 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.817+0000 7fc28b7fe640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fc28c0ce8c0 0x7fc28c0ced50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.116:37778/0 (socket says 172.21.15.116:37778) 2024-02-21T22:53:37.808 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.817+0000 7fc28b7fe640 1 -- 172.21.15.116:0/3444121304 learned_addr learned my addr 172.21.15.116:0/3444121304 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-02-21T22:53:37.810 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.817+0000 7fc28affd640 1 -- 172.21.15.116:0/3444121304 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc28c0d1c30 msgr2=0x7fc28c0d2430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:53:37.810 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.817+0000 7fc28affd640 1 --2- 172.21.15.116:0/3444121304 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc28c0d1c30 0x7fc28c0d2430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:37.810 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.817+0000 7fc28affd640 1 -- 172.21.15.116:0/3444121304 >> v1:172.21.15.142:6789/0 conn(0x7fc28c0ce8c0 legacy=0x7fc28c0ced50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:37.810 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.817+0000 7fc28affd640 1 -- 172.21.15.116:0/3444121304 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc28c0cfcc0 con 0x7fc28c0d0510 2024-02-21T22:53:37.810 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.817+0000 7fc28a7fc640 1 --2- 172.21.15.116:0/3444121304 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc28c0d1c30 0x7fc28c0d2430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T22:53:37.810 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.818+0000 7fc28affd640 1 --2- 172.21.15.116:0/3444121304 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc28c0d0510 0x7fc28c0d08f0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fc27c009d90 tx=0x7fc27c02be10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c7ecb1db69721983 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:37.810 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.818+0000 7fc289ffb640 1 -- 172.21.15.116:0/3444121304 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc27c039070 con 0x7fc28c0d0510 2024-02-21T22:53:37.810 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.818+0000 7fc289ffb640 1 -- 172.21.15.116:0/3444121304 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc27c02cbc0 con 0x7fc28c0d0510 2024-02-21T22:53:37.810 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.818+0000 7fc289ffb640 1 -- 172.21.15.116:0/3444121304 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc27c034440 con 0x7fc28c0d0510 2024-02-21T22:53:37.811 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.819+0000 7fc291974640 1 -- 172.21.15.116:0/3444121304 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc28c0d0510 msgr2=0x7fc28c0d08f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:37.811 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.819+0000 7fc291974640 1 --2- 172.21.15.116:0/3444121304 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc28c0d0510 0x7fc28c0d08f0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fc27c009d90 tx=0x7fc27c02be10 comp rx=0 tx=0).stop 2024-02-21T22:53:37.811 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.819+0000 7fc291974640 1 -- 172.21.15.116:0/3444121304 shutdown_connections 2024-02-21T22:53:37.811 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.819+0000 7fc291974640 1 --2- 172.21.15.116:0/3444121304 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc28c0d1c30 0x7fc28c0d2430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:37.811 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.819+0000 7fc291974640 1 --2- 172.21.15.116:0/3444121304 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc28c0d0510 0x7fc28c0d08f0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:37.811 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.819+0000 7fc291974640 1 -- 172.21.15.116:0/3444121304 >> 172.21.15.116:0/3444121304 conn(0x7fc28c0d3e50 msgr2=0x7fc28c0d4260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:37.811 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.819+0000 7fc291974640 1 -- 172.21.15.116:0/3444121304 shutdown_connections 2024-02-21T22:53:37.811 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.819+0000 7fc291974640 1 -- 172.21.15.116:0/3444121304 wait complete. 2024-02-21T22:53:37.814 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.820+0000 7fc291974640 1 Processor -- start 2024-02-21T22:53:37.815 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.820+0000 7fc291974640 1 -- start start 2024-02-21T22:53:37.815 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.821+0000 7fc291974640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc28c0ce8c0 0x7fc28c0c8800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:37.815 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.821+0000 7fc291974640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc28c0d0510 0x7fc28c151bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:37.815 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.821+0000 7fc291974640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc28c0d1c30 0x7fc28c154b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:37.815 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.821+0000 7fc291974640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc28c15e640 con 0x7fc28c0d0510 2024-02-21T22:53:37.815 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.821+0000 7fc291974640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc28c0d10e0 con 0x7fc28c0ce8c0 2024-02-21T22:53:37.815 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.821+0000 7fc291974640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc28c0d2970 con 0x7fc28c0d1c30 2024-02-21T22:53:37.815 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.821+0000 7fc28a7fc640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc28c0d0510 0x7fc28c151bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:37.815 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.821+0000 7fc28a7fc640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc28c0d0510 0x7fc28c151bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:37928/0 (socket says 172.21.15.116:37928) 2024-02-21T22:53:37.815 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.821+0000 7fc28a7fc640 1 -- 172.21.15.116:0/3361406111 learned_addr learned my addr 172.21.15.116:0/3361406111 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:37.815 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.821+0000 7fc28b7fe640 1 --2- 172.21.15.116:0/3361406111 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc28c0d1c30 0x7fc28c154b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:37.815 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.821+0000 7fc28affd640 1 --2- 172.21.15.116:0/3361406111 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc28c0ce8c0 0x7fc28c0c8800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:37.815 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.822+0000 7fc28a7fc640 1 -- 172.21.15.116:0/3361406111 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc28c0d1c30 msgr2=0x7fc28c154b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:37.815 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.822+0000 7fc28a7fc640 1 --2- 172.21.15.116:0/3361406111 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc28c0d1c30 0x7fc28c154b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:37.816 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.822+0000 7fc28a7fc640 1 -- 172.21.15.116:0/3361406111 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc28c0ce8c0 msgr2=0x7fc28c0c8800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:37.816 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.822+0000 7fc28a7fc640 1 --2- 172.21.15.116:0/3361406111 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc28c0ce8c0 0x7fc28c0c8800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:37.816 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.822+0000 7fc28a7fc640 1 -- 172.21.15.116:0/3361406111 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc28c0c9050 con 0x7fc28c0d0510 2024-02-21T22:53:37.816 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.822+0000 7fc28b7fe640 1 --2- 172.21.15.116:0/3361406111 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc28c0d1c30 0x7fc28c154b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T22:53:37.816 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.822+0000 7fc28affd640 1 --2- 172.21.15.116:0/3361406111 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc28c0ce8c0 0x7fc28c0c8800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T22:53:37.816 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.822+0000 7fc28a7fc640 1 --2- 172.21.15.116:0/3361406111 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc28c0d0510 0x7fc28c151bc0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fc28000ebe0 tx=0x7fc28000c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:37.816 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.822+0000 7fc273fff640 1 -- 172.21.15.116:0/3361406111 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc280017070 con 0x7fc28c0d0510 2024-02-21T22:53:37.816 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.822+0000 7fc273fff640 1 -- 172.21.15.116:0/3361406111 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc28000cc30 con 0x7fc28c0d0510 2024-02-21T22:53:37.816 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.822+0000 7fc291974640 1 -- 172.21.15.116:0/3361406111 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc28c0c9330 con 0x7fc28c0d0510 2024-02-21T22:53:37.816 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.822+0000 7fc273fff640 1 -- 172.21.15.116:0/3361406111 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc280013470 con 0x7fc28c0d0510 2024-02-21T22:53:37.816 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.822+0000 7fc291974640 1 -- 172.21.15.116:0/3361406111 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc28c0c98f0 con 0x7fc28c0d0510 2024-02-21T22:53:37.816 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.823+0000 7fc291974640 1 -- 172.21.15.116:0/3361406111 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc28c0752f0 con 0x7fc28c0d0510 2024-02-21T22:53:37.816 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.823+0000 7fc273fff640 1 -- 172.21.15.116:0/3361406111 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fc28001a070 con 0x7fc28c0d0510 2024-02-21T22:53:37.817 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.824+0000 7fc273fff640 1 --2- 172.21.15.116:0/3361406111 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fc27806b4d0 0x7fc27806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:37.817 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.824+0000 7fc273fff640 1 -- 172.21.15.116:0/3361406111 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fc28008a1d0 con 0x7fc28c0d0510 2024-02-21T22:53:37.817 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.824+0000 7fc28affd640 1 --2- 172.21.15.116:0/3361406111 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fc27806b4d0 0x7fc27806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:37.817 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.824+0000 7fc28affd640 1 --2- 172.21.15.116:0/3361406111 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fc27806b4d0 0x7fc27806d990 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fc27c036000 tx=0x7fc27c030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:37.818 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:37.828+0000 7fc273fff640 1 -- 172.21.15.116:0/3361406111 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7fc2800593b0 con 0x7fc28c0d0510 2024-02-21T22:53:38.057 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.066+0000 7fc291974640 1 -- 172.21.15.116:0/3361406111 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7fc28c0d2210 con 0x7fc28c0d0510 2024-02-21T22:53:38.058 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.068+0000 7fc273fff640 1 -- 172.21.15.116:0/3361406111 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7fc280058cb0 con 0x7fc28c0d0510 2024-02-21T22:53:38.061 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.070+0000 7fc291974640 1 -- 172.21.15.116:0/3361406111 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fc27806b4d0 msgr2=0x7fc27806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:38.061 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.070+0000 7fc291974640 1 --2- 172.21.15.116:0/3361406111 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fc27806b4d0 0x7fc27806d990 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fc27c036000 tx=0x7fc27c030000 comp rx=0 tx=0).stop 2024-02-21T22:53:38.061 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.070+0000 7fc291974640 1 -- 172.21.15.116:0/3361406111 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc28c0d0510 msgr2=0x7fc28c151bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:38.061 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.070+0000 7fc291974640 1 --2- 172.21.15.116:0/3361406111 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc28c0d0510 0x7fc28c151bc0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fc28000ebe0 tx=0x7fc28000c520 comp rx=0 tx=0).stop 2024-02-21T22:53:38.062 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.070+0000 7fc291974640 1 -- 172.21.15.116:0/3361406111 shutdown_connections 2024-02-21T22:53:38.062 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.070+0000 7fc291974640 1 --2- 172.21.15.116:0/3361406111 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fc27806b4d0 0x7fc27806d990 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:38.062 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.070+0000 7fc291974640 1 --2- 172.21.15.116:0/3361406111 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc28c0d1c30 0x7fc28c154b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:38.062 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.070+0000 7fc291974640 1 --2- 172.21.15.116:0/3361406111 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc28c0d0510 0x7fc28c151bc0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:38.062 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.070+0000 7fc291974640 1 --2- 172.21.15.116:0/3361406111 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc28c0ce8c0 0x7fc28c0c8800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:38.062 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.070+0000 7fc291974640 1 -- 172.21.15.116:0/3361406111 >> 172.21.15.116:0/3361406111 conn(0x7fc28c0d3e50 msgr2=0x7fc28c15bcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:38.062 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.070+0000 7fc291974640 1 -- 172.21.15.116:0/3361406111 shutdown_connections 2024-02-21T22:53:38.062 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.070+0000 7fc291974640 1 -- 172.21.15.116:0/3361406111 wait complete. 2024-02-21T22:53:38.071 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-02-21T22:53:38.173 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.182+0000 7fda6d236640 1 Processor -- start 2024-02-21T22:53:38.173 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.182+0000 7fda6d236640 1 -- start start 2024-02-21T22:53:38.174 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.183+0000 7fda6d236640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fda680b3f90 0x7fda6806ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:38.174 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.183+0000 7fda6d236640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fda6806b380 0x7fda68071c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:38.174 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.183+0000 7fda6d236640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda6815f570 con 0x7fda680b0290 2024-02-21T22:53:38.175 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.183+0000 7fda6d236640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda6806b7f0 con 0x7fda680b3f90 2024-02-21T22:53:38.175 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.183+0000 7fda6d236640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda6815f0e0 con 0x7fda6806b380 2024-02-21T22:53:38.175 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.183+0000 7fda6659c640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fda680b3f90 0x7fda6806ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:38.175 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.183+0000 7fda6659c640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fda680b3f90 0x7fda6806ae40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:37940/0 (socket says 172.21.15.116:37940) 2024-02-21T22:53:38.175 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.183+0000 7fda6659c640 1 -- 172.21.15.116:0/3124900801 learned_addr learned my addr 172.21.15.116:0/3124900801 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:38.175 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.183+0000 7fda6759e640 1 --2- 172.21.15.116:0/3124900801 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fda6806b380 0x7fda68071c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:38.175 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.184+0000 7fda6659c640 1 -- 172.21.15.116:0/3124900801 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fda6806b380 msgr2=0x7fda68071c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:53:38.175 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.184+0000 7fda6659c640 1 --2- 172.21.15.116:0/3124900801 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fda6806b380 0x7fda68071c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:38.175 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.184+0000 7fda6659c640 1 -- 172.21.15.116:0/3124900801 >> v1:172.21.15.142:6789/0 conn(0x7fda680b0290 legacy=0x7fda6806f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:38.175 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.184+0000 7fda6659c640 1 -- 172.21.15.116:0/3124900801 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda6815e7b0 con 0x7fda680b3f90 2024-02-21T22:53:38.175 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.184+0000 7fda6659c640 1 --2- 172.21.15.116:0/3124900801 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fda680b3f90 0x7fda6806ae40 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fda5c009870 tx=0x7fda5c02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bceb13cd6718b0e0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:38.177 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.184+0000 7fda65d9b640 1 -- 172.21.15.116:0/3124900801 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda5c035020 con 0x7fda680b3f90 2024-02-21T22:53:38.177 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.184+0000 7fda65d9b640 1 -- 172.21.15.116:0/3124900801 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda5c031640 con 0x7fda680b3f90 2024-02-21T22:53:38.177 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.184+0000 7fda65d9b640 1 -- 172.21.15.116:0/3124900801 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda5c02d040 con 0x7fda680b3f90 2024-02-21T22:53:38.177 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.185+0000 7fda6d236640 1 -- 172.21.15.116:0/3124900801 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fda680b3f90 msgr2=0x7fda6806ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:38.177 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.185+0000 7fda6d236640 1 --2- 172.21.15.116:0/3124900801 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fda680b3f90 0x7fda6806ae40 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fda5c009870 tx=0x7fda5c02b8f0 comp rx=0 tx=0).stop 2024-02-21T22:53:38.177 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.185+0000 7fda6d236640 1 -- 172.21.15.116:0/3124900801 shutdown_connections 2024-02-21T22:53:38.177 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.185+0000 7fda6d236640 1 --2- 172.21.15.116:0/3124900801 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fda6806b380 0x7fda68071c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:38.177 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.185+0000 7fda6d236640 1 --2- 172.21.15.116:0/3124900801 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fda680b3f90 0x7fda6806ae40 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:38.177 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.185+0000 7fda6d236640 1 -- 172.21.15.116:0/3124900801 >> 172.21.15.116:0/3124900801 conn(0x7fda680b29f0 msgr2=0x7fda680b2e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:38.177 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.185+0000 7fda6d236640 1 -- 172.21.15.116:0/3124900801 shutdown_connections 2024-02-21T22:53:38.177 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.185+0000 7fda6d236640 1 -- 172.21.15.116:0/3124900801 wait complete. 2024-02-21T22:53:38.177 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.186+0000 7fda6d236640 1 Processor -- start 2024-02-21T22:53:38.178 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.187+0000 7fda6d236640 1 -- start start 2024-02-21T22:53:38.180 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.187+0000 7fda6d236640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fda6806b380 0x7fda681e77b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:38.180 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.187+0000 7fda6d236640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fda680b0290 0x7fda68142600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:38.180 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.187+0000 7fda6d236640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fda680b3f90 0x7fda6806da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:38.180 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.187+0000 7fda6d236640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda680b0670 con 0x7fda680b3f90 2024-02-21T22:53:38.180 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.187+0000 7fda6d236640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda6815ed70 con 0x7fda6806b380 2024-02-21T22:53:38.180 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.187+0000 7fda6d236640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda680721c0 con 0x7fda680b0290 2024-02-21T22:53:38.180 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.187+0000 7fda6759e640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fda680b3f90 0x7fda6806da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:38.180 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.187+0000 7fda6759e640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fda680b3f90 0x7fda6806da00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:37956/0 (socket says 172.21.15.116:37956) 2024-02-21T22:53:38.180 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.187+0000 7fda6759e640 1 -- 172.21.15.116:0/1868977121 learned_addr learned my addr 172.21.15.116:0/1868977121 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:38.180 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.187+0000 7fda6659c640 1 --2- 172.21.15.116:0/1868977121 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fda680b0290 0x7fda68142600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:38.180 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.187+0000 7fda66d9d640 1 --2- 172.21.15.116:0/1868977121 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fda6806b380 0x7fda681e77b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:38.180 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.188+0000 7fda6759e640 1 -- 172.21.15.116:0/1868977121 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fda680b0290 msgr2=0x7fda68142600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:38.180 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.188+0000 7fda6759e640 1 --2- 172.21.15.116:0/1868977121 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fda680b0290 0x7fda68142600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:38.181 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.188+0000 7fda6759e640 1 -- 172.21.15.116:0/1868977121 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fda6806b380 msgr2=0x7fda681e77b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:38.181 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.188+0000 7fda6759e640 1 --2- 172.21.15.116:0/1868977121 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fda6806b380 0x7fda681e77b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:38.181 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.188+0000 7fda6759e640 1 -- 172.21.15.116:0/1868977121 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda681e69f0 con 0x7fda680b3f90 2024-02-21T22:53:38.181 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.188+0000 7fda6759e640 1 --2- 172.21.15.116:0/1868977121 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fda680b3f90 0x7fda6806da00 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fda6000efc0 tx=0x7fda6000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:38.181 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.188+0000 7fda4f7fe640 1 -- 172.21.15.116:0/1868977121 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda60018020 con 0x7fda680b3f90 2024-02-21T22:53:38.181 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.188+0000 7fda4f7fe640 1 -- 172.21.15.116:0/1868977121 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda60014480 con 0x7fda680b3f90 2024-02-21T22:53:38.181 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.188+0000 7fda4f7fe640 1 -- 172.21.15.116:0/1868977121 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda60014870 con 0x7fda680b3f90 2024-02-21T22:53:38.181 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.188+0000 7fda6d236640 1 -- 172.21.15.116:0/1868977121 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda681e6cd0 con 0x7fda680b3f90 2024-02-21T22:53:38.181 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.188+0000 7fda6d236640 1 -- 172.21.15.116:0/1868977121 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda681e7290 con 0x7fda680b3f90 2024-02-21T22:53:38.181 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.189+0000 7fda6d236640 1 -- 172.21.15.116:0/1868977121 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda680752f0 con 0x7fda680b3f90 2024-02-21T22:53:38.181 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.189+0000 7fda4f7fe640 1 -- 172.21.15.116:0/1868977121 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fda60005d10 con 0x7fda680b3f90 2024-02-21T22:53:38.182 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.190+0000 7fda4f7fe640 1 --2- 172.21.15.116:0/1868977121 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fda5406b4d0 0x7fda5406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:38.182 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.190+0000 7fda4f7fe640 1 -- 172.21.15.116:0/1868977121 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fda6008a890 con 0x7fda680b3f90 2024-02-21T22:53:38.182 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.190+0000 7fda66d9d640 1 --2- 172.21.15.116:0/1868977121 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fda5406b4d0 0x7fda5406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:38.182 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.190+0000 7fda66d9d640 1 --2- 172.21.15.116:0/1868977121 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fda5406b4d0 0x7fda5406d990 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fda58001780 tx=0x7fda58009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:38.184 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.194+0000 7fda4f7fe640 1 -- 172.21.15.116:0/1868977121 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7fda60022070 con 0x7fda680b3f90 2024-02-21T22:53:38.421 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.431+0000 7fda6d236640 1 -- 172.21.15.116:0/1868977121 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7fda6806d390 con 0x7fda680b3f90 2024-02-21T22:53:38.423 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.433+0000 7fda4f7fe640 1 -- 172.21.15.116:0/1868977121 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v9) v1 ==== 90+0+0 (secure 0 0 0) 0x7fda60010040 con 0x7fda680b3f90 2024-02-21T22:53:38.425 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.435+0000 7fda6d236640 1 -- 172.21.15.116:0/1868977121 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fda5406b4d0 msgr2=0x7fda5406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:38.425 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.435+0000 7fda6d236640 1 --2- 172.21.15.116:0/1868977121 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fda5406b4d0 0x7fda5406d990 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fda58001780 tx=0x7fda58009040 comp rx=0 tx=0).stop 2024-02-21T22:53:38.425 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.435+0000 7fda6d236640 1 -- 172.21.15.116:0/1868977121 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fda680b3f90 msgr2=0x7fda6806da00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:38.426 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.435+0000 7fda6d236640 1 --2- 172.21.15.116:0/1868977121 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fda680b3f90 0x7fda6806da00 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fda6000efc0 tx=0x7fda6000c490 comp rx=0 tx=0).stop 2024-02-21T22:53:38.426 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.435+0000 7fda6d236640 1 -- 172.21.15.116:0/1868977121 shutdown_connections 2024-02-21T22:53:38.426 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.435+0000 7fda6d236640 1 --2- 172.21.15.116:0/1868977121 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fda680b3f90 0x7fda6806da00 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:38.426 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.435+0000 7fda6d236640 1 --2- 172.21.15.116:0/1868977121 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fda5406b4d0 0x7fda5406d990 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:38.426 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.435+0000 7fda6d236640 1 --2- 172.21.15.116:0/1868977121 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fda680b0290 0x7fda68142600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:38.426 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.435+0000 7fda6d236640 1 --2- 172.21.15.116:0/1868977121 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fda6806b380 0x7fda681e77b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:38.426 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.435+0000 7fda6d236640 1 -- 172.21.15.116:0/1868977121 >> 172.21.15.116:0/1868977121 conn(0x7fda680b29f0 msgr2=0x7fda681608f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:38.426 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.435+0000 7fda6d236640 1 -- 172.21.15.116:0/1868977121 shutdown_connections 2024-02-21T22:53:38.426 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.435+0000 7fda6d236640 1 -- 172.21.15.116:0/1868977121 wait complete. 2024-02-21T22:53:38.436 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-02-21T22:53:38.537 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.547+0000 7f8c01e60640 1 Processor -- start 2024-02-21T22:53:38.538 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.547+0000 7f8c01e60640 1 -- start start 2024-02-21T22:53:38.539 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.548+0000 7f8c01e60640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f8bfc06c8f0 0x7f8bfc0716d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:38.539 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.548+0000 7f8c01e60640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bfc15feb0 con 0x7f8bfc145210 2024-02-21T22:53:38.539 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.548+0000 7f8c01e60640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bfc160190 con 0x7f8bfc15f9b0 2024-02-21T22:53:38.539 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.548+0000 7f8c01e60640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bfc160470 con 0x7f8bfc06c8f0 2024-02-21T22:53:38.539 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.548+0000 7f8bfaffd640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f8bfc06c8f0 0x7f8bfc0716d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:38.539 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.548+0000 7f8bfb7fe640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f8bfc145210 0x7f8bfc070fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:54186/0 (socket says 172.21.15.116:54186) 2024-02-21T22:53:38.539 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.548+0000 7f8bfb7fe640 1 -- 172.21.15.116:0/767058876 learned_addr learned my addr 172.21.15.116:0/767058876 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-02-21T22:53:38.539 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.548+0000 7f8bfaffd640 1 -- 172.21.15.116:0/767058876 >> v1:172.21.15.142:6789/0 conn(0x7f8bfc15f9b0 legacy=0x7f8bfc15c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:53:38.539 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.548+0000 7f8bfaffd640 1 -- 172.21.15.116:0/767058876 >> v1:172.21.15.116:6789/0 conn(0x7f8bfc145210 legacy=0x7f8bfc070fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:38.539 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.548+0000 7f8bfaffd640 1 -- 172.21.15.116:0/767058876 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bfc160750 con 0x7f8bfc06c8f0 2024-02-21T22:53:38.539 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.548+0000 7f8bfa7fc640 1 -- 172.21.15.116:0/767058876 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1247971626 0 0) 0x7f8bfc15feb0 con 0x7f8bfc145210 2024-02-21T22:53:38.541 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.549+0000 7f8bfaffd640 1 --2- 172.21.15.116:0/767058876 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8bfc06c8f0 0x7f8bfc0716d0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f8bf00097a0 tx=0x7f8bf002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b282191dac781f52 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:38.541 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.549+0000 7f8bfa7fc640 1 -- 172.21.15.116:0/767058876 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bf0035020 con 0x7f8bfc06c8f0 2024-02-21T22:53:38.541 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.549+0000 7f8bfa7fc640 1 -- 172.21.15.116:0/767058876 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bf0031830 con 0x7f8bfc06c8f0 2024-02-21T22:53:38.541 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.549+0000 7f8bfa7fc640 1 -- 172.21.15.116:0/767058876 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bf0031c00 con 0x7f8bfc06c8f0 2024-02-21T22:53:38.541 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.550+0000 7f8c01e60640 1 -- 172.21.15.116:0/767058876 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8bfc06c8f0 msgr2=0x7f8bfc0716d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:38.541 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.550+0000 7f8c01e60640 1 --2- 172.21.15.116:0/767058876 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8bfc06c8f0 0x7f8bfc0716d0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f8bf00097a0 tx=0x7f8bf002b8d0 comp rx=0 tx=0).stop 2024-02-21T22:53:38.541 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.550+0000 7f8c01e60640 1 -- 172.21.15.116:0/767058876 shutdown_connections 2024-02-21T22:53:38.541 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.550+0000 7f8c01e60640 1 --2- 172.21.15.116:0/767058876 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8bfc06c8f0 0x7f8bfc0716d0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:38.541 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.550+0000 7f8c01e60640 1 -- 172.21.15.116:0/767058876 >> 172.21.15.116:0/767058876 conn(0x7f8bfc0b18e0 msgr2=0x7f8bfc0b1cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:38.542 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.550+0000 7f8c01e60640 1 -- 172.21.15.116:0/767058876 shutdown_connections 2024-02-21T22:53:38.542 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.550+0000 7f8c01e60640 1 -- 172.21.15.116:0/767058876 wait complete. 2024-02-21T22:53:38.545 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.551+0000 7f8c01e60640 1 Processor -- start 2024-02-21T22:53:38.545 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.551+0000 7f8c01e60640 1 -- start start 2024-02-21T22:53:38.545 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.552+0000 7f8c01e60640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8bfc06c8f0 0x7f8bfc15aff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:38.545 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.552+0000 7f8c01e60640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8bfc145210 0x7f8bfc09b160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:38.545 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.552+0000 7f8c01e60640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8bfc15f9b0 0x7f8bfc09b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:38.545 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.552+0000 7f8c01e60640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bfc071d90 con 0x7f8bfc06c8f0 2024-02-21T22:53:38.545 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.552+0000 7f8c01e60640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bfc071c10 con 0x7f8bfc15f9b0 2024-02-21T22:53:38.545 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.552+0000 7f8c01e60640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bfc15cb30 con 0x7f8bfc145210 2024-02-21T22:53:38.545 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.552+0000 7f8bfb7fe640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8bfc06c8f0 0x7f8bfc15aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:38.546 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.552+0000 7f8bfb7fe640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8bfc06c8f0 0x7f8bfc15aff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:37980/0 (socket says 172.21.15.116:37980) 2024-02-21T22:53:38.546 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.552+0000 7f8bfb7fe640 1 -- 172.21.15.116:0/2833971583 learned_addr learned my addr 172.21.15.116:0/2833971583 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:38.546 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.552+0000 7f8bfbfff640 1 --2- 172.21.15.116:0/2833971583 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8bfc15f9b0 0x7f8bfc09b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:38.546 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.552+0000 7f8bfaffd640 1 --2- 172.21.15.116:0/2833971583 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8bfc145210 0x7f8bfc09b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:38.546 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.552+0000 7f8bfb7fe640 1 -- 172.21.15.116:0/2833971583 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8bfc145210 msgr2=0x7f8bfc09b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:38.546 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.552+0000 7f8bfb7fe640 1 --2- 172.21.15.116:0/2833971583 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8bfc145210 0x7f8bfc09b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:38.546 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.552+0000 7f8bfb7fe640 1 -- 172.21.15.116:0/2833971583 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8bfc15f9b0 msgr2=0x7f8bfc09b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:38.546 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.552+0000 7f8bfb7fe640 1 --2- 172.21.15.116:0/2833971583 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8bfc15f9b0 0x7f8bfc09b6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:38.546 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.552+0000 7f8bfb7fe640 1 -- 172.21.15.116:0/2833971583 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bfc15e1f0 con 0x7f8bfc06c8f0 2024-02-21T22:53:38.546 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.552+0000 7f8bfb7fe640 1 --2- 172.21.15.116:0/2833971583 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8bfc06c8f0 0x7f8bfc15aff0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f8bec00c500 tx=0x7f8bec00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:38.546 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.552+0000 7f8be3fff640 1 -- 172.21.15.116:0/2833971583 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bec018070 con 0x7f8bfc06c8f0 2024-02-21T22:53:38.546 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.552+0000 7f8be3fff640 1 -- 172.21.15.116:0/2833971583 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bec007580 con 0x7f8bfc06c8f0 2024-02-21T22:53:38.546 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.552+0000 7f8c01e60640 1 -- 172.21.15.116:0/2833971583 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bfc15e4d0 con 0x7f8bfc06c8f0 2024-02-21T22:53:38.546 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.552+0000 7f8be3fff640 1 -- 172.21.15.116:0/2833971583 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bec004a20 con 0x7f8bfc06c8f0 2024-02-21T22:53:38.546 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.552+0000 7f8c01e60640 1 -- 172.21.15.116:0/2833971583 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bfc15ea90 con 0x7f8bfc06c8f0 2024-02-21T22:53:38.547 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.554+0000 7f8c01e60640 1 -- 172.21.15.116:0/2833971583 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bfc0752f0 con 0x7f8bfc06c8f0 2024-02-21T22:53:38.547 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.554+0000 7f8be3fff640 1 -- 172.21.15.116:0/2833971583 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f8bec01b070 con 0x7f8bfc06c8f0 2024-02-21T22:53:38.547 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.554+0000 7f8be3fff640 1 --2- 172.21.15.116:0/2833971583 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f8be806b4d0 0x7f8be806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:38.547 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.554+0000 7f8be3fff640 1 -- 172.21.15.116:0/2833971583 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f8bec089130 con 0x7f8bfc06c8f0 2024-02-21T22:53:38.547 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.554+0000 7f8bfaffd640 1 --2- 172.21.15.116:0/2833971583 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f8be806b4d0 0x7f8be806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:38.547 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.555+0000 7f8bfaffd640 1 --2- 172.21.15.116:0/2833971583 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f8be806b4d0 0x7f8be806d990 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f8bf0036000 tx=0x7f8bf0008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:38.548 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.558+0000 7f8be3fff640 1 -- 172.21.15.116:0/2833971583 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f8bec058390 con 0x7f8bfc06c8f0 2024-02-21T22:53:38.786 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.796+0000 7f8c01e60640 1 -- 172.21.15.116:0/2833971583 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f8bfc0cd370 con 0x7f8bfc06c8f0 2024-02-21T22:53:38.788 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.798+0000 7f8be3fff640 1 -- 172.21.15.116:0/2833971583 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7f8bec057c90 con 0x7f8bfc06c8f0 2024-02-21T22:53:38.791 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.800+0000 7f8c01e60640 1 -- 172.21.15.116:0/2833971583 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f8be806b4d0 msgr2=0x7f8be806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:38.791 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.800+0000 7f8c01e60640 1 --2- 172.21.15.116:0/2833971583 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f8be806b4d0 0x7f8be806d990 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f8bf0036000 tx=0x7f8bf0008030 comp rx=0 tx=0).stop 2024-02-21T22:53:38.791 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.800+0000 7f8c01e60640 1 -- 172.21.15.116:0/2833971583 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8bfc06c8f0 msgr2=0x7f8bfc15aff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:38.791 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.800+0000 7f8c01e60640 1 --2- 172.21.15.116:0/2833971583 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8bfc06c8f0 0x7f8bfc15aff0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f8bec00c500 tx=0x7f8bec00c9c0 comp rx=0 tx=0).stop 2024-02-21T22:53:38.791 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.800+0000 7f8c01e60640 1 -- 172.21.15.116:0/2833971583 shutdown_connections 2024-02-21T22:53:38.791 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.800+0000 7f8c01e60640 1 --2- 172.21.15.116:0/2833971583 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8bfc15f9b0 0x7f8bfc09b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:38.792 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.800+0000 7f8c01e60640 1 --2- 172.21.15.116:0/2833971583 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f8be806b4d0 0x7f8be806d990 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:38.792 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.800+0000 7f8c01e60640 1 --2- 172.21.15.116:0/2833971583 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8bfc145210 0x7f8bfc09b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:38.792 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.800+0000 7f8c01e60640 1 --2- 172.21.15.116:0/2833971583 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8bfc06c8f0 0x7f8bfc15aff0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:38.792 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.800+0000 7f8c01e60640 1 -- 172.21.15.116:0/2833971583 >> 172.21.15.116:0/2833971583 conn(0x7f8bfc0b18e0 msgr2=0x7f8bfc143890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:38.792 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.800+0000 7f8c01e60640 1 -- 172.21.15.116:0/2833971583 shutdown_connections 2024-02-21T22:53:38.792 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.800+0000 7f8c01e60640 1 -- 172.21.15.116:0/2833971583 wait complete. 2024-02-21T22:53:38.801 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-02-21T22:53:38.902 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.911+0000 7f98d3860640 1 Processor -- start 2024-02-21T22:53:38.902 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.912+0000 7f98d3860640 1 -- start start 2024-02-21T22:53:38.905 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.912+0000 7f98d3860640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f98cc0afa80 0x7f98cc0b5990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:38.905 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.912+0000 7f98d3860640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f98cc0b5ed0 0x7f98cc06ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:38.905 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.912+0000 7f98d3860640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98cc0afe60 con 0x7f98cc06b380 2024-02-21T22:53:38.905 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.912+0000 7f98d3860640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98cc0b5500 con 0x7f98cc0b5ed0 2024-02-21T22:53:38.906 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.912+0000 7f98d3860640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98cc15f510 con 0x7f98cc0afa80 2024-02-21T22:53:38.906 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.913+0000 7f98d0dfb640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f98cc0b5ed0 0x7f98cc06ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:38.906 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.913+0000 7f98d0dfb640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f98cc0b5ed0 0x7f98cc06ae40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:37994/0 (socket says 172.21.15.116:37994) 2024-02-21T22:53:38.906 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.913+0000 7f98d0dfb640 1 -- 172.21.15.116:0/4003812196 learned_addr learned my addr 172.21.15.116:0/4003812196 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:38.906 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.913+0000 7f98d15fc640 1 --2- 172.21.15.116:0/4003812196 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f98cc0afa80 0x7f98cc0b5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:38.906 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.913+0000 7f98d0dfb640 1 -- 172.21.15.116:0/4003812196 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f98cc0afa80 msgr2=0x7f98cc0b5990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:53:38.906 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.913+0000 7f98d0dfb640 1 --2- 172.21.15.116:0/4003812196 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f98cc0afa80 0x7f98cc0b5990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:38.906 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.913+0000 7f98d0dfb640 1 -- 172.21.15.116:0/4003812196 >> v1:172.21.15.142:6789/0 conn(0x7f98cc06b380 legacy=0x7f98cc0b0220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:38.906 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.913+0000 7f98d0dfb640 1 -- 172.21.15.116:0/4003812196 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98cc15f7f0 con 0x7f98cc0b5ed0 2024-02-21T22:53:38.906 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.914+0000 7f98d0dfb640 1 --2- 172.21.15.116:0/4003812196 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f98cc0b5ed0 0x7f98cc06ae40 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f98c8009870 tx=0x7f98c802b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a112feed47f3a9eb server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:38.906 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.914+0000 7f98c3fff640 1 -- 172.21.15.116:0/4003812196 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98c8034070 con 0x7f98cc0b5ed0 2024-02-21T22:53:38.906 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.914+0000 7f98c3fff640 1 -- 172.21.15.116:0/4003812196 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98c8030840 con 0x7f98cc0b5ed0 2024-02-21T22:53:38.906 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.914+0000 7f98c3fff640 1 -- 172.21.15.116:0/4003812196 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98c8030c10 con 0x7f98cc0b5ed0 2024-02-21T22:53:38.907 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.914+0000 7f98d3860640 1 -- 172.21.15.116:0/4003812196 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f98cc0b5ed0 msgr2=0x7f98cc06ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:38.907 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.914+0000 7f98d3860640 1 --2- 172.21.15.116:0/4003812196 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f98cc0b5ed0 0x7f98cc06ae40 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f98c8009870 tx=0x7f98c802b980 comp rx=0 tx=0).stop 2024-02-21T22:53:38.907 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.914+0000 7f98d3860640 1 -- 172.21.15.116:0/4003812196 shutdown_connections 2024-02-21T22:53:38.907 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.914+0000 7f98d3860640 1 --2- 172.21.15.116:0/4003812196 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f98cc0b5ed0 0x7f98cc06ae40 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:38.907 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.914+0000 7f98d3860640 1 --2- 172.21.15.116:0/4003812196 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f98cc0afa80 0x7f98cc0b5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:38.907 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.914+0000 7f98d3860640 1 -- 172.21.15.116:0/4003812196 >> 172.21.15.116:0/4003812196 conn(0x7f98cc0724f0 msgr2=0x7f98cc072900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:38.907 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.914+0000 7f98d3860640 1 -- 172.21.15.116:0/4003812196 shutdown_connections 2024-02-21T22:53:38.907 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.914+0000 7f98d3860640 1 -- 172.21.15.116:0/4003812196 wait complete. 2024-02-21T22:53:38.910 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.916+0000 7f98d3860640 1 Processor -- start 2024-02-21T22:53:38.910 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.916+0000 7f98d3860640 1 -- start start 2024-02-21T22:53:38.910 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.916+0000 7f98d3860640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f98cc06b380 0x7f98cc14e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:38.910 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.916+0000 7f98d3860640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f98cc0afa80 0x7f98cc14fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:38.911 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.916+0000 7f98d3860640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f98cc0b5ed0 0x7f98cc09dc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:38.911 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.916+0000 7f98d3860640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98cc0b0ab0 con 0x7f98cc0b5ed0 2024-02-21T22:53:38.911 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.916+0000 7f98d3860640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98cc0b0930 con 0x7f98cc0afa80 2024-02-21T22:53:38.911 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.916+0000 7f98d3860640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98cc0b0c30 con 0x7f98cc06b380 2024-02-21T22:53:38.911 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.916+0000 7f98d1dfd640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f98cc0b5ed0 0x7f98cc09dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:38.911 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.916+0000 7f98d1dfd640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f98cc0b5ed0 0x7f98cc09dc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:38006/0 (socket says 172.21.15.116:38006) 2024-02-21T22:53:38.911 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.916+0000 7f98d1dfd640 1 -- 172.21.15.116:0/549315177 learned_addr learned my addr 172.21.15.116:0/549315177 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:38.911 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.917+0000 7f98d15fc640 1 --2- 172.21.15.116:0/549315177 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f98cc06b380 0x7f98cc14e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:38.911 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.917+0000 7f98d0dfb640 1 --2- 172.21.15.116:0/549315177 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f98cc0afa80 0x7f98cc14fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:38.911 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.917+0000 7f98d1dfd640 1 -- 172.21.15.116:0/549315177 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f98cc06b380 msgr2=0x7f98cc14e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:38.911 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.917+0000 7f98d1dfd640 1 --2- 172.21.15.116:0/549315177 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f98cc06b380 0x7f98cc14e320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:38.911 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.917+0000 7f98d1dfd640 1 -- 172.21.15.116:0/549315177 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f98cc0afa80 msgr2=0x7f98cc14fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:38.911 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.917+0000 7f98d1dfd640 1 --2- 172.21.15.116:0/549315177 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f98cc0afa80 0x7f98cc14fb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:38.911 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.917+0000 7f98d1dfd640 1 -- 172.21.15.116:0/549315177 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98cc14ea90 con 0x7f98cc0b5ed0 2024-02-21T22:53:38.912 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.917+0000 7f98d0dfb640 1 --2- 172.21.15.116:0/549315177 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f98cc0afa80 0x7f98cc14fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T22:53:38.912 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.917+0000 7f98d1dfd640 1 --2- 172.21.15.116:0/549315177 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f98cc0b5ed0 0x7f98cc09dc60 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f98c400c7a0 tx=0x7f98c400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:38.912 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.917+0000 7f98c1ffb640 1 -- 172.21.15.116:0/549315177 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98c4003b70 con 0x7f98cc0b5ed0 2024-02-21T22:53:38.912 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.917+0000 7f98c1ffb640 1 -- 172.21.15.116:0/549315177 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98c4003d30 con 0x7f98cc0b5ed0 2024-02-21T22:53:38.912 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.917+0000 7f98d3860640 1 -- 172.21.15.116:0/549315177 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98cc14ed70 con 0x7f98cc0b5ed0 2024-02-21T22:53:38.912 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.917+0000 7f98c1ffb640 1 -- 172.21.15.116:0/549315177 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98c400aa90 con 0x7f98cc0b5ed0 2024-02-21T22:53:38.912 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.917+0000 7f98d3860640 1 -- 172.21.15.116:0/549315177 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98cc14f330 con 0x7f98cc0b5ed0 2024-02-21T22:53:38.912 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.918+0000 7f98d3860640 1 -- 172.21.15.116:0/549315177 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98cc0752f0 con 0x7f98cc0b5ed0 2024-02-21T22:53:38.912 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.918+0000 7f98c1ffb640 1 -- 172.21.15.116:0/549315177 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f98c400ac30 con 0x7f98cc0b5ed0 2024-02-21T22:53:38.912 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.919+0000 7f98c1ffb640 1 --2- 172.21.15.116:0/549315177 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f98b006b4d0 0x7f98b006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:38.912 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.919+0000 7f98c1ffb640 1 -- 172.21.15.116:0/549315177 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f98c4089e80 con 0x7f98cc0b5ed0 2024-02-21T22:53:38.912 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.919+0000 7f98d15fc640 1 --2- 172.21.15.116:0/549315177 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f98b006b4d0 0x7f98b006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:38.912 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.920+0000 7f98d15fc640 1 --2- 172.21.15.116:0/549315177 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f98b006b4d0 0x7f98b006d990 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f98bc006fd0 tx=0x7f98bc008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:38.914 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:38.923+0000 7f98c1ffb640 1 -- 172.21.15.116:0/549315177 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f98cc0afe60 con 0x7f98cc0b5ed0 2024-02-21T22:53:39.156 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.166+0000 7f98d3860640 1 -- 172.21.15.116:0/549315177 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f98cc0b0280 con 0x7f98cc0b5ed0 2024-02-21T22:53:39.158 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.167+0000 7f98c1ffb640 1 -- 172.21.15.116:0/549315177 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v11) v1 ==== 97+0+0 (secure 0 0 0) 0x7f98c4058fc0 con 0x7f98cc0b5ed0 2024-02-21T22:53:39.160 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.170+0000 7f98d3860640 1 -- 172.21.15.116:0/549315177 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f98b006b4d0 msgr2=0x7f98b006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:39.160 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.170+0000 7f98d3860640 1 --2- 172.21.15.116:0/549315177 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f98b006b4d0 0x7f98b006d990 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f98bc006fd0 tx=0x7f98bc008040 comp rx=0 tx=0).stop 2024-02-21T22:53:39.161 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.170+0000 7f98d3860640 1 -- 172.21.15.116:0/549315177 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f98cc0b5ed0 msgr2=0x7f98cc09dc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:39.161 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.170+0000 7f98d3860640 1 --2- 172.21.15.116:0/549315177 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f98cc0b5ed0 0x7f98cc09dc60 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f98c400c7a0 tx=0x7f98c400cc60 comp rx=0 tx=0).stop 2024-02-21T22:53:39.161 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.170+0000 7f98d3860640 1 -- 172.21.15.116:0/549315177 shutdown_connections 2024-02-21T22:53:39.161 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.170+0000 7f98d3860640 1 --2- 172.21.15.116:0/549315177 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f98cc0b5ed0 0x7f98cc09dc60 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:39.161 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.170+0000 7f98d3860640 1 --2- 172.21.15.116:0/549315177 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f98cc0afa80 0x7f98cc14fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:39.161 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.170+0000 7f98d3860640 1 --2- 172.21.15.116:0/549315177 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f98b006b4d0 0x7f98b006d990 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:39.161 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.170+0000 7f98d3860640 1 --2- 172.21.15.116:0/549315177 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f98cc06b380 0x7f98cc14e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:39.161 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.170+0000 7f98d3860640 1 -- 172.21.15.116:0/549315177 >> 172.21.15.116:0/549315177 conn(0x7f98cc0724f0 msgr2=0x7f98cc0728d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:39.161 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.170+0000 7f98d3860640 1 -- 172.21.15.116:0/549315177 shutdown_connections 2024-02-21T22:53:39.161 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.170+0000 7f98d3860640 1 -- 172.21.15.116:0/549315177 wait complete. 2024-02-21T22:53:39.171 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-02-21T22:53:39.273 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.281+0000 7f79d91f0640 1 Processor -- start 2024-02-21T22:53:39.273 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.281+0000 7f79d91f0640 1 -- start start 2024-02-21T22:53:39.274 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.282+0000 7f79d91f0640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f79d415f5a0 0x7f79d40cec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:39.274 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.282+0000 7f79d91f0640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f79d40b26d0 0x7f79d40d01f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:39.274 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.282+0000 7f79d91f0640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79d40ae8a0 con 0x7f79d40d0730 2024-02-21T22:53:39.274 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.282+0000 7f79d91f0640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79d40cf9f0 con 0x7f79d415f5a0 2024-02-21T22:53:39.274 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.282+0000 7f79d91f0640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79d40d2730 con 0x7f79d40b26d0 2024-02-21T22:53:39.274 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.282+0000 7f79d2d9d640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f79d415f5a0 0x7f79d40cec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:39.274 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.282+0000 7f79d2d9d640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f79d415f5a0 0x7f79d40cec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:38010/0 (socket says 172.21.15.116:38010) 2024-02-21T22:53:39.274 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.282+0000 7f79d2d9d640 1 -- 172.21.15.116:0/3172279467 learned_addr learned my addr 172.21.15.116:0/3172279467 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:39.274 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.282+0000 7f79d2d9d640 1 -- 172.21.15.116:0/3172279467 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f79d40b26d0 msgr2=0x7f79d40d01f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:53:39.274 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.282+0000 7f79d2d9d640 1 --2- 172.21.15.116:0/3172279467 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f79d40b26d0 0x7f79d40d01f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:39.274 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.282+0000 7f79d2d9d640 1 -- 172.21.15.116:0/3172279467 >> v1:172.21.15.142:6789/0 conn(0x7f79d40d0730 legacy=0x7f79d40b1570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:53:39.274 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.282+0000 7f79d2d9d640 1 -- 172.21.15.116:0/3172279467 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79d40cff20 con 0x7f79d415f5a0 2024-02-21T22:53:39.274 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.283+0000 7f79d2d9d640 1 --2- 172.21.15.116:0/3172279467 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f79d415f5a0 0x7f79d40cec50 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f79c4009870 tx=0x7f79c402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2a5f3776f90f96c server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:39.274 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.283+0000 7f79d259c640 1 -- 172.21.15.116:0/3172279467 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79c4035020 con 0x7f79d415f5a0 2024-02-21T22:53:39.274 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.283+0000 7f79d259c640 1 -- 172.21.15.116:0/3172279467 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79c4031640 con 0x7f79d415f5a0 2024-02-21T22:53:39.275 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.283+0000 7f79d259c640 1 -- 172.21.15.116:0/3172279467 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79c402d040 con 0x7f79d415f5a0 2024-02-21T22:53:39.277 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.283+0000 7f79d91f0640 1 -- 172.21.15.116:0/3172279467 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f79d415f5a0 msgr2=0x7f79d40cec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:39.278 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.283+0000 7f79d91f0640 1 --2- 172.21.15.116:0/3172279467 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f79d415f5a0 0x7f79d40cec50 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f79c4009870 tx=0x7f79c402b8f0 comp rx=0 tx=0).stop 2024-02-21T22:53:39.278 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.283+0000 7f79d91f0640 1 -- 172.21.15.116:0/3172279467 shutdown_connections 2024-02-21T22:53:39.278 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.283+0000 7f79d91f0640 1 --2- 172.21.15.116:0/3172279467 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f79d40b26d0 0x7f79d40d01f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:39.278 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.283+0000 7f79d91f0640 1 --2- 172.21.15.116:0/3172279467 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f79d415f5a0 0x7f79d40cec50 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:39.278 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.283+0000 7f79d91f0640 1 -- 172.21.15.116:0/3172279467 >> 172.21.15.116:0/3172279467 conn(0x7f79d40d1c10 msgr2=0x7f79d40d2020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:39.278 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.283+0000 7f79d91f0640 1 -- 172.21.15.116:0/3172279467 shutdown_connections 2024-02-21T22:53:39.278 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.283+0000 7f79d91f0640 1 -- 172.21.15.116:0/3172279467 wait complete. 2024-02-21T22:53:39.278 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.285+0000 7f79d91f0640 1 Processor -- start 2024-02-21T22:53:39.278 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.285+0000 7f79d91f0640 1 -- start start 2024-02-21T22:53:39.278 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.286+0000 7f79d91f0640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f79d40b26d0 0x7f79d40c8640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:39.278 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.286+0000 7f79d91f0640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f79d40d0730 0x7f79d40c6360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:39.278 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.286+0000 7f79d91f0640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f79d415f5a0 0x7f79d4154060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:39.278 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.286+0000 7f79d91f0640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79d40b2e90 con 0x7f79d415f5a0 2024-02-21T22:53:39.279 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.286+0000 7f79d91f0640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79d40cfc40 con 0x7f79d40b26d0 2024-02-21T22:53:39.279 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.286+0000 7f79d91f0640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79d40b3010 con 0x7f79d40d0730 2024-02-21T22:53:39.279 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.286+0000 7f79d359e640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f79d415f5a0 0x7f79d4154060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:39.279 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.286+0000 7f79d359e640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f79d415f5a0 0x7f79d4154060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:38024/0 (socket says 172.21.15.116:38024) 2024-02-21T22:53:39.279 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.286+0000 7f79d359e640 1 -- 172.21.15.116:0/1048846716 learned_addr learned my addr 172.21.15.116:0/1048846716 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:39.279 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.286+0000 7f79d2d9d640 1 --2- 172.21.15.116:0/1048846716 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f79d40b26d0 0x7f79d40c8640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:39.279 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.286+0000 7f79ca59c640 1 --2- 172.21.15.116:0/1048846716 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f79d40d0730 0x7f79d40c6360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:39.279 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.286+0000 7f79d359e640 1 -- 172.21.15.116:0/1048846716 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f79d40d0730 msgr2=0x7f79d40c6360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:39.279 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.286+0000 7f79d359e640 1 --2- 172.21.15.116:0/1048846716 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f79d40d0730 0x7f79d40c6360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:39.279 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.286+0000 7f79d359e640 1 -- 172.21.15.116:0/1048846716 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f79d40b26d0 msgr2=0x7f79d40c8640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:39.279 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.286+0000 7f79d359e640 1 --2- 172.21.15.116:0/1048846716 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f79d40b26d0 0x7f79d40c8640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:39.279 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.286+0000 7f79d359e640 1 -- 172.21.15.116:0/1048846716 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79d40c6ad0 con 0x7f79d415f5a0 2024-02-21T22:53:39.279 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.286+0000 7f79d359e640 1 --2- 172.21.15.116:0/1048846716 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f79d415f5a0 0x7f79d4154060 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f79cc00c780 tx=0x7f79cc00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:39.279 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.286+0000 7f79cbfff640 1 -- 172.21.15.116:0/1048846716 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79cc017070 con 0x7f79d415f5a0 2024-02-21T22:53:39.280 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.286+0000 7f79cbfff640 1 -- 172.21.15.116:0/1048846716 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79cc003da0 con 0x7f79d415f5a0 2024-02-21T22:53:39.280 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.286+0000 7f79d91f0640 1 -- 172.21.15.116:0/1048846716 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79d40c6db0 con 0x7f79d415f5a0 2024-02-21T22:53:39.280 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.286+0000 7f79cbfff640 1 -- 172.21.15.116:0/1048846716 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79cc0052b0 con 0x7f79d415f5a0 2024-02-21T22:53:39.280 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.286+0000 7f79d91f0640 1 -- 172.21.15.116:0/1048846716 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79d40b65e0 con 0x7f79d415f5a0 2024-02-21T22:53:39.280 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.287+0000 7f79d91f0640 1 -- 172.21.15.116:0/1048846716 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79d40c5350 con 0x7f79d415f5a0 2024-02-21T22:53:39.281 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.288+0000 7f79cbfff640 1 -- 172.21.15.116:0/1048846716 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f79cc01a070 con 0x7f79d415f5a0 2024-02-21T22:53:39.281 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.288+0000 7f79cbfff640 1 --2- 172.21.15.116:0/1048846716 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f79b406b4d0 0x7f79b406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:39.281 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.288+0000 7f79cbfff640 1 -- 172.21.15.116:0/1048846716 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f79cc089510 con 0x7f79d415f5a0 2024-02-21T22:53:39.281 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.288+0000 7f79d2d9d640 1 --2- 172.21.15.116:0/1048846716 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f79b406b4d0 0x7f79b406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:39.281 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.289+0000 7f79d2d9d640 1 --2- 172.21.15.116:0/1048846716 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f79b406b4d0 0x7f79b406d990 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f79c4036000 tx=0x7f79c403c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:39.283 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.292+0000 7f79cbfff640 1 -- 172.21.15.116:0/1048846716 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f79d40c5350 con 0x7f79d415f5a0 2024-02-21T22:53:39.518 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.528+0000 7f79d91f0640 1 -- 172.21.15.116:0/1048846716 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f79d40cef70 con 0x7f79d415f5a0 2024-02-21T22:53:39.520 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.530+0000 7f79cbfff640 1 -- 172.21.15.116:0/1048846716 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v12) v1 ==== 90+0+0 (secure 0 0 0) 0x7f79d40cef70 con 0x7f79d415f5a0 2024-02-21T22:53:39.524 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.533+0000 7f79d91f0640 1 -- 172.21.15.116:0/1048846716 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f79b406b4d0 msgr2=0x7f79b406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:39.524 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.533+0000 7f79d91f0640 1 --2- 172.21.15.116:0/1048846716 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f79b406b4d0 0x7f79b406d990 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f79c4036000 tx=0x7f79c403c040 comp rx=0 tx=0).stop 2024-02-21T22:53:39.524 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.533+0000 7f79d91f0640 1 -- 172.21.15.116:0/1048846716 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f79d415f5a0 msgr2=0x7f79d4154060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:39.524 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.533+0000 7f79d91f0640 1 --2- 172.21.15.116:0/1048846716 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f79d415f5a0 0x7f79d4154060 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f79cc00c780 tx=0x7f79cc00cc40 comp rx=0 tx=0).stop 2024-02-21T22:53:39.524 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.533+0000 7f79d91f0640 1 -- 172.21.15.116:0/1048846716 shutdown_connections 2024-02-21T22:53:39.524 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.533+0000 7f79d91f0640 1 --2- 172.21.15.116:0/1048846716 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f79d415f5a0 0x7f79d4154060 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:39.524 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.533+0000 7f79d91f0640 1 --2- 172.21.15.116:0/1048846716 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f79b406b4d0 0x7f79b406d990 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:39.524 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.533+0000 7f79d91f0640 1 --2- 172.21.15.116:0/1048846716 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f79d40d0730 0x7f79d40c6360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:39.524 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.533+0000 7f79d91f0640 1 --2- 172.21.15.116:0/1048846716 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f79d40b26d0 0x7f79d40c8640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:39.525 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.533+0000 7f79d91f0640 1 -- 172.21.15.116:0/1048846716 >> 172.21.15.116:0/1048846716 conn(0x7f79d40d1c10 msgr2=0x7f79d40b0ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:39.525 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.533+0000 7f79d91f0640 1 -- 172.21.15.116:0/1048846716 shutdown_connections 2024-02-21T22:53:39.525 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.533+0000 7f79d91f0640 1 -- 172.21.15.116:0/1048846716 wait complete. 2024-02-21T22:53:39.535 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-21T22:53:39.638 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.648+0000 7fc324faa640 1 Processor -- start 2024-02-21T22:53:39.639 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.648+0000 7fc324faa640 1 -- start start 2024-02-21T22:53:39.640 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.649+0000 7fc324faa640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc32006ae40 0x7fc32006b260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:39.640 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.649+0000 7fc324faa640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc3200b0220 0x7fc3200b06b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:39.640 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.649+0000 7fc324faa640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc32006b7a0 con 0x7fc3200afa80 2024-02-21T22:53:39.640 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.649+0000 7fc324faa640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3200b5500 con 0x7fc3200b0220 2024-02-21T22:53:39.640 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.649+0000 7fc324faa640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3200b0bf0 con 0x7fc32006ae40 2024-02-21T22:53:39.640 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.649+0000 7fc31e59c640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7fc3200afa80 0x7fc3200b5990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:54194/0 (socket says 172.21.15.116:54194) 2024-02-21T22:53:39.640 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.649+0000 7fc31e59c640 1 -- 172.21.15.116:0/1939823393 learned_addr learned my addr 172.21.15.116:0/1939823393 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-02-21T22:53:39.641 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.649+0000 7fc31ed9d640 1 --2- 172.21.15.116:0/1939823393 >> v2:172.21.15.142:3300/0 conn(0x7fc3200b0220 0x7fc3200b06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:39.641 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.649+0000 7fc317fff640 1 --2- 172.21.15.116:0/1939823393 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc32006ae40 0x7fc32006b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:39.641 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.649+0000 7fc31dd9b640 1 -- 172.21.15.116:0/1939823393 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1426091606 0 0) 0x7fc32006b7a0 con 0x7fc3200afa80 2024-02-21T22:53:39.641 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.649+0000 7fc31dd9b640 1 -- 172.21.15.116:0/1939823393 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc30c003520 con 0x7fc3200afa80 2024-02-21T22:53:39.641 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.649+0000 7fc31ed9d640 1 -- 172.21.15.116:0/1939823393 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc32006ae40 msgr2=0x7fc32006b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:53:39.641 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.649+0000 7fc31dd9b640 1 -- 172.21.15.116:0/1939823393 <== mon.0 v1:172.21.15.116:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 902389766 0 0) 0x7fc30c003520 con 0x7fc3200afa80 2024-02-21T22:53:39.641 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.649+0000 7fc31ed9d640 1 --2- 172.21.15.116:0/1939823393 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc32006ae40 0x7fc32006b260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:39.641 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.649+0000 7fc31ed9d640 1 -- 172.21.15.116:0/1939823393 >> v1:172.21.15.116:6789/0 conn(0x7fc3200afa80 legacy=0x7fc3200b5990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:39.641 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.649+0000 7fc31ed9d640 1 -- 172.21.15.116:0/1939823393 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3200afe60 con 0x7fc3200b0220 2024-02-21T22:53:39.641 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.650+0000 7fc31ed9d640 1 --2- 172.21.15.116:0/1939823393 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc3200b0220 0x7fc3200b06b0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fc318009d90 tx=0x7fc31802bd70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1dcf94915707c6ca server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:39.643 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.650+0000 7fc31dd9b640 1 -- 172.21.15.116:0/1939823393 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc318039070 con 0x7fc3200b0220 2024-02-21T22:53:39.643 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.650+0000 7fc31dd9b640 1 -- 172.21.15.116:0/1939823393 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc31802c8a0 con 0x7fc3200b0220 2024-02-21T22:53:39.643 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.650+0000 7fc31dd9b640 1 -- 172.21.15.116:0/1939823393 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc310001670 con 0x7fc3200b0220 2024-02-21T22:53:39.643 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.651+0000 7fc324faa640 1 -- 172.21.15.116:0/1939823393 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc3200b0220 msgr2=0x7fc3200b06b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:39.643 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.651+0000 7fc324faa640 1 --2- 172.21.15.116:0/1939823393 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc3200b0220 0x7fc3200b06b0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fc318009d90 tx=0x7fc31802bd70 comp rx=0 tx=0).stop 2024-02-21T22:53:39.643 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.651+0000 7fc324faa640 1 -- 172.21.15.116:0/1939823393 shutdown_connections 2024-02-21T22:53:39.643 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.651+0000 7fc324faa640 1 --2- 172.21.15.116:0/1939823393 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc3200b0220 0x7fc3200b06b0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:39.643 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.651+0000 7fc324faa640 1 --2- 172.21.15.116:0/1939823393 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc32006ae40 0x7fc32006b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:39.643 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.651+0000 7fc324faa640 1 -- 172.21.15.116:0/1939823393 >> 172.21.15.116:0/1939823393 conn(0x7fc3200724f0 msgr2=0x7fc320072900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:39.643 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.651+0000 7fc324faa640 1 -- 172.21.15.116:0/1939823393 shutdown_connections 2024-02-21T22:53:39.643 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.651+0000 7fc324faa640 1 -- 172.21.15.116:0/1939823393 wait complete. 2024-02-21T22:53:39.643 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.652+0000 7fc324faa640 1 Processor -- start 2024-02-21T22:53:39.643 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.652+0000 7fc324faa640 1 -- start start 2024-02-21T22:53:39.645 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.653+0000 7fc324faa640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc32006ae40 0x7fc320099920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:39.645 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.653+0000 7fc324faa640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc3200afa80 0x7fc32014a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:39.646 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.653+0000 7fc324faa640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc3200b0220 0x7fc32015d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:39.646 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.653+0000 7fc324faa640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3200b5190 con 0x7fc3200b0220 2024-02-21T22:53:39.646 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.653+0000 7fc324faa640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc32015f7f0 con 0x7fc32006ae40 2024-02-21T22:53:39.646 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.653+0000 7fc324faa640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3200b60a0 con 0x7fc3200afa80 2024-02-21T22:53:39.646 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.653+0000 7fc31ed9d640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc3200b0220 0x7fc32015d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:39.646 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.653+0000 7fc31ed9d640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc3200b0220 0x7fc32015d010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:38038/0 (socket says 172.21.15.116:38038) 2024-02-21T22:53:39.646 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.653+0000 7fc31ed9d640 1 -- 172.21.15.116:0/720686131 learned_addr learned my addr 172.21.15.116:0/720686131 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:39.646 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.653+0000 7fc31e59c640 1 --2- 172.21.15.116:0/720686131 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc32006ae40 0x7fc320099920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:39.646 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.653+0000 7fc317fff640 1 --2- 172.21.15.116:0/720686131 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc3200afa80 0x7fc32014a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:39.646 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.653+0000 7fc31ed9d640 1 -- 172.21.15.116:0/720686131 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc3200afa80 msgr2=0x7fc32014a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:39.646 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.653+0000 7fc31ed9d640 1 --2- 172.21.15.116:0/720686131 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc3200afa80 0x7fc32014a8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:39.646 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.653+0000 7fc31ed9d640 1 -- 172.21.15.116:0/720686131 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc32006ae40 msgr2=0x7fc320099920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:39.646 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.653+0000 7fc31ed9d640 1 --2- 172.21.15.116:0/720686131 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc32006ae40 0x7fc320099920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:39.646 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.653+0000 7fc31ed9d640 1 -- 172.21.15.116:0/720686131 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc320099e60 con 0x7fc3200b0220 2024-02-21T22:53:39.647 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.654+0000 7fc31ed9d640 1 --2- 172.21.15.116:0/720686131 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc3200b0220 0x7fc32015d010 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fc318009d90 tx=0x7fc318004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:39.647 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.654+0000 7fc316ffd640 1 -- 172.21.15.116:0/720686131 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc318039050 con 0x7fc3200b0220 2024-02-21T22:53:39.647 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.654+0000 7fc316ffd640 1 -- 172.21.15.116:0/720686131 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc318045070 con 0x7fc3200b0220 2024-02-21T22:53:39.647 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.654+0000 7fc324faa640 1 -- 172.21.15.116:0/720686131 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc32009c4c0 con 0x7fc3200b0220 2024-02-21T22:53:39.647 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.654+0000 7fc316ffd640 1 -- 172.21.15.116:0/720686131 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc318009450 con 0x7fc3200b0220 2024-02-21T22:53:39.647 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.654+0000 7fc324faa640 1 -- 172.21.15.116:0/720686131 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc32009ca80 con 0x7fc3200b0220 2024-02-21T22:53:39.647 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.655+0000 7fc324faa640 1 -- 172.21.15.116:0/720686131 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3200752f0 con 0x7fc3200b0220 2024-02-21T22:53:39.647 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.655+0000 7fc316ffd640 1 -- 172.21.15.116:0/720686131 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fc318040690 con 0x7fc3200b0220 2024-02-21T22:53:39.648 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.656+0000 7fc316ffd640 1 --2- 172.21.15.116:0/720686131 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fc30006b4d0 0x7fc30006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:39.648 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.656+0000 7fc316ffd640 1 -- 172.21.15.116:0/720686131 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fc3180ac5a0 con 0x7fc3200b0220 2024-02-21T22:53:39.648 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.656+0000 7fc31e59c640 1 --2- 172.21.15.116:0/720686131 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fc30006b4d0 0x7fc30006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:39.648 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.656+0000 7fc31e59c640 1 --2- 172.21.15.116:0/720686131 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fc30006b4d0 0x7fc30006d990 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fc3100013c0 tx=0x7fc310001350 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:39.650 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.660+0000 7fc316ffd640 1 -- 172.21.15.116:0/720686131 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7fc3200afe60 con 0x7fc3200b0220 2024-02-21T22:53:39.823 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.833+0000 7fc324faa640 1 -- 172.21.15.116:0/720686131 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc3200b5cd0 con 0x7fc3200b0220 2024-02-21T22:53:39.824 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.834+0000 7fc316ffd640 1 -- 172.21.15.116:0/720686131 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+12939 (secure 0 0 0) 0x7fc31807b120 con 0x7fc3200b0220 2024-02-21T22:53:39.824 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-02-21T22:53:39.825 INFO:teuthology.orchestra.run.smithi116.stdout:{"epoch":29,"fsid":"7c298660-5f63-4b5c-a800-58c5be9a8445","created":"2024-02-21T22:52:25.994613+0000","modified":"2024-02-21T22:53:36.977927+0000","last_up_change":"2024-02-21T22:52:37.313595+0000","last_in_change":"2024-02-21T22:52:28.176031+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-21T22:52:38.328796+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4f09126b-b5e4-4876-8b08-f5cbb967388a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":1613202231},{"type":"v1","addr":"172.21.15.116:6809","nonce":1613202231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":1613202231},{"type":"v1","addr":"172.21.15.116:6811","nonce":1613202231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":1613202231},{"type":"v1","addr":"172.21.15.116:6815","nonce":1613202231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":1613202231},{"type":"v1","addr":"172.21.15.116:6813","nonce":1613202231}]},"public_addr":"172.21.15.116:6809/1613202231","cluster_addr":"172.21.15.116:6811/1613202231","heartbeat_back_addr":"172.21.15.116:6815/1613202231","heartbeat_front_addr":"172.21.15.116:6813/1613202231","state":["exists","up"]},{"osd":1,"uuid":"7272c51d-51f9-4536-931d-33ad7a4b377e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6816","nonce":172614746},{"type":"v1","addr":"172.21.15.116:6817","nonce":172614746}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":172614746},{"type":"v1","addr":"172.21.15.116:6819","nonce":172614746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":172614746},{"type":"v1","addr":"172.21.15.116:6823","nonce":172614746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":172614746},{"type":"v1","addr":"172.21.15.116:6821","nonce":172614746}]},"public_addr":"172.21.15.116:6817/172614746","cluster_addr":"172.21.15.116:6819/172614746","heartbeat_back_addr":"172.21.15.116:6823/172614746","heartbeat_front_addr":"172.21.15.116:6821/172614746","state":["exists","up"]},{"osd":2,"uuid":"2589616c-adf1-4187-aac3-735256cf624b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":1029280577},{"type":"v1","addr":"172.21.15.116:6825","nonce":1029280577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":1029280577},{"type":"v1","addr":"172.21.15.116:6827","nonce":1029280577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":1029280577},{"type":"v1","addr":"172.21.15.116:6831","nonce":1029280577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":1029280577},{"type":"v1","addr":"172.21.15.116:6829","nonce":1029280577}]},"public_addr":"172.21.15.116:6825/1029280577","cluster_addr":"172.21.15.116:6827/1029280577","heartbeat_back_addr":"172.21.15.116:6831/1029280577","heartbeat_front_addr":"172.21.15.116:6829/1029280577","state":["exists","up"]},{"osd":3,"uuid":"0fd2e563-7c5b-46f6-82c2-b60c86072c93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":3106627557},{"type":"v1","addr":"172.21.15.116:6801","nonce":3106627557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":3106627557},{"type":"v1","addr":"172.21.15.116:6803","nonce":3106627557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":3106627557},{"type":"v1","addr":"172.21.15.116:6807","nonce":3106627557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":3106627557},{"type":"v1","addr":"172.21.15.116:6805","nonce":3106627557}]},"public_addr":"172.21.15.116:6801/3106627557","cluster_addr":"172.21.15.116:6803/3106627557","heartbeat_back_addr":"172.21.15.116:6807/3106627557","heartbeat_front_addr":"172.21.15.116:6805/3106627557","state":["exists","up"]},{"osd":4,"uuid":"79ae35b7-dda8-4ab8-96ce-47515afde082","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":3231407772},{"type":"v1","addr":"172.21.15.142:6825","nonce":3231407772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":3231407772},{"type":"v1","addr":"172.21.15.142:6827","nonce":3231407772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":3231407772},{"type":"v1","addr":"172.21.15.142:6831","nonce":3231407772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":3231407772},{"type":"v1","addr":"172.21.15.142:6829","nonce":3231407772}]},"public_addr":"172.21.15.142:6825/3231407772","cluster_addr":"172.21.15.142:6827/3231407772","heartbeat_back_addr":"172.21.15.142:6831/3231407772","heartbeat_front_addr":"172.21.15.142:6829/3231407772","state":["exists","up"]},{"osd":5,"uuid":"3166eb2c-3fcf-41c8-9362-45bafaabaa39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":1184158716},{"type":"v1","addr":"172.21.15.142:6817","nonce":1184158716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":1184158716},{"type":"v1","addr":"172.21.15.142:6819","nonce":1184158716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":1184158716},{"type":"v1","addr":"172.21.15.142:6823","nonce":1184158716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":1184158716},{"type":"v1","addr":"172.21.15.142:6821","nonce":1184158716}]},"public_addr":"172.21.15.142:6817/1184158716","cluster_addr":"172.21.15.142:6819/1184158716","heartbeat_back_addr":"172.21.15.142:6823/1184158716","heartbeat_front_addr":"172.21.15.142:6821/1184158716","state":["exists","up"]},{"osd":6,"uuid":"f9aa9672-7527-43e2-963e-b61868e5e63f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":1987868911},{"type":"v1","addr":"172.21.15.142:6801","nonce":1987868911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":1987868911},{"type":"v1","addr":"172.21.15.142:6803","nonce":1987868911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":1987868911},{"type":"v1","addr":"172.21.15.142:6807","nonce":1987868911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":1987868911},{"type":"v1","addr":"172.21.15.142:6805","nonce":1987868911}]},"public_addr":"172.21.15.142:6801/1987868911","cluster_addr":"172.21.15.142:6803/1987868911","heartbeat_back_addr":"172.21.15.142:6807/1987868911","heartbeat_front_addr":"172.21.15.142:6805/1987868911","state":["exists","up"]},{"osd":7,"uuid":"7ed29226-fc42-4382-a91a-fa50f7ec5426","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":1272081937},{"type":"v1","addr":"172.21.15.142:6809","nonce":1272081937}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":1272081937},{"type":"v1","addr":"172.21.15.142:6811","nonce":1272081937}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":1272081937},{"type":"v1","addr":"172.21.15.142:6815","nonce":1272081937}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":1272081937},{"type":"v1","addr":"172.21.15.142:6813","nonce":1272081937}]},"public_addr":"172.21.15.142:6809/1272081937","cluster_addr":"172.21.15.142:6811/1272081937","heartbeat_back_addr":"172.21.15.142:6815/1272081937","heartbeat_front_addr":"172.21.15.142:6813/1272081937","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.350998+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.307201+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.289112+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.243888+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.312091+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.370472+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.275659+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.289297+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-21T22:53:39.827 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.836+0000 7fc324faa640 1 -- 172.21.15.116:0/720686131 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fc30006b4d0 msgr2=0x7fc30006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:39.827 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.836+0000 7fc324faa640 1 --2- 172.21.15.116:0/720686131 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fc30006b4d0 0x7fc30006d990 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fc3100013c0 tx=0x7fc310001350 comp rx=0 tx=0).stop 2024-02-21T22:53:39.827 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.836+0000 7fc324faa640 1 -- 172.21.15.116:0/720686131 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc3200b0220 msgr2=0x7fc32015d010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:39.827 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.836+0000 7fc324faa640 1 --2- 172.21.15.116:0/720686131 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc3200b0220 0x7fc32015d010 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fc318009d90 tx=0x7fc318004a40 comp rx=0 tx=0).stop 2024-02-21T22:53:39.827 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.836+0000 7fc324faa640 1 -- 172.21.15.116:0/720686131 shutdown_connections 2024-02-21T22:53:39.827 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.836+0000 7fc324faa640 1 --2- 172.21.15.116:0/720686131 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc3200b0220 0x7fc32015d010 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:39.827 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.836+0000 7fc324faa640 1 --2- 172.21.15.116:0/720686131 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fc30006b4d0 0x7fc30006d990 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:39.827 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.836+0000 7fc324faa640 1 --2- 172.21.15.116:0/720686131 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc3200afa80 0x7fc32014a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:39.827 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.836+0000 7fc324faa640 1 --2- 172.21.15.116:0/720686131 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc32006ae40 0x7fc320099920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:39.827 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.836+0000 7fc324faa640 1 -- 172.21.15.116:0/720686131 >> 172.21.15.116:0/720686131 conn(0x7fc3200724f0 msgr2=0x7fc32006d1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:39.828 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.836+0000 7fc324faa640 1 -- 172.21.15.116:0/720686131 shutdown_connections 2024-02-21T22:53:39.828 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.836+0000 7fc324faa640 1 -- 172.21.15.116:0/720686131 wait complete. 2024-02-21T22:53:39.837 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-21T22:52:38.328796+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-21T22:53:39.838 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-21T22:53:39.941 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.950+0000 7ff57df88640 1 Processor -- start 2024-02-21T22:53:39.941 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.951+0000 7ff57df88640 1 -- start start 2024-02-21T22:53:39.942 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.951+0000 7ff57df88640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff5780d2b10 0x7ff5780d4940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:39.942 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.951+0000 7ff57df88640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7ff57815da70 0x7ff57815dee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:39.942 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.951+0000 7ff57df88640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5780ceea0 con 0x7ff5780d0ca0 2024-02-21T22:53:39.943 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.951+0000 7ff57df88640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5780cf180 con 0x7ff57815da70 2024-02-21T22:53:39.943 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.951+0000 7ff57df88640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5780cf460 con 0x7ff5780d2b10 2024-02-21T22:53:39.943 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.951+0000 7ff577fff640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7ff57815da70 0x7ff57815dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:39.943 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.952+0000 7ff5777fe640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7ff5780d0ca0 0x7ff5780d2400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:54198/0 (socket says 172.21.15.116:54198) 2024-02-21T22:53:39.943 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.952+0000 7ff5777fe640 1 -- 172.21.15.116:0/1635907113 learned_addr learned my addr 172.21.15.116:0/1635907113 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-02-21T22:53:39.943 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.952+0000 7ff577fff640 1 -- 172.21.15.116:0/1635907113 >> v2:172.21.15.142:3300/0 conn(0x7ff5780d2b10 msgr2=0x7ff5780d4940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:53:39.943 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.952+0000 7ff577fff640 1 --2- 172.21.15.116:0/1635907113 >> v2:172.21.15.142:3300/0 conn(0x7ff5780d2b10 0x7ff5780d4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:39.943 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.952+0000 7ff577fff640 1 -- 172.21.15.116:0/1635907113 >> v1:172.21.15.116:6789/0 conn(0x7ff5780d0ca0 legacy=0x7ff5780d2400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:39.943 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.952+0000 7ff577fff640 1 -- 172.21.15.116:0/1635907113 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5780cf740 con 0x7ff57815da70 2024-02-21T22:53:39.943 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.952+0000 7ff5767fc640 1 -- 172.21.15.116:0/1635907113 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1700902382 0 0) 0x7ff5780ceea0 con 0x7ff5780d0ca0 2024-02-21T22:53:39.944 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.952+0000 7ff577fff640 1 --2- 172.21.15.116:0/1635907113 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff57815da70 0x7ff57815dee0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7ff57808c5d0 tx=0x7ff57002bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1eb8f22d0563aad2 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:39.945 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.953+0000 7ff5767fc640 1 -- 172.21.15.116:0/1635907113 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff570039070 con 0x7ff57815da70 2024-02-21T22:53:39.945 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.953+0000 7ff5767fc640 1 -- 172.21.15.116:0/1635907113 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff57002cd00 con 0x7ff57815da70 2024-02-21T22:53:39.945 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.953+0000 7ff5767fc640 1 -- 172.21.15.116:0/1635907113 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff570034660 con 0x7ff57815da70 2024-02-21T22:53:39.945 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.953+0000 7ff57df88640 1 -- 172.21.15.116:0/1635907113 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff57815da70 msgr2=0x7ff57815dee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:39.945 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.953+0000 7ff57df88640 1 --2- 172.21.15.116:0/1635907113 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff57815da70 0x7ff57815dee0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7ff57808c5d0 tx=0x7ff57002bf50 comp rx=0 tx=0).stop 2024-02-21T22:53:39.945 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.953+0000 7ff57df88640 1 -- 172.21.15.116:0/1635907113 shutdown_connections 2024-02-21T22:53:39.945 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.953+0000 7ff57df88640 1 --2- 172.21.15.116:0/1635907113 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff57815da70 0x7ff57815dee0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:39.945 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.953+0000 7ff57df88640 1 --2- 172.21.15.116:0/1635907113 >> v2:172.21.15.142:3300/0 conn(0x7ff5780d2b10 0x7ff5780d4940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:39.945 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.953+0000 7ff57df88640 1 -- 172.21.15.116:0/1635907113 >> 172.21.15.116:0/1635907113 conn(0x7ff5780d3e20 msgr2=0x7ff5780d4230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:39.945 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.953+0000 7ff57df88640 1 -- 172.21.15.116:0/1635907113 shutdown_connections 2024-02-21T22:53:39.945 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.953+0000 7ff57df88640 1 -- 172.21.15.116:0/1635907113 wait complete. 2024-02-21T22:53:39.945 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.954+0000 7ff57df88640 1 Processor -- start 2024-02-21T22:53:39.948 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.955+0000 7ff57df88640 1 -- start start 2024-02-21T22:53:39.948 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.955+0000 7ff57df88640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff5780d0ca0 0x7ff5781584a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:39.948 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.955+0000 7ff57df88640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff5780d2b10 0x7ff57806c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:39.948 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.955+0000 7ff57df88640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff57815da70 0x7ff57806cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:39.948 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.955+0000 7ff57df88640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5780d1200 con 0x7ff5780d2b10 2024-02-21T22:53:39.948 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.955+0000 7ff57df88640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5780d1080 con 0x7ff57815da70 2024-02-21T22:53:39.948 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.955+0000 7ff57df88640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5780ceaa0 con 0x7ff5780d0ca0 2024-02-21T22:53:39.948 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.955+0000 7ff576ffd640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff5780d2b10 0x7ff57806c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:39.948 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.956+0000 7ff576ffd640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff5780d2b10 0x7ff57806c6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:38056/0 (socket says 172.21.15.116:38056) 2024-02-21T22:53:39.948 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.956+0000 7ff576ffd640 1 -- 172.21.15.116:0/1429965769 learned_addr learned my addr 172.21.15.116:0/1429965769 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:39.948 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.956+0000 7ff577fff640 1 --2- 172.21.15.116:0/1429965769 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff57815da70 0x7ff57806cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:39.948 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.956+0000 7ff5777fe640 1 --2- 172.21.15.116:0/1429965769 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff5780d0ca0 0x7ff5781584a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:39.949 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.956+0000 7ff576ffd640 1 -- 172.21.15.116:0/1429965769 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff5780d0ca0 msgr2=0x7ff5781584a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:39.949 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.956+0000 7ff576ffd640 1 --2- 172.21.15.116:0/1429965769 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff5780d0ca0 0x7ff5781584a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:39.949 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.956+0000 7ff576ffd640 1 -- 172.21.15.116:0/1429965769 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff57815da70 msgr2=0x7ff57806cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:39.949 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.956+0000 7ff576ffd640 1 --2- 172.21.15.116:0/1429965769 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff57815da70 0x7ff57806cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:39.949 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.956+0000 7ff576ffd640 1 -- 172.21.15.116:0/1429965769 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff578159830 con 0x7ff5780d2b10 2024-02-21T22:53:39.949 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.956+0000 7ff576ffd640 1 --2- 172.21.15.116:0/1429965769 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff5780d2b10 0x7ff57806c6d0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7ff56c00b4a0 tx=0x7ff56c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:39.949 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.956+0000 7ff55ffff640 1 -- 172.21.15.116:0/1429965769 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff56c014070 con 0x7ff5780d2b10 2024-02-21T22:53:39.949 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.956+0000 7ff55ffff640 1 -- 172.21.15.116:0/1429965769 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff56c010610 con 0x7ff5780d2b10 2024-02-21T22:53:39.949 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.956+0000 7ff57df88640 1 -- 172.21.15.116:0/1429965769 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff578159b10 con 0x7ff5780d2b10 2024-02-21T22:53:39.949 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.956+0000 7ff55ffff640 1 -- 172.21.15.116:0/1429965769 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff56c010a00 con 0x7ff5780d2b10 2024-02-21T22:53:39.949 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.956+0000 7ff57df88640 1 -- 172.21.15.116:0/1429965769 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff57815a0d0 con 0x7ff5780d2b10 2024-02-21T22:53:39.949 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.957+0000 7ff57df88640 1 -- 172.21.15.116:0/1429965769 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5780d3070 con 0x7ff5780d2b10 2024-02-21T22:53:39.949 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.958+0000 7ff55ffff640 1 -- 172.21.15.116:0/1429965769 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ff56c017070 con 0x7ff5780d2b10 2024-02-21T22:53:39.950 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.958+0000 7ff55ffff640 1 --2- 172.21.15.116:0/1429965769 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7ff56406b4d0 0x7ff56406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:39.950 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.958+0000 7ff55ffff640 1 -- 172.21.15.116:0/1429965769 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7ff56c089760 con 0x7ff5780d2b10 2024-02-21T22:53:39.950 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.958+0000 7ff5777fe640 1 --2- 172.21.15.116:0/1429965769 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7ff56406b4d0 0x7ff56406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:39.950 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.959+0000 7ff5777fe640 1 --2- 172.21.15.116:0/1429965769 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7ff56406b4d0 0x7ff56406d990 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ff568000f60 tx=0x7ff568007d50 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:39.952 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:39.962+0000 7ff55ffff640 1 -- 172.21.15.116:0/1429965769 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7ff5780d3070 con 0x7ff5780d2b10 2024-02-21T22:53:40.125 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:40.134+0000 7ff57df88640 1 -- 172.21.15.116:0/1429965769 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff5780752f0 con 0x7ff5780d2b10 2024-02-21T22:53:40.125 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:40.135+0000 7ff55ffff640 1 -- 172.21.15.116:0/1429965769 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff56c058370 con 0x7ff5780d2b10 2024-02-21T22:53:40.126 INFO:teuthology.orchestra.run.smithi116.stdout:pg_num: 1 2024-02-21T22:53:40.127 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:40.136+0000 7ff57df88640 1 -- 172.21.15.116:0/1429965769 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7ff56406b4d0 msgr2=0x7ff56406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:40.128 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:40.136+0000 7ff57df88640 1 --2- 172.21.15.116:0/1429965769 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7ff56406b4d0 0x7ff56406d990 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ff568000f60 tx=0x7ff568007d50 comp rx=0 tx=0).stop 2024-02-21T22:53:40.128 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:40.136+0000 7ff57df88640 1 -- 172.21.15.116:0/1429965769 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff5780d2b10 msgr2=0x7ff57806c6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:40.128 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:40.136+0000 7ff57df88640 1 --2- 172.21.15.116:0/1429965769 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff5780d2b10 0x7ff57806c6d0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7ff56c00b4a0 tx=0x7ff56c00b960 comp rx=0 tx=0).stop 2024-02-21T22:53:40.128 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:40.137+0000 7ff57df88640 1 -- 172.21.15.116:0/1429965769 shutdown_connections 2024-02-21T22:53:40.128 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:40.137+0000 7ff57df88640 1 --2- 172.21.15.116:0/1429965769 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff57815da70 0x7ff57806cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:40.128 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:40.137+0000 7ff57df88640 1 --2- 172.21.15.116:0/1429965769 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff5780d2b10 0x7ff57806c6d0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:40.128 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:40.137+0000 7ff57df88640 1 --2- 172.21.15.116:0/1429965769 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7ff56406b4d0 0x7ff56406d990 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:40.128 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:40.137+0000 7ff57df88640 1 --2- 172.21.15.116:0/1429965769 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff5780d0ca0 0x7ff5781584a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:40.129 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:40.137+0000 7ff57df88640 1 -- 172.21.15.116:0/1429965769 >> 172.21.15.116:0/1429965769 conn(0x7ff5780d3e20 msgr2=0x7ff5780d2400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:40.129 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:40.137+0000 7ff57df88640 1 -- 172.21.15.116:0/1429965769 shutdown_connections 2024-02-21T22:53:40.129 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:40.137+0000 7ff57df88640 1 -- 172.21.15.116:0/1429965769 wait complete. 2024-02-21T22:53:40.138 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-02-21T22:53:40.238 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:40.248+0000 7f3927755640 1 Processor -- start 2024-02-21T22:53:40.239 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:40.248+0000 7f3927755640 1 -- start start 2024-02-21T22:53:40.240 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:40.249+0000 7f3927755640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3920145210 0x7f3920070fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:40.240 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:40.249+0000 7f3927755640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f392006c8f0 0x7f3920071500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:40.241 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:40.249+0000 7f3927755640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f392015feb0 con 0x7f392015f9b0 2024-02-21T22:53:40.241 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:40.249+0000 7f3927755640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3920160190 con 0x7f392006c8f0 2024-02-21T22:53:40.241 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:40.249+0000 7f3927755640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3920160470 con 0x7f3920145210 2024-02-21T22:53:40.241 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:40.249+0000 7f3924cf0640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f392006c8f0 0x7f3920071500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:40.241 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:40.249+0000 7f3925cf2640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f392015f9b0 0x7f39200ae620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:54200/0 (socket says 172.21.15.116:54200) 2024-02-21T22:53:40.241 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:40.249+0000 7f3925cf2640 1 -- 172.21.15.116:0/1979086609 learned_addr learned my addr 172.21.15.116:0/1979086609 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-02-21T22:53:40.241 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:40.249+0000 7f3924cf0640 1 -- 172.21.15.116:0/1979086609 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3920145210 msgr2=0x7f3920070fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:53:40.241 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:40.249+0000 7f3924cf0640 1 --2- 172.21.15.116:0/1979086609 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3920145210 0x7f3920070fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:40.241 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:40.249+0000 7f3924cf0640 1 -- 172.21.15.116:0/1979086609 >> v1:172.21.15.116:6789/0 conn(0x7f392015f9b0 legacy=0x7f39200ae620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:40.241 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:40.249+0000 7f3924cf0640 1 -- 172.21.15.116:0/1979086609 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3920160750 con 0x7f392006c8f0 2024-02-21T22:53:40.241 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:40.249+0000 7f3917fff640 1 -- 172.21.15.116:0/1979086609 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2315620084 0 0) 0x7f392015feb0 con 0x7f392015f9b0 2024-02-21T22:53:40.241 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:40.250+0000 7f3924cf0640 1 --2- 172.21.15.116:0/1979086609 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f392006c8f0 0x7f3920071500 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f39100097a0 tx=0x7f391002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc9d6540305266df server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:40.241 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:40.250+0000 7f3917fff640 1 -- 172.21.15.116:0/1979086609 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3910035020 con 0x7f392006c8f0 2024-02-21T22:53:40.241 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:40.250+0000 7f3917fff640 1 -- 172.21.15.116:0/1979086609 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3910031830 con 0x7f392006c8f0 2024-02-21T22:53:40.241 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:40.250+0000 7f3917fff640 1 -- 172.21.15.116:0/1979086609 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3910031c00 con 0x7f392006c8f0 2024-02-21T22:53:40.244 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:40.251+0000 7f3927755640 1 -- 172.21.15.116:0/1979086609 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f392006c8f0 msgr2=0x7f3920071500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:40.244 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:40.251+0000 7f3927755640 1 --2- 172.21.15.116:0/1979086609 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f392006c8f0 0x7f3920071500 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f39100097a0 tx=0x7f391002b8d0 comp rx=0 tx=0).stop 2024-02-21T22:53:40.244 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:40.251+0000 7f3927755640 1 -- 172.21.15.116:0/1979086609 shutdown_connections 2024-02-21T22:53:40.244 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:40.251+0000 7f3927755640 1 --2- 172.21.15.116:0/1979086609 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f392006c8f0 0x7f3920071500 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:40.245 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:40.251+0000 7f3927755640 1 --2- 172.21.15.116:0/1979086609 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3920145210 0x7f3920070fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:40.245 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:40.251+0000 7f3927755640 1 -- 172.21.15.116:0/1979086609 >> 172.21.15.116:0/1979086609 conn(0x7f39200b18e0 msgr2=0x7f39200b1cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:40.245 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:40.251+0000 7f3927755640 1 -- 172.21.15.116:0/1979086609 shutdown_connections 2024-02-21T22:53:40.245 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:40.251+0000 7f3927755640 1 -- 172.21.15.116:0/1979086609 wait complete. 2024-02-21T22:53:40.245 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:40.252+0000 7f3927755640 1 Processor -- start 2024-02-21T22:53:40.245 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:40.252+0000 7f3927755640 1 -- start start 2024-02-21T22:53:40.245 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:40.252+0000 7f3927755640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f392006c8f0 0x7f392013acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:40.245 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:40.253+0000 7f3927755640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3920145210 0x7f392015abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:40.245 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:40.253+0000 7f3927755640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f392015f9b0 0x7f39200ce7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:40.245 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:40.253+0000 7f3927755640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3920071bc0 con 0x7f392015f9b0 2024-02-21T22:53:40.245 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:40.253+0000 7f3927755640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3920071a40 con 0x7f3920145210 2024-02-21T22:53:40.245 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:40.253+0000 7f3927755640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3920071d40 con 0x7f392006c8f0 2024-02-21T22:53:40.246 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:40.253+0000 7f3925cf2640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f392015f9b0 0x7f39200ce7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:40.246 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:40.253+0000 7f3925cf2640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f392015f9b0 0x7f39200ce7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:38080/0 (socket says 172.21.15.116:38080) 2024-02-21T22:53:40.246 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:40.253+0000 7f3925cf2640 1 -- 172.21.15.116:0/611687871 learned_addr learned my addr 172.21.15.116:0/611687871 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:40.246 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:40.253+0000 7f3925cf2640 1 -- 172.21.15.116:0/611687871 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f392006c8f0 msgr2=0x7f392013acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:40.246 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:40.253+0000 7f3925cf2640 1 --2- 172.21.15.116:0/611687871 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f392006c8f0 0x7f392013acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:40.246 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:40.253+0000 7f3925cf2640 1 -- 172.21.15.116:0/611687871 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3920145210 msgr2=0x7f392015abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:40.246 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:40.253+0000 7f3925cf2640 1 --2- 172.21.15.116:0/611687871 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3920145210 0x7f392015abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:40.246 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:40.253+0000 7f3925cf2640 1 -- 172.21.15.116:0/611687871 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f392013b520 con 0x7f392015f9b0 2024-02-21T22:53:40.246 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:40.253+0000 7f3925cf2640 1 --2- 172.21.15.116:0/611687871 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f392015f9b0 0x7f39200ce7d0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f391800c770 tx=0x7f391800cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:40.246 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:40.253+0000 7f3915ffb640 1 -- 172.21.15.116:0/611687871 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3918018070 con 0x7f392015f9b0 2024-02-21T22:53:40.246 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:40.253+0000 7f3915ffb640 1 -- 172.21.15.116:0/611687871 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f391800a640 con 0x7f392015f9b0 2024-02-21T22:53:40.246 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:40.253+0000 7f3927755640 1 -- 172.21.15.116:0/611687871 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f392013b800 con 0x7f392015f9b0 2024-02-21T22:53:40.246 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:40.253+0000 7f3915ffb640 1 -- 172.21.15.116:0/611687871 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f391800aa30 con 0x7f392015f9b0 2024-02-21T22:53:40.246 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:40.253+0000 7f3927755640 1 -- 172.21.15.116:0/611687871 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f392015d9b0 con 0x7f392015f9b0 2024-02-21T22:53:40.247 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:40.254+0000 7f3927755640 1 -- 172.21.15.116:0/611687871 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39200752f0 con 0x7f392015f9b0 2024-02-21T22:53:40.247 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:40.255+0000 7f3915ffb640 1 -- 172.21.15.116:0/611687871 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f391801b070 con 0x7f392015f9b0 2024-02-21T22:53:40.248 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:40.255+0000 7f3915ffb640 1 --2- 172.21.15.116:0/611687871 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f390406b4d0 0x7f390406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:40.248 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:40.255+0000 7f3915ffb640 1 -- 172.21.15.116:0/611687871 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f3918089570 con 0x7f392015f9b0 2024-02-21T22:53:40.248 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:40.255+0000 7f39254f1640 1 --2- 172.21.15.116:0/611687871 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f390406b4d0 0x7f390406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:40.248 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:40.256+0000 7f39254f1640 1 --2- 172.21.15.116:0/611687871 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f390406b4d0 0x7f390406d990 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f391c009670 tx=0x7f391c006bf0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:40.249 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:40.259+0000 7f3915ffb640 1 -- 172.21.15.116:0/611687871 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f39180586b0 con 0x7f392015f9b0 2024-02-21T22:53:40.423 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:40.432+0000 7f3927755640 1 -- 172.21.15.116:0/611687871 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f39200cc340 con 0x7f392015f9b0 2024-02-21T22:53:40.423 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:40.432+0000 7f3915ffb640 1 -- 172.21.15.116:0/611687871 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v29) v1 ==== 84+0+65 (secure 0 0 0) 0x7f3918057fb0 con 0x7f392015f9b0 2024-02-21T22:53:40.423 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-02-21T22:53:40.423 INFO:teuthology.orchestra.run.smithi116.stdout:[ 2024-02-21T22:53:40.424 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-02-21T22:53:40.424 INFO:teuthology.orchestra.run.smithi116.stdout: "poolnum": 1, 2024-02-21T22:53:40.424 INFO:teuthology.orchestra.run.smithi116.stdout: "poolname": ".mgr" 2024-02-21T22:53:40.424 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-02-21T22:53:40.424 INFO:teuthology.orchestra.run.smithi116.stdout:] 2024-02-21T22:53:40.425 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:40.434+0000 7f3927755640 1 -- 172.21.15.116:0/611687871 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f390406b4d0 msgr2=0x7f390406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:40.425 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:40.434+0000 7f3927755640 1 --2- 172.21.15.116:0/611687871 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f390406b4d0 0x7f390406d990 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f391c009670 tx=0x7f391c006bf0 comp rx=0 tx=0).stop 2024-02-21T22:53:40.425 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:40.434+0000 7f3927755640 1 -- 172.21.15.116:0/611687871 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f392015f9b0 msgr2=0x7f39200ce7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:40.425 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:40.434+0000 7f3927755640 1 --2- 172.21.15.116:0/611687871 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f392015f9b0 0x7f39200ce7d0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f391800c770 tx=0x7f391800cc30 comp rx=0 tx=0).stop 2024-02-21T22:53:40.426 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:40.434+0000 7f3927755640 1 -- 172.21.15.116:0/611687871 shutdown_connections 2024-02-21T22:53:40.426 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:40.434+0000 7f3927755640 1 --2- 172.21.15.116:0/611687871 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f392015f9b0 0x7f39200ce7d0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:40.426 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:40.434+0000 7f3927755640 1 --2- 172.21.15.116:0/611687871 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3920145210 0x7f392015abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:40.426 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:40.434+0000 7f3927755640 1 --2- 172.21.15.116:0/611687871 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f390406b4d0 0x7f390406d990 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:40.426 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:40.434+0000 7f3927755640 1 --2- 172.21.15.116:0/611687871 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f392006c8f0 0x7f392013acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:40.426 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:40.434+0000 7f3927755640 1 -- 172.21.15.116:0/611687871 >> 172.21.15.116:0/611687871 conn(0x7f39200b18e0 msgr2=0x7f39200b05b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:40.426 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:40.435+0000 7f3927755640 1 -- 172.21.15.116:0/611687871 shutdown_connections 2024-02-21T22:53:40.426 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:40.435+0000 7f3927755640 1 -- 172.21.15.116:0/611687871 wait complete. 2024-02-21T22:53:40.436 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-02-21T22:53:40.436 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-02-21T22:53:40.540 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:40.549+0000 7fe1910b0640 1 Processor -- start 2024-02-21T22:53:40.540 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:40.549+0000 7fe1910b0640 1 -- start start 2024-02-21T22:53:40.543 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:40.550+0000 7fe1910b0640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fe18c161700 0x7fe18c0d2350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:40.543 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:40.550+0000 7fe1910b0640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe18c161ae0 con 0x7fe18c0d0e40 2024-02-21T22:53:40.543 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:40.550+0000 7fe1910b0640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe18c0d4be0 con 0x7fe18c0d2890 2024-02-21T22:53:40.543 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:40.550+0000 7fe1910b0640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe18c0b3c30 con 0x7fe18c161700 2024-02-21T22:53:40.543 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:40.550+0000 7fe18ad9d640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fe18c161700 0x7fe18c0d2350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:40.543 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:40.550+0000 7fe18a59c640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7fe18c0d0e40 0x7fe18c0b40c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:54206/0 (socket says 172.21.15.116:54206) 2024-02-21T22:53:40.543 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:40.550+0000 7fe18a59c640 1 -- 172.21.15.116:0/1190268387 learned_addr learned my addr 172.21.15.116:0/1190268387 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-02-21T22:53:40.543 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:40.551+0000 7fe18ad9d640 1 -- 172.21.15.116:0/1190268387 >> v1:172.21.15.142:6789/0 conn(0x7fe18c0d2890 legacy=0x7fe18c0b47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:40.543 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:40.551+0000 7fe18ad9d640 1 -- 172.21.15.116:0/1190268387 >> v1:172.21.15.116:6789/0 conn(0x7fe18c0d0e40 legacy=0x7fe18c0b40c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:40.543 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:40.551+0000 7fe18ad9d640 1 -- 172.21.15.116:0/1190268387 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe18c0b3300 con 0x7fe18c161700 2024-02-21T22:53:40.544 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:40.551+0000 7fe189d9b640 1 -- 172.21.15.116:0/1190268387 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3999233632 0 0) 0x7fe180001110 con 0x7fe18c0d0e40 2024-02-21T22:53:40.544 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:40.551+0000 7fe18ad9d640 1 --2- 172.21.15.116:0/1190268387 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe18c161700 0x7fe18c0d2350 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fe17c009d90 tx=0x7fe17c02bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=592d3e286de41347 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:40.544 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:40.552+0000 7fe189d9b640 1 -- 172.21.15.116:0/1190268387 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe17c039070 con 0x7fe18c161700 2024-02-21T22:53:40.544 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:40.552+0000 7fe189d9b640 1 -- 172.21.15.116:0/1190268387 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe17c02cd00 con 0x7fe18c161700 2024-02-21T22:53:40.544 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:40.552+0000 7fe189d9b640 1 -- 172.21.15.116:0/1190268387 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe17c034660 con 0x7fe18c161700 2024-02-21T22:53:40.544 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:40.552+0000 7fe1910b0640 1 -- 172.21.15.116:0/1190268387 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe18c161700 msgr2=0x7fe18c0d2350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:40.544 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:40.552+0000 7fe1910b0640 1 --2- 172.21.15.116:0/1190268387 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe18c161700 0x7fe18c0d2350 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fe17c009d90 tx=0x7fe17c02bf50 comp rx=0 tx=0).stop 2024-02-21T22:53:40.544 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:40.552+0000 7fe1910b0640 1 -- 172.21.15.116:0/1190268387 shutdown_connections 2024-02-21T22:53:40.544 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:40.552+0000 7fe1910b0640 1 --2- 172.21.15.116:0/1190268387 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe18c161700 0x7fe18c0d2350 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:40.544 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:40.552+0000 7fe1910b0640 1 -- 172.21.15.116:0/1190268387 >> 172.21.15.116:0/1190268387 conn(0x7fe18c0d3d70 msgr2=0x7fe18c0d4180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:40.544 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:40.552+0000 7fe1910b0640 1 -- 172.21.15.116:0/1190268387 shutdown_connections 2024-02-21T22:53:40.544 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:40.552+0000 7fe1910b0640 1 -- 172.21.15.116:0/1190268387 wait complete. 2024-02-21T22:53:40.547 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:40.554+0000 7fe1910b0640 1 Processor -- start 2024-02-21T22:53:40.547 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:40.554+0000 7fe1910b0640 1 -- start start 2024-02-21T22:53:40.547 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:40.554+0000 7fe1910b0640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe18c0d0e40 0x7fe18c0c9d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:40.547 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:40.554+0000 7fe1910b0640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe18c0d2890 0x7fe18c0b1d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:40.547 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:40.554+0000 7fe1910b0640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe18c161700 0x7fe18c1f76c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:40.547 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:40.554+0000 7fe1910b0640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe18c0d4890 con 0x7fe18c161700 2024-02-21T22:53:40.547 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:40.554+0000 7fe1910b0640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe18c0b38c0 con 0x7fe18c0d2890 2024-02-21T22:53:40.548 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:40.554+0000 7fe1910b0640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe18c0cf990 con 0x7fe18c0d0e40 2024-02-21T22:53:40.548 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:40.554+0000 7fe18b59e640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe18c161700 0x7fe18c1f76c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:40.548 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:40.554+0000 7fe18b59e640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe18c161700 0x7fe18c1f76c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:38098/0 (socket says 172.21.15.116:38098) 2024-02-21T22:53:40.548 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:40.554+0000 7fe18b59e640 1 -- 172.21.15.116:0/1077272886 learned_addr learned my addr 172.21.15.116:0/1077272886 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:40.548 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:40.555+0000 7fe18a59c640 1 --2- 172.21.15.116:0/1077272886 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe18c0d2890 0x7fe18c0b1d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:40.548 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:40.555+0000 7fe18b59e640 1 -- 172.21.15.116:0/1077272886 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe18c0d0e40 msgr2=0x7fe18c0c9d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:40.548 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:40.555+0000 7fe18ad9d640 1 --2- 172.21.15.116:0/1077272886 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe18c0d0e40 0x7fe18c0c9d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:40.548 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:40.555+0000 7fe18b59e640 1 --2- 172.21.15.116:0/1077272886 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe18c0d0e40 0x7fe18c0c9d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:40.548 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:40.555+0000 7fe18b59e640 1 -- 172.21.15.116:0/1077272886 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe18c0d2890 msgr2=0x7fe18c0b1d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:40.548 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:40.555+0000 7fe18b59e640 1 --2- 172.21.15.116:0/1077272886 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe18c0d2890 0x7fe18c0b1d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:40.548 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:40.555+0000 7fe18b59e640 1 -- 172.21.15.116:0/1077272886 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe18c0cc060 con 0x7fe18c161700 2024-02-21T22:53:40.549 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:40.555+0000 7fe18a59c640 1 --2- 172.21.15.116:0/1077272886 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe18c0d2890 0x7fe18c0b1d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T22:53:40.549 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:40.555+0000 7fe18ad9d640 1 --2- 172.21.15.116:0/1077272886 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe18c0d0e40 0x7fe18c0c9d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T22:53:40.549 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:40.555+0000 7fe18b59e640 1 --2- 172.21.15.116:0/1077272886 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe18c161700 0x7fe18c1f76c0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fe18400c400 tx=0x7fe18400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:40.549 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:40.555+0000 7fe1737fe640 1 -- 172.21.15.116:0/1077272886 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe184017070 con 0x7fe18c161700 2024-02-21T22:53:40.549 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:40.555+0000 7fe1737fe640 1 -- 172.21.15.116:0/1077272886 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1840052d0 con 0x7fe18c161700 2024-02-21T22:53:40.549 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:40.555+0000 7fe1910b0640 1 -- 172.21.15.116:0/1077272886 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe18c0cc340 con 0x7fe18c161700 2024-02-21T22:53:40.549 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:40.555+0000 7fe1737fe640 1 -- 172.21.15.116:0/1077272886 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe184003810 con 0x7fe18c161700 2024-02-21T22:53:40.549 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:40.555+0000 7fe1910b0640 1 -- 172.21.15.116:0/1077272886 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe18c0cc900 con 0x7fe18c161700 2024-02-21T22:53:40.549 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:40.556+0000 7fe1910b0640 1 -- 172.21.15.116:0/1077272886 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe18c0752f0 con 0x7fe18c161700 2024-02-21T22:53:40.549 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:40.556+0000 7fe1737fe640 1 -- 172.21.15.116:0/1077272886 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fe18401a070 con 0x7fe18c161700 2024-02-21T22:53:40.549 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:40.557+0000 7fe1737fe640 1 --2- 172.21.15.116:0/1077272886 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fe17806b4d0 0x7fe17806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:40.549 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:40.557+0000 7fe1737fe640 1 -- 172.21.15.116:0/1077272886 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fe184089230 con 0x7fe18c161700 2024-02-21T22:53:40.550 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:40.557+0000 7fe18ad9d640 1 --2- 172.21.15.116:0/1077272886 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fe17806b4d0 0x7fe17806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:40.550 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:40.558+0000 7fe18ad9d640 1 --2- 172.21.15.116:0/1077272886 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fe17806b4d0 0x7fe17806d990 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fe17c036000 tx=0x7fe17c030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:40.551 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:40.561+0000 7fe1737fe640 1 -- 172.21.15.116:0/1077272886 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7fe184058400 con 0x7fe18c161700 2024-02-21T22:53:40.724 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:40.733+0000 7fe1910b0640 1 -- 172.21.15.116:0/1077272886 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fe18c0c74b0 con 0x7fe18c161700 2024-02-21T22:53:40.961 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:40.970+0000 7fe1737fe640 1 -- 172.21.15.116:0/1077272886 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v30) v1 ==== 138+0+0 (secure 0 0 0) 0x7fe184057d00 con 0x7fe18c161700 2024-02-21T22:53:40.961 INFO:teuthology.orchestra.run.smithi116.stderr:pool 'cephfs_metadata' created 2024-02-21T22:53:40.963 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:40.973+0000 7fe1910b0640 1 -- 172.21.15.116:0/1077272886 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fe17806b4d0 msgr2=0x7fe17806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:40.964 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:40.973+0000 7fe1910b0640 1 --2- 172.21.15.116:0/1077272886 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fe17806b4d0 0x7fe17806d990 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fe17c036000 tx=0x7fe17c030000 comp rx=0 tx=0).stop 2024-02-21T22:53:40.964 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:40.973+0000 7fe1910b0640 1 -- 172.21.15.116:0/1077272886 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe18c161700 msgr2=0x7fe18c1f76c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:40.964 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:40.973+0000 7fe1910b0640 1 --2- 172.21.15.116:0/1077272886 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe18c161700 0x7fe18c1f76c0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fe18400c400 tx=0x7fe18400c8c0 comp rx=0 tx=0).stop 2024-02-21T22:53:40.964 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:40.973+0000 7fe1910b0640 1 -- 172.21.15.116:0/1077272886 shutdown_connections 2024-02-21T22:53:40.964 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:40.973+0000 7fe1910b0640 1 --2- 172.21.15.116:0/1077272886 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe18c161700 0x7fe18c1f76c0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:40.964 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:40.973+0000 7fe1910b0640 1 --2- 172.21.15.116:0/1077272886 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe18c0d2890 0x7fe18c0b1d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:40.964 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:40.973+0000 7fe1910b0640 1 --2- 172.21.15.116:0/1077272886 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fe17806b4d0 0x7fe17806d990 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:40.964 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:40.973+0000 7fe1910b0640 1 --2- 172.21.15.116:0/1077272886 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe18c0d0e40 0x7fe18c0c9d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:40.964 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:40.973+0000 7fe1910b0640 1 -- 172.21.15.116:0/1077272886 >> 172.21.15.116:0/1077272886 conn(0x7fe18c0d3d70 msgr2=0x7fe18c06ce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:40.964 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:40.973+0000 7fe1910b0640 1 -- 172.21.15.116:0/1077272886 shutdown_connections 2024-02-21T22:53:40.964 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:40.973+0000 7fe1910b0640 1 -- 172.21.15.116:0/1077272886 wait complete. 2024-02-21T22:53:40.977 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-02-21T22:53:41.085 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:41.094+0000 7fd455bed640 1 Processor -- start 2024-02-21T22:53:41.085 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:41.095+0000 7fd455bed640 1 -- start start 2024-02-21T22:53:41.090 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:41.095+0000 7fd455bed640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd45015e120 0x7fd4500d22f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:41.090 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:41.095+0000 7fd455bed640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4500d1e60 con 0x7fd4500d48c0 2024-02-21T22:53:41.090 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:41.095+0000 7fd455bed640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4500b35a0 con 0x7fd45015e500 2024-02-21T22:53:41.090 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:41.095+0000 7fd455bed640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4500d1720 con 0x7fd45015e120 2024-02-21T22:53:41.090 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:41.095+0000 7fd44ffff640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7fd4500d48c0 0x7fd4500b4790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:54220/0 (socket says 172.21.15.116:54220) 2024-02-21T22:53:41.090 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:41.095+0000 7fd44ffff640 1 -- 172.21.15.116:0/3839660007 learned_addr learned my addr 172.21.15.116:0/3839660007 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-02-21T22:53:41.090 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:41.096+0000 7fd44f7fe640 1 --2- 172.21.15.116:0/3839660007 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd45015e120 0x7fd4500d22f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:41.090 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:41.096+0000 7fd44e7fc640 1 -- 172.21.15.116:0/3839660007 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3009743136 0 0) 0x7fd4500d1e60 con 0x7fd4500d48c0 2024-02-21T22:53:41.091 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:41.096+0000 7fd44e7fc640 1 -- 172.21.15.116:0/3839660007 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd438003520 con 0x7fd4500d48c0 2024-02-21T22:53:41.091 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:41.096+0000 7fd44e7fc640 1 -- 172.21.15.116:0/3839660007 <== mon.0 v1:172.21.15.116:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2794473918 0 0) 0x7fd438003520 con 0x7fd4500d48c0 2024-02-21T22:53:41.091 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:41.096+0000 7fd44e7fc640 1 -- 172.21.15.116:0/3839660007 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd45015e120 msgr2=0x7fd4500d22f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:53:41.091 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:41.096+0000 7fd44e7fc640 1 --2- 172.21.15.116:0/3839660007 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd45015e120 0x7fd4500d22f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:41.091 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:41.096+0000 7fd44e7fc640 1 -- 172.21.15.116:0/3839660007 >> v1:172.21.15.142:6789/0 conn(0x7fd45015e500 legacy=0x7fd4500b4080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:41.091 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:41.096+0000 7fd44e7fc640 1 -- 172.21.15.116:0/3839660007 --> v1:172.21.15.116:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4500b3880 con 0x7fd4500d48c0 2024-02-21T22:53:41.091 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:41.096+0000 7fd44e7fc640 1 -- 172.21.15.116:0/3839660007 <== mon.0 v1:172.21.15.116:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1101981580 0 0) 0x7fd4480019f0 con 0x7fd4500d48c0 2024-02-21T22:53:41.092 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:41.096+0000 7fd44e7fc640 1 -- 172.21.15.116:0/3839660007 >> v1:172.21.15.116:6789/0 conn(0x7fd4500d48c0 legacy=0x7fd4500b4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:41.092 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:41.096+0000 7fd44e7fc640 1 --2- 172.21.15.116:0/3839660007 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd45015e120 0x7fd4380039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:41.092 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:41.096+0000 7fd44e7fc640 1 --2- 172.21.15.116:0/3839660007 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd438003f20 0x7fd438004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:41.092 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:41.096+0000 7fd44e7fc640 1 --2- 172.21.15.116:0/3839660007 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd438004d40 0x7fd4380051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:41.092 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:41.096+0000 7fd44e7fc640 1 -- 172.21.15.116:0/3839660007 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4500d1720 con 0x7fd438004d40 2024-02-21T22:53:41.092 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:41.096+0000 7fd44e7fc640 1 -- 172.21.15.116:0/3839660007 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd43800ba20 con 0x7fd438003f20 2024-02-21T22:53:41.092 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:41.096+0000 7fd44e7fc640 1 -- 172.21.15.116:0/3839660007 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd43800bc20 con 0x7fd45015e120 2024-02-21T22:53:41.092 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:41.096+0000 7fd44ffff640 1 --2- 172.21.15.116:0/3839660007 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd438004d40 0x7fd4380051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:41.092 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:41.096+0000 7fd44f7fe640 1 --2- 172.21.15.116:0/3839660007 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd45015e120 0x7fd4380039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:41.092 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:41.096+0000 7fd44effd640 1 --2- 172.21.15.116:0/3839660007 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd438003f20 0x7fd438004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:41.092 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:41.097+0000 7fd44ffff640 1 -- 172.21.15.116:0/3839660007 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd45015e120 msgr2=0x7fd4380039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:53:41.093 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:41.097+0000 7fd44ffff640 1 --2- 172.21.15.116:0/3839660007 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd45015e120 0x7fd4380039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:41.093 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:41.097+0000 7fd44ffff640 1 -- 172.21.15.116:0/3839660007 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd438003f20 msgr2=0x7fd438004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:53:41.093 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:41.097+0000 7fd44ffff640 1 --2- 172.21.15.116:0/3839660007 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd438003f20 0x7fd438004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:41.093 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:41.097+0000 7fd44ffff640 1 -- 172.21.15.116:0/3839660007 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd438003520 con 0x7fd438004d40 2024-02-21T22:53:41.093 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:41.097+0000 7fd44f7fe640 1 --2- 172.21.15.116:0/3839660007 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd45015e120 0x7fd4380039e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T22:53:41.093 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:41.097+0000 7fd44ffff640 1 --2- 172.21.15.116:0/3839660007 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd438004d40 0x7fd4380051c0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fd44800a7c0 tx=0x7fd438005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1632b4d35d30d80f server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:41.093 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:41.097+0000 7fd44e7fc640 1 -- 172.21.15.116:0/3839660007 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd44800a410 con 0x7fd438004d40 2024-02-21T22:53:41.093 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:41.097+0000 7fd44e7fc640 1 -- 172.21.15.116:0/3839660007 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd448034630 con 0x7fd438004d40 2024-02-21T22:53:41.093 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:41.097+0000 7fd44e7fc640 1 -- 172.21.15.116:0/3839660007 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd448034a20 con 0x7fd438004d40 2024-02-21T22:53:41.094 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:41.098+0000 7fd455bed640 1 -- 172.21.15.116:0/3839660007 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd438004d40 msgr2=0x7fd4380051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:41.094 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:41.098+0000 7fd455bed640 1 --2- 172.21.15.116:0/3839660007 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd438004d40 0x7fd4380051c0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fd44800a7c0 tx=0x7fd438005830 comp rx=0 tx=0).stop 2024-02-21T22:53:41.094 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:41.098+0000 7fd44ffff640 1 -- 172.21.15.116:0/3839660007 reap_dead start 2024-02-21T22:53:41.094 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:41.098+0000 7fd455bed640 1 -- 172.21.15.116:0/3839660007 shutdown_connections 2024-02-21T22:53:41.094 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:41.098+0000 7fd455bed640 1 -- 172.21.15.116:0/3839660007 >> 172.21.15.116:0/3839660007 conn(0x7fd4500d3da0 msgr2=0x7fd4500d41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:41.094 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:41.098+0000 7fd455bed640 1 -- 172.21.15.116:0/3839660007 shutdown_connections 2024-02-21T22:53:41.094 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:41.098+0000 7fd455bed640 1 -- 172.21.15.116:0/3839660007 wait complete. 2024-02-21T22:53:41.094 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:41.099+0000 7fd455bed640 1 Processor -- start 2024-02-21T22:53:41.094 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:41.099+0000 7fd455bed640 1 -- start start 2024-02-21T22:53:41.097 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:41.100+0000 7fd455bed640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd438004d40 0x7fd45015e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:41.097 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:41.100+0000 7fd455bed640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd45015ee40 0x7fd4501608f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:41.097 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:41.100+0000 7fd455bed640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd450160e30 0x7fd4501612c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:41.097 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:41.100+0000 7fd455bed640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4500cfe00 con 0x7fd450160e30 2024-02-21T22:53:41.097 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:41.100+0000 7fd455bed640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4500cfc80 con 0x7fd438004d40 2024-02-21T22:53:41.097 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:41.100+0000 7fd455bed640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4500d1c10 con 0x7fd45015ee40 2024-02-21T22:53:41.097 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:41.100+0000 7fd44ffff640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd450160e30 0x7fd4501612c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:41.098 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:41.100+0000 7fd44ffff640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd450160e30 0x7fd4501612c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:38112/0 (socket says 172.21.15.116:38112) 2024-02-21T22:53:41.098 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:41.100+0000 7fd44ffff640 1 -- 172.21.15.116:0/3476632978 learned_addr learned my addr 172.21.15.116:0/3476632978 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:41.098 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:41.100+0000 7fd44effd640 1 --2- 172.21.15.116:0/3476632978 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd45015ee40 0x7fd4501608f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:41.098 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:41.100+0000 7fd44f7fe640 1 --2- 172.21.15.116:0/3476632978 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd438004d40 0x7fd45015e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:41.098 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:41.100+0000 7fd44ffff640 1 -- 172.21.15.116:0/3476632978 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd45015ee40 msgr2=0x7fd4501608f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:41.098 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:41.100+0000 7fd44ffff640 1 --2- 172.21.15.116:0/3476632978 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd45015ee40 0x7fd4501608f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:41.098 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:41.100+0000 7fd44ffff640 1 -- 172.21.15.116:0/3476632978 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd438004d40 msgr2=0x7fd45015e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:41.098 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:41.100+0000 7fd44ffff640 1 --2- 172.21.15.116:0/3476632978 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd438004d40 0x7fd45015e900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:41.098 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:41.100+0000 7fd44ffff640 1 -- 172.21.15.116:0/3476632978 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4500b6ac0 con 0x7fd450160e30 2024-02-21T22:53:41.098 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:41.100+0000 7fd44effd640 1 --2- 172.21.15.116:0/3476632978 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd45015ee40 0x7fd4501608f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T22:53:41.098 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:41.100+0000 7fd44f7fe640 1 --2- 172.21.15.116:0/3476632978 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd438004d40 0x7fd45015e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T22:53:41.098 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:41.101+0000 7fd44ffff640 1 --2- 172.21.15.116:0/3476632978 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd450160e30 0x7fd4501612c0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fd44800a7c0 tx=0x7fd4500ce9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:41.098 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:41.101+0000 7fd437fff640 1 -- 172.21.15.116:0/3476632978 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd448039040 con 0x7fd450160e30 2024-02-21T22:53:41.098 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:41.101+0000 7fd437fff640 1 -- 172.21.15.116:0/3476632978 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd44800a3f0 con 0x7fd450160e30 2024-02-21T22:53:41.098 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:41.101+0000 7fd455bed640 1 -- 172.21.15.116:0/3476632978 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4500b6da0 con 0x7fd450160e30 2024-02-21T22:53:41.098 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:41.101+0000 7fd437fff640 1 -- 172.21.15.116:0/3476632978 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd440009690 con 0x7fd450160e30 2024-02-21T22:53:41.099 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:41.101+0000 7fd455bed640 1 -- 172.21.15.116:0/3476632978 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4500b7360 con 0x7fd450160e30 2024-02-21T22:53:41.099 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:41.102+0000 7fd455bed640 1 -- 172.21.15.116:0/3476632978 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4500752f0 con 0x7fd450160e30 2024-02-21T22:53:41.099 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:41.102+0000 7fd437fff640 1 -- 172.21.15.116:0/3476632978 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fd448046020 con 0x7fd450160e30 2024-02-21T22:53:41.099 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:41.102+0000 7fd437fff640 1 --2- 172.21.15.116:0/3476632978 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fd43c06b500 0x7fd43c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:41.099 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:41.103+0000 7fd437fff640 1 -- 172.21.15.116:0/3476632978 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5227+0+0 (secure 0 0 0) 0x7fd448034430 con 0x7fd450160e30 2024-02-21T22:53:41.099 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:41.103+0000 7fd44f7fe640 1 --2- 172.21.15.116:0/3476632978 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fd43c06b500 0x7fd43c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:41.099 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:41.103+0000 7fd44f7fe640 1 --2- 172.21.15.116:0/3476632978 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fd43c06b500 0x7fd43c06d9c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fd4500cdf70 tx=0x7fd440008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:41.099 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:41.107+0000 7fd437fff640 1 -- 172.21.15.116:0/3476632978 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7fd44807a8d0 con 0x7fd450160e30 2024-02-21T22:53:41.271 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:41.280+0000 7fd455bed640 1 -- 172.21.15.116:0/3476632978 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fd45015f220 con 0x7fd450160e30 2024-02-21T22:53:41.963 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:41.972+0000 7fd437fff640 1 -- 172.21.15.116:0/3476632978 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v31) v1 ==== 170+0+0 (secure 0 0 0) 0x7fd44807a1d0 con 0x7fd450160e30 2024-02-21T22:53:41.963 INFO:teuthology.orchestra.run.smithi116.stderr:pool 'cephfs_data' created 2024-02-21T22:53:41.967 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:41.976+0000 7fd455bed640 1 -- 172.21.15.116:0/3476632978 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fd43c06b500 msgr2=0x7fd43c06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:41.967 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:41.976+0000 7fd455bed640 1 --2- 172.21.15.116:0/3476632978 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fd43c06b500 0x7fd43c06d9c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fd4500cdf70 tx=0x7fd440008040 comp rx=0 tx=0).stop 2024-02-21T22:53:41.967 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:41.976+0000 7fd455bed640 1 -- 172.21.15.116:0/3476632978 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd450160e30 msgr2=0x7fd4501612c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:41.967 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:41.976+0000 7fd455bed640 1 --2- 172.21.15.116:0/3476632978 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd450160e30 0x7fd4501612c0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fd44800a7c0 tx=0x7fd4500ce9b0 comp rx=0 tx=0).stop 2024-02-21T22:53:41.967 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:41.976+0000 7fd455bed640 1 -- 172.21.15.116:0/3476632978 shutdown_connections 2024-02-21T22:53:41.967 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:41.976+0000 7fd455bed640 1 --2- 172.21.15.116:0/3476632978 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd450160e30 0x7fd4501612c0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:41.967 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:41.976+0000 7fd455bed640 1 --2- 172.21.15.116:0/3476632978 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fd43c06b500 0x7fd43c06d9c0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:41.967 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:41.976+0000 7fd455bed640 1 --2- 172.21.15.116:0/3476632978 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd45015ee40 0x7fd4501608f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:41.967 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:41.976+0000 7fd455bed640 1 --2- 172.21.15.116:0/3476632978 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd438004d40 0x7fd45015e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:41.967 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:41.976+0000 7fd455bed640 1 -- 172.21.15.116:0/3476632978 >> 172.21.15.116:0/3476632978 conn(0x7fd4500d3da0 msgr2=0x7fd4500d41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:41.970 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:41.980+0000 7fd455bed640 1 -- 172.21.15.116:0/3476632978 shutdown_connections 2024-02-21T22:53:41.972 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:41.980+0000 7fd455bed640 1 -- 172.21.15.116:0/3476632978 wait complete. 2024-02-21T22:53:41.992 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-02-21T22:53:42.096 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:42.106+0000 7f5abcc36640 1 Processor -- start 2024-02-21T22:53:42.096 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:42.106+0000 7f5abcc36640 1 -- start start 2024-02-21T22:53:42.097 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:42.106+0000 7f5abcc36640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5ab81456c0 0x7f5ab80b2260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:42.097 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:42.106+0000 7f5abcc36640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f5ab815f920 0x7f5ab815fd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:42.097 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:42.107+0000 7f5abcc36640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f5ab81602a0 0x7f5ab80ce090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:42.097 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:42.107+0000 7f5abcc36640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ab80b3c30 con 0x7f5ab815f920 2024-02-21T22:53:42.098 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:42.107+0000 7f5abcc36640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ab80b3f10 con 0x7f5ab81602a0 2024-02-21T22:53:42.098 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:42.107+0000 7f5abcc36640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ab80b41f0 con 0x7f5ab81456c0 2024-02-21T22:53:42.098 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:42.107+0000 7f5ab5d9b640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f5ab815f920 0x7f5ab815fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:42.098 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:42.107+0000 7f5ab5d9b640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f5ab815f920 0x7f5ab815fd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:38128/0 (socket says 172.21.15.116:38128) 2024-02-21T22:53:42.098 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:42.107+0000 7f5ab5d9b640 1 -- 172.21.15.116:0/4068625428 learned_addr learned my addr 172.21.15.116:0/4068625428 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:42.098 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:42.107+0000 7f5ab6d9d640 1 --2- 172.21.15.116:0/4068625428 >> v2:172.21.15.142:3300/0 conn(0x7f5ab81602a0 0x7f5ab80ce090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:42.098 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:42.107+0000 7f5ab5d9b640 1 -- 172.21.15.116:0/4068625428 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5ab81456c0 msgr2=0x7f5ab80b2260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:53:42.098 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:42.107+0000 7f5ab5d9b640 1 --2- 172.21.15.116:0/4068625428 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5ab81456c0 0x7f5ab80b2260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:42.098 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:42.107+0000 7f5ab5d9b640 1 -- 172.21.15.116:0/4068625428 >> v2:172.21.15.142:3300/0 conn(0x7f5ab81602a0 msgr2=0x7f5ab80ce090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:53:42.098 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:42.107+0000 7f5ab5d9b640 1 --2- 172.21.15.116:0/4068625428 >> v2:172.21.15.142:3300/0 conn(0x7f5ab81602a0 0x7f5ab80ce090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:42.098 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:42.107+0000 7f5ab5d9b640 1 -- 172.21.15.116:0/4068625428 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ab806cb10 con 0x7f5ab815f920 2024-02-21T22:53:42.099 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:42.108+0000 7f5ab5d9b640 1 --2- 172.21.15.116:0/4068625428 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5ab815f920 0x7f5ab815fd60 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f5ab80b4120 tx=0x7f5aa002b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=563dd5a712359655 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:42.100 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:42.108+0000 7f5ab559a640 1 -- 172.21.15.116:0/4068625428 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aa00317c0 con 0x7f5ab815f920 2024-02-21T22:53:42.100 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:42.108+0000 7f5ab559a640 1 -- 172.21.15.116:0/4068625428 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5aa0037070 con 0x7f5ab815f920 2024-02-21T22:53:42.100 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:42.108+0000 7f5ab559a640 1 -- 172.21.15.116:0/4068625428 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aa0031b80 con 0x7f5ab815f920 2024-02-21T22:53:42.100 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:42.108+0000 7f5abcc36640 1 -- 172.21.15.116:0/4068625428 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5ab815f920 msgr2=0x7f5ab815fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:42.100 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:42.108+0000 7f5abcc36640 1 --2- 172.21.15.116:0/4068625428 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5ab815f920 0x7f5ab815fd60 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f5ab80b4120 tx=0x7f5aa002b860 comp rx=0 tx=0).stop 2024-02-21T22:53:42.100 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:42.108+0000 7f5abcc36640 1 -- 172.21.15.116:0/4068625428 shutdown_connections 2024-02-21T22:53:42.100 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:42.108+0000 7f5abcc36640 1 --2- 172.21.15.116:0/4068625428 >> v2:172.21.15.142:3300/0 conn(0x7f5ab81602a0 0x7f5ab80ce090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:42.100 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:42.108+0000 7f5abcc36640 1 --2- 172.21.15.116:0/4068625428 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5ab815f920 0x7f5ab815fd60 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:42.100 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:42.108+0000 7f5abcc36640 1 --2- 172.21.15.116:0/4068625428 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5ab81456c0 0x7f5ab80b2260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:42.100 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:42.108+0000 7f5abcc36640 1 -- 172.21.15.116:0/4068625428 >> 172.21.15.116:0/4068625428 conn(0x7f5ab80b1740 msgr2=0x7f5ab80b1b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:42.100 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:42.109+0000 7f5abcc36640 1 -- 172.21.15.116:0/4068625428 shutdown_connections 2024-02-21T22:53:42.100 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:42.109+0000 7f5abcc36640 1 -- 172.21.15.116:0/4068625428 wait complete. 2024-02-21T22:53:42.102 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:42.110+0000 7f5abcc36640 1 Processor -- start 2024-02-21T22:53:42.102 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:42.110+0000 7f5abcc36640 1 -- start start 2024-02-21T22:53:42.102 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:42.110+0000 7f5abcc36640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5ab81456c0 0x7f5ab815ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:42.103 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:42.110+0000 7f5abcc36640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5ab815f920 0x7f5ab815ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:42.103 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:42.110+0000 7f5abcc36640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5ab81602a0 0x7f5ab813aea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:42.103 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:42.110+0000 7f5abcc36640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ab80ce5d0 con 0x7f5ab815f920 2024-02-21T22:53:42.103 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:42.110+0000 7f5abcc36640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ab8145aa0 con 0x7f5ab81602a0 2024-02-21T22:53:42.103 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:42.110+0000 7f5abcc36640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ab80ce750 con 0x7f5ab81456c0 2024-02-21T22:53:42.103 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:42.111+0000 7f5ab5d9b640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5ab815f920 0x7f5ab815ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:42.103 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:42.111+0000 7f5ab5d9b640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5ab815f920 0x7f5ab815ccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:38132/0 (socket says 172.21.15.116:38132) 2024-02-21T22:53:42.103 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:42.111+0000 7f5ab5d9b640 1 -- 172.21.15.116:0/2320925458 learned_addr learned my addr 172.21.15.116:0/2320925458 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:42.103 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:42.111+0000 7f5ab5d9b640 1 -- 172.21.15.116:0/2320925458 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5ab81456c0 msgr2=0x7f5ab815ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:42.103 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:42.111+0000 7f5ab5d9b640 1 --2- 172.21.15.116:0/2320925458 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5ab81456c0 0x7f5ab815ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:42.103 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:42.111+0000 7f5ab5d9b640 1 -- 172.21.15.116:0/2320925458 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5ab81602a0 msgr2=0x7f5ab813aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:42.103 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:42.111+0000 7f5ab6d9d640 1 --2- 172.21.15.116:0/2320925458 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5ab81602a0 0x7f5ab813aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:42.103 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:42.111+0000 7f5ab5d9b640 1 --2- 172.21.15.116:0/2320925458 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5ab81602a0 0x7f5ab813aea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:42.103 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:42.111+0000 7f5ab5d9b640 1 -- 172.21.15.116:0/2320925458 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ab815d510 con 0x7f5ab815f920 2024-02-21T22:53:42.103 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:42.111+0000 7f5ab6d9d640 1 --2- 172.21.15.116:0/2320925458 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5ab81602a0 0x7f5ab813aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T22:53:42.104 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:42.111+0000 7f5ab5d9b640 1 --2- 172.21.15.116:0/2320925458 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5ab815f920 0x7f5ab815ccb0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f5aa002b8a0 tx=0x7f5aa00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:42.104 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:42.111+0000 7f5aaeffd640 1 -- 172.21.15.116:0/2320925458 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aa0032860 con 0x7f5ab815f920 2024-02-21T22:53:42.104 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:42.111+0000 7f5aaeffd640 1 -- 172.21.15.116:0/2320925458 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5aa0032a00 con 0x7f5ab815f920 2024-02-21T22:53:42.104 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:42.111+0000 7f5abcc36640 1 -- 172.21.15.116:0/2320925458 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ab815d7f0 con 0x7f5ab815f920 2024-02-21T22:53:42.104 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:42.111+0000 7f5aaeffd640 1 -- 172.21.15.116:0/2320925458 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aa0032dd0 con 0x7f5ab815f920 2024-02-21T22:53:42.104 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:42.111+0000 7f5abcc36640 1 -- 172.21.15.116:0/2320925458 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ab815d1f0 con 0x7f5ab815f920 2024-02-21T22:53:42.104 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:42.112+0000 7f5abcc36640 1 -- 172.21.15.116:0/2320925458 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ab80752f0 con 0x7f5ab815f920 2024-02-21T22:53:42.105 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:42.113+0000 7f5aaeffd640 1 -- 172.21.15.116:0/2320925458 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f5aa00453f0 con 0x7f5ab815f920 2024-02-21T22:53:42.105 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:42.113+0000 7f5aaeffd640 1 --2- 172.21.15.116:0/2320925458 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f5a9806b4d0 0x7f5a9806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:42.105 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:42.113+0000 7f5aaeffd640 1 -- 172.21.15.116:0/2320925458 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f5aa00ac350 con 0x7f5ab815f920 2024-02-21T22:53:42.105 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:42.113+0000 7f5ab659c640 1 --2- 172.21.15.116:0/2320925458 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f5a9806b4d0 0x7f5a9806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:42.105 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:42.114+0000 7f5ab659c640 1 --2- 172.21.15.116:0/2320925458 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f5a9806b4d0 0x7f5a9806d990 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f5aa8009710 tx=0x7f5aa8006c90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:42.108 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:42.118+0000 7f5aaeffd640 1 -- 172.21.15.116:0/2320925458 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f5aa0040070 con 0x7f5ab815f920 2024-02-21T22:53:42.317 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:42.327+0000 7f5abcc36640 1 -- 172.21.15.116:0/2320925458 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f5ab80cf350 con 0x7f5ab815f920 2024-02-21T22:53:42.976 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:42.985+0000 7f5aaeffd640 1 -- 172.21.15.116:0/2320925458 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v11) v1 ==== 172+0+0 (secure 0 0 0) 0x7f5aa007b2c0 con 0x7f5ab815f920 2024-02-21T22:53:42.976 INFO:teuthology.orchestra.run.smithi116.stderr:new fs with metadata pool 4 and data pool 5 2024-02-21T22:53:42.979 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:42.988+0000 7f5abcc36640 1 -- 172.21.15.116:0/2320925458 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f5a9806b4d0 msgr2=0x7f5a9806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:42.979 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:42.988+0000 7f5abcc36640 1 --2- 172.21.15.116:0/2320925458 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f5a9806b4d0 0x7f5a9806d990 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f5aa8009710 tx=0x7f5aa8006c90 comp rx=0 tx=0).stop 2024-02-21T22:53:42.979 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:42.988+0000 7f5abcc36640 1 -- 172.21.15.116:0/2320925458 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5ab815f920 msgr2=0x7f5ab815ccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:42.979 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:42.988+0000 7f5abcc36640 1 --2- 172.21.15.116:0/2320925458 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5ab815f920 0x7f5ab815ccb0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f5aa002b8a0 tx=0x7f5aa00046c0 comp rx=0 tx=0).stop 2024-02-21T22:53:42.979 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:42.988+0000 7f5abcc36640 1 -- 172.21.15.116:0/2320925458 shutdown_connections 2024-02-21T22:53:42.979 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:42.988+0000 7f5abcc36640 1 --2- 172.21.15.116:0/2320925458 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5ab81602a0 0x7f5ab813aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:42.979 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:42.988+0000 7f5abcc36640 1 --2- 172.21.15.116:0/2320925458 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5ab815f920 0x7f5ab815ccb0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:42.979 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:42.988+0000 7f5abcc36640 1 --2- 172.21.15.116:0/2320925458 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f5a9806b4d0 0x7f5a9806d990 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:42.980 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:42.988+0000 7f5abcc36640 1 --2- 172.21.15.116:0/2320925458 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5ab81456c0 0x7f5ab815ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:42.980 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:42.988+0000 7f5abcc36640 1 -- 172.21.15.116:0/2320925458 >> 172.21.15.116:0/2320925458 conn(0x7f5ab80b1740 msgr2=0x7f5ab8143470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:42.980 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:42.989+0000 7f5abcc36640 1 -- 172.21.15.116:0/2320925458 shutdown_connections 2024-02-21T22:53:42.980 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:42.989+0000 7f5abcc36640 1 -- 172.21.15.116:0/2320925458 wait complete. 2024-02-21T22:53:43.004 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-21T22:53:43.106 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.115+0000 7f821c460640 1 Processor -- start 2024-02-21T22:53:43.106 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.115+0000 7f821c460640 1 -- start start 2024-02-21T22:53:43.107 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.116+0000 7f821c460640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f82140b2e40 0x7f82140d4910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:43.108 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.116+0000 7f821c460640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f82140d23d0 0x7f82140d2820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:43.108 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.116+0000 7f821c460640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82140d1c70 con 0x7f821415e190 2024-02-21T22:53:43.108 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.116+0000 7f821c460640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82140cea00 con 0x7f82140b2e40 2024-02-21T22:53:43.108 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.116+0000 7f821c460640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82140d2d60 con 0x7f82140d23d0 2024-02-21T22:53:43.108 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.116+0000 7f82199fb640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f82140b2e40 0x7f82140d4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:43.108 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.116+0000 7f82199fb640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f82140b2e40 0x7f82140d4910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:38148/0 (socket says 172.21.15.116:38148) 2024-02-21T22:53:43.108 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.116+0000 7f821a1fc640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f821415e190 0x7f82140b0a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:54222/0 (socket says 172.21.15.116:54222) 2024-02-21T22:53:43.108 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.116+0000 7f82199fb640 1 -- 172.21.15.116:0/1144524114 learned_addr learned my addr 172.21.15.116:0/1144524114 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:43.108 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.117+0000 7f821a9fd640 1 --2- 172.21.15.116:0/1144524114 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f82140d23d0 0x7f82140d2820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:43.108 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.117+0000 7f82199fb640 1 -- 172.21.15.116:0/1144524114 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f82140d23d0 msgr2=0x7f82140d2820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:53:43.108 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.117+0000 7f82199fb640 1 --2- 172.21.15.116:0/1144524114 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f82140d23d0 0x7f82140d2820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:43.108 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.117+0000 7f82199fb640 1 -- 172.21.15.116:0/1144524114 >> v1:172.21.15.116:6789/0 conn(0x7f821415e190 legacy=0x7f82140b0a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:43.108 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.117+0000 7f82199fb640 1 -- 172.21.15.116:0/1144524114 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82140b1150 con 0x7f82140b2e40 2024-02-21T22:53:43.108 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.117+0000 7f82191fa640 1 -- 172.21.15.116:0/1144524114 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2414370031 0 0) 0x7f82140d1c70 con 0x7f821415e190 2024-02-21T22:53:43.109 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.117+0000 7f82199fb640 1 --2- 172.21.15.116:0/1144524114 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f82140b2e40 0x7f82140d4910 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f8208009870 tx=0x7f820802b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cac88c053de61d server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:43.110 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.118+0000 7f82191fa640 1 -- 172.21.15.116:0/1144524114 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8208034070 con 0x7f82140b2e40 2024-02-21T22:53:43.110 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.118+0000 7f82191fa640 1 -- 172.21.15.116:0/1144524114 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8208030840 con 0x7f82140b2e40 2024-02-21T22:53:43.110 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.118+0000 7f82191fa640 1 -- 172.21.15.116:0/1144524114 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8208030c10 con 0x7f82140b2e40 2024-02-21T22:53:43.110 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.118+0000 7f821c460640 1 -- 172.21.15.116:0/1144524114 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f82140b2e40 msgr2=0x7f82140d4910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:43.110 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.118+0000 7f821c460640 1 --2- 172.21.15.116:0/1144524114 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f82140b2e40 0x7f82140d4910 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f8208009870 tx=0x7f820802b980 comp rx=0 tx=0).stop 2024-02-21T22:53:43.110 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.118+0000 7f821c460640 1 -- 172.21.15.116:0/1144524114 shutdown_connections 2024-02-21T22:53:43.110 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.118+0000 7f821c460640 1 --2- 172.21.15.116:0/1144524114 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f82140d23d0 0x7f82140d2820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:43.110 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.118+0000 7f821c460640 1 --2- 172.21.15.116:0/1144524114 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f82140b2e40 0x7f82140d4910 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:43.110 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.118+0000 7f821c460640 1 -- 172.21.15.116:0/1144524114 >> 172.21.15.116:0/1144524114 conn(0x7f82140d3df0 msgr2=0x7f82140d4200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:43.110 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.118+0000 7f821c460640 1 -- 172.21.15.116:0/1144524114 shutdown_connections 2024-02-21T22:53:43.111 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.118+0000 7f821c460640 1 -- 172.21.15.116:0/1144524114 wait complete. 2024-02-21T22:53:43.111 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.119+0000 7f821c460640 1 Processor -- start 2024-02-21T22:53:43.111 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.119+0000 7f821c460640 1 -- start start 2024-02-21T22:53:43.114 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.120+0000 7f821c460640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f82140b2e40 0x7f821414c180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:43.114 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.120+0000 7f821c460640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f82140d23d0 0x7f82140b3300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:43.114 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.120+0000 7f821c460640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f821415e190 0x7f82140cd590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:43.114 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.120+0000 7f821c460640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82140d21f0 con 0x7f82140d23d0 2024-02-21T22:53:43.114 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.120+0000 7f821c460640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82140cefa0 con 0x7f821415e190 2024-02-21T22:53:43.114 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.120+0000 7f821c460640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82140d1f10 con 0x7f82140b2e40 2024-02-21T22:53:43.114 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.120+0000 7f82199fb640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f82140d23d0 0x7f82140b3300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:43.114 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.120+0000 7f82199fb640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f82140d23d0 0x7f82140b3300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:38160/0 (socket says 172.21.15.116:38160) 2024-02-21T22:53:43.114 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.120+0000 7f82199fb640 1 -- 172.21.15.116:0/2514246388 learned_addr learned my addr 172.21.15.116:0/2514246388 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:43.114 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.120+0000 7f821a1fc640 1 --2- 172.21.15.116:0/2514246388 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f82140b2e40 0x7f821414c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:43.114 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.120+0000 7f821a9fd640 1 --2- 172.21.15.116:0/2514246388 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f821415e190 0x7f82140cd590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:43.114 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.120+0000 7f82199fb640 1 -- 172.21.15.116:0/2514246388 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f82140b2e40 msgr2=0x7f821414c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:43.114 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.120+0000 7f82199fb640 1 --2- 172.21.15.116:0/2514246388 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f82140b2e40 0x7f821414c180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:43.115 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.120+0000 7f82199fb640 1 -- 172.21.15.116:0/2514246388 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f821415e190 msgr2=0x7f82140cd590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:43.115 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.120+0000 7f82199fb640 1 --2- 172.21.15.116:0/2514246388 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f821415e190 0x7f82140cd590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:43.115 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.120+0000 7f82199fb640 1 -- 172.21.15.116:0/2514246388 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82140cc4f0 con 0x7f82140d23d0 2024-02-21T22:53:43.115 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.120+0000 7f821a1fc640 1 --2- 172.21.15.116:0/2514246388 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f82140b2e40 0x7f821414c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T22:53:43.115 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.121+0000 7f82199fb640 1 --2- 172.21.15.116:0/2514246388 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f82140d23d0 0x7f82140b3300 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f8208000c00 tx=0x7f82080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:43.115 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.121+0000 7f8212ffd640 1 -- 172.21.15.116:0/2514246388 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8208034040 con 0x7f82140d23d0 2024-02-21T22:53:43.115 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.121+0000 7f8212ffd640 1 -- 172.21.15.116:0/2514246388 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f820803ab90 con 0x7f82140d23d0 2024-02-21T22:53:43.115 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.121+0000 7f821c460640 1 -- 172.21.15.116:0/2514246388 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82140cc7d0 con 0x7f82140d23d0 2024-02-21T22:53:43.115 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.121+0000 7f8212ffd640 1 -- 172.21.15.116:0/2514246388 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8208004030 con 0x7f82140d23d0 2024-02-21T22:53:43.115 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.121+0000 7f821c460640 1 -- 172.21.15.116:0/2514246388 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82140ccd90 con 0x7f82140d23d0 2024-02-21T22:53:43.115 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.122+0000 7f821c460640 1 -- 172.21.15.116:0/2514246388 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82140752f0 con 0x7f82140d23d0 2024-02-21T22:53:43.115 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.122+0000 7f8212ffd640 1 -- 172.21.15.116:0/2514246388 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f820804b060 con 0x7f82140d23d0 2024-02-21T22:53:43.115 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.122+0000 7f8212ffd640 1 --2- 172.21.15.116:0/2514246388 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f820006b4d0 0x7f820006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:43.115 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.122+0000 7f8212ffd640 1 -- 172.21.15.116:0/2514246388 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f82080abff0 con 0x7f82140d23d0 2024-02-21T22:53:43.115 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.123+0000 7f821a1fc640 1 --2- 172.21.15.116:0/2514246388 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f820006b4d0 0x7f820006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:43.116 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.123+0000 7f821a1fc640 1 --2- 172.21.15.116:0/2514246388 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f820006b4d0 0x7f820006d990 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f82040012e0 tx=0x7f8204007f90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:43.117 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.127+0000 7f8212ffd640 1 -- 172.21.15.116:0/2514246388 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f820803f070 con 0x7f82140d23d0 2024-02-21T22:53:43.290 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.300+0000 7f821c460640 1 -- 172.21.15.116:0/2514246388 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f82140cf560 con 0x7f82140d23d0 2024-02-21T22:53:43.291 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.301+0000 7f8212ffd640 1 -- 172.21.15.116:0/2514246388 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+16730 (secure 0 0 0) 0x7f820807af00 con 0x7f82140d23d0 2024-02-21T22:53:43.292 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-02-21T22:53:43.292 INFO:teuthology.orchestra.run.smithi116.stdout:{"epoch":32,"fsid":"7c298660-5f63-4b5c-a800-58c5be9a8445","created":"2024-02-21T22:52:25.994613+0000","modified":"2024-02-21T22:53:42.328462+0000","last_up_change":"2024-02-21T22:52:37.313595+0000","last_in_change":"2024-02-21T22:52:28.176031+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-21T22:52:38.328796+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-02-21T22:53:40.752689+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-02-21T22:53:41.300199+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4f09126b-b5e4-4876-8b08-f5cbb967388a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":1613202231},{"type":"v1","addr":"172.21.15.116:6809","nonce":1613202231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":1613202231},{"type":"v1","addr":"172.21.15.116:6811","nonce":1613202231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":1613202231},{"type":"v1","addr":"172.21.15.116:6815","nonce":1613202231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":1613202231},{"type":"v1","addr":"172.21.15.116:6813","nonce":1613202231}]},"public_addr":"172.21.15.116:6809/1613202231","cluster_addr":"172.21.15.116:6811/1613202231","heartbeat_back_addr":"172.21.15.116:6815/1613202231","heartbeat_front_addr":"172.21.15.116:6813/1613202231","state":["exists","up"]},{"osd":1,"uuid":"7272c51d-51f9-4536-931d-33ad7a4b377e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6816","nonce":172614746},{"type":"v1","addr":"172.21.15.116:6817","nonce":172614746}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":172614746},{"type":"v1","addr":"172.21.15.116:6819","nonce":172614746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":172614746},{"type":"v1","addr":"172.21.15.116:6823","nonce":172614746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":172614746},{"type":"v1","addr":"172.21.15.116:6821","nonce":172614746}]},"public_addr":"172.21.15.116:6817/172614746","cluster_addr":"172.21.15.116:6819/172614746","heartbeat_back_addr":"172.21.15.116:6823/172614746","heartbeat_front_addr":"172.21.15.116:6821/172614746","state":["exists","up"]},{"osd":2,"uuid":"2589616c-adf1-4187-aac3-735256cf624b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":1029280577},{"type":"v1","addr":"172.21.15.116:6825","nonce":1029280577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":1029280577},{"type":"v1","addr":"172.21.15.116:6827","nonce":1029280577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":1029280577},{"type":"v1","addr":"172.21.15.116:6831","nonce":1029280577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":1029280577},{"type":"v1","addr":"172.21.15.116:6829","nonce":1029280577}]},"public_addr":"172.21.15.116:6825/1029280577","cluster_addr":"172.21.15.116:6827/1029280577","heartbeat_back_addr":"172.21.15.116:6831/1029280577","heartbeat_front_addr":"172.21.15.116:6829/1029280577","state":["exists","up"]},{"osd":3,"uuid":"0fd2e563-7c5b-46f6-82c2-b60c86072c93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":3106627557},{"type":"v1","addr":"172.21.15.116:6801","nonce":3106627557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":3106627557},{"type":"v1","addr":"172.21.15.116:6803","nonce":3106627557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":3106627557},{"type":"v1","addr":"172.21.15.116:6807","nonce":3106627557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":3106627557},{"type":"v1","addr":"172.21.15.116:6805","nonce":3106627557}]},"public_addr":"172.21.15.116:6801/3106627557","cluster_addr":"172.21.15.116:6803/3106627557","heartbeat_back_addr":"172.21.15.116:6807/3106627557","heartbeat_front_addr":"172.21.15.116:6805/3106627557","state":["exists","up"]},{"osd":4,"uuid":"79ae35b7-dda8-4ab8-96ce-47515afde082","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":3231407772},{"type":"v1","addr":"172.21.15.142:6825","nonce":3231407772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":3231407772},{"type":"v1","addr":"172.21.15.142:6827","nonce":3231407772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":3231407772},{"type":"v1","addr":"172.21.15.142:6831","nonce":3231407772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":3231407772},{"type":"v1","addr":"172.21.15.142:6829","nonce":3231407772}]},"public_addr":"172.21.15.142:6825/3231407772","cluster_addr":"172.21.15.142:6827/3231407772","heartbeat_back_addr":"172.21.15.142:6831/3231407772","heartbeat_front_addr":"172.21.15.142:6829/3231407772","state":["exists","up"]},{"osd":5,"uuid":"3166eb2c-3fcf-41c8-9362-45bafaabaa39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":1184158716},{"type":"v1","addr":"172.21.15.142:6817","nonce":1184158716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":1184158716},{"type":"v1","addr":"172.21.15.142:6819","nonce":1184158716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":1184158716},{"type":"v1","addr":"172.21.15.142:6823","nonce":1184158716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":1184158716},{"type":"v1","addr":"172.21.15.142:6821","nonce":1184158716}]},"public_addr":"172.21.15.142:6817/1184158716","cluster_addr":"172.21.15.142:6819/1184158716","heartbeat_back_addr":"172.21.15.142:6823/1184158716","heartbeat_front_addr":"172.21.15.142:6821/1184158716","state":["exists","up"]},{"osd":6,"uuid":"f9aa9672-7527-43e2-963e-b61868e5e63f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":1987868911},{"type":"v1","addr":"172.21.15.142:6801","nonce":1987868911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":1987868911},{"type":"v1","addr":"172.21.15.142:6803","nonce":1987868911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":1987868911},{"type":"v1","addr":"172.21.15.142:6807","nonce":1987868911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":1987868911},{"type":"v1","addr":"172.21.15.142:6805","nonce":1987868911}]},"public_addr":"172.21.15.142:6801/1987868911","cluster_addr":"172.21.15.142:6803/1987868911","heartbeat_back_addr":"172.21.15.142:6807/1987868911","heartbeat_front_addr":"172.21.15.142:6805/1987868911","state":["exists","up"]},{"osd":7,"uuid":"7ed29226-fc42-4382-a91a-fa50f7ec5426","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":1272081937},{"type":"v1","addr":"172.21.15.142:6809","nonce":1272081937}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":1272081937},{"type":"v1","addr":"172.21.15.142:6811","nonce":1272081937}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":1272081937},{"type":"v1","addr":"172.21.15.142:6815","nonce":1272081937}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":1272081937},{"type":"v1","addr":"172.21.15.142:6813","nonce":1272081937}]},"public_addr":"172.21.15.142:6809/1272081937","cluster_addr":"172.21.15.142:6811/1272081937","heartbeat_back_addr":"172.21.15.142:6815/1272081937","heartbeat_front_addr":"172.21.15.142:6813/1272081937","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.350998+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.307201+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.289112+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.243888+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.312091+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.370472+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.275659+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.289297+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-21T22:53:43.294 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.303+0000 7f821c460640 1 -- 172.21.15.116:0/2514246388 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f820006b4d0 msgr2=0x7f820006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:43.294 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.303+0000 7f821c460640 1 --2- 172.21.15.116:0/2514246388 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f820006b4d0 0x7f820006d990 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f82040012e0 tx=0x7f8204007f90 comp rx=0 tx=0).stop 2024-02-21T22:53:43.294 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.303+0000 7f821c460640 1 -- 172.21.15.116:0/2514246388 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f82140d23d0 msgr2=0x7f82140b3300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:43.294 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.303+0000 7f821c460640 1 --2- 172.21.15.116:0/2514246388 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f82140d23d0 0x7f82140b3300 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f8208000c00 tx=0x7f82080046c0 comp rx=0 tx=0).stop 2024-02-21T22:53:43.294 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.303+0000 7f821c460640 1 -- 172.21.15.116:0/2514246388 shutdown_connections 2024-02-21T22:53:43.294 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.303+0000 7f821c460640 1 --2- 172.21.15.116:0/2514246388 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f821415e190 0x7f82140cd590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:43.294 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.303+0000 7f821c460640 1 --2- 172.21.15.116:0/2514246388 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f82140d23d0 0x7f82140b3300 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:43.294 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.303+0000 7f821c460640 1 --2- 172.21.15.116:0/2514246388 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f820006b4d0 0x7f820006d990 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:43.294 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.303+0000 7f821c460640 1 --2- 172.21.15.116:0/2514246388 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f82140b2e40 0x7f821414c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:43.294 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.303+0000 7f821c460640 1 -- 172.21.15.116:0/2514246388 >> 172.21.15.116:0/2514246388 conn(0x7f82140d3df0 msgr2=0x7f82140c7d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:43.295 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.303+0000 7f821c460640 1 -- 172.21.15.116:0/2514246388 shutdown_connections 2024-02-21T22:53:43.295 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.303+0000 7f821c460640 1 -- 172.21.15.116:0/2514246388 wait complete. 2024-02-21T22:53:43.305 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-21T22:53:43.406 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.414+0000 7fb7abbcc640 1 Processor -- start 2024-02-21T22:53:43.406 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.414+0000 7fb7abbcc640 1 -- start start 2024-02-21T22:53:43.406 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.415+0000 7fb7abbcc640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fb7a40d1c30 0x7fb7a40d2430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:43.407 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.415+0000 7fb7abbcc640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7a40cfa50 con 0x7fb7a40d0510 2024-02-21T22:53:43.407 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.415+0000 7fb7abbcc640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7a40cfcc0 con 0x7fb7a40cb930 2024-02-21T22:53:43.407 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.415+0000 7fb7abbcc640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7a40d1450 con 0x7fb7a40d1c30 2024-02-21T22:53:43.407 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.415+0000 7fb7a9167640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fb7a40d1c30 0x7fb7a40d2430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:43.407 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.415+0000 7fb7a9167640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fb7a40d1c30 0x7fb7a40d2430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:38174/0 (socket says 172.21.15.116:38174) 2024-02-21T22:53:43.407 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.415+0000 7fb7a9167640 1 -- 172.21.15.116:0/2367777769 learned_addr learned my addr 172.21.15.116:0/2367777769 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:43.407 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.415+0000 7fb7a9968640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7fb7a40d0510 0x7fb7a40d08f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:54224/0 (socket says 172.21.15.116:54224) 2024-02-21T22:53:43.407 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.416+0000 7fb7a9167640 1 -- 172.21.15.116:0/2367777769 >> v1:172.21.15.142:6789/0 conn(0x7fb7a40cb930 legacy=0x7fb7a40cbda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:53:43.407 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.416+0000 7fb7a9167640 1 -- 172.21.15.116:0/2367777769 >> v1:172.21.15.116:6789/0 conn(0x7fb7a40d0510 legacy=0x7fb7a40d08f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:43.407 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.416+0000 7fb7a8966640 1 -- 172.21.15.116:0/2367777769 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3192520749 0 0) 0x7fb7a40cfa50 con 0x7fb7a40d0510 2024-02-21T22:53:43.407 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.416+0000 7fb7a9167640 1 -- 172.21.15.116:0/2367777769 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7a40cffa0 con 0x7fb7a40d1c30 2024-02-21T22:53:43.411 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.416+0000 7fb7a9167640 1 --2- 172.21.15.116:0/2367777769 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb7a40d1c30 0x7fb7a40d2430 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fb7a40d15d0 tx=0x7fb79402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=201e0b4a2876c5a2 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:43.411 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.416+0000 7fb7a8966640 1 -- 172.21.15.116:0/2367777769 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb794035020 con 0x7fb7a40d1c30 2024-02-21T22:53:43.412 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.417+0000 7fb7a8966640 1 -- 172.21.15.116:0/2367777769 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb794031640 con 0x7fb7a40d1c30 2024-02-21T22:53:43.412 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.417+0000 7fb7a8966640 1 -- 172.21.15.116:0/2367777769 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb79402d040 con 0x7fb7a40d1c30 2024-02-21T22:53:43.412 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.417+0000 7fb7abbcc640 1 -- 172.21.15.116:0/2367777769 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb7a40d1c30 msgr2=0x7fb7a40d2430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:43.412 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.417+0000 7fb7abbcc640 1 --2- 172.21.15.116:0/2367777769 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb7a40d1c30 0x7fb7a40d2430 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fb7a40d15d0 tx=0x7fb79402b8f0 comp rx=0 tx=0).stop 2024-02-21T22:53:43.412 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.417+0000 7fb7abbcc640 1 -- 172.21.15.116:0/2367777769 shutdown_connections 2024-02-21T22:53:43.412 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.417+0000 7fb7abbcc640 1 --2- 172.21.15.116:0/2367777769 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb7a40d1c30 0x7fb7a40d2430 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:43.412 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.417+0000 7fb7abbcc640 1 -- 172.21.15.116:0/2367777769 >> 172.21.15.116:0/2367777769 conn(0x7fb7a40d3e50 msgr2=0x7fb7a40d4260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:43.412 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.417+0000 7fb7abbcc640 1 -- 172.21.15.116:0/2367777769 shutdown_connections 2024-02-21T22:53:43.412 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.417+0000 7fb7abbcc640 1 -- 172.21.15.116:0/2367777769 wait complete. 2024-02-21T22:53:43.412 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.418+0000 7fb7abbcc640 1 Processor -- start 2024-02-21T22:53:43.412 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.418+0000 7fb7abbcc640 1 -- start start 2024-02-21T22:53:43.412 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.419+0000 7fb7abbcc640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb7a40cb930 0x7fb7a409f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:43.413 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.419+0000 7fb7abbcc640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb7a40d0510 0x7fb7a40a0900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:43.413 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.419+0000 7fb7abbcc640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb7a40d1c30 0x7fb7a40a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:43.413 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.419+0000 7fb7abbcc640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7a40d2970 con 0x7fb7a40d1c30 2024-02-21T22:53:43.413 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.419+0000 7fb7abbcc640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7a415e640 con 0x7fb7a40cb930 2024-02-21T22:53:43.413 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.419+0000 7fb7abbcc640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7a40d2af0 con 0x7fb7a40d0510 2024-02-21T22:53:43.413 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.419+0000 7fb7aa169640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb7a40d1c30 0x7fb7a40a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:43.413 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.419+0000 7fb7aa169640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb7a40d1c30 0x7fb7a40a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:38184/0 (socket says 172.21.15.116:38184) 2024-02-21T22:53:43.413 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.419+0000 7fb7aa169640 1 -- 172.21.15.116:0/1069124791 learned_addr learned my addr 172.21.15.116:0/1069124791 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:43.413 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.419+0000 7fb7a9968640 1 --2- 172.21.15.116:0/1069124791 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb7a40cb930 0x7fb7a409f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:43.413 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.419+0000 7fb7a9167640 1 --2- 172.21.15.116:0/1069124791 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb7a40d0510 0x7fb7a40a0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:43.413 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.419+0000 7fb7aa169640 1 -- 172.21.15.116:0/1069124791 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb7a40d0510 msgr2=0x7fb7a40a0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:43.413 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.419+0000 7fb7aa169640 1 --2- 172.21.15.116:0/1069124791 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb7a40d0510 0x7fb7a40a0900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:43.413 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.419+0000 7fb7aa169640 1 -- 172.21.15.116:0/1069124791 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb7a40cb930 msgr2=0x7fb7a409f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:43.413 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.419+0000 7fb7aa169640 1 --2- 172.21.15.116:0/1069124791 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb7a40cb930 0x7fb7a409f4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:43.413 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.419+0000 7fb7aa169640 1 -- 172.21.15.116:0/1069124791 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7a409fe90 con 0x7fb7a40d1c30 2024-02-21T22:53:43.414 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.419+0000 7fb7a9167640 1 --2- 172.21.15.116:0/1069124791 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb7a40d0510 0x7fb7a40a0900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T22:53:43.414 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.419+0000 7fb7a9968640 1 --2- 172.21.15.116:0/1069124791 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb7a40cb930 0x7fb7a409f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T22:53:43.414 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.420+0000 7fb7aa169640 1 --2- 172.21.15.116:0/1069124791 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb7a40d1c30 0x7fb7a40a0e40 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fb79c00b490 tx=0x7fb79c00b950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:43.414 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.420+0000 7fb79a7fc640 1 -- 172.21.15.116:0/1069124791 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb79c015020 con 0x7fb7a40d1c30 2024-02-21T22:53:43.414 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.420+0000 7fb79a7fc640 1 -- 172.21.15.116:0/1069124791 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb79c011850 con 0x7fb7a40d1c30 2024-02-21T22:53:43.414 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.420+0000 7fb7abbcc640 1 -- 172.21.15.116:0/1069124791 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7a40a0170 con 0x7fb7a40d1c30 2024-02-21T22:53:43.414 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.420+0000 7fb79a7fc640 1 -- 172.21.15.116:0/1069124791 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb79c011c40 con 0x7fb7a40d1c30 2024-02-21T22:53:43.414 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.420+0000 7fb7abbcc640 1 -- 172.21.15.116:0/1069124791 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7a415fd90 con 0x7fb7a40d1c30 2024-02-21T22:53:43.414 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.421+0000 7fb7abbcc640 1 -- 172.21.15.116:0/1069124791 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7a40752f0 con 0x7fb7a40d1c30 2024-02-21T22:53:43.414 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.421+0000 7fb79a7fc640 1 -- 172.21.15.116:0/1069124791 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fb79c018020 con 0x7fb7a40d1c30 2024-02-21T22:53:43.415 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.422+0000 7fb79a7fc640 1 --2- 172.21.15.116:0/1069124791 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fb78806b4d0 0x7fb78806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:43.415 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.422+0000 7fb79a7fc640 1 -- 172.21.15.116:0/1069124791 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb79c08a0b0 con 0x7fb7a40d1c30 2024-02-21T22:53:43.415 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.422+0000 7fb7a9968640 1 --2- 172.21.15.116:0/1069124791 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fb78806b4d0 0x7fb78806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:43.415 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.422+0000 7fb7a9968640 1 --2- 172.21.15.116:0/1069124791 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fb78806b4d0 0x7fb78806d990 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fb7a0007fd0 tx=0x7fb7a0005b70 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:43.416 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.426+0000 7fb79a7fc640 1 -- 172.21.15.116:0/1069124791 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7fb79c01f020 con 0x7fb7a40d1c30 2024-02-21T22:53:43.590 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.599+0000 7fb7abbcc640 1 -- 172.21.15.116:0/1069124791 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb7a41588c0 con 0x7fb7a40d1c30 2024-02-21T22:53:43.591 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.600+0000 7fb79a7fc640 1 -- 172.21.15.116:0/1069124791 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+16730 (secure 0 0 0) 0x7fb79c0172c0 con 0x7fb7a40d1c30 2024-02-21T22:53:43.591 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-02-21T22:53:43.591 INFO:teuthology.orchestra.run.smithi116.stdout:{"epoch":32,"fsid":"7c298660-5f63-4b5c-a800-58c5be9a8445","created":"2024-02-21T22:52:25.994613+0000","modified":"2024-02-21T22:53:42.328462+0000","last_up_change":"2024-02-21T22:52:37.313595+0000","last_in_change":"2024-02-21T22:52:28.176031+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-21T22:52:38.328796+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-02-21T22:53:40.752689+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-02-21T22:53:41.300199+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4f09126b-b5e4-4876-8b08-f5cbb967388a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":1613202231},{"type":"v1","addr":"172.21.15.116:6809","nonce":1613202231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":1613202231},{"type":"v1","addr":"172.21.15.116:6811","nonce":1613202231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":1613202231},{"type":"v1","addr":"172.21.15.116:6815","nonce":1613202231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":1613202231},{"type":"v1","addr":"172.21.15.116:6813","nonce":1613202231}]},"public_addr":"172.21.15.116:6809/1613202231","cluster_addr":"172.21.15.116:6811/1613202231","heartbeat_back_addr":"172.21.15.116:6815/1613202231","heartbeat_front_addr":"172.21.15.116:6813/1613202231","state":["exists","up"]},{"osd":1,"uuid":"7272c51d-51f9-4536-931d-33ad7a4b377e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6816","nonce":172614746},{"type":"v1","addr":"172.21.15.116:6817","nonce":172614746}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":172614746},{"type":"v1","addr":"172.21.15.116:6819","nonce":172614746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":172614746},{"type":"v1","addr":"172.21.15.116:6823","nonce":172614746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":172614746},{"type":"v1","addr":"172.21.15.116:6821","nonce":172614746}]},"public_addr":"172.21.15.116:6817/172614746","cluster_addr":"172.21.15.116:6819/172614746","heartbeat_back_addr":"172.21.15.116:6823/172614746","heartbeat_front_addr":"172.21.15.116:6821/172614746","state":["exists","up"]},{"osd":2,"uuid":"2589616c-adf1-4187-aac3-735256cf624b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":1029280577},{"type":"v1","addr":"172.21.15.116:6825","nonce":1029280577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":1029280577},{"type":"v1","addr":"172.21.15.116:6827","nonce":1029280577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":1029280577},{"type":"v1","addr":"172.21.15.116:6831","nonce":1029280577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":1029280577},{"type":"v1","addr":"172.21.15.116:6829","nonce":1029280577}]},"public_addr":"172.21.15.116:6825/1029280577","cluster_addr":"172.21.15.116:6827/1029280577","heartbeat_back_addr":"172.21.15.116:6831/1029280577","heartbeat_front_addr":"172.21.15.116:6829/1029280577","state":["exists","up"]},{"osd":3,"uuid":"0fd2e563-7c5b-46f6-82c2-b60c86072c93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":3106627557},{"type":"v1","addr":"172.21.15.116:6801","nonce":3106627557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":3106627557},{"type":"v1","addr":"172.21.15.116:6803","nonce":3106627557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":3106627557},{"type":"v1","addr":"172.21.15.116:6807","nonce":3106627557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":3106627557},{"type":"v1","addr":"172.21.15.116:6805","nonce":3106627557}]},"public_addr":"172.21.15.116:6801/3106627557","cluster_addr":"172.21.15.116:6803/3106627557","heartbeat_back_addr":"172.21.15.116:6807/3106627557","heartbeat_front_addr":"172.21.15.116:6805/3106627557","state":["exists","up"]},{"osd":4,"uuid":"79ae35b7-dda8-4ab8-96ce-47515afde082","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":3231407772},{"type":"v1","addr":"172.21.15.142:6825","nonce":3231407772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":3231407772},{"type":"v1","addr":"172.21.15.142:6827","nonce":3231407772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":3231407772},{"type":"v1","addr":"172.21.15.142:6831","nonce":3231407772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":3231407772},{"type":"v1","addr":"172.21.15.142:6829","nonce":3231407772}]},"public_addr":"172.21.15.142:6825/3231407772","cluster_addr":"172.21.15.142:6827/3231407772","heartbeat_back_addr":"172.21.15.142:6831/3231407772","heartbeat_front_addr":"172.21.15.142:6829/3231407772","state":["exists","up"]},{"osd":5,"uuid":"3166eb2c-3fcf-41c8-9362-45bafaabaa39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":1184158716},{"type":"v1","addr":"172.21.15.142:6817","nonce":1184158716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":1184158716},{"type":"v1","addr":"172.21.15.142:6819","nonce":1184158716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":1184158716},{"type":"v1","addr":"172.21.15.142:6823","nonce":1184158716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":1184158716},{"type":"v1","addr":"172.21.15.142:6821","nonce":1184158716}]},"public_addr":"172.21.15.142:6817/1184158716","cluster_addr":"172.21.15.142:6819/1184158716","heartbeat_back_addr":"172.21.15.142:6823/1184158716","heartbeat_front_addr":"172.21.15.142:6821/1184158716","state":["exists","up"]},{"osd":6,"uuid":"f9aa9672-7527-43e2-963e-b61868e5e63f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":1987868911},{"type":"v1","addr":"172.21.15.142:6801","nonce":1987868911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":1987868911},{"type":"v1","addr":"172.21.15.142:6803","nonce":1987868911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":1987868911},{"type":"v1","addr":"172.21.15.142:6807","nonce":1987868911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":1987868911},{"type":"v1","addr":"172.21.15.142:6805","nonce":1987868911}]},"public_addr":"172.21.15.142:6801/1987868911","cluster_addr":"172.21.15.142:6803/1987868911","heartbeat_back_addr":"172.21.15.142:6807/1987868911","heartbeat_front_addr":"172.21.15.142:6805/1987868911","state":["exists","up"]},{"osd":7,"uuid":"7ed29226-fc42-4382-a91a-fa50f7ec5426","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":1272081937},{"type":"v1","addr":"172.21.15.142:6809","nonce":1272081937}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":1272081937},{"type":"v1","addr":"172.21.15.142:6811","nonce":1272081937}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":1272081937},{"type":"v1","addr":"172.21.15.142:6815","nonce":1272081937}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":1272081937},{"type":"v1","addr":"172.21.15.142:6813","nonce":1272081937}]},"public_addr":"172.21.15.142:6809/1272081937","cluster_addr":"172.21.15.142:6811/1272081937","heartbeat_back_addr":"172.21.15.142:6815/1272081937","heartbeat_front_addr":"172.21.15.142:6813/1272081937","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.350998+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.307201+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.289112+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.243888+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.312091+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.370472+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.275659+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.289297+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-21T22:53:43.593 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.602+0000 7fb7abbcc640 1 -- 172.21.15.116:0/1069124791 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fb78806b4d0 msgr2=0x7fb78806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:43.593 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.602+0000 7fb7abbcc640 1 --2- 172.21.15.116:0/1069124791 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fb78806b4d0 0x7fb78806d990 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fb7a0007fd0 tx=0x7fb7a0005b70 comp rx=0 tx=0).stop 2024-02-21T22:53:43.593 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.602+0000 7fb7abbcc640 1 -- 172.21.15.116:0/1069124791 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb7a40d1c30 msgr2=0x7fb7a40a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:43.593 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.602+0000 7fb7abbcc640 1 --2- 172.21.15.116:0/1069124791 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb7a40d1c30 0x7fb7a40a0e40 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fb79c00b490 tx=0x7fb79c00b950 comp rx=0 tx=0).stop 2024-02-21T22:53:43.594 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.602+0000 7fb7abbcc640 1 -- 172.21.15.116:0/1069124791 shutdown_connections 2024-02-21T22:53:43.594 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.602+0000 7fb7abbcc640 1 --2- 172.21.15.116:0/1069124791 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb7a40d1c30 0x7fb7a40a0e40 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:43.594 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.602+0000 7fb7abbcc640 1 --2- 172.21.15.116:0/1069124791 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fb78806b4d0 0x7fb78806d990 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:43.594 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.602+0000 7fb7abbcc640 1 --2- 172.21.15.116:0/1069124791 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb7a40d0510 0x7fb7a40a0900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:43.594 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.602+0000 7fb7abbcc640 1 --2- 172.21.15.116:0/1069124791 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb7a40cb930 0x7fb7a409f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:43.594 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.602+0000 7fb7abbcc640 1 -- 172.21.15.116:0/1069124791 >> 172.21.15.116:0/1069124791 conn(0x7fb7a40d3e50 msgr2=0x7fb7a415d930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:43.594 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.603+0000 7fb7abbcc640 1 -- 172.21.15.116:0/1069124791 shutdown_connections 2024-02-21T22:53:43.594 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.603+0000 7fb7abbcc640 1 -- 172.21.15.116:0/1069124791 wait complete. 2024-02-21T22:53:43.604 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-02-21T22:53:43.708 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.717+0000 7f43d619c640 1 Processor -- start 2024-02-21T22:53:43.708 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.717+0000 7f43d619c640 1 -- start start 2024-02-21T22:53:43.709 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.717+0000 7f43d619c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f43d00d2b10 0x7f43d00d4940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:43.709 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.717+0000 7f43d619c640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f43d015da70 0x7f43d015df20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:43.709 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.717+0000 7f43d619c640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43d00ceea0 con 0x7f43d00d0ca0 2024-02-21T22:53:43.709 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.717+0000 7f43d619c640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43d00cf180 con 0x7f43d015da70 2024-02-21T22:53:43.709 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.717+0000 7f43d619c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43d00cf460 con 0x7f43d00d2b10 2024-02-21T22:53:43.709 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.718+0000 7f43cffff640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f43d015da70 0x7f43d015df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:43.709 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.718+0000 7f43cffff640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f43d015da70 0x7f43d015df20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:38200/0 (socket says 172.21.15.116:38200) 2024-02-21T22:53:43.709 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.718+0000 7f43cffff640 1 -- 172.21.15.116:0/3526705136 learned_addr learned my addr 172.21.15.116:0/3526705136 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:43.709 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.718+0000 7f43cffff640 1 -- 172.21.15.116:0/3526705136 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f43d00d2b10 msgr2=0x7f43d00d4940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:53:43.709 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.718+0000 7f43cffff640 1 --2- 172.21.15.116:0/3526705136 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f43d00d2b10 0x7f43d00d4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:43.709 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.718+0000 7f43cffff640 1 -- 172.21.15.116:0/3526705136 >> v1:172.21.15.142:6789/0 conn(0x7f43d00d0ca0 legacy=0x7f43d00d2400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:53:43.709 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.718+0000 7f43cffff640 1 -- 172.21.15.116:0/3526705136 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43d00cf740 con 0x7f43d015da70 2024-02-21T22:53:43.711 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.719+0000 7f43cffff640 1 --2- 172.21.15.116:0/3526705136 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f43d015da70 0x7f43d015df20 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f43c8009e50 tx=0x7f43c802bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61a6786269ba9ebc server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:43.711 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.719+0000 7f43ce7fc640 1 -- 172.21.15.116:0/3526705136 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43c802cb00 con 0x7f43d015da70 2024-02-21T22:53:43.711 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.719+0000 7f43ce7fc640 1 -- 172.21.15.116:0/3526705136 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43c802cca0 con 0x7f43d015da70 2024-02-21T22:53:43.711 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.719+0000 7f43ce7fc640 1 -- 172.21.15.116:0/3526705136 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43c8034610 con 0x7f43d015da70 2024-02-21T22:53:43.711 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.719+0000 7f43d619c640 1 -- 172.21.15.116:0/3526705136 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f43d015da70 msgr2=0x7f43d015df20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:43.711 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.719+0000 7f43d619c640 1 --2- 172.21.15.116:0/3526705136 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f43d015da70 0x7f43d015df20 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f43c8009e50 tx=0x7f43c802bf60 comp rx=0 tx=0).stop 2024-02-21T22:53:43.711 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.719+0000 7f43d619c640 1 -- 172.21.15.116:0/3526705136 shutdown_connections 2024-02-21T22:53:43.711 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.719+0000 7f43d619c640 1 --2- 172.21.15.116:0/3526705136 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f43d015da70 0x7f43d015df20 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:43.711 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.719+0000 7f43d619c640 1 --2- 172.21.15.116:0/3526705136 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f43d00d2b10 0x7f43d00d4940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:43.711 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.719+0000 7f43d619c640 1 -- 172.21.15.116:0/3526705136 >> 172.21.15.116:0/3526705136 conn(0x7f43d00d3e20 msgr2=0x7f43d00d4230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:43.712 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.719+0000 7f43d619c640 1 -- 172.21.15.116:0/3526705136 shutdown_connections 2024-02-21T22:53:43.712 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.719+0000 7f43d619c640 1 -- 172.21.15.116:0/3526705136 wait complete. 2024-02-21T22:53:43.712 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.720+0000 7f43d619c640 1 Processor -- start 2024-02-21T22:53:43.712 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.721+0000 7f43d619c640 1 -- start start 2024-02-21T22:53:43.714 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.721+0000 7f43d619c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f43d00d0ca0 0x7f43d015f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:43.714 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.721+0000 7f43d619c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f43d00d2b10 0x7f43d00cd0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:43.714 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.721+0000 7f43d619c640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f43d015da70 0x7f43d00cd620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:43.715 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.721+0000 7f43d619c640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43d00d1200 con 0x7f43d015da70 2024-02-21T22:53:43.715 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.721+0000 7f43d619c640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43d00d1080 con 0x7f43d00d0ca0 2024-02-21T22:53:43.715 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.721+0000 7f43d619c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43d00ceaa0 con 0x7f43d00d2b10 2024-02-21T22:53:43.715 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.721+0000 7f43cffff640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f43d015da70 0x7f43d00cd620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:43.715 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.721+0000 7f43cffff640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f43d015da70 0x7f43d00cd620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:38216/0 (socket says 172.21.15.116:38216) 2024-02-21T22:53:43.715 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.721+0000 7f43cffff640 1 -- 172.21.15.116:0/2711197972 learned_addr learned my addr 172.21.15.116:0/2711197972 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:43.715 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.722+0000 7f43cf7fe640 1 --2- 172.21.15.116:0/2711197972 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f43d00d0ca0 0x7f43d015f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:43.715 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.722+0000 7f43ceffd640 1 --2- 172.21.15.116:0/2711197972 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f43d00d2b10 0x7f43d00cd0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:43.715 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.722+0000 7f43cffff640 1 -- 172.21.15.116:0/2711197972 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f43d00d2b10 msgr2=0x7f43d00cd0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:43.715 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.722+0000 7f43cffff640 1 --2- 172.21.15.116:0/2711197972 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f43d00d2b10 0x7f43d00cd0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:43.715 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.722+0000 7f43cffff640 1 -- 172.21.15.116:0/2711197972 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f43d00d0ca0 msgr2=0x7f43d015f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:43.715 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.722+0000 7f43cffff640 1 --2- 172.21.15.116:0/2711197972 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f43d00d0ca0 0x7f43d015f0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:43.715 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.722+0000 7f43cffff640 1 -- 172.21.15.116:0/2711197972 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43d01e7f80 con 0x7f43d015da70 2024-02-21T22:53:43.715 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.722+0000 7f43cffff640 1 --2- 172.21.15.116:0/2711197972 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f43d015da70 0x7f43d00cd620 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f43c8036040 tx=0x7f43c8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:43.715 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.722+0000 7f43b7fff640 1 -- 172.21.15.116:0/2711197972 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43c8043020 con 0x7f43d015da70 2024-02-21T22:53:43.716 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.722+0000 7f43b7fff640 1 -- 172.21.15.116:0/2711197972 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43c802ce50 con 0x7f43d015da70 2024-02-21T22:53:43.716 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.722+0000 7f43d619c640 1 -- 172.21.15.116:0/2711197972 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43d015e040 con 0x7f43d015da70 2024-02-21T22:53:43.716 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.722+0000 7f43b7fff640 1 -- 172.21.15.116:0/2711197972 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43c803e650 con 0x7f43d015da70 2024-02-21T22:53:43.716 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.722+0000 7f43d619c640 1 -- 172.21.15.116:0/2711197972 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43d015e600 con 0x7f43d015da70 2024-02-21T22:53:43.716 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.723+0000 7f43d619c640 1 -- 172.21.15.116:0/2711197972 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43d00752f0 con 0x7f43d015da70 2024-02-21T22:53:43.716 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.723+0000 7f43b7fff640 1 -- 172.21.15.116:0/2711197972 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f43c8046020 con 0x7f43d015da70 2024-02-21T22:53:43.716 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.724+0000 7f43b7fff640 1 --2- 172.21.15.116:0/2711197972 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f43bc06b4d0 0x7f43bc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:43.716 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.724+0000 7f43b7fff640 1 -- 172.21.15.116:0/2711197972 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f43c80ac830 con 0x7f43d015da70 2024-02-21T22:53:43.716 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.724+0000 7f43cf7fe640 1 --2- 172.21.15.116:0/2711197972 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f43bc06b4d0 0x7f43bc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:43.716 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.724+0000 7f43cf7fe640 1 --2- 172.21.15.116:0/2711197972 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f43bc06b4d0 0x7f43bc06d990 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f43d00a1d60 tx=0x7f43c0009060 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:43.718 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.728+0000 7f43b7fff640 1 -- 172.21.15.116:0/2711197972 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f43c804d030 con 0x7f43d015da70 2024-02-21T22:53:43.927 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.937+0000 7f43d619c640 1 -- 172.21.15.116:0/2711197972 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f43d00d21e0 con 0x7f43d015da70 2024-02-21T22:53:43.989 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:43.999+0000 7f43b7fff640 1 -- 172.21.15.116:0/2711197972 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v12) v1 ==== 118+0+0 (secure 0 0 0) 0x7f43d01e7f80 con 0x7f43d015da70 2024-02-21T22:53:43.992 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:44.001+0000 7f43d619c640 1 -- 172.21.15.116:0/2711197972 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f43bc06b4d0 msgr2=0x7f43bc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:43.992 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:44.001+0000 7f43d619c640 1 --2- 172.21.15.116:0/2711197972 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f43bc06b4d0 0x7f43bc06d990 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f43d00a1d60 tx=0x7f43c0009060 comp rx=0 tx=0).stop 2024-02-21T22:53:43.992 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:44.001+0000 7f43d619c640 1 -- 172.21.15.116:0/2711197972 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f43d015da70 msgr2=0x7f43d00cd620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:43.992 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:44.001+0000 7f43d619c640 1 --2- 172.21.15.116:0/2711197972 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f43d015da70 0x7f43d00cd620 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f43c8036040 tx=0x7f43c8004a40 comp rx=0 tx=0).stop 2024-02-21T22:53:43.992 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:44.001+0000 7f43d619c640 1 -- 172.21.15.116:0/2711197972 shutdown_connections 2024-02-21T22:53:43.992 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:44.001+0000 7f43d619c640 1 --2- 172.21.15.116:0/2711197972 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f43d015da70 0x7f43d00cd620 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:43.993 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:44.001+0000 7f43d619c640 1 --2- 172.21.15.116:0/2711197972 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f43bc06b4d0 0x7f43bc06d990 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:43.993 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:44.001+0000 7f43d619c640 1 --2- 172.21.15.116:0/2711197972 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f43d00d2b10 0x7f43d00cd0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:43.993 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:44.001+0000 7f43d619c640 1 --2- 172.21.15.116:0/2711197972 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f43d00d0ca0 0x7f43d015f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:43.993 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:44.001+0000 7f43d619c640 1 -- 172.21.15.116:0/2711197972 >> 172.21.15.116:0/2711197972 conn(0x7f43d00d3e20 msgr2=0x7f43d00d19d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:43.993 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:44.001+0000 7f43d619c640 1 -- 172.21.15.116:0/2711197972 shutdown_connections 2024-02-21T22:53:43.993 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:44.001+0000 7f43d619c640 1 -- 172.21.15.116:0/2711197972 wait complete. 2024-02-21T22:53:44.003 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-02-21T22:53:44.003 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-02-21T22:53:44.115 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:44.116+0000 7ff5162de640 1 Processor -- start 2024-02-21T22:53:44.116 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:44.117+0000 7ff5162de640 1 -- start start 2024-02-21T22:53:44.116 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:44.117+0000 7ff5162de640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff5100cf260 0x7ff5100ce5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:44.116 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:44.117+0000 7ff5162de640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7ff5100ceb00 0x7ff5100b54f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:44.116 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:44.117+0000 7ff5162de640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5100cdde0 con 0x7ff51015c140 2024-02-21T22:53:44.116 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:44.117+0000 7ff5162de640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5100cef50 con 0x7ff5100ceb00 2024-02-21T22:53:44.116 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:44.117+0000 7ff5162de640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5100ce0c0 con 0x7ff5100cf260 2024-02-21T22:53:44.117 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:44.117+0000 7ff51487b640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7ff5100ceb00 0x7ff5100b54f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:44.117 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:44.117+0000 7ff51487b640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7ff5100ceb00 0x7ff5100b54f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:38222/0 (socket says 172.21.15.116:38222) 2024-02-21T22:53:44.117 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:44.117+0000 7ff51487b640 1 -- 172.21.15.116:0/3346933400 learned_addr learned my addr 172.21.15.116:0/3346933400 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:44.117 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:44.117+0000 7ff50f7fe640 1 --2- 172.21.15.116:0/3346933400 >> v2:172.21.15.142:3300/0 conn(0x7ff5100cf260 0x7ff5100ce5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:44.117 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:44.118+0000 7ff51487b640 1 -- 172.21.15.116:0/3346933400 >> v2:172.21.15.142:3300/0 conn(0x7ff5100cf260 msgr2=0x7ff5100ce5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:53:44.117 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:44.118+0000 7ff51487b640 1 --2- 172.21.15.116:0/3346933400 >> v2:172.21.15.142:3300/0 conn(0x7ff5100cf260 0x7ff5100ce5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:44.118 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:44.118+0000 7ff51487b640 1 -- 172.21.15.116:0/3346933400 >> v1:172.21.15.142:6789/0 conn(0x7ff51015c140 legacy=0x7ff5100cd590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:44.118 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:44.118+0000 7ff51487b640 1 -- 172.21.15.116:0/3346933400 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5100b4cf0 con 0x7ff5100ceb00 2024-02-21T22:53:44.118 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:44.118+0000 7ff51487b640 1 --2- 172.21.15.116:0/3346933400 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff5100ceb00 0x7ff5100b54f0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7ff5100688f0 tx=0x7ff50802bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b8cfcd4fc2368aa server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:44.118 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:44.119+0000 7ff50effd640 1 -- 172.21.15.116:0/3346933400 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff50802cb20 con 0x7ff5100ceb00 2024-02-21T22:53:44.118 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:44.119+0000 7ff50effd640 1 -- 172.21.15.116:0/3346933400 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff50802ccc0 con 0x7ff5100ceb00 2024-02-21T22:53:44.118 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:44.119+0000 7ff50effd640 1 -- 172.21.15.116:0/3346933400 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff508034610 con 0x7ff5100ceb00 2024-02-21T22:53:44.118 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:44.119+0000 7ff5162de640 1 -- 172.21.15.116:0/3346933400 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff5100ceb00 msgr2=0x7ff5100b54f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:44.118 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:44.119+0000 7ff5162de640 1 --2- 172.21.15.116:0/3346933400 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff5100ceb00 0x7ff5100b54f0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7ff5100688f0 tx=0x7ff50802bf80 comp rx=0 tx=0).stop 2024-02-21T22:53:44.118 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:44.119+0000 7ff5162de640 1 -- 172.21.15.116:0/3346933400 shutdown_connections 2024-02-21T22:53:44.119 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:44.119+0000 7ff5162de640 1 --2- 172.21.15.116:0/3346933400 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff5100ceb00 0x7ff5100b54f0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:44.119 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:44.119+0000 7ff5162de640 1 --2- 172.21.15.116:0/3346933400 >> v2:172.21.15.142:3300/0 conn(0x7ff5100cf260 0x7ff5100ce5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:44.119 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:44.119+0000 7ff5162de640 1 -- 172.21.15.116:0/3346933400 >> 172.21.15.116:0/3346933400 conn(0x7ff5100d1c90 msgr2=0x7ff5100d20a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:44.119 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:44.119+0000 7ff5162de640 1 -- 172.21.15.116:0/3346933400 shutdown_connections 2024-02-21T22:53:44.119 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:44.119+0000 7ff5162de640 1 -- 172.21.15.116:0/3346933400 wait complete. 2024-02-21T22:53:44.119 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:44.120+0000 7ff5162de640 1 Processor -- start 2024-02-21T22:53:44.119 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:44.120+0000 7ff5162de640 1 -- start start 2024-02-21T22:53:44.120 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:44.121+0000 7ff5162de640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff5100ceb00 0x7ff510151b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:44.120 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:44.121+0000 7ff5162de640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff5100cf260 0x7ff5100c9e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:44.120 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:44.121+0000 7ff5162de640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff51015c140 0x7ff5101540d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:44.120 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:44.121+0000 7ff5162de640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5100b5a30 con 0x7ff5100ceb00 2024-02-21T22:53:44.120 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:44.121+0000 7ff5162de640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff51015c520 con 0x7ff5100cf260 2024-02-21T22:53:44.120 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:44.121+0000 7ff5162de640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5100b5bb0 con 0x7ff51015c140 2024-02-21T22:53:44.120 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:44.121+0000 7ff50ffff640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff5100ceb00 0x7ff510151b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:44.121 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:44.121+0000 7ff50ffff640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff5100ceb00 0x7ff510151b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:38234/0 (socket says 172.21.15.116:38234) 2024-02-21T22:53:44.121 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:44.121+0000 7ff50ffff640 1 -- 172.21.15.116:0/3780987439 learned_addr learned my addr 172.21.15.116:0/3780987439 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:44.121 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:44.121+0000 7ff50f7fe640 1 --2- 172.21.15.116:0/3780987439 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff5100cf260 0x7ff5100c9e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:44.121 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:44.121+0000 7ff51487b640 1 --2- 172.21.15.116:0/3780987439 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff51015c140 0x7ff5101540d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:44.121 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:44.122+0000 7ff50ffff640 1 -- 172.21.15.116:0/3780987439 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff51015c140 msgr2=0x7ff5101540d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:44.121 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:44.122+0000 7ff50ffff640 1 --2- 172.21.15.116:0/3780987439 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff51015c140 0x7ff5101540d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:44.121 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:44.122+0000 7ff50ffff640 1 -- 172.21.15.116:0/3780987439 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff5100cf260 msgr2=0x7ff5100c9e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:44.122 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:44.122+0000 7ff50ffff640 1 --2- 172.21.15.116:0/3780987439 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff5100cf260 0x7ff5100c9e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:44.122 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:44.122+0000 7ff50ffff640 1 -- 172.21.15.116:0/3780987439 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff510152a30 con 0x7ff5100ceb00 2024-02-21T22:53:44.122 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:44.122+0000 7ff50ffff640 1 --2- 172.21.15.116:0/3780987439 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff5100ceb00 0x7ff510151b60 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7ff50000c3f0 tx=0x7ff50000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:44.122 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:44.122+0000 7ff50cff9640 1 -- 172.21.15.116:0/3780987439 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5000052d0 con 0x7ff5100ceb00 2024-02-21T22:53:44.122 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:44.122+0000 7ff50cff9640 1 -- 172.21.15.116:0/3780987439 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff500005490 con 0x7ff5100ceb00 2024-02-21T22:53:44.122 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:44.122+0000 7ff50cff9640 1 -- 172.21.15.116:0/3780987439 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff500007260 con 0x7ff5100ceb00 2024-02-21T22:53:44.122 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:44.122+0000 7ff5162de640 1 -- 172.21.15.116:0/3780987439 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff510157e70 con 0x7ff5100ceb00 2024-02-21T22:53:44.122 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:44.122+0000 7ff5162de640 1 -- 172.21.15.116:0/3780987439 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff510151130 con 0x7ff5100ceb00 2024-02-21T22:53:44.122 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:44.123+0000 7ff5162de640 1 -- 172.21.15.116:0/3780987439 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff51015e640 con 0x7ff5100ceb00 2024-02-21T22:53:44.123 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:44.123+0000 7ff50cff9640 1 -- 172.21.15.116:0/3780987439 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ff500007400 con 0x7ff5100ceb00 2024-02-21T22:53:44.123 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:44.124+0000 7ff50cff9640 1 --2- 172.21.15.116:0/3780987439 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7ff4fc06b4d0 0x7ff4fc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:44.123 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:44.124+0000 7ff50cff9640 1 -- 172.21.15.116:0/3780987439 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff500089580 con 0x7ff5100ceb00 2024-02-21T22:53:44.123 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:44.124+0000 7ff50f7fe640 1 --2- 172.21.15.116:0/3780987439 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7ff4fc06b4d0 0x7ff4fc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:44.123 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:44.124+0000 7ff50f7fe640 1 --2- 172.21.15.116:0/3780987439 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7ff4fc06b4d0 0x7ff4fc06d990 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7ff5101520a0 tx=0x7ff504009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:44.124 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:44.128+0000 7ff50cff9640 1 -- 172.21.15.116:0/3780987439 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7ff500057db0 con 0x7ff5100ceb00 2024-02-21T22:53:44.328 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:44.338+0000 7ff5162de640 1 -- 172.21.15.116:0/3780987439 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7ff5100752f0 con 0x7ff5100ceb00 2024-02-21T22:53:44.852 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T22:53:44.855 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T22:53:44.996 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.005+0000 7ff50cff9640 1 -- 172.21.15.116:0/3780987439 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v13) v1 ==== 122+0+0 (secure 0 0 0) 0x7ff50005be50 con 0x7ff5100ceb00 2024-02-21T22:53:44.999 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.008+0000 7ff5162de640 1 -- 172.21.15.116:0/3780987439 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7ff4fc06b4d0 msgr2=0x7ff4fc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:44.999 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.008+0000 7ff5162de640 1 --2- 172.21.15.116:0/3780987439 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7ff4fc06b4d0 0x7ff4fc06d990 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7ff5101520a0 tx=0x7ff504009190 comp rx=0 tx=0).stop 2024-02-21T22:53:44.999 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.008+0000 7ff5162de640 1 -- 172.21.15.116:0/3780987439 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff5100ceb00 msgr2=0x7ff510151b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:44.999 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.008+0000 7ff5162de640 1 --2- 172.21.15.116:0/3780987439 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff5100ceb00 0x7ff510151b60 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7ff50000c3f0 tx=0x7ff50000c8b0 comp rx=0 tx=0).stop 2024-02-21T22:53:44.999 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.008+0000 7ff5162de640 1 -- 172.21.15.116:0/3780987439 shutdown_connections 2024-02-21T22:53:44.999 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.008+0000 7ff5162de640 1 --2- 172.21.15.116:0/3780987439 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7ff4fc06b4d0 0x7ff4fc06d990 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:44.999 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.008+0000 7ff5162de640 1 --2- 172.21.15.116:0/3780987439 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff51015c140 0x7ff5101540d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:44.999 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.008+0000 7ff5162de640 1 --2- 172.21.15.116:0/3780987439 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff5100cf260 0x7ff5100c9e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:44.999 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.008+0000 7ff5162de640 1 --2- 172.21.15.116:0/3780987439 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff5100ceb00 0x7ff510151b60 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:44.999 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.008+0000 7ff5162de640 1 -- 172.21.15.116:0/3780987439 >> 172.21.15.116:0/3780987439 conn(0x7ff5100d1c90 msgr2=0x7ff5100b5e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:44.999 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.008+0000 7ff5162de640 1 -- 172.21.15.116:0/3780987439 shutdown_connections 2024-02-21T22:53:44.999 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.008+0000 7ff5162de640 1 -- 172.21.15.116:0/3780987439 wait complete. 2024-02-21T22:53:45.011 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-02-21T22:53:45.011 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-21T22:53:45.114 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.124+0000 7fec3eade640 1 Processor -- start 2024-02-21T22:53:45.114 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.124+0000 7fec3eade640 1 -- start start 2024-02-21T22:53:45.116 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.125+0000 7fec3eade640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fec3815afb0 0x7fec380af080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:45.116 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.125+0000 7fec3eade640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fec38071c90 0x7fec380b3860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:45.116 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.125+0000 7fec3eade640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec380710e0 con 0x7fec38070b70 2024-02-21T22:53:45.116 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.125+0000 7fec3eade640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec3815b390 con 0x7fec38071c90 2024-02-21T22:53:45.117 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.125+0000 7fec3eade640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec380713c0 con 0x7fec3815afb0 2024-02-21T22:53:45.117 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.125+0000 7fec3d07b640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fec38071c90 0x7fec380b3860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:45.117 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.125+0000 7fec3d07b640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fec38071c90 0x7fec380b3860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:38246/0 (socket says 172.21.15.116:38246) 2024-02-21T22:53:45.117 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.125+0000 7fec37fff640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7fec38070b70 0x7fec38071580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:54236/0 (socket says 172.21.15.116:54236) 2024-02-21T22:53:45.117 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.125+0000 7fec3d07b640 1 -- 172.21.15.116:0/3125405472 learned_addr learned my addr 172.21.15.116:0/3125405472 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:45.117 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.125+0000 7fec3c87a640 1 --2- 172.21.15.116:0/3125405472 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fec3815afb0 0x7fec380af080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:45.117 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.125+0000 7fec3d07b640 1 -- 172.21.15.116:0/3125405472 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fec3815afb0 msgr2=0x7fec380af080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:53:45.117 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.125+0000 7fec3d07b640 1 --2- 172.21.15.116:0/3125405472 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fec3815afb0 0x7fec380af080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:45.117 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.125+0000 7fec3d07b640 1 -- 172.21.15.116:0/3125405472 >> v1:172.21.15.116:6789/0 conn(0x7fec38070b70 legacy=0x7fec38071580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:45.117 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.125+0000 7fec3d07b640 1 -- 172.21.15.116:0/3125405472 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec380b2d80 con 0x7fec38071c90 2024-02-21T22:53:45.117 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.126+0000 7fec3d07b640 1 --2- 172.21.15.116:0/3125405472 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fec38071c90 0x7fec380b3860 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fec30009e50 tx=0x7fec3002e200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56fcf69f175406c9 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:45.117 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.126+0000 7fec377fe640 1 -- 172.21.15.116:0/3125405472 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec3002eda0 con 0x7fec38071c90 2024-02-21T22:53:45.117 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.126+0000 7fec377fe640 1 -- 172.21.15.116:0/3125405472 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec300363f0 con 0x7fec38071c90 2024-02-21T22:53:45.117 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.126+0000 7fec377fe640 1 -- 172.21.15.116:0/3125405472 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec300367c0 con 0x7fec38071c90 2024-02-21T22:53:45.118 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.126+0000 7fec3eade640 1 -- 172.21.15.116:0/3125405472 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fec38071c90 msgr2=0x7fec380b3860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:45.118 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.126+0000 7fec3eade640 1 --2- 172.21.15.116:0/3125405472 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fec38071c90 0x7fec380b3860 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fec30009e50 tx=0x7fec3002e200 comp rx=0 tx=0).stop 2024-02-21T22:53:45.119 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.127+0000 7fec3eade640 1 -- 172.21.15.116:0/3125405472 shutdown_connections 2024-02-21T22:53:45.119 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.127+0000 7fec3eade640 1 --2- 172.21.15.116:0/3125405472 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fec38071c90 0x7fec380b3860 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:45.119 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.127+0000 7fec3eade640 1 --2- 172.21.15.116:0/3125405472 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fec3815afb0 0x7fec380af080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:45.119 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.127+0000 7fec3eade640 1 -- 172.21.15.116:0/3125405472 >> 172.21.15.116:0/3125405472 conn(0x7fec380b18e0 msgr2=0x7fec380b1cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:45.119 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.127+0000 7fec3eade640 1 -- 172.21.15.116:0/3125405472 shutdown_connections 2024-02-21T22:53:45.119 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.127+0000 7fec3eade640 1 -- 172.21.15.116:0/3125405472 wait complete. 2024-02-21T22:53:45.119 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.128+0000 7fec3eade640 1 Processor -- start 2024-02-21T22:53:45.119 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.128+0000 7fec3eade640 1 -- start start 2024-02-21T22:53:45.121 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.129+0000 7fec3eade640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fec38070b70 0x7fec381efd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:45.121 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.129+0000 7fec3eade640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fec38071c90 0x7fec380af740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:45.121 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.129+0000 7fec3eade640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fec3815afb0 0x7fec380afc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:45.121 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.129+0000 7fec3eade640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec380af5c0 con 0x7fec38071c90 2024-02-21T22:53:45.121 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.129+0000 7fec3eade640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec380b3340 con 0x7fec38070b70 2024-02-21T22:53:45.121 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.129+0000 7fec3eade640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec380b3da0 con 0x7fec3815afb0 2024-02-21T22:53:45.121 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.129+0000 7fec37fff640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fec38071c90 0x7fec380af740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:45.122 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.129+0000 7fec37fff640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fec38071c90 0x7fec380af740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:38250/0 (socket says 172.21.15.116:38250) 2024-02-21T22:53:45.122 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.129+0000 7fec37fff640 1 -- 172.21.15.116:0/2945150665 learned_addr learned my addr 172.21.15.116:0/2945150665 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:45.122 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.129+0000 7fec3c87a640 1 --2- 172.21.15.116:0/2945150665 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fec38070b70 0x7fec381efd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:45.122 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.129+0000 7fec3d07b640 1 --2- 172.21.15.116:0/2945150665 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fec3815afb0 0x7fec380afc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:45.122 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.129+0000 7fec37fff640 1 -- 172.21.15.116:0/2945150665 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fec3815afb0 msgr2=0x7fec380afc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:45.122 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.129+0000 7fec37fff640 1 --2- 172.21.15.116:0/2945150665 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fec3815afb0 0x7fec380afc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:45.122 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.129+0000 7fec37fff640 1 -- 172.21.15.116:0/2945150665 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fec38070b70 msgr2=0x7fec381efd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:45.122 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.129+0000 7fec37fff640 1 --2- 172.21.15.116:0/2945150665 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fec38070b70 0x7fec381efd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:45.122 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.129+0000 7fec37fff640 1 -- 172.21.15.116:0/2945150665 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec3809aba0 con 0x7fec38071c90 2024-02-21T22:53:45.122 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.129+0000 7fec37fff640 1 --2- 172.21.15.116:0/2945150665 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fec38071c90 0x7fec380af740 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fec2400c400 tx=0x7fec2400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:45.122 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.129+0000 7fec357fa640 1 -- 172.21.15.116:0/2945150665 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec240074e0 con 0x7fec38071c90 2024-02-21T22:53:45.123 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.129+0000 7fec357fa640 1 -- 172.21.15.116:0/2945150665 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec24007680 con 0x7fec38071c90 2024-02-21T22:53:45.123 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.129+0000 7fec357fa640 1 -- 172.21.15.116:0/2945150665 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec24004a00 con 0x7fec38071c90 2024-02-21T22:53:45.123 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.129+0000 7fec3eade640 1 -- 172.21.15.116:0/2945150665 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec3815cdb0 con 0x7fec38071c90 2024-02-21T22:53:45.123 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.129+0000 7fec3eade640 1 -- 172.21.15.116:0/2945150665 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec38153620 con 0x7fec38071c90 2024-02-21T22:53:45.123 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.130+0000 7fec3eade640 1 -- 172.21.15.116:0/2945150665 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec380752f0 con 0x7fec38071c90 2024-02-21T22:53:45.123 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.131+0000 7fec357fa640 1 -- 172.21.15.116:0/2945150665 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fec2401a020 con 0x7fec38071c90 2024-02-21T22:53:45.123 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.131+0000 7fec357fa640 1 --2- 172.21.15.116:0/2945150665 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fec1c06b4d0 0x7fec1c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:45.124 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.131+0000 7fec357fa640 1 -- 172.21.15.116:0/2945150665 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fec24089860 con 0x7fec38071c90 2024-02-21T22:53:45.124 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.131+0000 7fec3c87a640 1 --2- 172.21.15.116:0/2945150665 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fec1c06b4d0 0x7fec1c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:45.124 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.132+0000 7fec3c87a640 1 --2- 172.21.15.116:0/2945150665 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fec1c06b4d0 0x7fec1c06d990 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fec2c009aa0 tx=0x7fec2c009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:45.125 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.135+0000 7fec357fa640 1 -- 172.21.15.116:0/2945150665 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7fec24058120 con 0x7fec38071c90 2024-02-21T22:53:45.335 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.344+0000 7fec3eade640 1 -- 172.21.15.116:0/2945150665 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fec380ae9a0 con 0x7fec38071c90 2024-02-21T22:53:45.335 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.344+0000 7fec357fa640 1 -- 172.21.15.116:0/2945150665 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+4943 (secure 0 0 0) 0x7fec24089020 con 0x7fec38071c90 2024-02-21T22:53:45.335 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-02-21T22:53:45.335 INFO:teuthology.orchestra.run.smithi116.stdout:{"epoch":13,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4808,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6834/422696755","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":422696755},{"type":"v1","addr":"172.21.15.116:6834","nonce":422696755}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":4820,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/1258680028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":1258680028},{"type":"v1","addr":"172.21.15.142:6836","nonce":1258680028}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":5097,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6835/758247165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6833","nonce":758247165},{"type":"v1","addr":"172.21.15.116:6835","nonce":758247165}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-21T22:53:42.328760+0000","modified":"2024-02-21T22:53:44.339386+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5098},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5098":{"gid":5098,"name":"d","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6837/3133486359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":3133486359},{"type":"v1","addr":"172.21.15.142:6837","nonce":3133486359}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-02-21T22:53:45.336 INFO:teuthology.orchestra.run.smithi116.stderr:dumped fsmap epoch 13 2024-02-21T22:53:45.337 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.347+0000 7fec3eade640 1 -- 172.21.15.116:0/2945150665 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fec1c06b4d0 msgr2=0x7fec1c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:45.338 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.347+0000 7fec3eade640 1 --2- 172.21.15.116:0/2945150665 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fec1c06b4d0 0x7fec1c06d990 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fec2c009aa0 tx=0x7fec2c009190 comp rx=0 tx=0).stop 2024-02-21T22:53:45.338 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.347+0000 7fec3eade640 1 -- 172.21.15.116:0/2945150665 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fec38071c90 msgr2=0x7fec380af740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:45.338 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.347+0000 7fec3eade640 1 --2- 172.21.15.116:0/2945150665 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fec38071c90 0x7fec380af740 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fec2400c400 tx=0x7fec2400c8c0 comp rx=0 tx=0).stop 2024-02-21T22:53:45.338 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.347+0000 7fec3eade640 1 -- 172.21.15.116:0/2945150665 shutdown_connections 2024-02-21T22:53:45.338 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.347+0000 7fec3eade640 1 --2- 172.21.15.116:0/2945150665 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fec1c06b4d0 0x7fec1c06d990 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:45.338 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.347+0000 7fec3eade640 1 --2- 172.21.15.116:0/2945150665 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fec3815afb0 0x7fec380afc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:45.338 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.347+0000 7fec3eade640 1 --2- 172.21.15.116:0/2945150665 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fec38071c90 0x7fec380af740 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:45.338 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.347+0000 7fec3eade640 1 --2- 172.21.15.116:0/2945150665 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fec38070b70 0x7fec381efd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:45.338 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.347+0000 7fec3eade640 1 -- 172.21.15.116:0/2945150665 >> 172.21.15.116:0/2945150665 conn(0x7fec380b18e0 msgr2=0x7fec380b1cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:45.338 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.347+0000 7fec3eade640 1 -- 172.21.15.116:0/2945150665 shutdown_connections 2024-02-21T22:53:45.338 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.347+0000 7fec3eade640 1 -- 172.21.15.116:0/2945150665 wait complete. 2024-02-21T22:53:45.348 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-21T22:53:45.449 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.458+0000 7f49f43cc640 1 Processor -- start 2024-02-21T22:53:45.449 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.458+0000 7f49f43cc640 1 -- start start 2024-02-21T22:53:45.452 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.459+0000 7f49f43cc640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f49ec0d1c30 0x7f49ec0d2430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:45.452 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.459+0000 7f49f43cc640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49ec0cfa50 con 0x7f49ec0d0510 2024-02-21T22:53:45.452 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.459+0000 7f49f43cc640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49ec0cfcc0 con 0x7f49ec0cb930 2024-02-21T22:53:45.453 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.459+0000 7f49f43cc640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49ec0d1450 con 0x7f49ec0d1c30 2024-02-21T22:53:45.453 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.459+0000 7f49f2168640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f49ec0d0510 0x7f49ec0d08f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:47278/0 (socket says 172.21.15.116:47278) 2024-02-21T22:53:45.453 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.459+0000 7f49f2168640 1 -- 172.21.15.116:0/279479611 learned_addr learned my addr 172.21.15.116:0/279479611 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-02-21T22:53:45.453 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.460+0000 7f49f1967640 1 --2- 172.21.15.116:0/279479611 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f49ec0d1c30 0x7f49ec0d2430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:45.453 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.460+0000 7f49f1166640 1 -- 172.21.15.116:0/279479611 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2050785267 0 0) 0x7f49ec0cfa50 con 0x7f49ec0d0510 2024-02-21T22:53:45.453 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.460+0000 7f49f1166640 1 -- 172.21.15.116:0/279479611 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f49d8003520 con 0x7f49ec0d0510 2024-02-21T22:53:45.453 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.460+0000 7f49f1166640 1 -- 172.21.15.116:0/279479611 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3820573731 0 0) 0x7f49ec0cfcc0 con 0x7f49ec0cb930 2024-02-21T22:53:45.453 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.460+0000 7f49f1166640 1 -- 172.21.15.116:0/279479611 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f49ec0cfa50 con 0x7f49ec0cb930 2024-02-21T22:53:45.453 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.460+0000 7f49f1166640 1 -- 172.21.15.116:0/279479611 <== mon.0 v1:172.21.15.116:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3568855115 0 0) 0x7f49d8003520 con 0x7f49ec0d0510 2024-02-21T22:53:45.453 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.460+0000 7f49f1166640 1 -- 172.21.15.116:0/279479611 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f49ec0d1c30 msgr2=0x7f49ec0d2430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:53:45.453 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.460+0000 7f49f1166640 1 --2- 172.21.15.116:0/279479611 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f49ec0d1c30 0x7f49ec0d2430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:45.453 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.460+0000 7f49f1166640 1 -- 172.21.15.116:0/279479611 >> v1:172.21.15.142:6789/0 conn(0x7f49ec0cb930 legacy=0x7f49ec0cbdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:45.453 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.460+0000 7f49f1166640 1 -- 172.21.15.116:0/279479611 --> v1:172.21.15.116:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49ec0cffa0 con 0x7f49ec0d0510 2024-02-21T22:53:45.453 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.460+0000 7f49f1166640 1 -- 172.21.15.116:0/279479611 <== mon.0 v1:172.21.15.116:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1101981580 0 0) 0x7f49e80019f0 con 0x7f49ec0d0510 2024-02-21T22:53:45.453 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.460+0000 7f49f1166640 1 -- 172.21.15.116:0/279479611 >> v1:172.21.15.116:6789/0 conn(0x7f49ec0d0510 legacy=0x7f49ec0d08f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:45.454 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.460+0000 7f49f1166640 1 --2- 172.21.15.116:0/279479611 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f49d8003b70 0x7f49d8003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:45.454 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.460+0000 7f49f1166640 1 --2- 172.21.15.116:0/279479611 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f49ec0d1c30 0x7f49d8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:45.454 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.460+0000 7f49f1166640 1 --2- 172.21.15.116:0/279479611 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f49d8004d40 0x7f49d80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:45.454 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.460+0000 7f49f1166640 1 -- 172.21.15.116:0/279479611 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49ec0d1450 con 0x7f49d8004d40 2024-02-21T22:53:45.454 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.460+0000 7f49f1166640 1 -- 172.21.15.116:0/279479611 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49d800bac0 con 0x7f49d8003b70 2024-02-21T22:53:45.454 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.460+0000 7f49f1166640 1 -- 172.21.15.116:0/279479611 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49d800bcc0 con 0x7f49ec0d1c30 2024-02-21T22:53:45.454 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.460+0000 7f49f2969640 1 --2- 172.21.15.116:0/279479611 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f49d8004d40 0x7f49d80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:45.454 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.460+0000 7f49f1967640 1 --2- 172.21.15.116:0/279479611 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f49ec0d1c30 0x7f49d8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:45.454 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.460+0000 7f49f2168640 1 --2- 172.21.15.116:0/279479611 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f49d8003b70 0x7f49d8003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:45.454 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.460+0000 7f49f2969640 1 -- 172.21.15.116:0/279479611 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f49ec0d1c30 msgr2=0x7f49d8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:53:45.454 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.460+0000 7f49f2969640 1 --2- 172.21.15.116:0/279479611 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f49ec0d1c30 0x7f49d8004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:45.454 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.460+0000 7f49f2969640 1 -- 172.21.15.116:0/279479611 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f49d8003b70 msgr2=0x7f49d8003f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:53:45.454 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.460+0000 7f49f2969640 1 --2- 172.21.15.116:0/279479611 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f49d8003b70 0x7f49d8003f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:45.454 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.460+0000 7f49f2969640 1 -- 172.21.15.116:0/279479611 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49d8003520 con 0x7f49d8004d40 2024-02-21T22:53:45.454 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.461+0000 7f49f2969640 1 --2- 172.21.15.116:0/279479611 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f49d8004d40 0x7f49d80051c0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f49e40018d0 tx=0x7f49d8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67826a7da832b332 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:45.455 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.461+0000 7f49f1166640 1 -- 172.21.15.116:0/279479611 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49e4037070 con 0x7f49d8004d40 2024-02-21T22:53:45.455 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.461+0000 7f49f1166640 1 -- 172.21.15.116:0/279479611 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49e40052d0 con 0x7f49d8004d40 2024-02-21T22:53:45.455 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.461+0000 7f49f1166640 1 -- 172.21.15.116:0/279479611 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49e40014f0 con 0x7f49d8004d40 2024-02-21T22:53:45.455 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.462+0000 7f49f43cc640 1 -- 172.21.15.116:0/279479611 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f49d8004d40 msgr2=0x7f49d80051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:45.455 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.462+0000 7f49f43cc640 1 --2- 172.21.15.116:0/279479611 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f49d8004d40 0x7f49d80051c0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f49e40018d0 tx=0x7f49d8005830 comp rx=0 tx=0).stop 2024-02-21T22:53:45.455 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.462+0000 7f49f2969640 1 -- 172.21.15.116:0/279479611 reap_dead start 2024-02-21T22:53:45.455 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.462+0000 7f49f43cc640 1 -- 172.21.15.116:0/279479611 shutdown_connections 2024-02-21T22:53:45.455 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.462+0000 7f49f43cc640 1 -- 172.21.15.116:0/279479611 >> 172.21.15.116:0/279479611 conn(0x7f49ec0d3e50 msgr2=0x7f49ec0d4260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:45.455 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.462+0000 7f49f43cc640 1 -- 172.21.15.116:0/279479611 shutdown_connections 2024-02-21T22:53:45.455 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.462+0000 7f49f43cc640 1 -- 172.21.15.116:0/279479611 wait complete. 2024-02-21T22:53:45.458 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.463+0000 7f49f43cc640 1 Processor -- start 2024-02-21T22:53:45.458 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.463+0000 7f49f43cc640 1 -- start start 2024-02-21T22:53:45.458 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.464+0000 7f49f43cc640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f49d8004d40 0x7f49ec0a1450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:45.458 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.464+0000 7f49f43cc640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f49ec0b6b10 0x7f49ec150f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:45.458 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.464+0000 7f49f43cc640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f49ec0b6f90 0x7f49ec151460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:45.458 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.464+0000 7f49f43cc640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49ec0d2430 con 0x7f49ec0b6f90 2024-02-21T22:53:45.458 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.464+0000 7f49f43cc640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49ec15e640 con 0x7f49d8004d40 2024-02-21T22:53:45.458 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.464+0000 7f49f43cc640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49ec0d25b0 con 0x7f49ec0b6b10 2024-02-21T22:53:45.458 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.464+0000 7f49f2969640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f49ec0b6f90 0x7f49ec151460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:45.459 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.464+0000 7f49f2969640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f49ec0b6f90 0x7f49ec151460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:39884/0 (socket says 172.21.15.116:39884) 2024-02-21T22:53:45.459 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.464+0000 7f49f2969640 1 -- 172.21.15.116:0/3733552669 learned_addr learned my addr 172.21.15.116:0/3733552669 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:45.459 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.464+0000 7f49f2168640 1 --2- 172.21.15.116:0/3733552669 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f49d8004d40 0x7f49ec0a1450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:45.459 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.464+0000 7f49f1967640 1 --2- 172.21.15.116:0/3733552669 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f49ec0b6b10 0x7f49ec150f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:45.459 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.464+0000 7f49f2969640 1 -- 172.21.15.116:0/3733552669 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f49ec0b6b10 msgr2=0x7f49ec150f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:45.459 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.464+0000 7f49f2969640 1 --2- 172.21.15.116:0/3733552669 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f49ec0b6b10 0x7f49ec150f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:45.459 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.464+0000 7f49f2969640 1 -- 172.21.15.116:0/3733552669 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f49d8004d40 msgr2=0x7f49ec0a1450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:45.459 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.464+0000 7f49f2969640 1 --2- 172.21.15.116:0/3733552669 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f49d8004d40 0x7f49ec0a1450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:45.459 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.464+0000 7f49f2969640 1 -- 172.21.15.116:0/3733552669 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49ec0b5a70 con 0x7f49ec0b6f90 2024-02-21T22:53:45.459 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.464+0000 7f49f2969640 1 --2- 172.21.15.116:0/3733552669 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f49ec0b6f90 0x7f49ec151460 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f49e4035040 tx=0x7f49e40012d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:45.459 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.464+0000 7f49e2ffd640 1 -- 172.21.15.116:0/3733552669 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49e4042020 con 0x7f49ec0b6f90 2024-02-21T22:53:45.459 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.464+0000 7f49e2ffd640 1 -- 172.21.15.116:0/3733552669 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49e4038040 con 0x7f49ec0b6f90 2024-02-21T22:53:45.459 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.464+0000 7f49f43cc640 1 -- 172.21.15.116:0/3733552669 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49ec0b5d50 con 0x7f49ec0b6f90 2024-02-21T22:53:45.459 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.464+0000 7f49e2ffd640 1 -- 172.21.15.116:0/3733552669 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49e4037070 con 0x7f49ec0b6f90 2024-02-21T22:53:45.459 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.464+0000 7f49f43cc640 1 -- 172.21.15.116:0/3733552669 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49ec0b6310 con 0x7f49ec0b6f90 2024-02-21T22:53:45.460 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.465+0000 7f49f43cc640 1 -- 172.21.15.116:0/3733552669 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49ec0752f0 con 0x7f49ec0b6f90 2024-02-21T22:53:45.460 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.466+0000 7f49e2ffd640 1 -- 172.21.15.116:0/3733552669 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f49e4045020 con 0x7f49ec0b6f90 2024-02-21T22:53:45.460 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.466+0000 7f49e2ffd640 1 --2- 172.21.15.116:0/3733552669 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f49d006b500 0x7f49d006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:45.460 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.466+0000 7f49e2ffd640 1 -- 172.21.15.116:0/3733552669 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f49e40ab7a0 con 0x7f49ec0b6f90 2024-02-21T22:53:45.460 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.466+0000 7f49f2168640 1 --2- 172.21.15.116:0/3733552669 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f49d006b500 0x7f49d006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:45.460 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.467+0000 7f49f2168640 1 --2- 172.21.15.116:0/3733552669 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f49d006b500 0x7f49d006d9c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f49e8000f80 tx=0x7f49e8006040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:45.461 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.470+0000 7f49e2ffd640 1 -- 172.21.15.116:0/3733552669 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f49e404c030 con 0x7f49ec0b6f90 2024-02-21T22:53:45.634 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.643+0000 7f49f43cc640 1 -- 172.21.15.116:0/3733552669 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f49ec15dce0 con 0x7f49ec0b6f90 2024-02-21T22:53:45.635 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.645+0000 7f49e2ffd640 1 -- 172.21.15.116:0/3733552669 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+16717 (secure 0 0 0) 0x7f49e407a180 con 0x7f49ec0b6f90 2024-02-21T22:53:45.635 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-02-21T22:53:45.635 INFO:teuthology.orchestra.run.smithi116.stdout:{"epoch":33,"fsid":"7c298660-5f63-4b5c-a800-58c5be9a8445","created":"2024-02-21T22:52:25.994613+0000","modified":"2024-02-21T22:53:43.986422+0000","last_up_change":"2024-02-21T22:52:37.313595+0000","last_in_change":"2024-02-21T22:52:28.176031+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-21T22:52:38.328796+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-02-21T22:53:40.752689+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-02-21T22:53:41.300199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4f09126b-b5e4-4876-8b08-f5cbb967388a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":1613202231},{"type":"v1","addr":"172.21.15.116:6809","nonce":1613202231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":1613202231},{"type":"v1","addr":"172.21.15.116:6811","nonce":1613202231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":1613202231},{"type":"v1","addr":"172.21.15.116:6815","nonce":1613202231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":1613202231},{"type":"v1","addr":"172.21.15.116:6813","nonce":1613202231}]},"public_addr":"172.21.15.116:6809/1613202231","cluster_addr":"172.21.15.116:6811/1613202231","heartbeat_back_addr":"172.21.15.116:6815/1613202231","heartbeat_front_addr":"172.21.15.116:6813/1613202231","state":["exists","up"]},{"osd":1,"uuid":"7272c51d-51f9-4536-931d-33ad7a4b377e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6816","nonce":172614746},{"type":"v1","addr":"172.21.15.116:6817","nonce":172614746}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":172614746},{"type":"v1","addr":"172.21.15.116:6819","nonce":172614746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":172614746},{"type":"v1","addr":"172.21.15.116:6823","nonce":172614746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":172614746},{"type":"v1","addr":"172.21.15.116:6821","nonce":172614746}]},"public_addr":"172.21.15.116:6817/172614746","cluster_addr":"172.21.15.116:6819/172614746","heartbeat_back_addr":"172.21.15.116:6823/172614746","heartbeat_front_addr":"172.21.15.116:6821/172614746","state":["exists","up"]},{"osd":2,"uuid":"2589616c-adf1-4187-aac3-735256cf624b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":1029280577},{"type":"v1","addr":"172.21.15.116:6825","nonce":1029280577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":1029280577},{"type":"v1","addr":"172.21.15.116:6827","nonce":1029280577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":1029280577},{"type":"v1","addr":"172.21.15.116:6831","nonce":1029280577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":1029280577},{"type":"v1","addr":"172.21.15.116:6829","nonce":1029280577}]},"public_addr":"172.21.15.116:6825/1029280577","cluster_addr":"172.21.15.116:6827/1029280577","heartbeat_back_addr":"172.21.15.116:6831/1029280577","heartbeat_front_addr":"172.21.15.116:6829/1029280577","state":["exists","up"]},{"osd":3,"uuid":"0fd2e563-7c5b-46f6-82c2-b60c86072c93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":3106627557},{"type":"v1","addr":"172.21.15.116:6801","nonce":3106627557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":3106627557},{"type":"v1","addr":"172.21.15.116:6803","nonce":3106627557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":3106627557},{"type":"v1","addr":"172.21.15.116:6807","nonce":3106627557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":3106627557},{"type":"v1","addr":"172.21.15.116:6805","nonce":3106627557}]},"public_addr":"172.21.15.116:6801/3106627557","cluster_addr":"172.21.15.116:6803/3106627557","heartbeat_back_addr":"172.21.15.116:6807/3106627557","heartbeat_front_addr":"172.21.15.116:6805/3106627557","state":["exists","up"]},{"osd":4,"uuid":"79ae35b7-dda8-4ab8-96ce-47515afde082","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":3231407772},{"type":"v1","addr":"172.21.15.142:6825","nonce":3231407772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":3231407772},{"type":"v1","addr":"172.21.15.142:6827","nonce":3231407772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":3231407772},{"type":"v1","addr":"172.21.15.142:6831","nonce":3231407772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":3231407772},{"type":"v1","addr":"172.21.15.142:6829","nonce":3231407772}]},"public_addr":"172.21.15.142:6825/3231407772","cluster_addr":"172.21.15.142:6827/3231407772","heartbeat_back_addr":"172.21.15.142:6831/3231407772","heartbeat_front_addr":"172.21.15.142:6829/3231407772","state":["exists","up"]},{"osd":5,"uuid":"3166eb2c-3fcf-41c8-9362-45bafaabaa39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":1184158716},{"type":"v1","addr":"172.21.15.142:6817","nonce":1184158716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":1184158716},{"type":"v1","addr":"172.21.15.142:6819","nonce":1184158716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":1184158716},{"type":"v1","addr":"172.21.15.142:6823","nonce":1184158716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":1184158716},{"type":"v1","addr":"172.21.15.142:6821","nonce":1184158716}]},"public_addr":"172.21.15.142:6817/1184158716","cluster_addr":"172.21.15.142:6819/1184158716","heartbeat_back_addr":"172.21.15.142:6823/1184158716","heartbeat_front_addr":"172.21.15.142:6821/1184158716","state":["exists","up"]},{"osd":6,"uuid":"f9aa9672-7527-43e2-963e-b61868e5e63f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":1987868911},{"type":"v1","addr":"172.21.15.142:6801","nonce":1987868911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":1987868911},{"type":"v1","addr":"172.21.15.142:6803","nonce":1987868911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":1987868911},{"type":"v1","addr":"172.21.15.142:6807","nonce":1987868911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":1987868911},{"type":"v1","addr":"172.21.15.142:6805","nonce":1987868911}]},"public_addr":"172.21.15.142:6801/1987868911","cluster_addr":"172.21.15.142:6803/1987868911","heartbeat_back_addr":"172.21.15.142:6807/1987868911","heartbeat_front_addr":"172.21.15.142:6805/1987868911","state":["exists","up"]},{"osd":7,"uuid":"7ed29226-fc42-4382-a91a-fa50f7ec5426","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":1272081937},{"type":"v1","addr":"172.21.15.142:6809","nonce":1272081937}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":1272081937},{"type":"v1","addr":"172.21.15.142:6811","nonce":1272081937}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":1272081937},{"type":"v1","addr":"172.21.15.142:6815","nonce":1272081937}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":1272081937},{"type":"v1","addr":"172.21.15.142:6813","nonce":1272081937}]},"public_addr":"172.21.15.142:6809/1272081937","cluster_addr":"172.21.15.142:6811/1272081937","heartbeat_back_addr":"172.21.15.142:6815/1272081937","heartbeat_front_addr":"172.21.15.142:6813/1272081937","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.350998+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.307201+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.289112+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.243888+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.312091+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.370472+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.275659+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.289297+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-21T22:53:45.637 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.647+0000 7f49f43cc640 1 -- 172.21.15.116:0/3733552669 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f49d006b500 msgr2=0x7f49d006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:45.638 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.647+0000 7f49f43cc640 1 --2- 172.21.15.116:0/3733552669 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f49d006b500 0x7f49d006d9c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f49e8000f80 tx=0x7f49e8006040 comp rx=0 tx=0).stop 2024-02-21T22:53:45.638 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.647+0000 7f49f43cc640 1 -- 172.21.15.116:0/3733552669 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f49ec0b6f90 msgr2=0x7f49ec151460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:45.638 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.647+0000 7f49f43cc640 1 --2- 172.21.15.116:0/3733552669 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f49ec0b6f90 0x7f49ec151460 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f49e4035040 tx=0x7f49e40012d0 comp rx=0 tx=0).stop 2024-02-21T22:53:45.638 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.647+0000 7f49f43cc640 1 -- 172.21.15.116:0/3733552669 shutdown_connections 2024-02-21T22:53:45.638 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.647+0000 7f49f43cc640 1 --2- 172.21.15.116:0/3733552669 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f49ec0b6f90 0x7f49ec151460 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:45.638 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.647+0000 7f49f43cc640 1 --2- 172.21.15.116:0/3733552669 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f49d006b500 0x7f49d006d9c0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:45.638 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.647+0000 7f49f43cc640 1 --2- 172.21.15.116:0/3733552669 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f49ec0b6b10 0x7f49ec150f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:45.638 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.647+0000 7f49f43cc640 1 --2- 172.21.15.116:0/3733552669 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f49d8004d40 0x7f49ec0a1450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:45.638 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.647+0000 7f49f43cc640 1 -- 172.21.15.116:0/3733552669 >> 172.21.15.116:0/3733552669 conn(0x7f49ec0d3e50 msgr2=0x7f49ec15b7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:45.638 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.647+0000 7f49f43cc640 1 -- 172.21.15.116:0/3733552669 shutdown_connections 2024-02-21T22:53:45.638 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.647+0000 7f49f43cc640 1 -- 172.21.15.116:0/3733552669 wait complete. 2024-02-21T22:53:45.648 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-02-21T22:53:45.648 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-21T22:53:45.749 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.759+0000 7f9287436640 1 Processor -- start 2024-02-21T22:53:45.749 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.759+0000 7f9287436640 1 -- start start 2024-02-21T22:53:45.750 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.760+0000 7f9287436640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f92800b3f90 0x7f928006ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:45.750 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.760+0000 7f9287436640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f928006b380 0x7f9280071c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:45.751 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.760+0000 7f9287436640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f928015f570 con 0x7f92800b0290 2024-02-21T22:53:45.751 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.760+0000 7f9287436640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f928006b7d0 con 0x7f928006b380 2024-02-21T22:53:45.751 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.760+0000 7f9287436640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f928015f0e0 con 0x7f92800b3f90 2024-02-21T22:53:45.751 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.760+0000 7f92859d3640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f928006b380 0x7f9280071c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:45.751 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.760+0000 7f92859d3640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f928006b380 0x7f9280071c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:39896/0 (socket says 172.21.15.116:39896) 2024-02-21T22:53:45.751 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.760+0000 7f92859d3640 1 -- 172.21.15.116:0/2975445107 learned_addr learned my addr 172.21.15.116:0/2975445107 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:45.751 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.760+0000 7f92849d1640 1 --2- 172.21.15.116:0/2975445107 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f92800b3f90 0x7f928006ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:45.751 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.760+0000 7f92859d3640 1 -- 172.21.15.116:0/2975445107 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f92800b3f90 msgr2=0x7f928006ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:53:45.751 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.760+0000 7f92859d3640 1 --2- 172.21.15.116:0/2975445107 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f92800b3f90 0x7f928006ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:45.751 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.760+0000 7f92859d3640 1 -- 172.21.15.116:0/2975445107 >> v1:172.21.15.142:6789/0 conn(0x7f92800b0290 legacy=0x7f928006f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:45.751 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.760+0000 7f92859d3640 1 -- 172.21.15.116:0/2975445107 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f928015e7b0 con 0x7f928006b380 2024-02-21T22:53:45.753 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.761+0000 7f92859d3640 1 --2- 172.21.15.116:0/2975445107 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f928006b380 0x7f9280071c80 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f9278009e50 tx=0x7f927802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21b27e9a14620c61 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:45.753 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.761+0000 7f9277fff640 1 -- 172.21.15.116:0/2975445107 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f927802ca70 con 0x7f928006b380 2024-02-21T22:53:45.753 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.761+0000 7f9277fff640 1 -- 172.21.15.116:0/2975445107 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f927802cc10 con 0x7f928006b380 2024-02-21T22:53:45.753 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.761+0000 7f9277fff640 1 -- 172.21.15.116:0/2975445107 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92780343f0 con 0x7f928006b380 2024-02-21T22:53:45.753 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.761+0000 7f9287436640 1 -- 172.21.15.116:0/2975445107 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f928006b380 msgr2=0x7f9280071c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:45.753 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.761+0000 7f9287436640 1 --2- 172.21.15.116:0/2975445107 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f928006b380 0x7f9280071c80 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f9278009e50 tx=0x7f927802bed0 comp rx=0 tx=0).stop 2024-02-21T22:53:45.753 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.761+0000 7f9287436640 1 -- 172.21.15.116:0/2975445107 shutdown_connections 2024-02-21T22:53:45.753 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.761+0000 7f9287436640 1 --2- 172.21.15.116:0/2975445107 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f928006b380 0x7f9280071c80 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:45.753 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.761+0000 7f9287436640 1 --2- 172.21.15.116:0/2975445107 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f92800b3f90 0x7f928006ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:45.753 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.762+0000 7f9287436640 1 -- 172.21.15.116:0/2975445107 >> 172.21.15.116:0/2975445107 conn(0x7f92800b29f0 msgr2=0x7f92800b2e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:45.753 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.762+0000 7f9287436640 1 -- 172.21.15.116:0/2975445107 shutdown_connections 2024-02-21T22:53:45.754 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.762+0000 7f9287436640 1 -- 172.21.15.116:0/2975445107 wait complete. 2024-02-21T22:53:45.754 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.763+0000 7f9287436640 1 Processor -- start 2024-02-21T22:53:45.754 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.763+0000 7f9287436640 1 -- start start 2024-02-21T22:53:45.756 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.763+0000 7f9287436640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f928006b380 0x7f928014c760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:45.756 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.763+0000 7f9287436640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f92800b0290 0x7f9280156510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:45.757 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.763+0000 7f9287436640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f92800b3f90 0x7f9280156a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:45.757 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.763+0000 7f9287436640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92800b0670 con 0x7f92800b0290 2024-02-21T22:53:45.757 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.763+0000 7f9287436640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f928015ed70 con 0x7f928006b380 2024-02-21T22:53:45.757 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.763+0000 7f9287436640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92800721c0 con 0x7f92800b3f90 2024-02-21T22:53:45.757 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.764+0000 7f92849d1640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f92800b0290 0x7f9280156510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:45.757 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.764+0000 7f92849d1640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f92800b0290 0x7f9280156510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:39906/0 (socket says 172.21.15.116:39906) 2024-02-21T22:53:45.757 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.764+0000 7f92849d1640 1 -- 172.21.15.116:0/2425893178 learned_addr learned my addr 172.21.15.116:0/2425893178 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:45.757 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.764+0000 7f92851d2640 1 --2- 172.21.15.116:0/2425893178 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f928006b380 0x7f928014c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:45.757 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.764+0000 7f92859d3640 1 --2- 172.21.15.116:0/2425893178 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f92800b3f90 0x7f9280156a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:45.757 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.764+0000 7f92849d1640 1 -- 172.21.15.116:0/2425893178 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f92800b3f90 msgr2=0x7f9280156a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:45.757 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.764+0000 7f92849d1640 1 --2- 172.21.15.116:0/2425893178 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f92800b3f90 0x7f9280156a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:45.757 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.764+0000 7f92849d1640 1 -- 172.21.15.116:0/2425893178 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f928006b380 msgr2=0x7f928014c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:45.757 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.764+0000 7f92849d1640 1 --2- 172.21.15.116:0/2425893178 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f928006b380 0x7f928014c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:45.757 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.764+0000 7f92849d1640 1 -- 172.21.15.116:0/2425893178 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92801560a0 con 0x7f92800b0290 2024-02-21T22:53:45.757 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.764+0000 7f92859d3640 1 --2- 172.21.15.116:0/2425893178 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f92800b3f90 0x7f9280156a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T22:53:45.758 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.764+0000 7f92849d1640 1 --2- 172.21.15.116:0/2425893178 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f92800b0290 0x7f9280156510 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f927000e870 tx=0x7f927000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:45.758 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.764+0000 7f9275ffb640 1 -- 172.21.15.116:0/2425893178 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9270017070 con 0x7f92800b0290 2024-02-21T22:53:45.758 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.764+0000 7f9275ffb640 1 -- 172.21.15.116:0/2425893178 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f927000c940 con 0x7f92800b0290 2024-02-21T22:53:45.758 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.764+0000 7f9287436640 1 -- 172.21.15.116:0/2425893178 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92801570b0 con 0x7f92800b0290 2024-02-21T22:53:45.758 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.764+0000 7f9275ffb640 1 -- 172.21.15.116:0/2425893178 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f927000cd30 con 0x7f92800b0290 2024-02-21T22:53:45.758 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.764+0000 7f9287436640 1 -- 172.21.15.116:0/2425893178 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9280157670 con 0x7f92800b0290 2024-02-21T22:53:45.758 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.765+0000 7f9287436640 1 -- 172.21.15.116:0/2425893178 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9280157d90 con 0x7f92800b0290 2024-02-21T22:53:45.758 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.766+0000 7f9275ffb640 1 -- 172.21.15.116:0/2425893178 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f927001a070 con 0x7f92800b0290 2024-02-21T22:53:45.758 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.766+0000 7f9275ffb640 1 --2- 172.21.15.116:0/2425893178 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f926406b4d0 0x7f926406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:45.758 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.766+0000 7f9275ffb640 1 -- 172.21.15.116:0/2425893178 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9270089f80 con 0x7f92800b0290 2024-02-21T22:53:45.758 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.766+0000 7f92851d2640 1 --2- 172.21.15.116:0/2425893178 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f926406b4d0 0x7f926406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:45.759 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.767+0000 7f92851d2640 1 --2- 172.21.15.116:0/2425893178 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f926406b4d0 0x7f926406d990 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f92800b2910 tx=0x7f927c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:45.761 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.770+0000 7f9275ffb640 1 -- 172.21.15.116:0/2425893178 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f92801560a0 con 0x7f92800b0290 2024-02-21T22:53:45.927 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.937+0000 7f9287436640 1 -- 172.21.15.116:0/2425893178 --> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f928006d390 con 0x7f926406b4d0 2024-02-21T22:53:45.939 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.949+0000 7f9275ffb640 1 -- 172.21.15.116:0/2425893178 <== mgr.4103 v2:172.21.15.142:6832/1381484782 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251882 (secure 0 0 0) 0x7f928006d390 con 0x7f926406b4d0 2024-02-21T22:53:45.943 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-02-21T22:53:45.945 INFO:teuthology.orchestra.run.smithi116.stderr:dumped all 2024-02-21T22:53:45.946 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.952+0000 7f9287436640 1 -- 172.21.15.116:0/2425893178 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f926406b4d0 msgr2=0x7f926406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:45.946 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.952+0000 7f9287436640 1 --2- 172.21.15.116:0/2425893178 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f926406b4d0 0x7f926406d990 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f92800b2910 tx=0x7f927c009040 comp rx=0 tx=0).stop 2024-02-21T22:53:45.946 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.952+0000 7f9287436640 1 -- 172.21.15.116:0/2425893178 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f92800b0290 msgr2=0x7f9280156510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:45.947 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.952+0000 7f9287436640 1 --2- 172.21.15.116:0/2425893178 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f92800b0290 0x7f9280156510 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f927000e870 tx=0x7f927000ed30 comp rx=0 tx=0).stop 2024-02-21T22:53:45.947 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.952+0000 7f9287436640 1 -- 172.21.15.116:0/2425893178 shutdown_connections 2024-02-21T22:53:45.947 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.952+0000 7f9287436640 1 --2- 172.21.15.116:0/2425893178 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f926406b4d0 0x7f926406d990 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:45.947 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.952+0000 7f9287436640 1 --2- 172.21.15.116:0/2425893178 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f92800b3f90 0x7f9280156a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:45.947 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.952+0000 7f9287436640 1 --2- 172.21.15.116:0/2425893178 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f92800b0290 0x7f9280156510 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:45.947 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.952+0000 7f9287436640 1 --2- 172.21.15.116:0/2425893178 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f928006b380 0x7f928014c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:45.947 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.952+0000 7f9287436640 1 -- 172.21.15.116:0/2425893178 >> 172.21.15.116:0/2425893178 conn(0x7f92800b29f0 msgr2=0x7f9280160930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:45.947 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.952+0000 7f9287436640 1 -- 172.21.15.116:0/2425893178 shutdown_connections 2024-02-21T22:53:45.947 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:45.952+0000 7f9287436640 1 -- 172.21.15.116:0/2425893178 wait complete. 2024-02-21T22:53:45.953 INFO:teuthology.orchestra.run.smithi116.stdout:{"pg_ready":true,"pg_map":{"version":59,"stamp":"2024-02-21T22:53:44.297270+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":94,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220072,"kb_used_data":3908,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754648,"statfs":{"total":773094113280,"available":772868759552,"internally_reserved":0,"allocated":4001792,"data_stored":2257473,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000684"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.006204+0000","last_change":"2024-02-21T22:53:43.002525+0000","last_active":"2024-02-21T22:53:43.006204+0000","last_peered":"2024-02-21T22:53:43.006204+0000","last_clean":"2024-02-21T22:53:43.006204+0000","last_became_active":"2024-02-21T22:53:43.002238+0000","last_became_peered":"2024-02-21T22:53:43.002238+0000","last_unstale":"2024-02-21T22:53:43.006204+0000","last_undegraded":"2024-02-21T22:53:43.006204+0000","last_fullsized":"2024-02-21T22:53:43.006204+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:52:03.788166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.004954+0000","last_change":"2024-02-21T22:53:43.000671+0000","last_active":"2024-02-21T22:53:43.004954+0000","last_peered":"2024-02-21T22:53:43.004954+0000","last_clean":"2024-02-21T22:53:43.004954+0000","last_became_active":"2024-02-21T22:53:43.000396+0000","last_became_peered":"2024-02-21T22:53:43.000396+0000","last_unstale":"2024-02-21T22:53:43.004954+0000","last_undegraded":"2024-02-21T22:53:43.004954+0000","last_fullsized":"2024-02-21T22:53:43.004954+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:02:41.596861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.007778+0000","last_change":"2024-02-21T22:53:43.004625+0000","last_active":"2024-02-21T22:53:43.007778+0000","last_peered":"2024-02-21T22:53:43.007778+0000","last_clean":"2024-02-21T22:53:43.007778+0000","last_became_active":"2024-02-21T22:53:43.004321+0000","last_became_peered":"2024-02-21T22:53:43.004321+0000","last_unstale":"2024-02-21T22:53:43.007778+0000","last_undegraded":"2024-02-21T22:53:43.007778+0000","last_fullsized":"2024-02-21T22:53:43.007778+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:15:36.152598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.016041+0000","last_change":"2024-02-21T22:53:43.010931+0000","last_active":"2024-02-21T22:53:43.016041+0000","last_peered":"2024-02-21T22:53:43.016041+0000","last_clean":"2024-02-21T22:53:43.016041+0000","last_became_active":"2024-02-21T22:53:43.010683+0000","last_became_peered":"2024-02-21T22:53:43.010683+0000","last_unstale":"2024-02-21T22:53:43.016041+0000","last_undegraded":"2024-02-21T22:53:43.016041+0000","last_fullsized":"2024-02-21T22:53:43.016041+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:26:25.990337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.014335+0000","last_change":"2024-02-21T22:53:43.006662+0000","last_active":"2024-02-21T22:53:43.014335+0000","last_peered":"2024-02-21T22:53:43.014335+0000","last_clean":"2024-02-21T22:53:43.014335+0000","last_became_active":"2024-02-21T22:53:43.006405+0000","last_became_peered":"2024-02-21T22:53:43.006405+0000","last_unstale":"2024-02-21T22:53:43.014335+0000","last_undegraded":"2024-02-21T22:53:43.014335+0000","last_fullsized":"2024-02-21T22:53:43.014335+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:08:37.881320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.005208+0000","last_change":"2024-02-21T22:53:42.997969+0000","last_active":"2024-02-21T22:53:43.005208+0000","last_peered":"2024-02-21T22:53:43.005208+0000","last_clean":"2024-02-21T22:53:43.005208+0000","last_became_active":"2024-02-21T22:53:42.997719+0000","last_became_peered":"2024-02-21T22:53:42.997719+0000","last_unstale":"2024-02-21T22:53:43.005208+0000","last_undegraded":"2024-02-21T22:53:43.005208+0000","last_fullsized":"2024-02-21T22:53:43.005208+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:15:36.152598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.011871+0000","last_change":"2024-02-21T22:53:43.007930+0000","last_active":"2024-02-21T22:53:43.011871+0000","last_peered":"2024-02-21T22:53:43.011871+0000","last_clean":"2024-02-21T22:53:43.011871+0000","last_became_active":"2024-02-21T22:53:43.007675+0000","last_became_peered":"2024-02-21T22:53:43.007675+0000","last_unstale":"2024-02-21T22:53:43.011871+0000","last_undegraded":"2024-02-21T22:53:43.011871+0000","last_fullsized":"2024-02-21T22:53:43.011871+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:09:01.597859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.006767+0000","last_change":"2024-02-21T22:53:43.001108+0000","last_active":"2024-02-21T22:53:43.006767+0000","last_peered":"2024-02-21T22:53:43.006767+0000","last_clean":"2024-02-21T22:53:43.006767+0000","last_became_active":"2024-02-21T22:53:43.000729+0000","last_became_peered":"2024-02-21T22:53:43.000729+0000","last_unstale":"2024-02-21T22:53:43.006767+0000","last_undegraded":"2024-02-21T22:53:43.006767+0000","last_fullsized":"2024-02-21T22:53:43.006767+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:28:10.850115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.018822+0000","last_change":"2024-02-21T22:53:43.016364+0000","last_active":"2024-02-21T22:53:43.018822+0000","last_peered":"2024-02-21T22:53:43.018822+0000","last_clean":"2024-02-21T22:53:43.018822+0000","last_became_active":"2024-02-21T22:53:43.015907+0000","last_became_peered":"2024-02-21T22:53:43.015907+0000","last_unstale":"2024-02-21T22:53:43.018822+0000","last_undegraded":"2024-02-21T22:53:43.018822+0000","last_fullsized":"2024-02-21T22:53:43.018822+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:10:10.130504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.014752+0000","last_change":"2024-02-21T22:53:43.005373+0000","last_active":"2024-02-21T22:53:43.014752+0000","last_peered":"2024-02-21T22:53:43.014752+0000","last_clean":"2024-02-21T22:53:43.014752+0000","last_became_active":"2024-02-21T22:53:43.005035+0000","last_became_peered":"2024-02-21T22:53:43.005035+0000","last_unstale":"2024-02-21T22:53:43.014752+0000","last_undegraded":"2024-02-21T22:53:43.014752+0000","last_fullsized":"2024-02-21T22:53:43.014752+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:54:01.357343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.018013+0000","last_change":"2024-02-21T22:53:43.011309+0000","last_active":"2024-02-21T22:53:43.018013+0000","last_peered":"2024-02-21T22:53:43.018013+0000","last_clean":"2024-02-21T22:53:43.018013+0000","last_became_active":"2024-02-21T22:53:43.010956+0000","last_became_peered":"2024-02-21T22:53:43.010956+0000","last_unstale":"2024-02-21T22:53:43.018013+0000","last_undegraded":"2024-02-21T22:53:43.018013+0000","last_fullsized":"2024-02-21T22:53:43.018013+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:53:37.219886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.011398+0000","last_change":"2024-02-21T22:53:43.007326+0000","last_active":"2024-02-21T22:53:43.011398+0000","last_peered":"2024-02-21T22:53:43.011398+0000","last_clean":"2024-02-21T22:53:43.011398+0000","last_became_active":"2024-02-21T22:53:43.007022+0000","last_became_peered":"2024-02-21T22:53:43.007022+0000","last_unstale":"2024-02-21T22:53:43.011398+0000","last_undegraded":"2024-02-21T22:53:43.011398+0000","last_fullsized":"2024-02-21T22:53:43.011398+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:53:37.531108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.000617+0000","last_change":"2024-02-21T22:53:42.999643+0000","last_active":"2024-02-21T22:53:43.000617+0000","last_peered":"2024-02-21T22:53:43.000617+0000","last_clean":"2024-02-21T22:53:43.000617+0000","last_became_active":"2024-02-21T22:53:42.999406+0000","last_became_peered":"2024-02-21T22:53:42.999406+0000","last_unstale":"2024-02-21T22:53:43.000617+0000","last_undegraded":"2024-02-21T22:53:43.000617+0000","last_fullsized":"2024-02-21T22:53:43.000617+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:03:56.897909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.014081+0000","last_change":"2024-02-21T22:53:43.005346+0000","last_active":"2024-02-21T22:53:43.014081+0000","last_peered":"2024-02-21T22:53:43.014081+0000","last_clean":"2024-02-21T22:53:43.014081+0000","last_became_active":"2024-02-21T22:53:43.004383+0000","last_became_peered":"2024-02-21T22:53:43.004383+0000","last_unstale":"2024-02-21T22:53:43.014081+0000","last_undegraded":"2024-02-21T22:53:43.014081+0000","last_fullsized":"2024-02-21T22:53:43.014081+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:31:54.235302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.006414+0000","last_change":"2024-02-21T22:53:42.995690+0000","last_active":"2024-02-21T22:53:43.006414+0000","last_peered":"2024-02-21T22:53:43.006414+0000","last_clean":"2024-02-21T22:53:43.006414+0000","last_became_active":"2024-02-21T22:53:42.995407+0000","last_became_peered":"2024-02-21T22:53:42.995407+0000","last_unstale":"2024-02-21T22:53:43.006414+0000","last_undegraded":"2024-02-21T22:53:43.006414+0000","last_fullsized":"2024-02-21T22:53:43.006414+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:54:01.357343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.012720+0000","last_change":"2024-02-21T22:53:43.009355+0000","last_active":"2024-02-21T22:53:43.012720+0000","last_peered":"2024-02-21T22:53:43.012720+0000","last_clean":"2024-02-21T22:53:43.012720+0000","last_became_active":"2024-02-21T22:53:43.009073+0000","last_became_peered":"2024-02-21T22:53:43.009073+0000","last_unstale":"2024-02-21T22:53:43.012720+0000","last_undegraded":"2024-02-21T22:53:43.012720+0000","last_fullsized":"2024-02-21T22:53:43.012720+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:06:03.706623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.011941+0000","last_change":"2024-02-21T22:53:43.008675+0000","last_active":"2024-02-21T22:53:43.011941+0000","last_peered":"2024-02-21T22:53:43.011941+0000","last_clean":"2024-02-21T22:53:43.011941+0000","last_became_active":"2024-02-21T22:53:43.008404+0000","last_became_peered":"2024-02-21T22:53:43.008404+0000","last_unstale":"2024-02-21T22:53:43.011941+0000","last_undegraded":"2024-02-21T22:53:43.011941+0000","last_fullsized":"2024-02-21T22:53:43.011941+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:54:01.357343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.004934+0000","last_change":"2024-02-21T22:53:42.999615+0000","last_active":"2024-02-21T22:53:43.004934+0000","last_peered":"2024-02-21T22:53:43.004934+0000","last_clean":"2024-02-21T22:53:43.004934+0000","last_became_active":"2024-02-21T22:53:42.999362+0000","last_became_peered":"2024-02-21T22:53:42.999362+0000","last_unstale":"2024-02-21T22:53:43.004934+0000","last_undegraded":"2024-02-21T22:53:43.004934+0000","last_fullsized":"2024-02-21T22:53:43.004934+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:40:05.306862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.015381+0000","last_change":"2024-02-21T22:53:43.010970+0000","last_active":"2024-02-21T22:53:43.015381+0000","last_peered":"2024-02-21T22:53:43.015381+0000","last_clean":"2024-02-21T22:53:43.015381+0000","last_became_active":"2024-02-21T22:53:43.010702+0000","last_became_peered":"2024-02-21T22:53:43.010702+0000","last_unstale":"2024-02-21T22:53:43.015381+0000","last_undegraded":"2024-02-21T22:53:43.015381+0000","last_fullsized":"2024-02-21T22:53:43.015381+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:41:56.581902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.014341+0000","last_change":"2024-02-21T22:53:43.006258+0000","last_active":"2024-02-21T22:53:43.014341+0000","last_peered":"2024-02-21T22:53:43.014341+0000","last_clean":"2024-02-21T22:53:43.014341+0000","last_became_active":"2024-02-21T22:53:43.005993+0000","last_became_peered":"2024-02-21T22:53:43.005993+0000","last_unstale":"2024-02-21T22:53:43.014341+0000","last_undegraded":"2024-02-21T22:53:43.014341+0000","last_fullsized":"2024-02-21T22:53:43.014341+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:46:32.488082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.018765+0000","last_change":"2024-02-21T22:53:43.015003+0000","last_active":"2024-02-21T22:53:43.018765+0000","last_peered":"2024-02-21T22:53:43.018765+0000","last_clean":"2024-02-21T22:53:43.018765+0000","last_became_active":"2024-02-21T22:53:43.014712+0000","last_became_peered":"2024-02-21T22:53:43.014712+0000","last_unstale":"2024-02-21T22:53:43.018765+0000","last_undegraded":"2024-02-21T22:53:43.018765+0000","last_fullsized":"2024-02-21T22:53:43.018765+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:52:03.788166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.018759+0000","last_change":"2024-02-21T22:53:43.014845+0000","last_active":"2024-02-21T22:53:43.018759+0000","last_peered":"2024-02-21T22:53:43.018759+0000","last_clean":"2024-02-21T22:53:43.018759+0000","last_became_active":"2024-02-21T22:53:43.014570+0000","last_became_peered":"2024-02-21T22:53:43.014570+0000","last_unstale":"2024-02-21T22:53:43.018759+0000","last_undegraded":"2024-02-21T22:53:43.018759+0000","last_fullsized":"2024-02-21T22:53:43.018759+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:28:10.850115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.005938+0000","last_change":"2024-02-21T22:53:43.002518+0000","last_active":"2024-02-21T22:53:43.005938+0000","last_peered":"2024-02-21T22:53:43.005938+0000","last_clean":"2024-02-21T22:53:43.005938+0000","last_became_active":"2024-02-21T22:53:43.002254+0000","last_became_peered":"2024-02-21T22:53:43.002254+0000","last_unstale":"2024-02-21T22:53:43.005938+0000","last_undegraded":"2024-02-21T22:53:43.005938+0000","last_fullsized":"2024-02-21T22:53:43.005938+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:10:10.130504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.006341+0000","last_change":"2024-02-21T22:53:42.996552+0000","last_active":"2024-02-21T22:53:43.006341+0000","last_peered":"2024-02-21T22:53:43.006341+0000","last_clean":"2024-02-21T22:53:43.006341+0000","last_became_active":"2024-02-21T22:53:42.996208+0000","last_became_peered":"2024-02-21T22:53:42.996208+0000","last_unstale":"2024-02-21T22:53:43.006341+0000","last_undegraded":"2024-02-21T22:53:43.006341+0000","last_fullsized":"2024-02-21T22:53:43.006341+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:06:03.706623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.015005+0000","last_change":"2024-02-21T22:53:43.003996+0000","last_active":"2024-02-21T22:53:43.015005+0000","last_peered":"2024-02-21T22:53:43.015005+0000","last_clean":"2024-02-21T22:53:43.015005+0000","last_became_active":"2024-02-21T22:53:43.003710+0000","last_became_peered":"2024-02-21T22:53:43.003710+0000","last_unstale":"2024-02-21T22:53:43.015005+0000","last_undegraded":"2024-02-21T22:53:43.015005+0000","last_fullsized":"2024-02-21T22:53:43.015005+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:10:10.130504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.004974+0000","last_change":"2024-02-21T22:53:43.000854+0000","last_active":"2024-02-21T22:53:43.004974+0000","last_peered":"2024-02-21T22:53:43.004974+0000","last_clean":"2024-02-21T22:53:43.004974+0000","last_became_active":"2024-02-21T22:53:43.000575+0000","last_became_peered":"2024-02-21T22:53:43.000575+0000","last_unstale":"2024-02-21T22:53:43.004974+0000","last_undegraded":"2024-02-21T22:53:43.004974+0000","last_fullsized":"2024-02-21T22:53:43.004974+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:53:37.531108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.015803+0000","last_change":"2024-02-21T22:53:43.011416+0000","last_active":"2024-02-21T22:53:43.015803+0000","last_peered":"2024-02-21T22:53:43.015803+0000","last_clean":"2024-02-21T22:53:43.015803+0000","last_became_active":"2024-02-21T22:53:43.010808+0000","last_became_peered":"2024-02-21T22:53:43.010808+0000","last_unstale":"2024-02-21T22:53:43.015803+0000","last_undegraded":"2024-02-21T22:53:43.015803+0000","last_fullsized":"2024-02-21T22:53:43.015803+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:13:51.231189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.006535+0000","last_change":"2024-02-21T22:53:42.999624+0000","last_active":"2024-02-21T22:53:43.006535+0000","last_peered":"2024-02-21T22:53:43.006535+0000","last_clean":"2024-02-21T22:53:43.006535+0000","last_became_active":"2024-02-21T22:53:42.999295+0000","last_became_peered":"2024-02-21T22:53:42.999295+0000","last_unstale":"2024-02-21T22:53:43.006535+0000","last_undegraded":"2024-02-21T22:53:43.006535+0000","last_fullsized":"2024-02-21T22:53:43.006535+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:53:37.219886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.018799+0000","last_change":"2024-02-21T22:53:43.016081+0000","last_active":"2024-02-21T22:53:43.018799+0000","last_peered":"2024-02-21T22:53:43.018799+0000","last_clean":"2024-02-21T22:53:43.018799+0000","last_became_active":"2024-02-21T22:53:43.015533+0000","last_became_peered":"2024-02-21T22:53:43.015533+0000","last_unstale":"2024-02-21T22:53:43.018799+0000","last_undegraded":"2024-02-21T22:53:43.018799+0000","last_fullsized":"2024-02-21T22:53:43.018799+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:09:01.597859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.012053+0000","last_change":"2024-02-21T22:53:43.007179+0000","last_active":"2024-02-21T22:53:43.012053+0000","last_peered":"2024-02-21T22:53:43.012053+0000","last_clean":"2024-02-21T22:53:43.012053+0000","last_became_active":"2024-02-21T22:53:43.006982+0000","last_became_peered":"2024-02-21T22:53:43.006982+0000","last_unstale":"2024-02-21T22:53:43.012053+0000","last_undegraded":"2024-02-21T22:53:43.012053+0000","last_fullsized":"2024-02-21T22:53:43.012053+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:08:09.142193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.005921+0000","last_change":"2024-02-21T22:53:43.000423+0000","last_active":"2024-02-21T22:53:43.005921+0000","last_peered":"2024-02-21T22:53:43.005921+0000","last_clean":"2024-02-21T22:53:43.005921+0000","last_became_active":"2024-02-21T22:53:43.000179+0000","last_became_peered":"2024-02-21T22:53:43.000179+0000","last_unstale":"2024-02-21T22:53:43.005921+0000","last_undegraded":"2024-02-21T22:53:43.005921+0000","last_fullsized":"2024-02-21T22:53:43.005921+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:28:10.850115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.018445+0000","last_change":"2024-02-21T22:53:43.013244+0000","last_active":"2024-02-21T22:53:43.018445+0000","last_peered":"2024-02-21T22:53:43.018445+0000","last_clean":"2024-02-21T22:53:43.018445+0000","last_became_active":"2024-02-21T22:53:43.012985+0000","last_became_peered":"2024-02-21T22:53:43.012985+0000","last_unstale":"2024-02-21T22:53:43.018445+0000","last_undegraded":"2024-02-21T22:53:43.018445+0000","last_fullsized":"2024-02-21T22:53:43.018445+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:15:36.152598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.003253+0000","last_change":"2024-02-21T22:53:43.001816+0000","last_active":"2024-02-21T22:53:43.003253+0000","last_peered":"2024-02-21T22:53:43.003253+0000","last_clean":"2024-02-21T22:53:43.003253+0000","last_became_active":"2024-02-21T22:53:43.001564+0000","last_became_peered":"2024-02-21T22:53:43.001564+0000","last_unstale":"2024-02-21T22:53:43.003253+0000","last_undegraded":"2024-02-21T22:53:43.003253+0000","last_fullsized":"2024-02-21T22:53:43.003253+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:09:01.597859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"32'4","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.011306+0000","last_change":"2024-02-21T22:53:41.994843+0000","last_active":"2024-02-21T22:53:43.011306+0000","last_peered":"2024-02-21T22:53:43.011306+0000","last_clean":"2024-02-21T22:53:43.011306+0000","last_became_active":"2024-02-21T22:53:41.994468+0000","last_became_peered":"2024-02-21T22:53:41.994468+0000","last_unstale":"2024-02-21T22:53:43.011306+0000","last_undegraded":"2024-02-21T22:53:43.011306+0000","last_fullsized":"2024-02-21T22:53:43.011306+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:27:18.184658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.010868+0000","last_change":"2024-02-21T22:53:43.008294+0000","last_active":"2024-02-21T22:53:43.010868+0000","last_peered":"2024-02-21T22:53:43.010868+0000","last_clean":"2024-02-21T22:53:43.010868+0000","last_became_active":"2024-02-21T22:53:43.008021+0000","last_became_peered":"2024-02-21T22:53:43.008021+0000","last_unstale":"2024-02-21T22:53:43.010868+0000","last_undegraded":"2024-02-21T22:53:43.010868+0000","last_fullsized":"2024-02-21T22:53:43.010868+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:08:09.142193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"32'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.012276+0000","last_change":"2024-02-21T22:53:41.987067+0000","last_active":"2024-02-21T22:53:43.012276+0000","last_peered":"2024-02-21T22:53:43.012276+0000","last_clean":"2024-02-21T22:53:43.012276+0000","last_became_active":"2024-02-21T22:53:41.986784+0000","last_became_peered":"2024-02-21T22:53:41.986784+0000","last_unstale":"2024-02-21T22:53:43.012276+0000","last_undegraded":"2024-02-21T22:53:43.012276+0000","last_fullsized":"2024-02-21T22:53:43.012276+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:34:59.792432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.018843+0000","last_change":"2024-02-21T22:53:43.016649+0000","last_active":"2024-02-21T22:53:43.018843+0000","last_peered":"2024-02-21T22:53:43.018843+0000","last_clean":"2024-02-21T22:53:43.018843+0000","last_became_active":"2024-02-21T22:53:43.016339+0000","last_became_peered":"2024-02-21T22:53:43.016339+0000","last_unstale":"2024-02-21T22:53:43.018843+0000","last_undegraded":"2024-02-21T22:53:43.018843+0000","last_fullsized":"2024-02-21T22:53:43.018843+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:54:01.357343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"32'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.016655+0000","last_change":"2024-02-21T22:53:41.991758+0000","last_active":"2024-02-21T22:53:43.016655+0000","last_peered":"2024-02-21T22:53:43.016655+0000","last_clean":"2024-02-21T22:53:43.016655+0000","last_became_active":"2024-02-21T22:53:41.990213+0000","last_became_peered":"2024-02-21T22:53:41.990213+0000","last_unstale":"2024-02-21T22:53:43.016655+0000","last_undegraded":"2024-02-21T22:53:43.016655+0000","last_fullsized":"2024-02-21T22:53:43.016655+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:54:00.352993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.015825+0000","last_change":"2024-02-21T22:53:43.011534+0000","last_active":"2024-02-21T22:53:43.015825+0000","last_peered":"2024-02-21T22:53:43.015825+0000","last_clean":"2024-02-21T22:53:43.015825+0000","last_became_active":"2024-02-21T22:53:43.011165+0000","last_became_peered":"2024-02-21T22:53:43.011165+0000","last_unstale":"2024-02-21T22:53:43.015825+0000","last_undegraded":"2024-02-21T22:53:43.015825+0000","last_fullsized":"2024-02-21T22:53:43.015825+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:40:05.306862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"32'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.016309+0000","last_change":"2024-02-21T22:53:41.989989+0000","last_active":"2024-02-21T22:53:43.016309+0000","last_peered":"2024-02-21T22:53:43.016309+0000","last_clean":"2024-02-21T22:53:43.016309+0000","last_became_active":"2024-02-21T22:53:41.989105+0000","last_became_peered":"2024-02-21T22:53:41.989105+0000","last_unstale":"2024-02-21T22:53:43.016309+0000","last_undegraded":"2024-02-21T22:53:43.016309+0000","last_fullsized":"2024-02-21T22:53:43.016309+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:22:53.606008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.018419+0000","last_change":"2024-02-21T22:53:43.012670+0000","last_active":"2024-02-21T22:53:43.018419+0000","last_peered":"2024-02-21T22:53:43.018419+0000","last_clean":"2024-02-21T22:53:43.018419+0000","last_became_active":"2024-02-21T22:53:43.012407+0000","last_became_peered":"2024-02-21T22:53:43.012407+0000","last_unstale":"2024-02-21T22:53:43.018419+0000","last_undegraded":"2024-02-21T22:53:43.018419+0000","last_fullsized":"2024-02-21T22:53:43.018419+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:26:25.990337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"32'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.015551+0000","last_change":"2024-02-21T22:53:41.992560+0000","last_active":"2024-02-21T22:53:43.015551+0000","last_peered":"2024-02-21T22:53:43.015551+0000","last_clean":"2024-02-21T22:53:43.015551+0000","last_became_active":"2024-02-21T22:53:41.992200+0000","last_became_peered":"2024-02-21T22:53:41.992200+0000","last_unstale":"2024-02-21T22:53:43.015551+0000","last_undegraded":"2024-02-21T22:53:43.015551+0000","last_fullsized":"2024-02-21T22:53:43.015551+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:47:38.675797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.008348+0000","last_change":"2024-02-21T22:53:43.003713+0000","last_active":"2024-02-21T22:53:43.008348+0000","last_peered":"2024-02-21T22:53:43.008348+0000","last_clean":"2024-02-21T22:53:43.008348+0000","last_became_active":"2024-02-21T22:53:43.003448+0000","last_became_peered":"2024-02-21T22:53:43.003448+0000","last_unstale":"2024-02-21T22:53:43.008348+0000","last_undegraded":"2024-02-21T22:53:43.008348+0000","last_fullsized":"2024-02-21T22:53:43.008348+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:26:25.990337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"32'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.015559+0000","last_change":"2024-02-21T22:53:41.989888+0000","last_active":"2024-02-21T22:53:43.015559+0000","last_peered":"2024-02-21T22:53:43.015559+0000","last_clean":"2024-02-21T22:53:43.015559+0000","last_became_active":"2024-02-21T22:53:41.989605+0000","last_became_peered":"2024-02-21T22:53:41.989605+0000","last_unstale":"2024-02-21T22:53:43.015559+0000","last_undegraded":"2024-02-21T22:53:43.015559+0000","last_fullsized":"2024-02-21T22:53:43.015559+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:28:50.954719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.018147+0000","last_change":"2024-02-21T22:53:43.011697+0000","last_active":"2024-02-21T22:53:43.018147+0000","last_peered":"2024-02-21T22:53:43.018147+0000","last_clean":"2024-02-21T22:53:43.018147+0000","last_became_active":"2024-02-21T22:53:43.011446+0000","last_became_peered":"2024-02-21T22:53:43.011446+0000","last_unstale":"2024-02-21T22:53:43.018147+0000","last_undegraded":"2024-02-21T22:53:43.018147+0000","last_fullsized":"2024-02-21T22:53:43.018147+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:35:00.796782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:42.988513+0000","last_change":"2024-02-21T22:53:41.990198+0000","last_active":"2024-02-21T22:53:42.988513+0000","last_peered":"2024-02-21T22:53:42.988513+0000","last_clean":"2024-02-21T22:53:42.988513+0000","last_became_active":"2024-02-21T22:53:41.989927+0000","last_became_peered":"2024-02-21T22:53:41.989927+0000","last_unstale":"2024-02-21T22:53:42.988513+0000","last_undegraded":"2024-02-21T22:53:42.988513+0000","last_fullsized":"2024-02-21T22:53:42.988513+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:08:08.137842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.014807+0000","last_change":"2024-02-21T22:53:43.008825+0000","last_active":"2024-02-21T22:53:43.014807+0000","last_peered":"2024-02-21T22:53:43.014807+0000","last_clean":"2024-02-21T22:53:43.014807+0000","last_became_active":"2024-02-21T22:53:43.008486+0000","last_became_peered":"2024-02-21T22:53:43.008486+0000","last_unstale":"2024-02-21T22:53:43.014807+0000","last_undegraded":"2024-02-21T22:53:43.014807+0000","last_fullsized":"2024-02-21T22:53:43.014807+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:53:37.219886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:42.998711+0000","last_change":"2024-02-21T22:53:41.985526+0000","last_active":"2024-02-21T22:53:42.998711+0000","last_peered":"2024-02-21T22:53:42.998711+0000","last_clean":"2024-02-21T22:53:42.998711+0000","last_became_active":"2024-02-21T22:53:41.985232+0000","last_became_peered":"2024-02-21T22:53:41.985232+0000","last_unstale":"2024-02-21T22:53:42.998711+0000","last_undegraded":"2024-02-21T22:53:42.998711+0000","last_fullsized":"2024-02-21T22:53:42.998711+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:46:31.483732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.007749+0000","last_change":"2024-02-21T22:53:43.005931+0000","last_active":"2024-02-21T22:53:43.007749+0000","last_peered":"2024-02-21T22:53:43.007749+0000","last_clean":"2024-02-21T22:53:43.007749+0000","last_became_active":"2024-02-21T22:53:43.005375+0000","last_became_peered":"2024-02-21T22:53:43.005375+0000","last_unstale":"2024-02-21T22:53:43.007749+0000","last_undegraded":"2024-02-21T22:53:43.007749+0000","last_fullsized":"2024-02-21T22:53:43.007749+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:40:05.306862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:42.989670+0000","last_change":"2024-02-21T22:53:41.987065+0000","last_active":"2024-02-21T22:53:42.989670+0000","last_peered":"2024-02-21T22:53:42.989670+0000","last_clean":"2024-02-21T22:53:42.989670+0000","last_became_active":"2024-02-21T22:53:41.986873+0000","last_became_peered":"2024-02-21T22:53:41.986873+0000","last_unstale":"2024-02-21T22:53:42.989670+0000","last_undegraded":"2024-02-21T22:53:42.989670+0000","last_fullsized":"2024-02-21T22:53:42.989670+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:53:36.215536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.014872+0000","last_change":"2024-02-21T22:53:43.010123+0000","last_active":"2024-02-21T22:53:43.014872+0000","last_peered":"2024-02-21T22:53:43.014872+0000","last_clean":"2024-02-21T22:53:43.014872+0000","last_became_active":"2024-02-21T22:53:43.009846+0000","last_became_peered":"2024-02-21T22:53:43.009846+0000","last_unstale":"2024-02-21T22:53:43.014872+0000","last_undegraded":"2024-02-21T22:53:43.014872+0000","last_fullsized":"2024-02-21T22:53:43.014872+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:03:52.457060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:42.995511+0000","last_change":"2024-02-21T22:53:41.987725+0000","last_active":"2024-02-21T22:53:42.995511+0000","last_peered":"2024-02-21T22:53:42.995511+0000","last_clean":"2024-02-21T22:53:42.995511+0000","last_became_active":"2024-02-21T22:53:41.987448+0000","last_became_peered":"2024-02-21T22:53:41.987448+0000","last_unstale":"2024-02-21T22:53:42.995511+0000","last_undegraded":"2024-02-21T22:53:42.995511+0000","last_fullsized":"2024-02-21T22:53:42.995511+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:52:02.783816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.001033+0000","last_change":"2024-02-21T22:53:42.997365+0000","last_active":"2024-02-21T22:53:43.001033+0000","last_peered":"2024-02-21T22:53:43.001033+0000","last_clean":"2024-02-21T22:53:43.001033+0000","last_became_active":"2024-02-21T22:53:42.997104+0000","last_became_peered":"2024-02-21T22:53:42.997104+0000","last_unstale":"2024-02-21T22:53:43.001033+0000","last_undegraded":"2024-02-21T22:53:43.001033+0000","last_fullsized":"2024-02-21T22:53:43.001033+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:26:25.990337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"32'3","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.011147+0000","last_change":"2024-02-21T22:53:41.994505+0000","last_active":"2024-02-21T22:53:43.011147+0000","last_peered":"2024-02-21T22:53:43.011147+0000","last_clean":"2024-02-21T22:53:43.011147+0000","last_became_active":"2024-02-21T22:53:41.994214+0000","last_became_peered":"2024-02-21T22:53:41.994214+0000","last_unstale":"2024-02-21T22:53:43.011147+0000","last_undegraded":"2024-02-21T22:53:43.011147+0000","last_fullsized":"2024-02-21T22:53:43.011147+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:10:09.126154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.007815+0000","last_change":"2024-02-21T22:53:43.005537+0000","last_active":"2024-02-21T22:53:43.007815+0000","last_peered":"2024-02-21T22:53:43.007815+0000","last_clean":"2024-02-21T22:53:43.007815+0000","last_became_active":"2024-02-21T22:53:43.004978+0000","last_became_peered":"2024-02-21T22:53:43.004978+0000","last_unstale":"2024-02-21T22:53:43.007815+0000","last_undegraded":"2024-02-21T22:53:43.007815+0000","last_fullsized":"2024-02-21T22:53:43.007815+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:13:51.231189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"32'6","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.023535+0000","last_change":"2024-02-21T22:53:41.989878+0000","last_active":"2024-02-21T22:53:43.023535+0000","last_peered":"2024-02-21T22:53:43.023535+0000","last_clean":"2024-02-21T22:53:43.023535+0000","last_became_active":"2024-02-21T22:53:41.989590+0000","last_became_peered":"2024-02-21T22:53:41.989590+0000","last_unstale":"2024-02-21T22:53:43.023535+0000","last_undegraded":"2024-02-21T22:53:43.023535+0000","last_fullsized":"2024-02-21T22:53:43.023535+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:06:02.702272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.014779+0000","last_change":"2024-02-21T22:53:43.008192+0000","last_active":"2024-02-21T22:53:43.014779+0000","last_peered":"2024-02-21T22:53:43.014779+0000","last_clean":"2024-02-21T22:53:43.014779+0000","last_became_active":"2024-02-21T22:53:43.007923+0000","last_became_peered":"2024-02-21T22:53:43.007923+0000","last_unstale":"2024-02-21T22:53:43.014779+0000","last_undegraded":"2024-02-21T22:53:43.014779+0000","last_fullsized":"2024-02-21T22:53:43.014779+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:06:03.706623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"32'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.013904+0000","last_change":"2024-02-21T22:53:41.986805+0000","last_active":"2024-02-21T22:53:43.013904+0000","last_peered":"2024-02-21T22:53:43.013904+0000","last_clean":"2024-02-21T22:53:43.013904+0000","last_became_active":"2024-02-21T22:53:41.985220+0000","last_became_peered":"2024-02-21T22:53:41.985220+0000","last_unstale":"2024-02-21T22:53:43.013904+0000","last_undegraded":"2024-02-21T22:53:43.013904+0000","last_fullsized":"2024-02-21T22:53:43.013904+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:21:25.274383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.008565+0000","last_change":"2024-02-21T22:53:43.003557+0000","last_active":"2024-02-21T22:53:43.008565+0000","last_peered":"2024-02-21T22:53:43.008565+0000","last_clean":"2024-02-21T22:53:43.008565+0000","last_became_active":"2024-02-21T22:53:43.003293+0000","last_became_peered":"2024-02-21T22:53:43.003293+0000","last_unstale":"2024-02-21T22:53:43.008565+0000","last_undegraded":"2024-02-21T22:53:43.008565+0000","last_fullsized":"2024-02-21T22:53:43.008565+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:38:31.580364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:42.996327+0000","last_change":"2024-02-21T22:53:41.987760+0000","last_active":"2024-02-21T22:53:42.996327+0000","last_peered":"2024-02-21T22:53:42.996327+0000","last_clean":"2024-02-21T22:53:42.996327+0000","last_became_active":"2024-02-21T22:53:41.987379+0000","last_became_peered":"2024-02-21T22:53:41.987379+0000","last_unstale":"2024-02-21T22:53:42.996327+0000","last_undegraded":"2024-02-21T22:53:42.996327+0000","last_fullsized":"2024-02-21T22:53:42.996327+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:28:09.845765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.018462+0000","last_change":"2024-02-21T22:53:43.014121+0000","last_active":"2024-02-21T22:53:43.018462+0000","last_peered":"2024-02-21T22:53:43.018462+0000","last_clean":"2024-02-21T22:53:43.018462+0000","last_became_active":"2024-02-21T22:53:43.013636+0000","last_became_peered":"2024-02-21T22:53:43.013636+0000","last_unstale":"2024-02-21T22:53:43.018462+0000","last_undegraded":"2024-02-21T22:53:43.018462+0000","last_fullsized":"2024-02-21T22:53:43.018462+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:13:51.231189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:42.988612+0000","last_change":"2024-02-21T22:53:41.989414+0000","last_active":"2024-02-21T22:53:42.988612+0000","last_peered":"2024-02-21T22:53:42.988612+0000","last_clean":"2024-02-21T22:53:42.988612+0000","last_became_active":"2024-02-21T22:53:41.988958+0000","last_became_peered":"2024-02-21T22:53:41.988958+0000","last_unstale":"2024-02-21T22:53:42.988612+0000","last_undegraded":"2024-02-21T22:53:42.988612+0000","last_fullsized":"2024-02-21T22:53:42.988612+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:09:00.593509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.012052+0000","last_change":"2024-02-21T22:53:43.010267+0000","last_active":"2024-02-21T22:53:43.012052+0000","last_peered":"2024-02-21T22:53:43.012052+0000","last_clean":"2024-02-21T22:53:43.012052+0000","last_became_active":"2024-02-21T22:53:43.010007+0000","last_became_peered":"2024-02-21T22:53:43.010007+0000","last_unstale":"2024-02-21T22:53:43.012052+0000","last_undegraded":"2024-02-21T22:53:43.012052+0000","last_fullsized":"2024-02-21T22:53:43.012052+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:09:01.597859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"32'8","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.017435+0000","last_change":"2024-02-21T22:53:41.990362+0000","last_active":"2024-02-21T22:53:43.017435+0000","last_peered":"2024-02-21T22:53:43.017435+0000","last_clean":"2024-02-21T22:53:43.017435+0000","last_became_active":"2024-02-21T22:53:41.989531+0000","last_became_peered":"2024-02-21T22:53:41.989531+0000","last_unstale":"2024-02-21T22:53:43.017435+0000","last_undegraded":"2024-02-21T22:53:43.017435+0000","last_fullsized":"2024-02-21T22:53:43.017435+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:10:09.126154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.018071+0000","last_change":"2024-02-21T22:53:43.010224+0000","last_active":"2024-02-21T22:53:43.018071+0000","last_peered":"2024-02-21T22:53:43.018071+0000","last_clean":"2024-02-21T22:53:43.018071+0000","last_became_active":"2024-02-21T22:53:43.009914+0000","last_became_peered":"2024-02-21T22:53:43.009914+0000","last_unstale":"2024-02-21T22:53:43.018071+0000","last_undegraded":"2024-02-21T22:53:43.018071+0000","last_fullsized":"2024-02-21T22:53:43.018071+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:27:19.189008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"32'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.017059+0000","last_change":"2024-02-21T22:53:41.988393+0000","last_active":"2024-02-21T22:53:43.017059+0000","last_peered":"2024-02-21T22:53:43.017059+0000","last_clean":"2024-02-21T22:53:43.017059+0000","last_became_active":"2024-02-21T22:53:41.987692+0000","last_became_peered":"2024-02-21T22:53:41.987692+0000","last_unstale":"2024-02-21T22:53:43.017059+0000","last_undegraded":"2024-02-21T22:53:43.017059+0000","last_fullsized":"2024-02-21T22:53:43.017059+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:08:08.137842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.012382+0000","last_change":"2024-02-21T22:53:43.009888+0000","last_active":"2024-02-21T22:53:43.012382+0000","last_peered":"2024-02-21T22:53:43.012382+0000","last_clean":"2024-02-21T22:53:43.012382+0000","last_became_active":"2024-02-21T22:53:43.009536+0000","last_became_peered":"2024-02-21T22:53:43.009536+0000","last_unstale":"2024-02-21T22:53:43.012382+0000","last_undegraded":"2024-02-21T22:53:43.012382+0000","last_fullsized":"2024-02-21T22:53:43.012382+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:38:31.580364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"32'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.014188+0000","last_change":"2024-02-21T22:53:41.986266+0000","last_active":"2024-02-21T22:53:43.014188+0000","last_peered":"2024-02-21T22:53:43.014188+0000","last_clean":"2024-02-21T22:53:43.014188+0000","last_became_active":"2024-02-21T22:53:41.985942+0000","last_became_peered":"2024-02-21T22:53:41.985942+0000","last_unstale":"2024-02-21T22:53:43.014188+0000","last_undegraded":"2024-02-21T22:53:43.014188+0000","last_fullsized":"2024-02-21T22:53:43.014188+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:29:52.528059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.016021+0000","last_change":"2024-02-21T22:53:43.010964+0000","last_active":"2024-02-21T22:53:43.016021+0000","last_peered":"2024-02-21T22:53:43.016021+0000","last_clean":"2024-02-21T22:53:43.016021+0000","last_became_active":"2024-02-21T22:53:43.010739+0000","last_became_peered":"2024-02-21T22:53:43.010739+0000","last_unstale":"2024-02-21T22:53:43.016021+0000","last_undegraded":"2024-02-21T22:53:43.016021+0000","last_fullsized":"2024-02-21T22:53:43.016021+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:15:36.152598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"32'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.015423+0000","last_change":"2024-02-21T22:53:41.987516+0000","last_active":"2024-02-21T22:53:43.015423+0000","last_peered":"2024-02-21T22:53:43.015423+0000","last_clean":"2024-02-21T22:53:43.015423+0000","last_became_active":"2024-02-21T22:53:41.986968+0000","last_became_peered":"2024-02-21T22:53:41.986968+0000","last_unstale":"2024-02-21T22:53:43.015423+0000","last_undegraded":"2024-02-21T22:53:43.015423+0000","last_fullsized":"2024-02-21T22:53:43.015423+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:08:36.876969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.008417+0000","last_change":"2024-02-21T22:53:43.001927+0000","last_active":"2024-02-21T22:53:43.008417+0000","last_peered":"2024-02-21T22:53:43.008417+0000","last_clean":"2024-02-21T22:53:43.008417+0000","last_became_active":"2024-02-21T22:53:43.001668+0000","last_became_peered":"2024-02-21T22:53:43.001668+0000","last_unstale":"2024-02-21T22:53:43.008417+0000","last_undegraded":"2024-02-21T22:53:43.008417+0000","last_fullsized":"2024-02-21T22:53:43.008417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T02:15:11.900251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:42.998914+0000","last_change":"2024-02-21T22:53:41.990148+0000","last_active":"2024-02-21T22:53:42.998914+0000","last_peered":"2024-02-21T22:53:42.998914+0000","last_clean":"2024-02-21T22:53:42.998914+0000","last_became_active":"2024-02-21T22:53:41.989146+0000","last_became_peered":"2024-02-21T22:53:41.989146+0000","last_unstale":"2024-02-21T22:53:42.998914+0000","last_undegraded":"2024-02-21T22:53:42.998914+0000","last_fullsized":"2024-02-21T22:53:42.998914+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:13:43.209250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.015103+0000","last_change":"2024-02-21T22:53:43.011129+0000","last_active":"2024-02-21T22:53:43.015103+0000","last_peered":"2024-02-21T22:53:43.015103+0000","last_clean":"2024-02-21T22:53:43.015103+0000","last_became_active":"2024-02-21T22:53:43.010865+0000","last_became_peered":"2024-02-21T22:53:43.010865+0000","last_unstale":"2024-02-21T22:53:43.015103+0000","last_undegraded":"2024-02-21T22:53:43.015103+0000","last_fullsized":"2024-02-21T22:53:43.015103+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:13:44.213600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"32'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.015780+0000","last_change":"2024-02-21T22:53:41.984829+0000","last_active":"2024-02-21T22:53:43.015780+0000","last_peered":"2024-02-21T22:53:43.015780+0000","last_clean":"2024-02-21T22:53:43.015780+0000","last_became_active":"2024-02-21T22:53:41.984573+0000","last_became_peered":"2024-02-21T22:53:41.984573+0000","last_unstale":"2024-02-21T22:53:43.015780+0000","last_undegraded":"2024-02-21T22:53:43.015780+0000","last_fullsized":"2024-02-21T22:53:43.015780+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:44:42.045212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.008366+0000","last_change":"2024-02-21T22:53:43.001820+0000","last_active":"2024-02-21T22:53:43.008366+0000","last_peered":"2024-02-21T22:53:43.008366+0000","last_clean":"2024-02-21T22:53:43.008366+0000","last_became_active":"2024-02-21T22:53:43.001513+0000","last_became_peered":"2024-02-21T22:53:43.001513+0000","last_unstale":"2024-02-21T22:53:43.008366+0000","last_undegraded":"2024-02-21T22:53:43.008366+0000","last_fullsized":"2024-02-21T22:53:43.008366+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:31:29.016944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:42.993046+0000","last_change":"2024-02-21T22:53:41.991544+0000","last_active":"2024-02-21T22:53:42.993046+0000","last_peered":"2024-02-21T22:53:42.993046+0000","last_clean":"2024-02-21T22:53:42.993046+0000","last_became_active":"2024-02-21T22:53:41.991247+0000","last_became_peered":"2024-02-21T22:53:41.991247+0000","last_unstale":"2024-02-21T22:53:42.993046+0000","last_undegraded":"2024-02-21T22:53:42.993046+0000","last_fullsized":"2024-02-21T22:53:42.993046+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:44:42.045212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.001123+0000","last_change":"2024-02-21T22:53:43.000454+0000","last_active":"2024-02-21T22:53:43.001123+0000","last_peered":"2024-02-21T22:53:43.001123+0000","last_clean":"2024-02-21T22:53:43.001123+0000","last_became_active":"2024-02-21T22:53:43.000172+0000","last_became_peered":"2024-02-21T22:53:43.000172+0000","last_unstale":"2024-02-21T22:53:43.001123+0000","last_undegraded":"2024-02-21T22:53:43.001123+0000","last_fullsized":"2024-02-21T22:53:43.001123+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:57:06.973476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.003774+0000","last_change":"2024-02-21T22:53:41.988349+0000","last_active":"2024-02-21T22:53:43.003774+0000","last_peered":"2024-02-21T22:53:43.003774+0000","last_clean":"2024-02-21T22:53:43.003774+0000","last_became_active":"2024-02-21T22:53:41.987202+0000","last_became_peered":"2024-02-21T22:53:41.987202+0000","last_unstale":"2024-02-21T22:53:43.003774+0000","last_undegraded":"2024-02-21T22:53:43.003774+0000","last_fullsized":"2024-02-21T22:53:43.003774+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:38:22.676905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.011892+0000","last_change":"2024-02-21T22:53:43.008590+0000","last_active":"2024-02-21T22:53:43.011892+0000","last_peered":"2024-02-21T22:53:43.011892+0000","last_clean":"2024-02-21T22:53:43.011892+0000","last_became_active":"2024-02-21T22:53:43.007502+0000","last_became_peered":"2024-02-21T22:53:43.007502+0000","last_unstale":"2024-02-21T22:53:43.011892+0000","last_undegraded":"2024-02-21T22:53:43.011892+0000","last_fullsized":"2024-02-21T22:53:43.011892+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:10:10.130504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:42.990744+0000","last_change":"2024-02-21T22:53:41.993199+0000","last_active":"2024-02-21T22:53:42.990744+0000","last_peered":"2024-02-21T22:53:42.990744+0000","last_clean":"2024-02-21T22:53:42.990744+0000","last_became_active":"2024-02-21T22:53:41.992944+0000","last_became_peered":"2024-02-21T22:53:41.992944+0000","last_unstale":"2024-02-21T22:53:42.990744+0000","last_undegraded":"2024-02-21T22:53:42.990744+0000","last_fullsized":"2024-02-21T22:53:42.990744+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:09:00.593509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.014278+0000","last_change":"2024-02-21T22:53:43.007504+0000","last_active":"2024-02-21T22:53:43.014278+0000","last_peered":"2024-02-21T22:53:43.014278+0000","last_clean":"2024-02-21T22:53:43.014278+0000","last_became_active":"2024-02-21T22:53:43.007283+0000","last_became_peered":"2024-02-21T22:53:43.007283+0000","last_unstale":"2024-02-21T22:53:43.014278+0000","last_undegraded":"2024-02-21T22:53:43.014278+0000","last_fullsized":"2024-02-21T22:53:43.014278+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:28:51.959069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"32'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.015166+0000","last_change":"2024-02-21T22:53:41.994504+0000","last_active":"2024-02-21T22:53:43.015166+0000","last_peered":"2024-02-21T22:53:43.015166+0000","last_clean":"2024-02-21T22:53:43.015166+0000","last_became_active":"2024-02-21T22:53:41.994229+0000","last_became_peered":"2024-02-21T22:53:41.994229+0000","last_unstale":"2024-02-21T22:53:43.015166+0000","last_undegraded":"2024-02-21T22:53:43.015166+0000","last_fullsized":"2024-02-21T22:53:43.015166+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:09:00.593509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.010881+0000","last_change":"2024-02-21T22:53:43.006538+0000","last_active":"2024-02-21T22:53:43.010881+0000","last_peered":"2024-02-21T22:53:43.010881+0000","last_clean":"2024-02-21T22:53:43.010881+0000","last_became_active":"2024-02-21T22:53:43.006058+0000","last_became_peered":"2024-02-21T22:53:43.006058+0000","last_unstale":"2024-02-21T22:53:43.010881+0000","last_undegraded":"2024-02-21T22:53:43.010881+0000","last_fullsized":"2024-02-21T22:53:43.010881+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:02:41.596861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:42.995329+0000","last_change":"2024-02-21T22:53:41.985703+0000","last_active":"2024-02-21T22:53:42.995329+0000","last_peered":"2024-02-21T22:53:42.995329+0000","last_clean":"2024-02-21T22:53:42.995329+0000","last_became_active":"2024-02-21T22:53:41.985263+0000","last_became_peered":"2024-02-21T22:53:41.985263+0000","last_unstale":"2024-02-21T22:53:42.995329+0000","last_undegraded":"2024-02-21T22:53:42.995329+0000","last_fullsized":"2024-02-21T22:53:42.995329+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:28:09.845765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.009186+0000","last_change":"2024-02-21T22:53:43.005317+0000","last_active":"2024-02-21T22:53:43.009186+0000","last_peered":"2024-02-21T22:53:43.009186+0000","last_clean":"2024-02-21T22:53:43.009186+0000","last_became_active":"2024-02-21T22:53:43.005033+0000","last_became_peered":"2024-02-21T22:53:43.005033+0000","last_unstale":"2024-02-21T22:53:43.009186+0000","last_undegraded":"2024-02-21T22:53:43.009186+0000","last_fullsized":"2024-02-21T22:53:43.009186+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:54:01.357343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:42.996513+0000","last_change":"2024-02-21T22:53:41.986296+0000","last_active":"2024-02-21T22:53:42.996513+0000","last_peered":"2024-02-21T22:53:42.996513+0000","last_clean":"2024-02-21T22:53:42.996513+0000","last_became_active":"2024-02-21T22:53:41.985909+0000","last_became_peered":"2024-02-21T22:53:41.985909+0000","last_unstale":"2024-02-21T22:53:42.996513+0000","last_undegraded":"2024-02-21T22:53:42.996513+0000","last_fullsized":"2024-02-21T22:53:42.996513+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:34:59.792432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.005879+0000","last_change":"2024-02-21T22:53:43.000226+0000","last_active":"2024-02-21T22:53:43.005879+0000","last_peered":"2024-02-21T22:53:43.005879+0000","last_clean":"2024-02-21T22:53:43.005879+0000","last_became_active":"2024-02-21T22:53:42.999987+0000","last_became_peered":"2024-02-21T22:53:42.999987+0000","last_unstale":"2024-02-21T22:53:43.005879+0000","last_undegraded":"2024-02-21T22:53:43.005879+0000","last_fullsized":"2024-02-21T22:53:43.005879+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:35:00.796782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:42.994590+0000","last_change":"2024-02-21T22:53:41.991285+0000","last_active":"2024-02-21T22:53:42.994590+0000","last_peered":"2024-02-21T22:53:42.994590+0000","last_clean":"2024-02-21T22:53:42.994590+0000","last_became_active":"2024-02-21T22:53:41.990977+0000","last_became_peered":"2024-02-21T22:53:41.990977+0000","last_unstale":"2024-02-21T22:53:42.994590+0000","last_undegraded":"2024-02-21T22:53:42.994590+0000","last_fullsized":"2024-02-21T22:53:42.994590+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:27:18.184658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.003445+0000","last_change":"2024-02-21T22:53:42.999736+0000","last_active":"2024-02-21T22:53:43.003445+0000","last_peered":"2024-02-21T22:53:43.003445+0000","last_clean":"2024-02-21T22:53:43.003445+0000","last_became_active":"2024-02-21T22:53:42.999472+0000","last_became_peered":"2024-02-21T22:53:42.999472+0000","last_unstale":"2024-02-21T22:53:43.003445+0000","last_undegraded":"2024-02-21T22:53:43.003445+0000","last_fullsized":"2024-02-21T22:53:43.003445+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:08:09.142193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:42.996479+0000","last_change":"2024-02-21T22:53:41.991062+0000","last_active":"2024-02-21T22:53:42.996479+0000","last_peered":"2024-02-21T22:53:42.996479+0000","last_clean":"2024-02-21T22:53:42.996479+0000","last_became_active":"2024-02-21T22:53:41.990791+0000","last_became_peered":"2024-02-21T22:53:41.990791+0000","last_unstale":"2024-02-21T22:53:42.996479+0000","last_undegraded":"2024-02-21T22:53:42.996479+0000","last_fullsized":"2024-02-21T22:53:42.996479+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:52:02.783816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.004801+0000","last_change":"2024-02-21T22:53:42.999431+0000","last_active":"2024-02-21T22:53:43.004801+0000","last_peered":"2024-02-21T22:53:43.004801+0000","last_clean":"2024-02-21T22:53:43.004801+0000","last_became_active":"2024-02-21T22:53:42.999170+0000","last_became_peered":"2024-02-21T22:53:42.999170+0000","last_unstale":"2024-02-21T22:53:43.004801+0000","last_undegraded":"2024-02-21T22:53:43.004801+0000","last_fullsized":"2024-02-21T22:53:43.004801+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:13:51.231189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.003903+0000","last_change":"2024-02-21T22:53:41.995139+0000","last_active":"2024-02-21T22:53:43.003903+0000","last_peered":"2024-02-21T22:53:43.003903+0000","last_clean":"2024-02-21T22:53:43.003903+0000","last_became_active":"2024-02-21T22:53:41.994560+0000","last_became_peered":"2024-02-21T22:53:41.994560+0000","last_unstale":"2024-02-21T22:53:43.003903+0000","last_undegraded":"2024-02-21T22:53:43.003903+0000","last_fullsized":"2024-02-21T22:53:43.003903+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:44:42.045212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.018796+0000","last_change":"2024-02-21T22:53:43.015964+0000","last_active":"2024-02-21T22:53:43.018796+0000","last_peered":"2024-02-21T22:53:43.018796+0000","last_clean":"2024-02-21T22:53:43.018796+0000","last_became_active":"2024-02-21T22:53:43.015685+0000","last_became_peered":"2024-02-21T22:53:43.015685+0000","last_unstale":"2024-02-21T22:53:43.018796+0000","last_undegraded":"2024-02-21T22:53:43.018796+0000","last_fullsized":"2024-02-21T22:53:43.018796+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:08:09.142193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:42.988436+0000","last_change":"2024-02-21T22:53:41.988521+0000","last_active":"2024-02-21T22:53:42.988436+0000","last_peered":"2024-02-21T22:53:42.988436+0000","last_clean":"2024-02-21T22:53:42.988436+0000","last_became_active":"2024-02-21T22:53:41.987907+0000","last_became_peered":"2024-02-21T22:53:41.987907+0000","last_unstale":"2024-02-21T22:53:42.988436+0000","last_undegraded":"2024-02-21T22:53:42.988436+0000","last_fullsized":"2024-02-21T22:53:42.988436+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:52:02.783816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.006220+0000","last_change":"2024-02-21T22:53:43.001964+0000","last_active":"2024-02-21T22:53:43.006220+0000","last_peered":"2024-02-21T22:53:43.006220+0000","last_clean":"2024-02-21T22:53:43.006220+0000","last_became_active":"2024-02-21T22:53:43.001671+0000","last_became_peered":"2024-02-21T22:53:43.001671+0000","last_unstale":"2024-02-21T22:53:43.006220+0000","last_undegraded":"2024-02-21T22:53:43.006220+0000","last_fullsized":"2024-02-21T22:53:43.006220+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:52:03.788166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:42.991966+0000","last_change":"2024-02-21T22:53:41.991783+0000","last_active":"2024-02-21T22:53:42.991966+0000","last_peered":"2024-02-21T22:53:42.991966+0000","last_clean":"2024-02-21T22:53:42.991966+0000","last_became_active":"2024-02-21T22:53:41.991530+0000","last_became_peered":"2024-02-21T22:53:41.991530+0000","last_unstale":"2024-02-21T22:53:42.991966+0000","last_undegraded":"2024-02-21T22:53:42.991966+0000","last_fullsized":"2024-02-21T22:53:42.991966+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:38:22.676905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":192,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:42.998433+0000","last_change":"2024-02-21T22:52:40.336187+0000","last_active":"2024-02-21T22:53:42.998433+0000","last_peered":"2024-02-21T22:53:42.998433+0000","last_clean":"2024-02-21T22:53:42.998433+0000","last_became_active":"2024-02-21T22:52:40.335061+0000","last_became_peered":"2024-02-21T22:52:40.335061+0000","last_unstale":"2024-02-21T22:53:42.998433+0000","last_undegraded":"2024-02-21T22:53:42.998433+0000","last_fullsized":"2024-02-21T22:53:42.998433+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:38.328863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:38.328863+0000","last_clean_scrub_stamp":"2024-02-21T22:52:38.328863+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:33:53.012414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574864,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27940,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343900,"statfs":{"total":96636764160,"available":96608153600,"internally_reserved":0,"allocated":942080,"data_stored":723909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574865,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":348160,"data_stored":133541,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574866,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":348160,"data_stored":133541,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574865,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":348160,"data_stored":133541,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574865,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":376832,"data_stored":141950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":348160,"data_stored":133541,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574866,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":348160,"data_stored":133541,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574864,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27940,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343900,"statfs":{"total":96636764160,"available":96608153600,"internally_reserved":0,"allocated":942080,"data_stored":723909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-21T22:53:45.958 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-21T22:53:46.098 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.103+0000 7ff420d55640 1 Processor -- start 2024-02-21T22:53:46.098 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.103+0000 7ff420d55640 1 -- start start 2024-02-21T22:53:46.098 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.104+0000 7ff420d55640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff41c15f5a0 0x7ff41c0cec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:46.098 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.104+0000 7ff420d55640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff41c0d0900 0x7ff41c0ccc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:46.099 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.104+0000 7ff420d55640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff41c0ae8a0 con 0x7ff41c0b26d0 2024-02-21T22:53:46.099 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.104+0000 7ff420d55640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff41c0cf9f0 con 0x7ff41c0d0900 2024-02-21T22:53:46.099 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.104+0000 7ff420d55640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff41c0d2730 con 0x7ff41c15f5a0 2024-02-21T22:53:46.099 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.104+0000 7ff419d9b640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7ff41c0b26d0 0x7ff41c0d01f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:47290/0 (socket says 172.21.15.116:47290) 2024-02-21T22:53:46.099 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.104+0000 7ff419d9b640 1 -- 172.21.15.116:0/600031233 learned_addr learned my addr 172.21.15.116:0/600031233 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-02-21T22:53:46.099 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.104+0000 7ff41ad9d640 1 --2- 172.21.15.116:0/600031233 >> v2:172.21.15.142:3300/0 conn(0x7ff41c0d0900 0x7ff41c0ccc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:46.099 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.105+0000 7ff41a59c640 1 --2- 172.21.15.116:0/600031233 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff41c15f5a0 0x7ff41c0cec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:46.099 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.105+0000 7ff41959a640 1 -- 172.21.15.116:0/600031233 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1654951294 0 0) 0x7ff41c0ae8a0 con 0x7ff41c0b26d0 2024-02-21T22:53:46.099 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.105+0000 7ff41959a640 1 -- 172.21.15.116:0/600031233 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff404003520 con 0x7ff41c0b26d0 2024-02-21T22:53:46.099 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.105+0000 7ff41ad9d640 1 -- 172.21.15.116:0/600031233 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff41c15f5a0 msgr2=0x7ff41c0cec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:53:46.099 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.105+0000 7ff41ad9d640 1 --2- 172.21.15.116:0/600031233 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff41c15f5a0 0x7ff41c0cec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:46.099 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.105+0000 7ff41ad9d640 1 -- 172.21.15.116:0/600031233 >> v1:172.21.15.116:6789/0 conn(0x7ff41c0b26d0 legacy=0x7ff41c0d01f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:46.099 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.105+0000 7ff41959a640 1 -- 172.21.15.116:0/600031233 <== mon.0 v1:172.21.15.116:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 318810324 0 0) 0x7ff404003520 con 0x7ff41c0b26d0 2024-02-21T22:53:46.099 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.105+0000 7ff41ad9d640 1 -- 172.21.15.116:0/600031233 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff41c0cff20 con 0x7ff41c0d0900 2024-02-21T22:53:46.099 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.105+0000 7ff41a59c640 1 --2- 172.21.15.116:0/600031233 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff41c15f5a0 0x7ff41c0cec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T22:53:46.100 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.106+0000 7ff41ad9d640 1 --2- 172.21.15.116:0/600031233 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff41c0d0900 0x7ff41c0ccc00 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7ff4140097a0 tx=0x7ff41402b790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b35fbabfd63f00af server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:46.100 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.106+0000 7ff41959a640 1 -- 172.21.15.116:0/600031233 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff414037070 con 0x7ff41c0d0900 2024-02-21T22:53:46.100 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.106+0000 7ff41959a640 1 -- 172.21.15.116:0/600031233 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff414030510 con 0x7ff41c0d0900 2024-02-21T22:53:46.100 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.106+0000 7ff41959a640 1 -- 172.21.15.116:0/600031233 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff410001670 con 0x7ff41c0d0900 2024-02-21T22:53:46.100 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.106+0000 7ff420d55640 1 -- 172.21.15.116:0/600031233 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff41c0d0900 msgr2=0x7ff41c0ccc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:46.100 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.106+0000 7ff420d55640 1 --2- 172.21.15.116:0/600031233 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff41c0d0900 0x7ff41c0ccc00 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7ff4140097a0 tx=0x7ff41402b790 comp rx=0 tx=0).stop 2024-02-21T22:53:46.100 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.106+0000 7ff420d55640 1 -- 172.21.15.116:0/600031233 shutdown_connections 2024-02-21T22:53:46.100 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.106+0000 7ff420d55640 1 --2- 172.21.15.116:0/600031233 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff41c0d0900 0x7ff41c0ccc00 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:46.100 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.106+0000 7ff420d55640 1 --2- 172.21.15.116:0/600031233 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff41c15f5a0 0x7ff41c0cec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:46.100 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.106+0000 7ff420d55640 1 -- 172.21.15.116:0/600031233 >> 172.21.15.116:0/600031233 conn(0x7ff41c0d1c10 msgr2=0x7ff41c0d2020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:46.100 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.106+0000 7ff420d55640 1 -- 172.21.15.116:0/600031233 shutdown_connections 2024-02-21T22:53:46.100 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.107+0000 7ff420d55640 1 -- 172.21.15.116:0/600031233 wait complete. 2024-02-21T22:53:46.100 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.108+0000 7ff420d55640 1 Processor -- start 2024-02-21T22:53:46.100 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.108+0000 7ff420d55640 1 -- start start 2024-02-21T22:53:46.103 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.108+0000 7ff420d55640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff41c0b26d0 0x7ff41c1f3af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:46.103 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.108+0000 7ff420d55640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff41c0d0900 0x7ff41c0b4a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:46.103 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.109+0000 7ff420d55640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff41c15f5a0 0x7ff41c0c7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:46.103 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.109+0000 7ff420d55640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff41c0b2e90 con 0x7ff41c15f5a0 2024-02-21T22:53:46.103 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.109+0000 7ff420d55640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff41c0cfc40 con 0x7ff41c0b26d0 2024-02-21T22:53:46.103 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.109+0000 7ff420d55640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff41c0b3010 con 0x7ff41c0d0900 2024-02-21T22:53:46.103 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.109+0000 7ff41ad9d640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff41c15f5a0 0x7ff41c0c7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:46.103 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.109+0000 7ff41ad9d640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff41c15f5a0 0x7ff41c0c7880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:39922/0 (socket says 172.21.15.116:39922) 2024-02-21T22:53:46.103 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.109+0000 7ff41ad9d640 1 -- 172.21.15.116:0/3493606748 learned_addr learned my addr 172.21.15.116:0/3493606748 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:46.103 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.109+0000 7ff419d9b640 1 --2- 172.21.15.116:0/3493606748 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff41c0d0900 0x7ff41c0b4a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:46.103 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.109+0000 7ff41a59c640 1 --2- 172.21.15.116:0/3493606748 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff41c0b26d0 0x7ff41c1f3af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:46.104 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.109+0000 7ff41ad9d640 1 -- 172.21.15.116:0/3493606748 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff41c0d0900 msgr2=0x7ff41c0b4a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:46.104 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.109+0000 7ff41ad9d640 1 --2- 172.21.15.116:0/3493606748 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff41c0d0900 0x7ff41c0b4a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:46.104 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.109+0000 7ff41ad9d640 1 -- 172.21.15.116:0/3493606748 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff41c0b26d0 msgr2=0x7ff41c1f3af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:46.104 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.109+0000 7ff41ad9d640 1 --2- 172.21.15.116:0/3493606748 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff41c0b26d0 0x7ff41c1f3af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:46.104 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.109+0000 7ff41ad9d640 1 -- 172.21.15.116:0/3493606748 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff41c0b52b0 con 0x7ff41c15f5a0 2024-02-21T22:53:46.104 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.109+0000 7ff41ad9d640 1 --2- 172.21.15.116:0/3493606748 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff41c15f5a0 0x7ff41c0c7880 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7ff41402b7d0 tx=0x7ff4140046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:46.104 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.109+0000 7ff40affd640 1 -- 172.21.15.116:0/3493606748 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff414042020 con 0x7ff41c15f5a0 2024-02-21T22:53:46.104 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.109+0000 7ff40affd640 1 -- 172.21.15.116:0/3493606748 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4140044c0 con 0x7ff41c15f5a0 2024-02-21T22:53:46.104 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.109+0000 7ff40affd640 1 -- 172.21.15.116:0/3493606748 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff414037040 con 0x7ff41c15f5a0 2024-02-21T22:53:46.104 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.109+0000 7ff420d55640 1 -- 172.21.15.116:0/3493606748 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff41c0b5590 con 0x7ff41c15f5a0 2024-02-21T22:53:46.104 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.109+0000 7ff420d55640 1 -- 172.21.15.116:0/3493606748 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff41c0b5b50 con 0x7ff41c15f5a0 2024-02-21T22:53:46.104 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.110+0000 7ff420d55640 1 -- 172.21.15.116:0/3493606748 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff41c0752f0 con 0x7ff41c15f5a0 2024-02-21T22:53:46.104 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.111+0000 7ff40affd640 1 -- 172.21.15.116:0/3493606748 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ff414045020 con 0x7ff41c15f5a0 2024-02-21T22:53:46.104 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.111+0000 7ff40affd640 1 --2- 172.21.15.116:0/3493606748 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7ff3fc06b4d0 0x7ff3fc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:46.104 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.111+0000 7ff40affd640 1 -- 172.21.15.116:0/3493606748 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff4140abcf0 con 0x7ff41c15f5a0 2024-02-21T22:53:46.105 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.111+0000 7ff41a59c640 1 --2- 172.21.15.116:0/3493606748 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7ff3fc06b4d0 0x7ff3fc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:46.105 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.112+0000 7ff41a59c640 1 --2- 172.21.15.116:0/3493606748 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7ff3fc06b4d0 0x7ff3fc06d990 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7ff41c0b66e0 tx=0x7ff40c00b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:46.105 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.115+0000 7ff40affd640 1 -- 172.21.15.116:0/3493606748 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7ff4140b0070 con 0x7ff41c15f5a0 2024-02-21T22:53:46.273 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.283+0000 7ff420d55640 1 -- 172.21.15.116:0/3493606748 --> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff41c0d04d0 con 0x7ff3fc06b4d0 2024-02-21T22:53:46.285 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.295+0000 7ff40affd640 1 -- 172.21.15.116:0/3493606748 <== mgr.4103 v2:172.21.15.142:6832/1381484782 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251882 (secure 0 0 0) 0x7ff41c0d04d0 con 0x7ff3fc06b4d0 2024-02-21T22:53:46.288 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-02-21T22:53:46.289 INFO:teuthology.orchestra.run.smithi116.stderr:dumped all 2024-02-21T22:53:46.291 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.298+0000 7ff420d55640 1 -- 172.21.15.116:0/3493606748 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7ff3fc06b4d0 msgr2=0x7ff3fc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:46.291 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.298+0000 7ff420d55640 1 --2- 172.21.15.116:0/3493606748 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7ff3fc06b4d0 0x7ff3fc06d990 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7ff41c0b66e0 tx=0x7ff40c00b040 comp rx=0 tx=0).stop 2024-02-21T22:53:46.291 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.298+0000 7ff420d55640 1 -- 172.21.15.116:0/3493606748 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff41c15f5a0 msgr2=0x7ff41c0c7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:46.291 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.298+0000 7ff420d55640 1 --2- 172.21.15.116:0/3493606748 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff41c15f5a0 0x7ff41c0c7880 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7ff41402b7d0 tx=0x7ff4140046c0 comp rx=0 tx=0).stop 2024-02-21T22:53:46.291 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.298+0000 7ff420d55640 1 -- 172.21.15.116:0/3493606748 shutdown_connections 2024-02-21T22:53:46.291 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.298+0000 7ff420d55640 1 --2- 172.21.15.116:0/3493606748 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff41c15f5a0 0x7ff41c0c7880 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:46.291 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.298+0000 7ff420d55640 1 --2- 172.21.15.116:0/3493606748 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7ff3fc06b4d0 0x7ff3fc06d990 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:46.292 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.298+0000 7ff420d55640 1 --2- 172.21.15.116:0/3493606748 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff41c0d0900 0x7ff41c0b4a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:46.292 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.298+0000 7ff420d55640 1 --2- 172.21.15.116:0/3493606748 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff41c0b26d0 0x7ff41c1f3af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:46.292 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.298+0000 7ff420d55640 1 -- 172.21.15.116:0/3493606748 >> 172.21.15.116:0/3493606748 conn(0x7ff41c0d1c10 msgr2=0x7ff41c0b0ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:46.292 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.298+0000 7ff420d55640 1 -- 172.21.15.116:0/3493606748 shutdown_connections 2024-02-21T22:53:46.292 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.298+0000 7ff420d55640 1 -- 172.21.15.116:0/3493606748 wait complete. 2024-02-21T22:53:46.300 INFO:teuthology.orchestra.run.smithi116.stdout:{"pg_ready":true,"pg_map":{"version":59,"stamp":"2024-02-21T22:53:44.297270+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":94,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220072,"kb_used_data":3908,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754648,"statfs":{"total":773094113280,"available":772868759552,"internally_reserved":0,"allocated":4001792,"data_stored":2257473,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000684"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.006204+0000","last_change":"2024-02-21T22:53:43.002525+0000","last_active":"2024-02-21T22:53:43.006204+0000","last_peered":"2024-02-21T22:53:43.006204+0000","last_clean":"2024-02-21T22:53:43.006204+0000","last_became_active":"2024-02-21T22:53:43.002238+0000","last_became_peered":"2024-02-21T22:53:43.002238+0000","last_unstale":"2024-02-21T22:53:43.006204+0000","last_undegraded":"2024-02-21T22:53:43.006204+0000","last_fullsized":"2024-02-21T22:53:43.006204+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:52:03.788166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.004954+0000","last_change":"2024-02-21T22:53:43.000671+0000","last_active":"2024-02-21T22:53:43.004954+0000","last_peered":"2024-02-21T22:53:43.004954+0000","last_clean":"2024-02-21T22:53:43.004954+0000","last_became_active":"2024-02-21T22:53:43.000396+0000","last_became_peered":"2024-02-21T22:53:43.000396+0000","last_unstale":"2024-02-21T22:53:43.004954+0000","last_undegraded":"2024-02-21T22:53:43.004954+0000","last_fullsized":"2024-02-21T22:53:43.004954+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:02:41.596861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.007778+0000","last_change":"2024-02-21T22:53:43.004625+0000","last_active":"2024-02-21T22:53:43.007778+0000","last_peered":"2024-02-21T22:53:43.007778+0000","last_clean":"2024-02-21T22:53:43.007778+0000","last_became_active":"2024-02-21T22:53:43.004321+0000","last_became_peered":"2024-02-21T22:53:43.004321+0000","last_unstale":"2024-02-21T22:53:43.007778+0000","last_undegraded":"2024-02-21T22:53:43.007778+0000","last_fullsized":"2024-02-21T22:53:43.007778+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:15:36.152598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.016041+0000","last_change":"2024-02-21T22:53:43.010931+0000","last_active":"2024-02-21T22:53:43.016041+0000","last_peered":"2024-02-21T22:53:43.016041+0000","last_clean":"2024-02-21T22:53:43.016041+0000","last_became_active":"2024-02-21T22:53:43.010683+0000","last_became_peered":"2024-02-21T22:53:43.010683+0000","last_unstale":"2024-02-21T22:53:43.016041+0000","last_undegraded":"2024-02-21T22:53:43.016041+0000","last_fullsized":"2024-02-21T22:53:43.016041+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:26:25.990337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.014335+0000","last_change":"2024-02-21T22:53:43.006662+0000","last_active":"2024-02-21T22:53:43.014335+0000","last_peered":"2024-02-21T22:53:43.014335+0000","last_clean":"2024-02-21T22:53:43.014335+0000","last_became_active":"2024-02-21T22:53:43.006405+0000","last_became_peered":"2024-02-21T22:53:43.006405+0000","last_unstale":"2024-02-21T22:53:43.014335+0000","last_undegraded":"2024-02-21T22:53:43.014335+0000","last_fullsized":"2024-02-21T22:53:43.014335+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:08:37.881320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.005208+0000","last_change":"2024-02-21T22:53:42.997969+0000","last_active":"2024-02-21T22:53:43.005208+0000","last_peered":"2024-02-21T22:53:43.005208+0000","last_clean":"2024-02-21T22:53:43.005208+0000","last_became_active":"2024-02-21T22:53:42.997719+0000","last_became_peered":"2024-02-21T22:53:42.997719+0000","last_unstale":"2024-02-21T22:53:43.005208+0000","last_undegraded":"2024-02-21T22:53:43.005208+0000","last_fullsized":"2024-02-21T22:53:43.005208+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:15:36.152598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.011871+0000","last_change":"2024-02-21T22:53:43.007930+0000","last_active":"2024-02-21T22:53:43.011871+0000","last_peered":"2024-02-21T22:53:43.011871+0000","last_clean":"2024-02-21T22:53:43.011871+0000","last_became_active":"2024-02-21T22:53:43.007675+0000","last_became_peered":"2024-02-21T22:53:43.007675+0000","last_unstale":"2024-02-21T22:53:43.011871+0000","last_undegraded":"2024-02-21T22:53:43.011871+0000","last_fullsized":"2024-02-21T22:53:43.011871+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:09:01.597859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.006767+0000","last_change":"2024-02-21T22:53:43.001108+0000","last_active":"2024-02-21T22:53:43.006767+0000","last_peered":"2024-02-21T22:53:43.006767+0000","last_clean":"2024-02-21T22:53:43.006767+0000","last_became_active":"2024-02-21T22:53:43.000729+0000","last_became_peered":"2024-02-21T22:53:43.000729+0000","last_unstale":"2024-02-21T22:53:43.006767+0000","last_undegraded":"2024-02-21T22:53:43.006767+0000","last_fullsized":"2024-02-21T22:53:43.006767+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:28:10.850115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.018822+0000","last_change":"2024-02-21T22:53:43.016364+0000","last_active":"2024-02-21T22:53:43.018822+0000","last_peered":"2024-02-21T22:53:43.018822+0000","last_clean":"2024-02-21T22:53:43.018822+0000","last_became_active":"2024-02-21T22:53:43.015907+0000","last_became_peered":"2024-02-21T22:53:43.015907+0000","last_unstale":"2024-02-21T22:53:43.018822+0000","last_undegraded":"2024-02-21T22:53:43.018822+0000","last_fullsized":"2024-02-21T22:53:43.018822+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:10:10.130504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.014752+0000","last_change":"2024-02-21T22:53:43.005373+0000","last_active":"2024-02-21T22:53:43.014752+0000","last_peered":"2024-02-21T22:53:43.014752+0000","last_clean":"2024-02-21T22:53:43.014752+0000","last_became_active":"2024-02-21T22:53:43.005035+0000","last_became_peered":"2024-02-21T22:53:43.005035+0000","last_unstale":"2024-02-21T22:53:43.014752+0000","last_undegraded":"2024-02-21T22:53:43.014752+0000","last_fullsized":"2024-02-21T22:53:43.014752+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:54:01.357343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.018013+0000","last_change":"2024-02-21T22:53:43.011309+0000","last_active":"2024-02-21T22:53:43.018013+0000","last_peered":"2024-02-21T22:53:43.018013+0000","last_clean":"2024-02-21T22:53:43.018013+0000","last_became_active":"2024-02-21T22:53:43.010956+0000","last_became_peered":"2024-02-21T22:53:43.010956+0000","last_unstale":"2024-02-21T22:53:43.018013+0000","last_undegraded":"2024-02-21T22:53:43.018013+0000","last_fullsized":"2024-02-21T22:53:43.018013+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:53:37.219886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.011398+0000","last_change":"2024-02-21T22:53:43.007326+0000","last_active":"2024-02-21T22:53:43.011398+0000","last_peered":"2024-02-21T22:53:43.011398+0000","last_clean":"2024-02-21T22:53:43.011398+0000","last_became_active":"2024-02-21T22:53:43.007022+0000","last_became_peered":"2024-02-21T22:53:43.007022+0000","last_unstale":"2024-02-21T22:53:43.011398+0000","last_undegraded":"2024-02-21T22:53:43.011398+0000","last_fullsized":"2024-02-21T22:53:43.011398+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:53:37.531108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.000617+0000","last_change":"2024-02-21T22:53:42.999643+0000","last_active":"2024-02-21T22:53:43.000617+0000","last_peered":"2024-02-21T22:53:43.000617+0000","last_clean":"2024-02-21T22:53:43.000617+0000","last_became_active":"2024-02-21T22:53:42.999406+0000","last_became_peered":"2024-02-21T22:53:42.999406+0000","last_unstale":"2024-02-21T22:53:43.000617+0000","last_undegraded":"2024-02-21T22:53:43.000617+0000","last_fullsized":"2024-02-21T22:53:43.000617+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:03:56.897909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.014081+0000","last_change":"2024-02-21T22:53:43.005346+0000","last_active":"2024-02-21T22:53:43.014081+0000","last_peered":"2024-02-21T22:53:43.014081+0000","last_clean":"2024-02-21T22:53:43.014081+0000","last_became_active":"2024-02-21T22:53:43.004383+0000","last_became_peered":"2024-02-21T22:53:43.004383+0000","last_unstale":"2024-02-21T22:53:43.014081+0000","last_undegraded":"2024-02-21T22:53:43.014081+0000","last_fullsized":"2024-02-21T22:53:43.014081+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:31:54.235302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.006414+0000","last_change":"2024-02-21T22:53:42.995690+0000","last_active":"2024-02-21T22:53:43.006414+0000","last_peered":"2024-02-21T22:53:43.006414+0000","last_clean":"2024-02-21T22:53:43.006414+0000","last_became_active":"2024-02-21T22:53:42.995407+0000","last_became_peered":"2024-02-21T22:53:42.995407+0000","last_unstale":"2024-02-21T22:53:43.006414+0000","last_undegraded":"2024-02-21T22:53:43.006414+0000","last_fullsized":"2024-02-21T22:53:43.006414+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:54:01.357343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.012720+0000","last_change":"2024-02-21T22:53:43.009355+0000","last_active":"2024-02-21T22:53:43.012720+0000","last_peered":"2024-02-21T22:53:43.012720+0000","last_clean":"2024-02-21T22:53:43.012720+0000","last_became_active":"2024-02-21T22:53:43.009073+0000","last_became_peered":"2024-02-21T22:53:43.009073+0000","last_unstale":"2024-02-21T22:53:43.012720+0000","last_undegraded":"2024-02-21T22:53:43.012720+0000","last_fullsized":"2024-02-21T22:53:43.012720+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:06:03.706623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.011941+0000","last_change":"2024-02-21T22:53:43.008675+0000","last_active":"2024-02-21T22:53:43.011941+0000","last_peered":"2024-02-21T22:53:43.011941+0000","last_clean":"2024-02-21T22:53:43.011941+0000","last_became_active":"2024-02-21T22:53:43.008404+0000","last_became_peered":"2024-02-21T22:53:43.008404+0000","last_unstale":"2024-02-21T22:53:43.011941+0000","last_undegraded":"2024-02-21T22:53:43.011941+0000","last_fullsized":"2024-02-21T22:53:43.011941+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:54:01.357343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.004934+0000","last_change":"2024-02-21T22:53:42.999615+0000","last_active":"2024-02-21T22:53:43.004934+0000","last_peered":"2024-02-21T22:53:43.004934+0000","last_clean":"2024-02-21T22:53:43.004934+0000","last_became_active":"2024-02-21T22:53:42.999362+0000","last_became_peered":"2024-02-21T22:53:42.999362+0000","last_unstale":"2024-02-21T22:53:43.004934+0000","last_undegraded":"2024-02-21T22:53:43.004934+0000","last_fullsized":"2024-02-21T22:53:43.004934+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:40:05.306862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.015381+0000","last_change":"2024-02-21T22:53:43.010970+0000","last_active":"2024-02-21T22:53:43.015381+0000","last_peered":"2024-02-21T22:53:43.015381+0000","last_clean":"2024-02-21T22:53:43.015381+0000","last_became_active":"2024-02-21T22:53:43.010702+0000","last_became_peered":"2024-02-21T22:53:43.010702+0000","last_unstale":"2024-02-21T22:53:43.015381+0000","last_undegraded":"2024-02-21T22:53:43.015381+0000","last_fullsized":"2024-02-21T22:53:43.015381+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:41:56.581902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.014341+0000","last_change":"2024-02-21T22:53:43.006258+0000","last_active":"2024-02-21T22:53:43.014341+0000","last_peered":"2024-02-21T22:53:43.014341+0000","last_clean":"2024-02-21T22:53:43.014341+0000","last_became_active":"2024-02-21T22:53:43.005993+0000","last_became_peered":"2024-02-21T22:53:43.005993+0000","last_unstale":"2024-02-21T22:53:43.014341+0000","last_undegraded":"2024-02-21T22:53:43.014341+0000","last_fullsized":"2024-02-21T22:53:43.014341+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:46:32.488082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.018765+0000","last_change":"2024-02-21T22:53:43.015003+0000","last_active":"2024-02-21T22:53:43.018765+0000","last_peered":"2024-02-21T22:53:43.018765+0000","last_clean":"2024-02-21T22:53:43.018765+0000","last_became_active":"2024-02-21T22:53:43.014712+0000","last_became_peered":"2024-02-21T22:53:43.014712+0000","last_unstale":"2024-02-21T22:53:43.018765+0000","last_undegraded":"2024-02-21T22:53:43.018765+0000","last_fullsized":"2024-02-21T22:53:43.018765+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:52:03.788166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.018759+0000","last_change":"2024-02-21T22:53:43.014845+0000","last_active":"2024-02-21T22:53:43.018759+0000","last_peered":"2024-02-21T22:53:43.018759+0000","last_clean":"2024-02-21T22:53:43.018759+0000","last_became_active":"2024-02-21T22:53:43.014570+0000","last_became_peered":"2024-02-21T22:53:43.014570+0000","last_unstale":"2024-02-21T22:53:43.018759+0000","last_undegraded":"2024-02-21T22:53:43.018759+0000","last_fullsized":"2024-02-21T22:53:43.018759+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:28:10.850115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.005938+0000","last_change":"2024-02-21T22:53:43.002518+0000","last_active":"2024-02-21T22:53:43.005938+0000","last_peered":"2024-02-21T22:53:43.005938+0000","last_clean":"2024-02-21T22:53:43.005938+0000","last_became_active":"2024-02-21T22:53:43.002254+0000","last_became_peered":"2024-02-21T22:53:43.002254+0000","last_unstale":"2024-02-21T22:53:43.005938+0000","last_undegraded":"2024-02-21T22:53:43.005938+0000","last_fullsized":"2024-02-21T22:53:43.005938+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:10:10.130504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.006341+0000","last_change":"2024-02-21T22:53:42.996552+0000","last_active":"2024-02-21T22:53:43.006341+0000","last_peered":"2024-02-21T22:53:43.006341+0000","last_clean":"2024-02-21T22:53:43.006341+0000","last_became_active":"2024-02-21T22:53:42.996208+0000","last_became_peered":"2024-02-21T22:53:42.996208+0000","last_unstale":"2024-02-21T22:53:43.006341+0000","last_undegraded":"2024-02-21T22:53:43.006341+0000","last_fullsized":"2024-02-21T22:53:43.006341+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:06:03.706623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.015005+0000","last_change":"2024-02-21T22:53:43.003996+0000","last_active":"2024-02-21T22:53:43.015005+0000","last_peered":"2024-02-21T22:53:43.015005+0000","last_clean":"2024-02-21T22:53:43.015005+0000","last_became_active":"2024-02-21T22:53:43.003710+0000","last_became_peered":"2024-02-21T22:53:43.003710+0000","last_unstale":"2024-02-21T22:53:43.015005+0000","last_undegraded":"2024-02-21T22:53:43.015005+0000","last_fullsized":"2024-02-21T22:53:43.015005+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:10:10.130504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.004974+0000","last_change":"2024-02-21T22:53:43.000854+0000","last_active":"2024-02-21T22:53:43.004974+0000","last_peered":"2024-02-21T22:53:43.004974+0000","last_clean":"2024-02-21T22:53:43.004974+0000","last_became_active":"2024-02-21T22:53:43.000575+0000","last_became_peered":"2024-02-21T22:53:43.000575+0000","last_unstale":"2024-02-21T22:53:43.004974+0000","last_undegraded":"2024-02-21T22:53:43.004974+0000","last_fullsized":"2024-02-21T22:53:43.004974+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:53:37.531108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.015803+0000","last_change":"2024-02-21T22:53:43.011416+0000","last_active":"2024-02-21T22:53:43.015803+0000","last_peered":"2024-02-21T22:53:43.015803+0000","last_clean":"2024-02-21T22:53:43.015803+0000","last_became_active":"2024-02-21T22:53:43.010808+0000","last_became_peered":"2024-02-21T22:53:43.010808+0000","last_unstale":"2024-02-21T22:53:43.015803+0000","last_undegraded":"2024-02-21T22:53:43.015803+0000","last_fullsized":"2024-02-21T22:53:43.015803+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:13:51.231189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.006535+0000","last_change":"2024-02-21T22:53:42.999624+0000","last_active":"2024-02-21T22:53:43.006535+0000","last_peered":"2024-02-21T22:53:43.006535+0000","last_clean":"2024-02-21T22:53:43.006535+0000","last_became_active":"2024-02-21T22:53:42.999295+0000","last_became_peered":"2024-02-21T22:53:42.999295+0000","last_unstale":"2024-02-21T22:53:43.006535+0000","last_undegraded":"2024-02-21T22:53:43.006535+0000","last_fullsized":"2024-02-21T22:53:43.006535+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:53:37.219886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.018799+0000","last_change":"2024-02-21T22:53:43.016081+0000","last_active":"2024-02-21T22:53:43.018799+0000","last_peered":"2024-02-21T22:53:43.018799+0000","last_clean":"2024-02-21T22:53:43.018799+0000","last_became_active":"2024-02-21T22:53:43.015533+0000","last_became_peered":"2024-02-21T22:53:43.015533+0000","last_unstale":"2024-02-21T22:53:43.018799+0000","last_undegraded":"2024-02-21T22:53:43.018799+0000","last_fullsized":"2024-02-21T22:53:43.018799+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:09:01.597859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.012053+0000","last_change":"2024-02-21T22:53:43.007179+0000","last_active":"2024-02-21T22:53:43.012053+0000","last_peered":"2024-02-21T22:53:43.012053+0000","last_clean":"2024-02-21T22:53:43.012053+0000","last_became_active":"2024-02-21T22:53:43.006982+0000","last_became_peered":"2024-02-21T22:53:43.006982+0000","last_unstale":"2024-02-21T22:53:43.012053+0000","last_undegraded":"2024-02-21T22:53:43.012053+0000","last_fullsized":"2024-02-21T22:53:43.012053+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:08:09.142193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.005921+0000","last_change":"2024-02-21T22:53:43.000423+0000","last_active":"2024-02-21T22:53:43.005921+0000","last_peered":"2024-02-21T22:53:43.005921+0000","last_clean":"2024-02-21T22:53:43.005921+0000","last_became_active":"2024-02-21T22:53:43.000179+0000","last_became_peered":"2024-02-21T22:53:43.000179+0000","last_unstale":"2024-02-21T22:53:43.005921+0000","last_undegraded":"2024-02-21T22:53:43.005921+0000","last_fullsized":"2024-02-21T22:53:43.005921+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:28:10.850115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.018445+0000","last_change":"2024-02-21T22:53:43.013244+0000","last_active":"2024-02-21T22:53:43.018445+0000","last_peered":"2024-02-21T22:53:43.018445+0000","last_clean":"2024-02-21T22:53:43.018445+0000","last_became_active":"2024-02-21T22:53:43.012985+0000","last_became_peered":"2024-02-21T22:53:43.012985+0000","last_unstale":"2024-02-21T22:53:43.018445+0000","last_undegraded":"2024-02-21T22:53:43.018445+0000","last_fullsized":"2024-02-21T22:53:43.018445+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:15:36.152598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.003253+0000","last_change":"2024-02-21T22:53:43.001816+0000","last_active":"2024-02-21T22:53:43.003253+0000","last_peered":"2024-02-21T22:53:43.003253+0000","last_clean":"2024-02-21T22:53:43.003253+0000","last_became_active":"2024-02-21T22:53:43.001564+0000","last_became_peered":"2024-02-21T22:53:43.001564+0000","last_unstale":"2024-02-21T22:53:43.003253+0000","last_undegraded":"2024-02-21T22:53:43.003253+0000","last_fullsized":"2024-02-21T22:53:43.003253+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:09:01.597859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"32'4","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.011306+0000","last_change":"2024-02-21T22:53:41.994843+0000","last_active":"2024-02-21T22:53:43.011306+0000","last_peered":"2024-02-21T22:53:43.011306+0000","last_clean":"2024-02-21T22:53:43.011306+0000","last_became_active":"2024-02-21T22:53:41.994468+0000","last_became_peered":"2024-02-21T22:53:41.994468+0000","last_unstale":"2024-02-21T22:53:43.011306+0000","last_undegraded":"2024-02-21T22:53:43.011306+0000","last_fullsized":"2024-02-21T22:53:43.011306+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:27:18.184658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.010868+0000","last_change":"2024-02-21T22:53:43.008294+0000","last_active":"2024-02-21T22:53:43.010868+0000","last_peered":"2024-02-21T22:53:43.010868+0000","last_clean":"2024-02-21T22:53:43.010868+0000","last_became_active":"2024-02-21T22:53:43.008021+0000","last_became_peered":"2024-02-21T22:53:43.008021+0000","last_unstale":"2024-02-21T22:53:43.010868+0000","last_undegraded":"2024-02-21T22:53:43.010868+0000","last_fullsized":"2024-02-21T22:53:43.010868+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:08:09.142193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"32'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.012276+0000","last_change":"2024-02-21T22:53:41.987067+0000","last_active":"2024-02-21T22:53:43.012276+0000","last_peered":"2024-02-21T22:53:43.012276+0000","last_clean":"2024-02-21T22:53:43.012276+0000","last_became_active":"2024-02-21T22:53:41.986784+0000","last_became_peered":"2024-02-21T22:53:41.986784+0000","last_unstale":"2024-02-21T22:53:43.012276+0000","last_undegraded":"2024-02-21T22:53:43.012276+0000","last_fullsized":"2024-02-21T22:53:43.012276+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:34:59.792432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.018843+0000","last_change":"2024-02-21T22:53:43.016649+0000","last_active":"2024-02-21T22:53:43.018843+0000","last_peered":"2024-02-21T22:53:43.018843+0000","last_clean":"2024-02-21T22:53:43.018843+0000","last_became_active":"2024-02-21T22:53:43.016339+0000","last_became_peered":"2024-02-21T22:53:43.016339+0000","last_unstale":"2024-02-21T22:53:43.018843+0000","last_undegraded":"2024-02-21T22:53:43.018843+0000","last_fullsized":"2024-02-21T22:53:43.018843+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:54:01.357343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"32'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.016655+0000","last_change":"2024-02-21T22:53:41.991758+0000","last_active":"2024-02-21T22:53:43.016655+0000","last_peered":"2024-02-21T22:53:43.016655+0000","last_clean":"2024-02-21T22:53:43.016655+0000","last_became_active":"2024-02-21T22:53:41.990213+0000","last_became_peered":"2024-02-21T22:53:41.990213+0000","last_unstale":"2024-02-21T22:53:43.016655+0000","last_undegraded":"2024-02-21T22:53:43.016655+0000","last_fullsized":"2024-02-21T22:53:43.016655+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:54:00.352993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.015825+0000","last_change":"2024-02-21T22:53:43.011534+0000","last_active":"2024-02-21T22:53:43.015825+0000","last_peered":"2024-02-21T22:53:43.015825+0000","last_clean":"2024-02-21T22:53:43.015825+0000","last_became_active":"2024-02-21T22:53:43.011165+0000","last_became_peered":"2024-02-21T22:53:43.011165+0000","last_unstale":"2024-02-21T22:53:43.015825+0000","last_undegraded":"2024-02-21T22:53:43.015825+0000","last_fullsized":"2024-02-21T22:53:43.015825+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:40:05.306862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"32'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.016309+0000","last_change":"2024-02-21T22:53:41.989989+0000","last_active":"2024-02-21T22:53:43.016309+0000","last_peered":"2024-02-21T22:53:43.016309+0000","last_clean":"2024-02-21T22:53:43.016309+0000","last_became_active":"2024-02-21T22:53:41.989105+0000","last_became_peered":"2024-02-21T22:53:41.989105+0000","last_unstale":"2024-02-21T22:53:43.016309+0000","last_undegraded":"2024-02-21T22:53:43.016309+0000","last_fullsized":"2024-02-21T22:53:43.016309+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:22:53.606008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.018419+0000","last_change":"2024-02-21T22:53:43.012670+0000","last_active":"2024-02-21T22:53:43.018419+0000","last_peered":"2024-02-21T22:53:43.018419+0000","last_clean":"2024-02-21T22:53:43.018419+0000","last_became_active":"2024-02-21T22:53:43.012407+0000","last_became_peered":"2024-02-21T22:53:43.012407+0000","last_unstale":"2024-02-21T22:53:43.018419+0000","last_undegraded":"2024-02-21T22:53:43.018419+0000","last_fullsized":"2024-02-21T22:53:43.018419+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:26:25.990337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"32'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.015551+0000","last_change":"2024-02-21T22:53:41.992560+0000","last_active":"2024-02-21T22:53:43.015551+0000","last_peered":"2024-02-21T22:53:43.015551+0000","last_clean":"2024-02-21T22:53:43.015551+0000","last_became_active":"2024-02-21T22:53:41.992200+0000","last_became_peered":"2024-02-21T22:53:41.992200+0000","last_unstale":"2024-02-21T22:53:43.015551+0000","last_undegraded":"2024-02-21T22:53:43.015551+0000","last_fullsized":"2024-02-21T22:53:43.015551+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:47:38.675797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.008348+0000","last_change":"2024-02-21T22:53:43.003713+0000","last_active":"2024-02-21T22:53:43.008348+0000","last_peered":"2024-02-21T22:53:43.008348+0000","last_clean":"2024-02-21T22:53:43.008348+0000","last_became_active":"2024-02-21T22:53:43.003448+0000","last_became_peered":"2024-02-21T22:53:43.003448+0000","last_unstale":"2024-02-21T22:53:43.008348+0000","last_undegraded":"2024-02-21T22:53:43.008348+0000","last_fullsized":"2024-02-21T22:53:43.008348+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:26:25.990337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"32'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.015559+0000","last_change":"2024-02-21T22:53:41.989888+0000","last_active":"2024-02-21T22:53:43.015559+0000","last_peered":"2024-02-21T22:53:43.015559+0000","last_clean":"2024-02-21T22:53:43.015559+0000","last_became_active":"2024-02-21T22:53:41.989605+0000","last_became_peered":"2024-02-21T22:53:41.989605+0000","last_unstale":"2024-02-21T22:53:43.015559+0000","last_undegraded":"2024-02-21T22:53:43.015559+0000","last_fullsized":"2024-02-21T22:53:43.015559+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:28:50.954719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.018147+0000","last_change":"2024-02-21T22:53:43.011697+0000","last_active":"2024-02-21T22:53:43.018147+0000","last_peered":"2024-02-21T22:53:43.018147+0000","last_clean":"2024-02-21T22:53:43.018147+0000","last_became_active":"2024-02-21T22:53:43.011446+0000","last_became_peered":"2024-02-21T22:53:43.011446+0000","last_unstale":"2024-02-21T22:53:43.018147+0000","last_undegraded":"2024-02-21T22:53:43.018147+0000","last_fullsized":"2024-02-21T22:53:43.018147+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:35:00.796782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:42.988513+0000","last_change":"2024-02-21T22:53:41.990198+0000","last_active":"2024-02-21T22:53:42.988513+0000","last_peered":"2024-02-21T22:53:42.988513+0000","last_clean":"2024-02-21T22:53:42.988513+0000","last_became_active":"2024-02-21T22:53:41.989927+0000","last_became_peered":"2024-02-21T22:53:41.989927+0000","last_unstale":"2024-02-21T22:53:42.988513+0000","last_undegraded":"2024-02-21T22:53:42.988513+0000","last_fullsized":"2024-02-21T22:53:42.988513+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:08:08.137842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.014807+0000","last_change":"2024-02-21T22:53:43.008825+0000","last_active":"2024-02-21T22:53:43.014807+0000","last_peered":"2024-02-21T22:53:43.014807+0000","last_clean":"2024-02-21T22:53:43.014807+0000","last_became_active":"2024-02-21T22:53:43.008486+0000","last_became_peered":"2024-02-21T22:53:43.008486+0000","last_unstale":"2024-02-21T22:53:43.014807+0000","last_undegraded":"2024-02-21T22:53:43.014807+0000","last_fullsized":"2024-02-21T22:53:43.014807+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:53:37.219886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:42.998711+0000","last_change":"2024-02-21T22:53:41.985526+0000","last_active":"2024-02-21T22:53:42.998711+0000","last_peered":"2024-02-21T22:53:42.998711+0000","last_clean":"2024-02-21T22:53:42.998711+0000","last_became_active":"2024-02-21T22:53:41.985232+0000","last_became_peered":"2024-02-21T22:53:41.985232+0000","last_unstale":"2024-02-21T22:53:42.998711+0000","last_undegraded":"2024-02-21T22:53:42.998711+0000","last_fullsized":"2024-02-21T22:53:42.998711+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:46:31.483732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.007749+0000","last_change":"2024-02-21T22:53:43.005931+0000","last_active":"2024-02-21T22:53:43.007749+0000","last_peered":"2024-02-21T22:53:43.007749+0000","last_clean":"2024-02-21T22:53:43.007749+0000","last_became_active":"2024-02-21T22:53:43.005375+0000","last_became_peered":"2024-02-21T22:53:43.005375+0000","last_unstale":"2024-02-21T22:53:43.007749+0000","last_undegraded":"2024-02-21T22:53:43.007749+0000","last_fullsized":"2024-02-21T22:53:43.007749+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:40:05.306862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:42.989670+0000","last_change":"2024-02-21T22:53:41.987065+0000","last_active":"2024-02-21T22:53:42.989670+0000","last_peered":"2024-02-21T22:53:42.989670+0000","last_clean":"2024-02-21T22:53:42.989670+0000","last_became_active":"2024-02-21T22:53:41.986873+0000","last_became_peered":"2024-02-21T22:53:41.986873+0000","last_unstale":"2024-02-21T22:53:42.989670+0000","last_undegraded":"2024-02-21T22:53:42.989670+0000","last_fullsized":"2024-02-21T22:53:42.989670+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:53:36.215536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.014872+0000","last_change":"2024-02-21T22:53:43.010123+0000","last_active":"2024-02-21T22:53:43.014872+0000","last_peered":"2024-02-21T22:53:43.014872+0000","last_clean":"2024-02-21T22:53:43.014872+0000","last_became_active":"2024-02-21T22:53:43.009846+0000","last_became_peered":"2024-02-21T22:53:43.009846+0000","last_unstale":"2024-02-21T22:53:43.014872+0000","last_undegraded":"2024-02-21T22:53:43.014872+0000","last_fullsized":"2024-02-21T22:53:43.014872+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:03:52.457060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:42.995511+0000","last_change":"2024-02-21T22:53:41.987725+0000","last_active":"2024-02-21T22:53:42.995511+0000","last_peered":"2024-02-21T22:53:42.995511+0000","last_clean":"2024-02-21T22:53:42.995511+0000","last_became_active":"2024-02-21T22:53:41.987448+0000","last_became_peered":"2024-02-21T22:53:41.987448+0000","last_unstale":"2024-02-21T22:53:42.995511+0000","last_undegraded":"2024-02-21T22:53:42.995511+0000","last_fullsized":"2024-02-21T22:53:42.995511+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:52:02.783816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.001033+0000","last_change":"2024-02-21T22:53:42.997365+0000","last_active":"2024-02-21T22:53:43.001033+0000","last_peered":"2024-02-21T22:53:43.001033+0000","last_clean":"2024-02-21T22:53:43.001033+0000","last_became_active":"2024-02-21T22:53:42.997104+0000","last_became_peered":"2024-02-21T22:53:42.997104+0000","last_unstale":"2024-02-21T22:53:43.001033+0000","last_undegraded":"2024-02-21T22:53:43.001033+0000","last_fullsized":"2024-02-21T22:53:43.001033+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:26:25.990337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"32'3","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.011147+0000","last_change":"2024-02-21T22:53:41.994505+0000","last_active":"2024-02-21T22:53:43.011147+0000","last_peered":"2024-02-21T22:53:43.011147+0000","last_clean":"2024-02-21T22:53:43.011147+0000","last_became_active":"2024-02-21T22:53:41.994214+0000","last_became_peered":"2024-02-21T22:53:41.994214+0000","last_unstale":"2024-02-21T22:53:43.011147+0000","last_undegraded":"2024-02-21T22:53:43.011147+0000","last_fullsized":"2024-02-21T22:53:43.011147+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:10:09.126154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.007815+0000","last_change":"2024-02-21T22:53:43.005537+0000","last_active":"2024-02-21T22:53:43.007815+0000","last_peered":"2024-02-21T22:53:43.007815+0000","last_clean":"2024-02-21T22:53:43.007815+0000","last_became_active":"2024-02-21T22:53:43.004978+0000","last_became_peered":"2024-02-21T22:53:43.004978+0000","last_unstale":"2024-02-21T22:53:43.007815+0000","last_undegraded":"2024-02-21T22:53:43.007815+0000","last_fullsized":"2024-02-21T22:53:43.007815+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:13:51.231189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"32'6","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.023535+0000","last_change":"2024-02-21T22:53:41.989878+0000","last_active":"2024-02-21T22:53:43.023535+0000","last_peered":"2024-02-21T22:53:43.023535+0000","last_clean":"2024-02-21T22:53:43.023535+0000","last_became_active":"2024-02-21T22:53:41.989590+0000","last_became_peered":"2024-02-21T22:53:41.989590+0000","last_unstale":"2024-02-21T22:53:43.023535+0000","last_undegraded":"2024-02-21T22:53:43.023535+0000","last_fullsized":"2024-02-21T22:53:43.023535+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:06:02.702272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.014779+0000","last_change":"2024-02-21T22:53:43.008192+0000","last_active":"2024-02-21T22:53:43.014779+0000","last_peered":"2024-02-21T22:53:43.014779+0000","last_clean":"2024-02-21T22:53:43.014779+0000","last_became_active":"2024-02-21T22:53:43.007923+0000","last_became_peered":"2024-02-21T22:53:43.007923+0000","last_unstale":"2024-02-21T22:53:43.014779+0000","last_undegraded":"2024-02-21T22:53:43.014779+0000","last_fullsized":"2024-02-21T22:53:43.014779+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:06:03.706623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"32'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.013904+0000","last_change":"2024-02-21T22:53:41.986805+0000","last_active":"2024-02-21T22:53:43.013904+0000","last_peered":"2024-02-21T22:53:43.013904+0000","last_clean":"2024-02-21T22:53:43.013904+0000","last_became_active":"2024-02-21T22:53:41.985220+0000","last_became_peered":"2024-02-21T22:53:41.985220+0000","last_unstale":"2024-02-21T22:53:43.013904+0000","last_undegraded":"2024-02-21T22:53:43.013904+0000","last_fullsized":"2024-02-21T22:53:43.013904+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:21:25.274383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.008565+0000","last_change":"2024-02-21T22:53:43.003557+0000","last_active":"2024-02-21T22:53:43.008565+0000","last_peered":"2024-02-21T22:53:43.008565+0000","last_clean":"2024-02-21T22:53:43.008565+0000","last_became_active":"2024-02-21T22:53:43.003293+0000","last_became_peered":"2024-02-21T22:53:43.003293+0000","last_unstale":"2024-02-21T22:53:43.008565+0000","last_undegraded":"2024-02-21T22:53:43.008565+0000","last_fullsized":"2024-02-21T22:53:43.008565+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:38:31.580364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:42.996327+0000","last_change":"2024-02-21T22:53:41.987760+0000","last_active":"2024-02-21T22:53:42.996327+0000","last_peered":"2024-02-21T22:53:42.996327+0000","last_clean":"2024-02-21T22:53:42.996327+0000","last_became_active":"2024-02-21T22:53:41.987379+0000","last_became_peered":"2024-02-21T22:53:41.987379+0000","last_unstale":"2024-02-21T22:53:42.996327+0000","last_undegraded":"2024-02-21T22:53:42.996327+0000","last_fullsized":"2024-02-21T22:53:42.996327+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:28:09.845765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.018462+0000","last_change":"2024-02-21T22:53:43.014121+0000","last_active":"2024-02-21T22:53:43.018462+0000","last_peered":"2024-02-21T22:53:43.018462+0000","last_clean":"2024-02-21T22:53:43.018462+0000","last_became_active":"2024-02-21T22:53:43.013636+0000","last_became_peered":"2024-02-21T22:53:43.013636+0000","last_unstale":"2024-02-21T22:53:43.018462+0000","last_undegraded":"2024-02-21T22:53:43.018462+0000","last_fullsized":"2024-02-21T22:53:43.018462+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:13:51.231189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:42.988612+0000","last_change":"2024-02-21T22:53:41.989414+0000","last_active":"2024-02-21T22:53:42.988612+0000","last_peered":"2024-02-21T22:53:42.988612+0000","last_clean":"2024-02-21T22:53:42.988612+0000","last_became_active":"2024-02-21T22:53:41.988958+0000","last_became_peered":"2024-02-21T22:53:41.988958+0000","last_unstale":"2024-02-21T22:53:42.988612+0000","last_undegraded":"2024-02-21T22:53:42.988612+0000","last_fullsized":"2024-02-21T22:53:42.988612+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:09:00.593509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.012052+0000","last_change":"2024-02-21T22:53:43.010267+0000","last_active":"2024-02-21T22:53:43.012052+0000","last_peered":"2024-02-21T22:53:43.012052+0000","last_clean":"2024-02-21T22:53:43.012052+0000","last_became_active":"2024-02-21T22:53:43.010007+0000","last_became_peered":"2024-02-21T22:53:43.010007+0000","last_unstale":"2024-02-21T22:53:43.012052+0000","last_undegraded":"2024-02-21T22:53:43.012052+0000","last_fullsized":"2024-02-21T22:53:43.012052+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:09:01.597859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"32'8","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.017435+0000","last_change":"2024-02-21T22:53:41.990362+0000","last_active":"2024-02-21T22:53:43.017435+0000","last_peered":"2024-02-21T22:53:43.017435+0000","last_clean":"2024-02-21T22:53:43.017435+0000","last_became_active":"2024-02-21T22:53:41.989531+0000","last_became_peered":"2024-02-21T22:53:41.989531+0000","last_unstale":"2024-02-21T22:53:43.017435+0000","last_undegraded":"2024-02-21T22:53:43.017435+0000","last_fullsized":"2024-02-21T22:53:43.017435+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:10:09.126154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.018071+0000","last_change":"2024-02-21T22:53:43.010224+0000","last_active":"2024-02-21T22:53:43.018071+0000","last_peered":"2024-02-21T22:53:43.018071+0000","last_clean":"2024-02-21T22:53:43.018071+0000","last_became_active":"2024-02-21T22:53:43.009914+0000","last_became_peered":"2024-02-21T22:53:43.009914+0000","last_unstale":"2024-02-21T22:53:43.018071+0000","last_undegraded":"2024-02-21T22:53:43.018071+0000","last_fullsized":"2024-02-21T22:53:43.018071+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:27:19.189008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"32'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.017059+0000","last_change":"2024-02-21T22:53:41.988393+0000","last_active":"2024-02-21T22:53:43.017059+0000","last_peered":"2024-02-21T22:53:43.017059+0000","last_clean":"2024-02-21T22:53:43.017059+0000","last_became_active":"2024-02-21T22:53:41.987692+0000","last_became_peered":"2024-02-21T22:53:41.987692+0000","last_unstale":"2024-02-21T22:53:43.017059+0000","last_undegraded":"2024-02-21T22:53:43.017059+0000","last_fullsized":"2024-02-21T22:53:43.017059+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:08:08.137842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.012382+0000","last_change":"2024-02-21T22:53:43.009888+0000","last_active":"2024-02-21T22:53:43.012382+0000","last_peered":"2024-02-21T22:53:43.012382+0000","last_clean":"2024-02-21T22:53:43.012382+0000","last_became_active":"2024-02-21T22:53:43.009536+0000","last_became_peered":"2024-02-21T22:53:43.009536+0000","last_unstale":"2024-02-21T22:53:43.012382+0000","last_undegraded":"2024-02-21T22:53:43.012382+0000","last_fullsized":"2024-02-21T22:53:43.012382+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:38:31.580364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"32'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.014188+0000","last_change":"2024-02-21T22:53:41.986266+0000","last_active":"2024-02-21T22:53:43.014188+0000","last_peered":"2024-02-21T22:53:43.014188+0000","last_clean":"2024-02-21T22:53:43.014188+0000","last_became_active":"2024-02-21T22:53:41.985942+0000","last_became_peered":"2024-02-21T22:53:41.985942+0000","last_unstale":"2024-02-21T22:53:43.014188+0000","last_undegraded":"2024-02-21T22:53:43.014188+0000","last_fullsized":"2024-02-21T22:53:43.014188+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:29:52.528059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.016021+0000","last_change":"2024-02-21T22:53:43.010964+0000","last_active":"2024-02-21T22:53:43.016021+0000","last_peered":"2024-02-21T22:53:43.016021+0000","last_clean":"2024-02-21T22:53:43.016021+0000","last_became_active":"2024-02-21T22:53:43.010739+0000","last_became_peered":"2024-02-21T22:53:43.010739+0000","last_unstale":"2024-02-21T22:53:43.016021+0000","last_undegraded":"2024-02-21T22:53:43.016021+0000","last_fullsized":"2024-02-21T22:53:43.016021+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:15:36.152598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"32'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.015423+0000","last_change":"2024-02-21T22:53:41.987516+0000","last_active":"2024-02-21T22:53:43.015423+0000","last_peered":"2024-02-21T22:53:43.015423+0000","last_clean":"2024-02-21T22:53:43.015423+0000","last_became_active":"2024-02-21T22:53:41.986968+0000","last_became_peered":"2024-02-21T22:53:41.986968+0000","last_unstale":"2024-02-21T22:53:43.015423+0000","last_undegraded":"2024-02-21T22:53:43.015423+0000","last_fullsized":"2024-02-21T22:53:43.015423+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:08:36.876969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.008417+0000","last_change":"2024-02-21T22:53:43.001927+0000","last_active":"2024-02-21T22:53:43.008417+0000","last_peered":"2024-02-21T22:53:43.008417+0000","last_clean":"2024-02-21T22:53:43.008417+0000","last_became_active":"2024-02-21T22:53:43.001668+0000","last_became_peered":"2024-02-21T22:53:43.001668+0000","last_unstale":"2024-02-21T22:53:43.008417+0000","last_undegraded":"2024-02-21T22:53:43.008417+0000","last_fullsized":"2024-02-21T22:53:43.008417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T02:15:11.900251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:42.998914+0000","last_change":"2024-02-21T22:53:41.990148+0000","last_active":"2024-02-21T22:53:42.998914+0000","last_peered":"2024-02-21T22:53:42.998914+0000","last_clean":"2024-02-21T22:53:42.998914+0000","last_became_active":"2024-02-21T22:53:41.989146+0000","last_became_peered":"2024-02-21T22:53:41.989146+0000","last_unstale":"2024-02-21T22:53:42.998914+0000","last_undegraded":"2024-02-21T22:53:42.998914+0000","last_fullsized":"2024-02-21T22:53:42.998914+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:13:43.209250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.015103+0000","last_change":"2024-02-21T22:53:43.011129+0000","last_active":"2024-02-21T22:53:43.015103+0000","last_peered":"2024-02-21T22:53:43.015103+0000","last_clean":"2024-02-21T22:53:43.015103+0000","last_became_active":"2024-02-21T22:53:43.010865+0000","last_became_peered":"2024-02-21T22:53:43.010865+0000","last_unstale":"2024-02-21T22:53:43.015103+0000","last_undegraded":"2024-02-21T22:53:43.015103+0000","last_fullsized":"2024-02-21T22:53:43.015103+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:13:44.213600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"32'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.015780+0000","last_change":"2024-02-21T22:53:41.984829+0000","last_active":"2024-02-21T22:53:43.015780+0000","last_peered":"2024-02-21T22:53:43.015780+0000","last_clean":"2024-02-21T22:53:43.015780+0000","last_became_active":"2024-02-21T22:53:41.984573+0000","last_became_peered":"2024-02-21T22:53:41.984573+0000","last_unstale":"2024-02-21T22:53:43.015780+0000","last_undegraded":"2024-02-21T22:53:43.015780+0000","last_fullsized":"2024-02-21T22:53:43.015780+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:44:42.045212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.008366+0000","last_change":"2024-02-21T22:53:43.001820+0000","last_active":"2024-02-21T22:53:43.008366+0000","last_peered":"2024-02-21T22:53:43.008366+0000","last_clean":"2024-02-21T22:53:43.008366+0000","last_became_active":"2024-02-21T22:53:43.001513+0000","last_became_peered":"2024-02-21T22:53:43.001513+0000","last_unstale":"2024-02-21T22:53:43.008366+0000","last_undegraded":"2024-02-21T22:53:43.008366+0000","last_fullsized":"2024-02-21T22:53:43.008366+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:31:29.016944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:42.993046+0000","last_change":"2024-02-21T22:53:41.991544+0000","last_active":"2024-02-21T22:53:42.993046+0000","last_peered":"2024-02-21T22:53:42.993046+0000","last_clean":"2024-02-21T22:53:42.993046+0000","last_became_active":"2024-02-21T22:53:41.991247+0000","last_became_peered":"2024-02-21T22:53:41.991247+0000","last_unstale":"2024-02-21T22:53:42.993046+0000","last_undegraded":"2024-02-21T22:53:42.993046+0000","last_fullsized":"2024-02-21T22:53:42.993046+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:44:42.045212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.001123+0000","last_change":"2024-02-21T22:53:43.000454+0000","last_active":"2024-02-21T22:53:43.001123+0000","last_peered":"2024-02-21T22:53:43.001123+0000","last_clean":"2024-02-21T22:53:43.001123+0000","last_became_active":"2024-02-21T22:53:43.000172+0000","last_became_peered":"2024-02-21T22:53:43.000172+0000","last_unstale":"2024-02-21T22:53:43.001123+0000","last_undegraded":"2024-02-21T22:53:43.001123+0000","last_fullsized":"2024-02-21T22:53:43.001123+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:57:06.973476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.003774+0000","last_change":"2024-02-21T22:53:41.988349+0000","last_active":"2024-02-21T22:53:43.003774+0000","last_peered":"2024-02-21T22:53:43.003774+0000","last_clean":"2024-02-21T22:53:43.003774+0000","last_became_active":"2024-02-21T22:53:41.987202+0000","last_became_peered":"2024-02-21T22:53:41.987202+0000","last_unstale":"2024-02-21T22:53:43.003774+0000","last_undegraded":"2024-02-21T22:53:43.003774+0000","last_fullsized":"2024-02-21T22:53:43.003774+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:38:22.676905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.011892+0000","last_change":"2024-02-21T22:53:43.008590+0000","last_active":"2024-02-21T22:53:43.011892+0000","last_peered":"2024-02-21T22:53:43.011892+0000","last_clean":"2024-02-21T22:53:43.011892+0000","last_became_active":"2024-02-21T22:53:43.007502+0000","last_became_peered":"2024-02-21T22:53:43.007502+0000","last_unstale":"2024-02-21T22:53:43.011892+0000","last_undegraded":"2024-02-21T22:53:43.011892+0000","last_fullsized":"2024-02-21T22:53:43.011892+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:10:10.130504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:42.990744+0000","last_change":"2024-02-21T22:53:41.993199+0000","last_active":"2024-02-21T22:53:42.990744+0000","last_peered":"2024-02-21T22:53:42.990744+0000","last_clean":"2024-02-21T22:53:42.990744+0000","last_became_active":"2024-02-21T22:53:41.992944+0000","last_became_peered":"2024-02-21T22:53:41.992944+0000","last_unstale":"2024-02-21T22:53:42.990744+0000","last_undegraded":"2024-02-21T22:53:42.990744+0000","last_fullsized":"2024-02-21T22:53:42.990744+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:09:00.593509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.014278+0000","last_change":"2024-02-21T22:53:43.007504+0000","last_active":"2024-02-21T22:53:43.014278+0000","last_peered":"2024-02-21T22:53:43.014278+0000","last_clean":"2024-02-21T22:53:43.014278+0000","last_became_active":"2024-02-21T22:53:43.007283+0000","last_became_peered":"2024-02-21T22:53:43.007283+0000","last_unstale":"2024-02-21T22:53:43.014278+0000","last_undegraded":"2024-02-21T22:53:43.014278+0000","last_fullsized":"2024-02-21T22:53:43.014278+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:28:51.959069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"32'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.015166+0000","last_change":"2024-02-21T22:53:41.994504+0000","last_active":"2024-02-21T22:53:43.015166+0000","last_peered":"2024-02-21T22:53:43.015166+0000","last_clean":"2024-02-21T22:53:43.015166+0000","last_became_active":"2024-02-21T22:53:41.994229+0000","last_became_peered":"2024-02-21T22:53:41.994229+0000","last_unstale":"2024-02-21T22:53:43.015166+0000","last_undegraded":"2024-02-21T22:53:43.015166+0000","last_fullsized":"2024-02-21T22:53:43.015166+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:09:00.593509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.010881+0000","last_change":"2024-02-21T22:53:43.006538+0000","last_active":"2024-02-21T22:53:43.010881+0000","last_peered":"2024-02-21T22:53:43.010881+0000","last_clean":"2024-02-21T22:53:43.010881+0000","last_became_active":"2024-02-21T22:53:43.006058+0000","last_became_peered":"2024-02-21T22:53:43.006058+0000","last_unstale":"2024-02-21T22:53:43.010881+0000","last_undegraded":"2024-02-21T22:53:43.010881+0000","last_fullsized":"2024-02-21T22:53:43.010881+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:02:41.596861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:42.995329+0000","last_change":"2024-02-21T22:53:41.985703+0000","last_active":"2024-02-21T22:53:42.995329+0000","last_peered":"2024-02-21T22:53:42.995329+0000","last_clean":"2024-02-21T22:53:42.995329+0000","last_became_active":"2024-02-21T22:53:41.985263+0000","last_became_peered":"2024-02-21T22:53:41.985263+0000","last_unstale":"2024-02-21T22:53:42.995329+0000","last_undegraded":"2024-02-21T22:53:42.995329+0000","last_fullsized":"2024-02-21T22:53:42.995329+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:28:09.845765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.009186+0000","last_change":"2024-02-21T22:53:43.005317+0000","last_active":"2024-02-21T22:53:43.009186+0000","last_peered":"2024-02-21T22:53:43.009186+0000","last_clean":"2024-02-21T22:53:43.009186+0000","last_became_active":"2024-02-21T22:53:43.005033+0000","last_became_peered":"2024-02-21T22:53:43.005033+0000","last_unstale":"2024-02-21T22:53:43.009186+0000","last_undegraded":"2024-02-21T22:53:43.009186+0000","last_fullsized":"2024-02-21T22:53:43.009186+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:54:01.357343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:42.996513+0000","last_change":"2024-02-21T22:53:41.986296+0000","last_active":"2024-02-21T22:53:42.996513+0000","last_peered":"2024-02-21T22:53:42.996513+0000","last_clean":"2024-02-21T22:53:42.996513+0000","last_became_active":"2024-02-21T22:53:41.985909+0000","last_became_peered":"2024-02-21T22:53:41.985909+0000","last_unstale":"2024-02-21T22:53:42.996513+0000","last_undegraded":"2024-02-21T22:53:42.996513+0000","last_fullsized":"2024-02-21T22:53:42.996513+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:34:59.792432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.005879+0000","last_change":"2024-02-21T22:53:43.000226+0000","last_active":"2024-02-21T22:53:43.005879+0000","last_peered":"2024-02-21T22:53:43.005879+0000","last_clean":"2024-02-21T22:53:43.005879+0000","last_became_active":"2024-02-21T22:53:42.999987+0000","last_became_peered":"2024-02-21T22:53:42.999987+0000","last_unstale":"2024-02-21T22:53:43.005879+0000","last_undegraded":"2024-02-21T22:53:43.005879+0000","last_fullsized":"2024-02-21T22:53:43.005879+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:35:00.796782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:42.994590+0000","last_change":"2024-02-21T22:53:41.991285+0000","last_active":"2024-02-21T22:53:42.994590+0000","last_peered":"2024-02-21T22:53:42.994590+0000","last_clean":"2024-02-21T22:53:42.994590+0000","last_became_active":"2024-02-21T22:53:41.990977+0000","last_became_peered":"2024-02-21T22:53:41.990977+0000","last_unstale":"2024-02-21T22:53:42.994590+0000","last_undegraded":"2024-02-21T22:53:42.994590+0000","last_fullsized":"2024-02-21T22:53:42.994590+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:27:18.184658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.003445+0000","last_change":"2024-02-21T22:53:42.999736+0000","last_active":"2024-02-21T22:53:43.003445+0000","last_peered":"2024-02-21T22:53:43.003445+0000","last_clean":"2024-02-21T22:53:43.003445+0000","last_became_active":"2024-02-21T22:53:42.999472+0000","last_became_peered":"2024-02-21T22:53:42.999472+0000","last_unstale":"2024-02-21T22:53:43.003445+0000","last_undegraded":"2024-02-21T22:53:43.003445+0000","last_fullsized":"2024-02-21T22:53:43.003445+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:08:09.142193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:42.996479+0000","last_change":"2024-02-21T22:53:41.991062+0000","last_active":"2024-02-21T22:53:42.996479+0000","last_peered":"2024-02-21T22:53:42.996479+0000","last_clean":"2024-02-21T22:53:42.996479+0000","last_became_active":"2024-02-21T22:53:41.990791+0000","last_became_peered":"2024-02-21T22:53:41.990791+0000","last_unstale":"2024-02-21T22:53:42.996479+0000","last_undegraded":"2024-02-21T22:53:42.996479+0000","last_fullsized":"2024-02-21T22:53:42.996479+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:52:02.783816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.004801+0000","last_change":"2024-02-21T22:53:42.999431+0000","last_active":"2024-02-21T22:53:43.004801+0000","last_peered":"2024-02-21T22:53:43.004801+0000","last_clean":"2024-02-21T22:53:43.004801+0000","last_became_active":"2024-02-21T22:53:42.999170+0000","last_became_peered":"2024-02-21T22:53:42.999170+0000","last_unstale":"2024-02-21T22:53:43.004801+0000","last_undegraded":"2024-02-21T22:53:43.004801+0000","last_fullsized":"2024-02-21T22:53:43.004801+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:13:51.231189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.003903+0000","last_change":"2024-02-21T22:53:41.995139+0000","last_active":"2024-02-21T22:53:43.003903+0000","last_peered":"2024-02-21T22:53:43.003903+0000","last_clean":"2024-02-21T22:53:43.003903+0000","last_became_active":"2024-02-21T22:53:41.994560+0000","last_became_peered":"2024-02-21T22:53:41.994560+0000","last_unstale":"2024-02-21T22:53:43.003903+0000","last_undegraded":"2024-02-21T22:53:43.003903+0000","last_fullsized":"2024-02-21T22:53:43.003903+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:44:42.045212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.018796+0000","last_change":"2024-02-21T22:53:43.015964+0000","last_active":"2024-02-21T22:53:43.018796+0000","last_peered":"2024-02-21T22:53:43.018796+0000","last_clean":"2024-02-21T22:53:43.018796+0000","last_became_active":"2024-02-21T22:53:43.015685+0000","last_became_peered":"2024-02-21T22:53:43.015685+0000","last_unstale":"2024-02-21T22:53:43.018796+0000","last_undegraded":"2024-02-21T22:53:43.018796+0000","last_fullsized":"2024-02-21T22:53:43.018796+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:08:09.142193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:42.988436+0000","last_change":"2024-02-21T22:53:41.988521+0000","last_active":"2024-02-21T22:53:42.988436+0000","last_peered":"2024-02-21T22:53:42.988436+0000","last_clean":"2024-02-21T22:53:42.988436+0000","last_became_active":"2024-02-21T22:53:41.987907+0000","last_became_peered":"2024-02-21T22:53:41.987907+0000","last_unstale":"2024-02-21T22:53:42.988436+0000","last_undegraded":"2024-02-21T22:53:42.988436+0000","last_fullsized":"2024-02-21T22:53:42.988436+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:52:02.783816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.006220+0000","last_change":"2024-02-21T22:53:43.001964+0000","last_active":"2024-02-21T22:53:43.006220+0000","last_peered":"2024-02-21T22:53:43.006220+0000","last_clean":"2024-02-21T22:53:43.006220+0000","last_became_active":"2024-02-21T22:53:43.001671+0000","last_became_peered":"2024-02-21T22:53:43.001671+0000","last_unstale":"2024-02-21T22:53:43.006220+0000","last_undegraded":"2024-02-21T22:53:43.006220+0000","last_fullsized":"2024-02-21T22:53:43.006220+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:52:03.788166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:42.991966+0000","last_change":"2024-02-21T22:53:41.991783+0000","last_active":"2024-02-21T22:53:42.991966+0000","last_peered":"2024-02-21T22:53:42.991966+0000","last_clean":"2024-02-21T22:53:42.991966+0000","last_became_active":"2024-02-21T22:53:41.991530+0000","last_became_peered":"2024-02-21T22:53:41.991530+0000","last_unstale":"2024-02-21T22:53:42.991966+0000","last_undegraded":"2024-02-21T22:53:42.991966+0000","last_fullsized":"2024-02-21T22:53:42.991966+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:38:22.676905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":192,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-21T22:53:42.998433+0000","last_change":"2024-02-21T22:52:40.336187+0000","last_active":"2024-02-21T22:53:42.998433+0000","last_peered":"2024-02-21T22:53:42.998433+0000","last_clean":"2024-02-21T22:53:42.998433+0000","last_became_active":"2024-02-21T22:52:40.335061+0000","last_became_peered":"2024-02-21T22:52:40.335061+0000","last_unstale":"2024-02-21T22:53:42.998433+0000","last_undegraded":"2024-02-21T22:53:42.998433+0000","last_fullsized":"2024-02-21T22:53:42.998433+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:38.328863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:38.328863+0000","last_clean_scrub_stamp":"2024-02-21T22:52:38.328863+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:33:53.012414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574864,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27940,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343900,"statfs":{"total":96636764160,"available":96608153600,"internally_reserved":0,"allocated":942080,"data_stored":723909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574865,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":348160,"data_stored":133541,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574866,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":348160,"data_stored":133541,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574865,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":348160,"data_stored":133541,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574865,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":376832,"data_stored":141950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":348160,"data_stored":133541,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574866,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":348160,"data_stored":133541,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574864,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27940,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343900,"statfs":{"total":96636764160,"available":96608153600,"internally_reserved":0,"allocated":942080,"data_stored":723909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-21T22:53:46.304 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-02-21T22:53:46.304 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-02-21T22:53:46.447 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.457+0000 7f36d48de640 1 Processor -- start 2024-02-21T22:53:46.448 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.457+0000 7f36d48de640 1 -- start start 2024-02-21T22:53:46.449 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.458+0000 7f36d48de640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f36d00d1580 0x7f36d006ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:46.449 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.458+0000 7f36d48de640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f36d006b380 0x7f36d0160140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:46.449 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.458+0000 7f36d48de640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36d00d19c0 con 0x7f36d015c1b0 2024-02-21T22:53:46.449 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.458+0000 7f36d48de640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36d006b7f0 con 0x7f36d00d1580 2024-02-21T22:53:46.449 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.458+0000 7f36d48de640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36d015fcb0 con 0x7f36d006b380 2024-02-21T22:53:46.449 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.458+0000 7f36cdd9b640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f36d00d1580 0x7f36d006ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:46.449 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.458+0000 7f36ce59c640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f36d015c1b0 0x7f36d0071870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:47306/0 (socket says 172.21.15.116:47306) 2024-02-21T22:53:46.449 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.458+0000 7f36ce59c640 1 -- 172.21.15.116:0/2909679738 learned_addr learned my addr 172.21.15.116:0/2909679738 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-02-21T22:53:46.449 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.458+0000 7f36ced9d640 1 --2- 172.21.15.116:0/2909679738 >> v2:172.21.15.142:3300/0 conn(0x7f36d006b380 0x7f36d0160140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:46.450 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.458+0000 7f36cdd9b640 1 -- 172.21.15.116:0/2909679738 >> v2:172.21.15.142:3300/0 conn(0x7f36d006b380 msgr2=0x7f36d0160140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:53:46.450 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.458+0000 7f36cdd9b640 1 --2- 172.21.15.116:0/2909679738 >> v2:172.21.15.142:3300/0 conn(0x7f36d006b380 0x7f36d0160140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:46.450 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.458+0000 7f36cdd9b640 1 -- 172.21.15.116:0/2909679738 >> v1:172.21.15.116:6789/0 conn(0x7f36d015c1b0 legacy=0x7f36d0071870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:46.450 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.459+0000 7f36cdd9b640 1 -- 172.21.15.116:0/2909679738 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36d015c590 con 0x7f36d00d1580 2024-02-21T22:53:46.451 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.459+0000 7f36cdd9b640 1 --2- 172.21.15.116:0/2909679738 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f36d00d1580 0x7f36d006ae40 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f36d006d100 tx=0x7f36c402b710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efc9fe91adac560 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:46.451 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.459+0000 7f36cd59a640 1 -- 172.21.15.116:0/2909679738 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36c4037070 con 0x7f36d00d1580 2024-02-21T22:53:46.451 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.459+0000 7f36cd59a640 1 -- 172.21.15.116:0/2909679738 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36c4030710 con 0x7f36d00d1580 2024-02-21T22:53:46.451 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.459+0000 7f36cd59a640 1 -- 172.21.15.116:0/2909679738 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36c4030ae0 con 0x7f36d00d1580 2024-02-21T22:53:46.451 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.460+0000 7f36d48de640 1 -- 172.21.15.116:0/2909679738 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f36d00d1580 msgr2=0x7f36d006ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:46.451 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.460+0000 7f36d48de640 1 --2- 172.21.15.116:0/2909679738 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f36d00d1580 0x7f36d006ae40 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f36d006d100 tx=0x7f36c402b710 comp rx=0 tx=0).stop 2024-02-21T22:53:46.451 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.460+0000 7f36d48de640 1 -- 172.21.15.116:0/2909679738 shutdown_connections 2024-02-21T22:53:46.452 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.460+0000 7f36d48de640 1 --2- 172.21.15.116:0/2909679738 >> v2:172.21.15.142:3300/0 conn(0x7f36d006b380 0x7f36d0160140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:46.452 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.460+0000 7f36d48de640 1 --2- 172.21.15.116:0/2909679738 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f36d00d1580 0x7f36d006ae40 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:46.452 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.460+0000 7f36d48de640 1 -- 172.21.15.116:0/2909679738 >> 172.21.15.116:0/2909679738 conn(0x7f36d00d0a60 msgr2=0x7f36d00d0e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:46.452 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.460+0000 7f36d48de640 1 -- 172.21.15.116:0/2909679738 shutdown_connections 2024-02-21T22:53:46.452 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.460+0000 7f36d48de640 1 -- 172.21.15.116:0/2909679738 wait complete. 2024-02-21T22:53:46.455 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.461+0000 7f36d48de640 1 Processor -- start 2024-02-21T22:53:46.455 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.461+0000 7f36d48de640 1 -- start start 2024-02-21T22:53:46.455 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.462+0000 7f36d48de640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f36d006b380 0x7f36d00c9150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:46.455 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.462+0000 7f36d48de640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f36d00d1580 0x7f36d00b4660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:46.455 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.462+0000 7f36d48de640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f36d015c1b0 0x7f36d00b4ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:46.455 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.462+0000 7f36d48de640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36d00cd160 con 0x7f36d006b380 2024-02-21T22:53:46.455 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.462+0000 7f36d48de640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36d00cce80 con 0x7f36d015c1b0 2024-02-21T22:53:46.456 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.462+0000 7f36d48de640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36d00ccb30 con 0x7f36d00d1580 2024-02-21T22:53:46.456 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.462+0000 7f36ce59c640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f36d006b380 0x7f36d00c9150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:46.456 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.462+0000 7f36ce59c640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f36d006b380 0x7f36d00c9150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:39944/0 (socket says 172.21.15.116:39944) 2024-02-21T22:53:46.456 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.462+0000 7f36ce59c640 1 -- 172.21.15.116:0/1393789694 learned_addr learned my addr 172.21.15.116:0/1393789694 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:46.456 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.462+0000 7f36cdd9b640 1 --2- 172.21.15.116:0/1393789694 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f36d00d1580 0x7f36d00b4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:46.456 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.462+0000 7f36ced9d640 1 --2- 172.21.15.116:0/1393789694 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f36d015c1b0 0x7f36d00b4ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:46.456 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.462+0000 7f36ce59c640 1 -- 172.21.15.116:0/1393789694 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f36d00d1580 msgr2=0x7f36d00b4660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:46.456 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.462+0000 7f36ce59c640 1 --2- 172.21.15.116:0/1393789694 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f36d00d1580 0x7f36d00b4660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:46.456 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.462+0000 7f36ce59c640 1 -- 172.21.15.116:0/1393789694 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f36d015c1b0 msgr2=0x7f36d00b4ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:46.456 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.462+0000 7f36ce59c640 1 --2- 172.21.15.116:0/1393789694 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f36d015c1b0 0x7f36d00b4ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:46.456 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.462+0000 7f36ce59c640 1 -- 172.21.15.116:0/1393789694 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36d00b5220 con 0x7f36d006b380 2024-02-21T22:53:46.456 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.462+0000 7f36ced9d640 1 --2- 172.21.15.116:0/1393789694 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f36d015c1b0 0x7f36d00b4ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T22:53:46.456 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.462+0000 7f36cdd9b640 1 --2- 172.21.15.116:0/1393789694 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f36d00d1580 0x7f36d00b4660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T22:53:46.456 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.463+0000 7f36ce59c640 1 --2- 172.21.15.116:0/1393789694 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f36d006b380 0x7f36d00c9150 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f36c000c780 tx=0x7f36c000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:46.457 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.463+0000 7f36beffd640 1 -- 172.21.15.116:0/1393789694 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36c0018070 con 0x7f36d006b380 2024-02-21T22:53:46.457 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.463+0000 7f36beffd640 1 -- 172.21.15.116:0/1393789694 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36c00072d0 con 0x7f36d006b380 2024-02-21T22:53:46.457 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.463+0000 7f36beffd640 1 -- 172.21.15.116:0/1393789694 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36c00047e0 con 0x7f36d006b380 2024-02-21T22:53:46.457 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.463+0000 7f36d48de640 1 -- 172.21.15.116:0/1393789694 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36d00b5500 con 0x7f36d006b380 2024-02-21T22:53:46.457 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.463+0000 7f36d48de640 1 -- 172.21.15.116:0/1393789694 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36d00b6600 con 0x7f36d006b380 2024-02-21T22:53:46.457 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.464+0000 7f36d48de640 1 -- 172.21.15.116:0/1393789694 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36d00b5a20 con 0x7f36d006b380 2024-02-21T22:53:46.457 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.464+0000 7f36beffd640 1 -- 172.21.15.116:0/1393789694 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f36c001b070 con 0x7f36d006b380 2024-02-21T22:53:46.457 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.465+0000 7f36beffd640 1 --2- 172.21.15.116:0/1393789694 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f36b006b4d0 0x7f36b006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:46.457 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.465+0000 7f36beffd640 1 -- 172.21.15.116:0/1393789694 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f36c0089670 con 0x7f36d006b380 2024-02-21T22:53:46.457 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.465+0000 7f36cdd9b640 1 --2- 172.21.15.116:0/1393789694 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f36b006b4d0 0x7f36b006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:46.458 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.465+0000 7f36cdd9b640 1 --2- 172.21.15.116:0/1393789694 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f36b006b4d0 0x7f36b006d990 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f36c4034000 tx=0x7f36c4008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:46.459 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.469+0000 7f36beffd640 1 -- 172.21.15.116:0/1393789694 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f36d00b5a20 con 0x7f36d006b380 2024-02-21T22:53:46.696 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.706+0000 7f36d48de640 1 -- 172.21.15.116:0/1393789694 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f36d00752f0 con 0x7f36d006b380 2024-02-21T22:53:46.698 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.708+0000 7f36beffd640 1 -- 172.21.15.116:0/1393789694 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) v1 ==== 190+0+147 (secure 0 0 0) 0x7f36c00585b0 con 0x7f36d006b380 2024-02-21T22:53:46.698 INFO:teuthology.orchestra.run.smithi116.stdout:[client.0] 2024-02-21T22:53:46.698 INFO:teuthology.orchestra.run.smithi116.stdout: key = AQCDftZlkppVJBAAGajc7P7grvYaJipfLBk5yw== 2024-02-21T22:53:46.698 INFO:teuthology.orchestra.run.smithi116.stdout: caps mds = "allow" 2024-02-21T22:53:46.699 INFO:teuthology.orchestra.run.smithi116.stdout: caps mon = "allow r" 2024-02-21T22:53:46.699 INFO:teuthology.orchestra.run.smithi116.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-02-21T22:53:46.699 INFO:teuthology.orchestra.run.smithi116.stderr:updated caps for client.0 2024-02-21T22:53:46.700 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.710+0000 7f36d48de640 1 -- 172.21.15.116:0/1393789694 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f36b006b4d0 msgr2=0x7f36b006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:46.700 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.710+0000 7f36d48de640 1 --2- 172.21.15.116:0/1393789694 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f36b006b4d0 0x7f36b006d990 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f36c4034000 tx=0x7f36c4008030 comp rx=0 tx=0).stop 2024-02-21T22:53:46.701 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.710+0000 7f36d48de640 1 -- 172.21.15.116:0/1393789694 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f36d006b380 msgr2=0x7f36d00c9150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:46.701 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.710+0000 7f36d48de640 1 --2- 172.21.15.116:0/1393789694 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f36d006b380 0x7f36d00c9150 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f36c000c780 tx=0x7f36c000cc40 comp rx=0 tx=0).stop 2024-02-21T22:53:46.701 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.710+0000 7f36d48de640 1 -- 172.21.15.116:0/1393789694 shutdown_connections 2024-02-21T22:53:46.701 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.710+0000 7f36d48de640 1 --2- 172.21.15.116:0/1393789694 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f36d015c1b0 0x7f36d00b4ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:46.701 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.710+0000 7f36d48de640 1 --2- 172.21.15.116:0/1393789694 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f36b006b4d0 0x7f36b006d990 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:46.701 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.710+0000 7f36d48de640 1 --2- 172.21.15.116:0/1393789694 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f36d00d1580 0x7f36d00b4660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:46.701 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.710+0000 7f36d48de640 1 --2- 172.21.15.116:0/1393789694 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f36d006b380 0x7f36d00c9150 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:46.701 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.710+0000 7f36d48de640 1 -- 172.21.15.116:0/1393789694 >> 172.21.15.116:0/1393789694 conn(0x7f36d00d0a60 msgr2=0x7f36d00b11c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:46.701 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.710+0000 7f36d48de640 1 -- 172.21.15.116:0/1393789694 shutdown_connections 2024-02-21T22:53:46.701 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.710+0000 7f36d48de640 1 -- 172.21.15.116:0/1393789694 wait complete. 2024-02-21T22:53:46.713 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-21T22:53:46.812 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.822+0000 7f42df3aa640 1 Processor -- start 2024-02-21T22:53:46.812 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.822+0000 7f42df3aa640 1 -- start start 2024-02-21T22:53:46.814 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.823+0000 7f42df3aa640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f42d80acd30 0x7f42d80ad1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:46.814 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.823+0000 7f42df3aa640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42d80b3690 con 0x7f42d815a680 2024-02-21T22:53:46.814 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.823+0000 7f42df3aa640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42d80b3930 con 0x7f42d8071580 2024-02-21T22:53:46.814 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.823+0000 7f42df3aa640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42d80b3c10 con 0x7f42d80acd30 2024-02-21T22:53:46.814 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.823+0000 7f42dd146640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f42d815a680 0x7f42d806e200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:47322/0 (socket says 172.21.15.116:47322) 2024-02-21T22:53:46.814 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.823+0000 7f42dd146640 1 -- 172.21.15.116:0/3023424173 learned_addr learned my addr 172.21.15.116:0/3023424173 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-02-21T22:53:46.814 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.823+0000 7f42dd947640 1 --2- 172.21.15.116:0/3023424173 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f42d80acd30 0x7f42d80ad1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:46.814 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.823+0000 7f42cffff640 1 -- 172.21.15.116:0/3023424173 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2286016184 0 0) 0x7f42d80b3690 con 0x7f42d815a680 2024-02-21T22:53:46.814 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.823+0000 7f42cffff640 1 -- 172.21.15.116:0/3023424173 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f42c4003440 con 0x7f42d815a680 2024-02-21T22:53:46.815 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.823+0000 7f42cffff640 1 -- 172.21.15.116:0/3023424173 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1035520131 0 0) 0x7f42d80b3930 con 0x7f42d8071580 2024-02-21T22:53:46.815 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.823+0000 7f42cffff640 1 -- 172.21.15.116:0/3023424173 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f42d80b3690 con 0x7f42d8071580 2024-02-21T22:53:46.815 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.823+0000 7f42dd947640 1 -- 172.21.15.116:0/3023424173 >> v1:172.21.15.142:6789/0 conn(0x7f42d8071580 legacy=0x7f42d80b46f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:46.815 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.823+0000 7f42dd947640 1 -- 172.21.15.116:0/3023424173 >> v1:172.21.15.116:6789/0 conn(0x7f42d815a680 legacy=0x7f42d806e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:46.815 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.823+0000 7f42dd947640 1 -- 172.21.15.116:0/3023424173 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42d80b3ef0 con 0x7f42d80acd30 2024-02-21T22:53:46.819 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.824+0000 7f42dd947640 1 --2- 172.21.15.116:0/3023424173 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f42d80acd30 0x7f42d80ad1e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f42d4009dc0 tx=0x7f42d402bf20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eedec41a0ac1c4ac server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:46.819 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.824+0000 7f42cffff640 1 -- 172.21.15.116:0/3023424173 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42d4039070 con 0x7f42d80acd30 2024-02-21T22:53:46.819 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.824+0000 7f42cffff640 1 -- 172.21.15.116:0/3023424173 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42d402ccd0 con 0x7f42d80acd30 2024-02-21T22:53:46.819 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.824+0000 7f42cffff640 1 -- 172.21.15.116:0/3023424173 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42d4034660 con 0x7f42d80acd30 2024-02-21T22:53:46.819 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.825+0000 7f42df3aa640 1 -- 172.21.15.116:0/3023424173 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f42d80acd30 msgr2=0x7f42d80ad1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:46.819 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.825+0000 7f42df3aa640 1 --2- 172.21.15.116:0/3023424173 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f42d80acd30 0x7f42d80ad1e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f42d4009dc0 tx=0x7f42d402bf20 comp rx=0 tx=0).stop 2024-02-21T22:53:46.819 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.825+0000 7f42df3aa640 1 -- 172.21.15.116:0/3023424173 shutdown_connections 2024-02-21T22:53:46.819 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.825+0000 7f42df3aa640 1 --2- 172.21.15.116:0/3023424173 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f42d80acd30 0x7f42d80ad1e0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:46.820 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.825+0000 7f42df3aa640 1 -- 172.21.15.116:0/3023424173 >> 172.21.15.116:0/3023424173 conn(0x7f42d80b18e0 msgr2=0x7f42d80b1cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:46.820 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.825+0000 7f42df3aa640 1 -- 172.21.15.116:0/3023424173 shutdown_connections 2024-02-21T22:53:46.820 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.825+0000 7f42df3aa640 1 -- 172.21.15.116:0/3023424173 wait complete. 2024-02-21T22:53:46.820 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.826+0000 7f42df3aa640 1 Processor -- start 2024-02-21T22:53:46.820 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.826+0000 7f42df3aa640 1 -- start start 2024-02-21T22:53:46.820 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.826+0000 7f42df3aa640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f42d8071580 0x7f42d81f4730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:46.820 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.826+0000 7f42df3aa640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f42d80acd30 0x7f42d8159040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:46.820 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.826+0000 7f42df3aa640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f42d809cc50 0x7f42d809d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:46.820 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.827+0000 7f42df3aa640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42d806c8f0 con 0x7f42d809cc50 2024-02-21T22:53:46.820 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.827+0000 7f42df3aa640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42d80b4e00 con 0x7f42d8071580 2024-02-21T22:53:46.820 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.827+0000 7f42df3aa640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42d806ca70 con 0x7f42d80acd30 2024-02-21T22:53:46.820 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.827+0000 7f42dd947640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f42d809cc50 0x7f42d809d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:46.820 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.827+0000 7f42dd947640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f42d809cc50 0x7f42d809d100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:39954/0 (socket says 172.21.15.116:39954) 2024-02-21T22:53:46.820 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.827+0000 7f42dd947640 1 -- 172.21.15.116:0/81254444 learned_addr learned my addr 172.21.15.116:0/81254444 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:46.820 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.827+0000 7f42dd146640 1 --2- 172.21.15.116:0/81254444 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f42d8071580 0x7f42d81f4730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:46.821 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.827+0000 7f42dc945640 1 --2- 172.21.15.116:0/81254444 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f42d80acd30 0x7f42d8159040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:46.821 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.827+0000 7f42dd947640 1 -- 172.21.15.116:0/81254444 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f42d80acd30 msgr2=0x7f42d8159040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:46.821 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.827+0000 7f42dd947640 1 --2- 172.21.15.116:0/81254444 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f42d80acd30 0x7f42d8159040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:46.821 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.827+0000 7f42dd947640 1 -- 172.21.15.116:0/81254444 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f42d8071580 msgr2=0x7f42d81f4730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:46.821 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.827+0000 7f42dd947640 1 --2- 172.21.15.116:0/81254444 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f42d8071580 0x7f42d81f4730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:46.821 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.827+0000 7f42dd947640 1 -- 172.21.15.116:0/81254444 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42d81537a0 con 0x7f42d809cc50 2024-02-21T22:53:46.821 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.827+0000 7f42dd947640 1 --2- 172.21.15.116:0/81254444 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f42d809cc50 0x7f42d809d100 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f42d402c530 tx=0x7f42d4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:46.821 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.827+0000 7f42cdffb640 1 -- 172.21.15.116:0/81254444 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42d4039050 con 0x7f42d809cc50 2024-02-21T22:53:46.821 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.827+0000 7f42cdffb640 1 -- 172.21.15.116:0/81254444 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42d4045070 con 0x7f42d809cc50 2024-02-21T22:53:46.821 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.827+0000 7f42df3aa640 1 -- 172.21.15.116:0/81254444 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42d8153a80 con 0x7f42d809cc50 2024-02-21T22:53:46.821 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.827+0000 7f42cdffb640 1 -- 172.21.15.116:0/81254444 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42d403e850 con 0x7f42d809cc50 2024-02-21T22:53:46.821 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.827+0000 7f42df3aa640 1 -- 172.21.15.116:0/81254444 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42d8154040 con 0x7f42d809cc50 2024-02-21T22:53:46.821 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.828+0000 7f42df3aa640 1 -- 172.21.15.116:0/81254444 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42d80752f0 con 0x7f42d809cc50 2024-02-21T22:53:46.822 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.829+0000 7f42cdffb640 1 -- 172.21.15.116:0/81254444 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f42d403e9f0 con 0x7f42d809cc50 2024-02-21T22:53:46.822 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.829+0000 7f42cdffb640 1 --2- 172.21.15.116:0/81254444 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f42bc06b4d0 0x7f42bc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:46.822 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.829+0000 7f42cdffb640 1 -- 172.21.15.116:0/81254444 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f42d40acdc0 con 0x7f42d809cc50 2024-02-21T22:53:46.822 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.829+0000 7f42dd146640 1 --2- 172.21.15.116:0/81254444 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f42bc06b4d0 0x7f42bc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:46.822 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.830+0000 7f42dd146640 1 --2- 172.21.15.116:0/81254444 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f42bc06b4d0 0x7f42bc06d990 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f42d0000f60 tx=0x7f42d0007d70 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:46.823 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:46.833+0000 7f42cdffb640 1 -- 172.21.15.116:0/81254444 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f42d407b710 con 0x7f42d809cc50 2024-02-21T22:53:47.034 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.044+0000 7f42df3aa640 1 -- 172.21.15.116:0/81254444 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f42d81f4c70 con 0x7f42d809cc50 2024-02-21T22:53:47.035 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.044+0000 7f42cdffb640 1 -- 172.21.15.116:0/81254444 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+4943 (secure 0 0 0) 0x7f42d407f7b0 con 0x7f42d809cc50 2024-02-21T22:53:47.035 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-02-21T22:53:47.035 INFO:teuthology.orchestra.run.smithi116.stdout:{"epoch":13,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4808,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6834/422696755","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":422696755},{"type":"v1","addr":"172.21.15.116:6834","nonce":422696755}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":4820,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/1258680028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":1258680028},{"type":"v1","addr":"172.21.15.142:6836","nonce":1258680028}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":5097,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6835/758247165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6833","nonce":758247165},{"type":"v1","addr":"172.21.15.116:6835","nonce":758247165}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-21T22:53:42.328760+0000","modified":"2024-02-21T22:53:44.339386+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5098},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5098":{"gid":5098,"name":"d","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6837/3133486359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":3133486359},{"type":"v1","addr":"172.21.15.142:6837","nonce":3133486359}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-02-21T22:53:47.035 INFO:teuthology.orchestra.run.smithi116.stderr:dumped fsmap epoch 13 2024-02-21T22:53:47.037 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.046+0000 7f42df3aa640 1 -- 172.21.15.116:0/81254444 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f42bc06b4d0 msgr2=0x7f42bc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:47.038 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.046+0000 7f42df3aa640 1 --2- 172.21.15.116:0/81254444 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f42bc06b4d0 0x7f42bc06d990 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f42d0000f60 tx=0x7f42d0007d70 comp rx=0 tx=0).stop 2024-02-21T22:53:47.038 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.046+0000 7f42df3aa640 1 -- 172.21.15.116:0/81254444 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f42d809cc50 msgr2=0x7f42d809d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:47.038 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.046+0000 7f42df3aa640 1 --2- 172.21.15.116:0/81254444 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f42d809cc50 0x7f42d809d100 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f42d402c530 tx=0x7f42d4004a40 comp rx=0 tx=0).stop 2024-02-21T22:53:47.038 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.046+0000 7f42df3aa640 1 -- 172.21.15.116:0/81254444 shutdown_connections 2024-02-21T22:53:47.038 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.046+0000 7f42df3aa640 1 --2- 172.21.15.116:0/81254444 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f42d809cc50 0x7f42d809d100 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:47.038 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.046+0000 7f42df3aa640 1 --2- 172.21.15.116:0/81254444 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f42bc06b4d0 0x7f42bc06d990 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:47.038 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.046+0000 7f42df3aa640 1 --2- 172.21.15.116:0/81254444 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f42d80acd30 0x7f42d8159040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:47.038 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.046+0000 7f42df3aa640 1 --2- 172.21.15.116:0/81254444 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f42d8071580 0x7f42d81f4730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:47.038 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.046+0000 7f42df3aa640 1 -- 172.21.15.116:0/81254444 >> 172.21.15.116:0/81254444 conn(0x7f42d80b18e0 msgr2=0x7f42d80b0b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:47.038 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.047+0000 7f42df3aa640 1 -- 172.21.15.116:0/81254444 shutdown_connections 2024-02-21T22:53:47.038 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.047+0000 7f42df3aa640 1 -- 172.21.15.116:0/81254444 wait complete. 2024-02-21T22:53:47.451 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 13, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-02-21T22:53:42.328760+0000', 'modified': '2024-02-21T22:53:44.339386+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5098}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5098': {'gid': 5098, 'name': 'd', 'rank': 0, 'incarnation': 11, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.142:6837/3133486359', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.142:6834', 'nonce': 3133486359}, {'type': 'v1', 'addr': '172.21.15.142:6837', 'nonce': 3133486359}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-02-21T22:53:47.452 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-02-21T22:53:47.452 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-02-21T22:53:47.554 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.564+0000 7fb4c3a36640 1 Processor -- start 2024-02-21T22:53:47.554 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.564+0000 7fb4c3a36640 1 -- start start 2024-02-21T22:53:47.556 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.565+0000 7fb4c3a36640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb4bc15afb0 0x7fb4bc0af080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:47.556 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.565+0000 7fb4c3a36640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fb4bc071c90 0x7fb4bc0b3860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:47.556 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.565+0000 7fb4c3a36640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4bc0710e0 con 0x7fb4bc070b70 2024-02-21T22:53:47.556 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.565+0000 7fb4c3a36640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4bc15b390 con 0x7fb4bc071c90 2024-02-21T22:53:47.556 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.565+0000 7fb4c3a36640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4bc0713c0 con 0x7fb4bc15afb0 2024-02-21T22:53:47.557 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.565+0000 7fb4c1fd3640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fb4bc071c90 0x7fb4bc0b3860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:47.557 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.565+0000 7fb4c0fd1640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7fb4bc070b70 0x7fb4bc071580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:47328/0 (socket says 172.21.15.116:47328) 2024-02-21T22:53:47.557 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.565+0000 7fb4c0fd1640 1 -- 172.21.15.116:0/167548649 learned_addr learned my addr 172.21.15.116:0/167548649 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-02-21T22:53:47.557 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.565+0000 7fb4c17d2640 1 --2- 172.21.15.116:0/167548649 >> v2:172.21.15.142:3300/0 conn(0x7fb4bc15afb0 0x7fb4bc0af080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:47.557 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.565+0000 7fb4b3fff640 1 -- 172.21.15.116:0/167548649 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1338842876 0 0) 0x7fb4bc0710e0 con 0x7fb4bc070b70 2024-02-21T22:53:47.557 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.565+0000 7fb4b3fff640 1 -- 172.21.15.116:0/167548649 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb4a8003520 con 0x7fb4bc070b70 2024-02-21T22:53:47.557 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.565+0000 7fb4c1fd3640 1 -- 172.21.15.116:0/167548649 >> v2:172.21.15.142:3300/0 conn(0x7fb4bc15afb0 msgr2=0x7fb4bc0af080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:53:47.557 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.565+0000 7fb4c1fd3640 1 --2- 172.21.15.116:0/167548649 >> v2:172.21.15.142:3300/0 conn(0x7fb4bc15afb0 0x7fb4bc0af080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:47.557 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.565+0000 7fb4c1fd3640 1 -- 172.21.15.116:0/167548649 >> v1:172.21.15.116:6789/0 conn(0x7fb4bc070b70 legacy=0x7fb4bc071580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:47.557 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.565+0000 7fb4c1fd3640 1 -- 172.21.15.116:0/167548649 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4bc0b2d80 con 0x7fb4bc071c90 2024-02-21T22:53:47.557 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.566+0000 7fb4c1fd3640 1 --2- 172.21.15.116:0/167548649 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb4bc071c90 0x7fb4bc0b3860 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fb4b4009d90 tx=0x7fb4b402bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d55531fa43370d3a server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:47.557 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.566+0000 7fb4b3fff640 1 -- 172.21.15.116:0/167548649 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4b4039070 con 0x7fb4bc071c90 2024-02-21T22:53:47.557 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.566+0000 7fb4b3fff640 1 -- 172.21.15.116:0/167548649 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4b402cd00 con 0x7fb4bc071c90 2024-02-21T22:53:47.557 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.566+0000 7fb4b3fff640 1 -- 172.21.15.116:0/167548649 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4b4034660 con 0x7fb4bc071c90 2024-02-21T22:53:47.560 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.567+0000 7fb4c3a36640 1 -- 172.21.15.116:0/167548649 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb4bc071c90 msgr2=0x7fb4bc0b3860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:47.561 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.567+0000 7fb4c3a36640 1 --2- 172.21.15.116:0/167548649 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb4bc071c90 0x7fb4bc0b3860 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fb4b4009d90 tx=0x7fb4b402bf50 comp rx=0 tx=0).stop 2024-02-21T22:53:47.561 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.567+0000 7fb4c3a36640 1 -- 172.21.15.116:0/167548649 shutdown_connections 2024-02-21T22:53:47.561 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.567+0000 7fb4c3a36640 1 --2- 172.21.15.116:0/167548649 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb4bc071c90 0x7fb4bc0b3860 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:47.561 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.567+0000 7fb4c3a36640 1 --2- 172.21.15.116:0/167548649 >> v2:172.21.15.142:3300/0 conn(0x7fb4bc15afb0 0x7fb4bc0af080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:47.561 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.567+0000 7fb4c3a36640 1 -- 172.21.15.116:0/167548649 >> 172.21.15.116:0/167548649 conn(0x7fb4bc0b18e0 msgr2=0x7fb4bc0b1cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:47.561 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.567+0000 7fb4c3a36640 1 -- 172.21.15.116:0/167548649 shutdown_connections 2024-02-21T22:53:47.561 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.567+0000 7fb4c3a36640 1 -- 172.21.15.116:0/167548649 wait complete. 2024-02-21T22:53:47.561 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.568+0000 7fb4c3a36640 1 Processor -- start 2024-02-21T22:53:47.561 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.568+0000 7fb4c3a36640 1 -- start start 2024-02-21T22:53:47.561 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.569+0000 7fb4c3a36640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb4bc070b70 0x7fb4bc06d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:47.561 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.569+0000 7fb4c3a36640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb4bc071c90 0x7fb4bc06d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:47.561 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.569+0000 7fb4c3a36640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb4bc15afb0 0x7fb4bc14ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:47.562 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.569+0000 7fb4c3a36640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4bc0af5c0 con 0x7fb4bc071c90 2024-02-21T22:53:47.562 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.569+0000 7fb4c3a36640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4bc0b3340 con 0x7fb4bc070b70 2024-02-21T22:53:47.562 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.569+0000 7fb4c3a36640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4bc0b3da0 con 0x7fb4bc15afb0 2024-02-21T22:53:47.562 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.569+0000 7fb4c0fd1640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb4bc071c90 0x7fb4bc06d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:47.562 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.569+0000 7fb4c0fd1640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb4bc071c90 0x7fb4bc06d6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:39972/0 (socket says 172.21.15.116:39972) 2024-02-21T22:53:47.562 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.569+0000 7fb4c0fd1640 1 -- 172.21.15.116:0/139513584 learned_addr learned my addr 172.21.15.116:0/139513584 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:47.562 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.569+0000 7fb4c17d2640 1 --2- 172.21.15.116:0/139513584 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb4bc070b70 0x7fb4bc06d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:47.562 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.569+0000 7fb4c1fd3640 1 --2- 172.21.15.116:0/139513584 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb4bc15afb0 0x7fb4bc14ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:47.562 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.569+0000 7fb4c0fd1640 1 -- 172.21.15.116:0/139513584 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb4bc15afb0 msgr2=0x7fb4bc14ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:47.562 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.569+0000 7fb4c0fd1640 1 --2- 172.21.15.116:0/139513584 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb4bc15afb0 0x7fb4bc14ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:47.562 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.569+0000 7fb4c0fd1640 1 -- 172.21.15.116:0/139513584 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb4bc070b70 msgr2=0x7fb4bc06d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:47.562 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.569+0000 7fb4c0fd1640 1 --2- 172.21.15.116:0/139513584 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb4bc070b70 0x7fb4bc06d180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:47.562 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.569+0000 7fb4c0fd1640 1 -- 172.21.15.116:0/139513584 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4bc1489f0 con 0x7fb4bc071c90 2024-02-21T22:53:47.563 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.569+0000 7fb4c1fd3640 1 --2- 172.21.15.116:0/139513584 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb4bc15afb0 0x7fb4bc14ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T22:53:47.563 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.569+0000 7fb4c0fd1640 1 --2- 172.21.15.116:0/139513584 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb4bc071c90 0x7fb4bc06d6c0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fb4ac00c430 tx=0x7fb4ac00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:47.563 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.569+0000 7fb4b1ffb640 1 -- 172.21.15.116:0/139513584 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4ac017070 con 0x7fb4bc071c90 2024-02-21T22:53:47.563 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.569+0000 7fb4b1ffb640 1 -- 172.21.15.116:0/139513584 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4ac005ce0 con 0x7fb4bc071c90 2024-02-21T22:53:47.563 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.569+0000 7fb4b1ffb640 1 -- 172.21.15.116:0/139513584 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4ac0072f0 con 0x7fb4bc071c90 2024-02-21T22:53:47.563 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.569+0000 7fb4c3a36640 1 -- 172.21.15.116:0/139513584 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4bc14b890 con 0x7fb4bc071c90 2024-02-21T22:53:47.563 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.570+0000 7fb4c3a36640 1 -- 172.21.15.116:0/139513584 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4bc148f70 con 0x7fb4bc071c90 2024-02-21T22:53:47.566 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.571+0000 7fb4b1ffb640 1 -- 172.21.15.116:0/139513584 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fb4ac01a070 con 0x7fb4bc071c90 2024-02-21T22:53:47.566 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.571+0000 7fb4b1ffb640 1 --2- 172.21.15.116:0/139513584 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fb4a006b4d0 0x7fb4a006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:47.566 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.572+0000 7fb4b1ffb640 1 -- 172.21.15.116:0/139513584 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb4ac0896c0 con 0x7fb4bc071c90 2024-02-21T22:53:47.566 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.572+0000 7fb4c17d2640 1 --2- 172.21.15.116:0/139513584 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fb4a006b4d0 0x7fb4a006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:47.566 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.572+0000 7fb4c17d2640 1 --2- 172.21.15.116:0/139513584 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fb4a006b4d0 0x7fb4a006d990 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fb4b8009aa0 tx=0x7fb4b8009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:47.566 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.572+0000 7fb4c6817740 1 Processor -- start 2024-02-21T22:53:47.566 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.573+0000 7fb4c6817740 1 -- start start 2024-02-21T22:53:47.566 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.573+0000 7fb4c6817740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556575c4dda0 0x556575c2fe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:47.566 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.573+0000 7fb4c6817740 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x556575c4b8c0 0x556575c303c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:47.566 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.573+0000 7fb4c6817740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556575c2d4b0 0x556575c03bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:47.567 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.573+0000 7fb4c6817740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x556575b69860 con 0x556575c2d4b0 2024-02-21T22:53:47.567 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.573+0000 7fb4c6817740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x556575b12980 con 0x556575c4dda0 2024-02-21T22:53:47.567 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.573+0000 7fb4c6817740 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x556575b65aa0 con 0x556575c4b8c0 2024-02-21T22:53:47.567 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.573+0000 7fb4c1fd3640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556575c2d4b0 0x556575c03bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:47.567 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.573+0000 7fb4c17d2640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556575c4dda0 0x556575c2fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:47.567 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.573+0000 7fb4c1fd3640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556575c2d4b0 0x556575c03bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:39978/0 (socket says 172.21.15.116:39978) 2024-02-21T22:53:47.567 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.573+0000 7fb4c1fd3640 1 -- 172.21.15.116:0/2911882736 learned_addr learned my addr 172.21.15.116:0/2911882736 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:47.567 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.573+0000 7fb4c0fd1640 1 --2- 172.21.15.116:0/2911882736 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x556575c4b8c0 0x556575c303c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:47.567 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.574+0000 7fb4c1fd3640 1 -- 172.21.15.116:0/2911882736 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x556575c4b8c0 msgr2=0x556575c303c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:53:47.567 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.574+0000 7fb4c1fd3640 1 --2- 172.21.15.116:0/2911882736 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x556575c4b8c0 0x556575c303c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:47.567 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.574+0000 7fb4c1fd3640 1 -- 172.21.15.116:0/2911882736 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556575c4dda0 msgr2=0x556575c2fe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:53:47.567 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.574+0000 7fb4c1fd3640 1 --2- 172.21.15.116:0/2911882736 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556575c4dda0 0x556575c2fe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:47.567 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.574+0000 7fb4c1fd3640 1 -- 172.21.15.116:0/2911882736 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556575b27c60 con 0x556575c2d4b0 2024-02-21T22:53:47.567 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.574+0000 7fb4c1fd3640 1 --2- 172.21.15.116:0/2911882736 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556575c2d4b0 0x556575c03bf0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fb4b4037040 tx=0x7fb4b402e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83d5b22875f28bfb server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:47.568 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.574+0000 7fb49effd640 1 -- 172.21.15.116:0/2911882736 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4b4039040 con 0x556575c2d4b0 2024-02-21T22:53:47.568 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.574+0000 7fb49effd640 1 -- 172.21.15.116:0/2911882736 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4b403f440 con 0x556575c2d4b0 2024-02-21T22:53:47.568 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.574+0000 7fb49effd640 1 -- 172.21.15.116:0/2911882736 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4b403f830 con 0x556575c2d4b0 2024-02-21T22:53:47.568 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.575+0000 7fb4c6817740 1 -- 172.21.15.116:0/2911882736 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556575c2d4b0 msgr2=0x556575c03bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:47.568 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.575+0000 7fb4c6817740 1 --2- 172.21.15.116:0/2911882736 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556575c2d4b0 0x556575c03bf0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fb4b4037040 tx=0x7fb4b402e000 comp rx=0 tx=0).stop 2024-02-21T22:53:47.568 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.575+0000 7fb4c6817740 1 -- 172.21.15.116:0/2911882736 shutdown_connections 2024-02-21T22:53:47.568 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.575+0000 7fb4c6817740 1 --2- 172.21.15.116:0/2911882736 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556575c2d4b0 0x556575c03bf0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:47.568 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.575+0000 7fb4c6817740 1 --2- 172.21.15.116:0/2911882736 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x556575c4b8c0 0x556575c303c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:47.568 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.575+0000 7fb4c6817740 1 --2- 172.21.15.116:0/2911882736 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556575c4dda0 0x556575c2fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:47.568 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.575+0000 7fb4c6817740 1 -- 172.21.15.116:0/2911882736 >> 172.21.15.116:0/2911882736 conn(0x556575c02300 msgr2=0x556575c4ae80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:47.568 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.575+0000 7fb4c6817740 1 -- 172.21.15.116:0/2911882736 shutdown_connections 2024-02-21T22:53:47.568 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.575+0000 7fb4c6817740 1 -- 172.21.15.116:0/2911882736 wait complete. 2024-02-21T22:53:47.568 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.575+0000 7fb4c6817740 1 -- start start 2024-02-21T22:53:47.569 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.575+0000 7fb4c6817740 1 Processor -- start 2024-02-21T22:53:47.573 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.576+0000 7fb4c6817740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556575c4b8c0 0x556575c318a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:47.573 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.576+0000 7fb4c6817740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556575c4dda0 0x556575c2f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:47.573 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.576+0000 7fb4c6817740 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x556575c5f9d0 0x556575c1def0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:47.573 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.576+0000 7fb4c6817740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x556575c00090 con 0x556575c4b8c0 2024-02-21T22:53:47.573 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.576+0000 7fb4c6817740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x556575b25f10 con 0x556575c4dda0 2024-02-21T22:53:47.573 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.576+0000 7fb4c6817740 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x556575c05f20 con 0x556575c5f9d0 2024-02-21T22:53:47.573 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.576+0000 7fb4c6817740 10 client.0 _ll_register_callbacks cb 0x556575b19d10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T22:53:47.574 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.576+0000 7fb4c17d2640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556575c4b8c0 0x556575c318a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:47.574 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.576+0000 7fb4c17d2640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556575c4b8c0 0x556575c318a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:39988/0 (socket says 172.21.15.116:39988) 2024-02-21T22:53:47.574 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.576+0000 7fb4c17d2640 1 -- 172.21.15.116:0/1374813930 learned_addr learned my addr 172.21.15.116:0/1374813930 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:47.574 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.576+0000 7fb4c0fd1640 1 --2- 172.21.15.116:0/1374813930 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556575c4dda0 0x556575c2f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:47.574 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.576+0000 7fb4c1fd3640 1 --2- 172.21.15.116:0/1374813930 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x556575c5f9d0 0x556575c1def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:47.574 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.576+0000 7fb4c17d2640 1 -- 172.21.15.116:0/1374813930 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x556575c5f9d0 msgr2=0x556575c1def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:53:47.574 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.576+0000 7fb4c17d2640 1 --2- 172.21.15.116:0/1374813930 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x556575c5f9d0 0x556575c1def0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:47.574 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.576+0000 7fb4c17d2640 1 -- 172.21.15.116:0/1374813930 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556575c4dda0 msgr2=0x556575c2f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:53:47.574 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.576+0000 7fb4c17d2640 1 --2- 172.21.15.116:0/1374813930 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556575c4dda0 0x556575c2f1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:47.574 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.576+0000 7fb4c17d2640 1 -- 172.21.15.116:0/1374813930 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55657587e2d0 con 0x556575c4b8c0 2024-02-21T22:53:47.574 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.577+0000 7fb4c17d2640 1 --2- 172.21.15.116:0/1374813930 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556575c4b8c0 0x556575c318a0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fb4b8011fe0 tx=0x7fb4b80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d73222f6dc69017 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:47.574 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.577+0000 7fb497fff640 10 client.0 ms_handle_connect on v2:172.21.15.116:3300/0 2024-02-21T22:53:47.574 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.577+0000 7fb497fff640 1 -- 172.21.15.116:0/1374813930 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4b8027070 con 0x556575c4b8c0 2024-02-21T22:53:47.574 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.577+0000 7fb497fff640 1 -- 172.21.15.116:0/1374813930 <== mon.0 v2:172.21.15.116:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb4b8014440 con 0x556575c4b8c0 2024-02-21T22:53:47.574 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.577+0000 7fb4c6817740 1 -- 172.21.15.116:0/1374813930 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb4b403f440 con 0x556575c4b8c0 2024-02-21T22:53:47.575 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.577+0000 7fb497fff640 1 -- 172.21.15.116:0/1374813930 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_get_version_reply(handle=1 version=13) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb4b8014640 con 0x556575c4b8c0 2024-02-21T22:53:47.575 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.577+0000 7fb4c6817740 10 client.5289 fetch_fsmap learned FSMap version 13 2024-02-21T22:53:47.575 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.577+0000 7fb4c6817740 1 -- 172.21.15.116:0/1374813930 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,fsmap=13,monmap=2+}) v3 -- 0x5565759486b0 con 0x556575c4b8c0 2024-02-21T22:53:47.575 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.577+0000 7fb497fff640 1 -- 172.21.15.116:0/1374813930 <== mon.0 v2:172.21.15.116:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4b403f440 con 0x556575c4b8c0 2024-02-21T22:53:47.575 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.577+0000 7fb497fff640 1 -- 172.21.15.116:0/1374813930 <== mon.0 v2:172.21.15.116:3300/0 5 ==== fsmap(e 13) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fb4b8035080 con 0x556575c4b8c0 2024-02-21T22:53:47.575 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.577+0000 7fb4c6817740 10 client.5289 fetch_fsmap finished waiting for FSMap version 13 2024-02-21T22:53:47.575 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.577+0000 7fb4c6817740 10 client.5289 resolve_mds: resolved name 'd' to daemon mds.d 2024-02-21T22:53:47.575 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.577+0000 7fb4c6817740 20 client.5289 populate_metadata read hostname 'smithi116' 2024-02-21T22:53:47.575 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.577+0000 7fb4c6817740 1 --2- 172.21.15.116:0/1374813930 >> [v2:172.21.15.142:6834/3133486359,v1:172.21.15.142:6837/3133486359] conn(0x556575c2aaa0 0x556575c2ae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:47.575 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.577+0000 7fb4c6817740 4 client.5289 mds_command: new command op to 5098 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T22:53:47.575 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.577+0000 7fb4c6817740 1 -- 172.21.15.116:0/1374813930 --> [v2:172.21.15.142:6834/3133486359,v1:172.21.15.142:6837/3133486359] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556575bc7480 con 0x556575c2aaa0 2024-02-21T22:53:47.575 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.577+0000 7fb4c0fd1640 1 --2- 172.21.15.116:0/1374813930 >> [v2:172.21.15.142:6834/3133486359,v1:172.21.15.142:6837/3133486359] conn(0x556575c2aaa0 0x556575c2ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:47.575 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.578+0000 7fb497fff640 10 client.5289 ms_handle_connect on v2:172.21.15.142:6834/3133486359 2024-02-21T22:53:47.575 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.578+0000 7fb4c0fd1640 1 --2- 172.21.15.116:0/1374813930 >> [v2:172.21.15.142:6834/3133486359,v1:172.21.15.142:6837/3133486359] conn(0x556575c2aaa0 0x556575c2ae80 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5636c6a4737cf815 server_cookie=337099877d1d6fbb in_seq=0 out_seq=0 2024-02-21T22:53:47.576 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.578+0000 7fb497fff640 1 -- 172.21.15.116:0/1374813930 <== mds.0 v2:172.21.15.142:6834/3133486359 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x556575bc7480 con 0x556575c2aaa0 2024-02-21T22:53:47.576 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.578+0000 7fb497fff640 10 client.5289 handle_command_reply: tid=0 2024-02-21T22:53:47.576 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.578+0000 7fb4c6817740 1 client.5289 shutdown 2024-02-21T22:53:47.576 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.578+0000 7fb4c6817740 1 -- 172.21.15.116:0/1374813930 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556575c4b8c0 msgr2=0x556575c318a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:47.576 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.578+0000 7fb4c6817740 1 --2- 172.21.15.116:0/1374813930 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556575c4b8c0 0x556575c318a0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fb4b8011fe0 tx=0x7fb4b80046c0 comp rx=0 tx=0).stop 2024-02-21T22:53:47.576 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.578+0000 7fb4c6817740 1 -- 172.21.15.116:0/1374813930 shutdown_connections 2024-02-21T22:53:47.576 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.578+0000 7fb4c6817740 1 --2- 172.21.15.116:0/1374813930 >> [v2:172.21.15.142:6834/3133486359,v1:172.21.15.142:6837/3133486359] conn(0x556575c2aaa0 0x556575c2ae80 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:47.576 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.579+0000 7fb4c6817740 1 --2- 172.21.15.116:0/1374813930 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x556575c5f9d0 0x556575c1def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:47.576 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.579+0000 7fb497fff640 0 client.5289 ms_handle_reset on v2:172.21.15.142:6834/3133486359 2024-02-21T22:53:47.576 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.579+0000 7fb4c6817740 1 --2- 172.21.15.116:0/1374813930 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556575c4dda0 0x556575c2f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:47.576 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.579+0000 7fb4c6817740 1 --2- 172.21.15.116:0/1374813930 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556575c4b8c0 0x556575c318a0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:47.576 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.579+0000 7fb4c6817740 1 -- 172.21.15.116:0/1374813930 >> 172.21.15.116:0/1374813930 conn(0x556575c2d4b0 msgr2=0x556575c4ada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:47.576 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.579+0000 7fb4c6817740 1 -- 172.21.15.116:0/1374813930 shutdown_connections 2024-02-21T22:53:47.576 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.579+0000 7fb4c6817740 1 -- 172.21.15.116:0/1374813930 wait complete. 2024-02-21T22:53:47.577 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.579+0000 7fb4c6817740 20 client.5289 trim_cache size 0 max 16384 2024-02-21T22:53:47.586 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.595+0000 7fb4c6817740 1 Processor -- start 2024-02-21T22:53:47.586 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.595+0000 7fb4c6817740 1 -- start start 2024-02-21T22:53:47.593 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.596+0000 7fb4c6817740 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x556575c4b8c0 0x556575c00cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:47.593 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.596+0000 7fb4c6817740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556575c4dda0 0x556575c47e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:47.593 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.596+0000 7fb4c6817740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556575c5f9d0 0x556575c483b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:47.593 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.596+0000 7fb4c6817740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4bc0ce450 con 0x556575c4dda0 2024-02-21T22:53:47.593 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.596+0000 7fb4c6817740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4bc0cd850 con 0x556575c5f9d0 2024-02-21T22:53:47.593 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.596+0000 7fb4c6817740 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4bc0cde50 con 0x556575c4b8c0 2024-02-21T22:53:47.593 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.596+0000 7fb4c0fd1640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556575c4dda0 0x556575c47e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:47.593 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.596+0000 7fb4c0fd1640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556575c4dda0 0x556575c47e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:39998/0 (socket says 172.21.15.116:39998) 2024-02-21T22:53:47.593 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.596+0000 7fb4c0fd1640 1 -- 172.21.15.116:0/52955271 learned_addr learned my addr 172.21.15.116:0/52955271 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:47.593 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.596+0000 7fb4c17d2640 1 --2- 172.21.15.116:0/52955271 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x556575c4b8c0 0x556575c00cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:47.593 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.596+0000 7fb4c1fd3640 1 --2- 172.21.15.116:0/52955271 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556575c5f9d0 0x556575c483b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:47.593 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.596+0000 7fb4c0fd1640 1 -- 172.21.15.116:0/52955271 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x556575c4b8c0 msgr2=0x556575c00cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:53:47.593 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.596+0000 7fb4c0fd1640 1 --2- 172.21.15.116:0/52955271 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x556575c4b8c0 0x556575c00cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:47.594 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.596+0000 7fb4c0fd1640 1 -- 172.21.15.116:0/52955271 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556575c5f9d0 msgr2=0x556575c483b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:53:47.594 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.596+0000 7fb4c0fd1640 1 --2- 172.21.15.116:0/52955271 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556575c5f9d0 0x556575c483b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:47.594 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.596+0000 7fb4c0fd1640 1 -- 172.21.15.116:0/52955271 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556575c2d2d0 con 0x556575c4dda0 2024-02-21T22:53:47.594 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.596+0000 7fb4c0fd1640 1 --2- 172.21.15.116:0/52955271 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556575c4dda0 0x556575c47e70 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fb4ac0542c0 tx=0x7fb4ac087ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0bc9470967b3c7f server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:47.594 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.597+0000 7fb49e7fc640 1 -- 172.21.15.116:0/52955271 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4ac056160 con 0x556575c4dda0 2024-02-21T22:53:47.594 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.597+0000 7fb49e7fc640 1 -- 172.21.15.116:0/52955271 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4ac0544d0 con 0x556575c4dda0 2024-02-21T22:53:47.594 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.597+0000 7fb49e7fc640 1 -- 172.21.15.116:0/52955271 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4ac060300 con 0x556575c4dda0 2024-02-21T22:53:47.594 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.597+0000 7fb4c6817740 1 -- 172.21.15.116:0/52955271 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556575c4dda0 msgr2=0x556575c47e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:47.594 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.597+0000 7fb4c6817740 1 --2- 172.21.15.116:0/52955271 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556575c4dda0 0x556575c47e70 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fb4ac0542c0 tx=0x7fb4ac087ac0 comp rx=0 tx=0).stop 2024-02-21T22:53:47.594 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.597+0000 7fb4c6817740 1 -- 172.21.15.116:0/52955271 shutdown_connections 2024-02-21T22:53:47.594 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.597+0000 7fb4c6817740 1 --2- 172.21.15.116:0/52955271 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556575c5f9d0 0x556575c483b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:47.594 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.597+0000 7fb4c6817740 1 --2- 172.21.15.116:0/52955271 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556575c4dda0 0x556575c47e70 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:47.594 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.597+0000 7fb4c6817740 1 --2- 172.21.15.116:0/52955271 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x556575c4b8c0 0x556575c00cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:47.594 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.597+0000 7fb4c6817740 1 -- 172.21.15.116:0/52955271 >> 172.21.15.116:0/52955271 conn(0x556575c2d4b0 msgr2=0x556575c31730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:47.594 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.597+0000 7fb4c6817740 1 -- 172.21.15.116:0/52955271 shutdown_connections 2024-02-21T22:53:47.595 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.597+0000 7fb4c6817740 1 -- 172.21.15.116:0/52955271 wait complete. 2024-02-21T22:53:47.595 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.598+0000 7fb4c6817740 1 -- start start 2024-02-21T22:53:47.595 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.598+0000 7fb4c6817740 1 Processor -- start 2024-02-21T22:53:47.595 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.599+0000 7fb4c6817740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556575c4b8c0 0x556575c2dd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:47.595 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.599+0000 7fb4c6817740 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x556575c4dda0 0x556575c2e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:47.595 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.599+0000 7fb4c6817740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556575c5f9d0 0x556575bff000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:47.595 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.599+0000 7fb4c6817740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x556575c5fea0 con 0x556575c4b8c0 2024-02-21T22:53:47.595 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.599+0000 7fb4c6817740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x556575c32c30 con 0x556575c5f9d0 2024-02-21T22:53:47.595 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.599+0000 7fb4c6817740 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x556575c336e0 con 0x556575c4dda0 2024-02-21T22:53:47.595 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.599+0000 7fb4c6817740 10 client.0 _ll_register_callbacks cb 0x7fb4b8004120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T22:53:47.595 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.599+0000 7fb4c17d2640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556575c4b8c0 0x556575c2dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:47.595 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.599+0000 7fb4c17d2640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556575c4b8c0 0x556575c2dd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:40014/0 (socket says 172.21.15.116:40014) 2024-02-21T22:53:47.595 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.599+0000 7fb4c17d2640 1 -- 172.21.15.116:0/58853488 learned_addr learned my addr 172.21.15.116:0/58853488 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:47.595 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.599+0000 7fb4c0fd1640 1 --2- 172.21.15.116:0/58853488 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x556575c4dda0 0x556575c2e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:47.595 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.599+0000 7fb4c1fd3640 1 --2- 172.21.15.116:0/58853488 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556575c5f9d0 0x556575bff000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:47.596 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.599+0000 7fb4c17d2640 1 -- 172.21.15.116:0/58853488 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x556575c4dda0 msgr2=0x556575c2e2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:53:47.596 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.599+0000 7fb4c17d2640 1 --2- 172.21.15.116:0/58853488 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x556575c4dda0 0x556575c2e2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:47.596 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.599+0000 7fb4c17d2640 1 -- 172.21.15.116:0/58853488 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556575c5f9d0 msgr2=0x556575bff000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:53:47.596 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.599+0000 7fb4c17d2640 1 --2- 172.21.15.116:0/58853488 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556575c5f9d0 0x556575bff000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:47.596 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.599+0000 7fb4c17d2640 1 -- 172.21.15.116:0/58853488 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556575c31b90 con 0x556575c4b8c0 2024-02-21T22:53:47.596 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.599+0000 7fb4c17d2640 1 --2- 172.21.15.116:0/58853488 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556575c4b8c0 0x556575c2dd60 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fb4b802c6a0 tx=0x7fb4b8019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ffa10f774f9598f server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:47.596 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.599+0000 7fb497fff640 10 client.0 ms_handle_connect on v2:172.21.15.116:3300/0 2024-02-21T22:53:47.596 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.599+0000 7fb497fff640 1 -- 172.21.15.116:0/58853488 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4b8027040 con 0x556575c4b8c0 2024-02-21T22:53:47.596 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.599+0000 7fb497fff640 1 -- 172.21.15.116:0/58853488 <== mon.0 v2:172.21.15.116:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb4b8014440 con 0x556575c4b8c0 2024-02-21T22:53:47.596 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.599+0000 7fb4c6817740 1 -- 172.21.15.116:0/58853488 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb4ac0544d0 con 0x556575c4b8c0 2024-02-21T22:53:47.596 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.599+0000 7fb497fff640 1 -- 172.21.15.116:0/58853488 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_get_version_reply(handle=1 version=13) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb4b8049050 con 0x556575c4b8c0 2024-02-21T22:53:47.596 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.599+0000 7fb4c6817740 10 client.5295 fetch_fsmap learned FSMap version 13 2024-02-21T22:53:47.597 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.599+0000 7fb4c6817740 1 -- 172.21.15.116:0/58853488 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,fsmap=13,monmap=2+}) v3 -- 0x556575c48690 con 0x556575c4b8c0 2024-02-21T22:53:47.597 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.599+0000 7fb497fff640 1 -- 172.21.15.116:0/58853488 <== mon.0 v2:172.21.15.116:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4ac0544d0 con 0x556575c4b8c0 2024-02-21T22:53:47.597 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.600+0000 7fb497fff640 1 -- 172.21.15.116:0/58853488 <== mon.0 v2:172.21.15.116:3300/0 5 ==== fsmap(e 13) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fb4b804c020 con 0x556575c4b8c0 2024-02-21T22:53:47.597 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.600+0000 7fb4c6817740 10 client.5295 fetch_fsmap finished waiting for FSMap version 13 2024-02-21T22:53:47.597 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.600+0000 7fb4c6817740 10 client.5295 resolve_mds: resolved name 'd' to daemon mds.d 2024-02-21T22:53:47.597 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.600+0000 7fb4c6817740 20 client.5295 populate_metadata read hostname 'smithi116' 2024-02-21T22:53:47.597 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.600+0000 7fb4c6817740 1 --2- 172.21.15.116:0/58853488 >> [v2:172.21.15.142:6834/3133486359,v1:172.21.15.142:6837/3133486359] conn(0x556575c53570 0x556575c53950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:47.597 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.600+0000 7fb4c6817740 4 client.5295 mds_command: new command op to 5098 tid=0 multi_id=0 [{"prefix": "status"}] 2024-02-21T22:53:47.597 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.600+0000 7fb4c6817740 1 -- 172.21.15.116:0/58853488 --> [v2:172.21.15.142:6834/3133486359,v1:172.21.15.142:6837/3133486359] -- command(tid 0: {"prefix": "status"}) v1 -- 0x556575b76da0 con 0x556575c53570 2024-02-21T22:53:47.597 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.600+0000 7fb4c0fd1640 1 --2- 172.21.15.116:0/58853488 >> [v2:172.21.15.142:6834/3133486359,v1:172.21.15.142:6837/3133486359] conn(0x556575c53570 0x556575c53950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:47.597 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.600+0000 7fb497fff640 10 client.5295 ms_handle_connect on v2:172.21.15.142:6834/3133486359 2024-02-21T22:53:47.597 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.600+0000 7fb4c0fd1640 1 --2- 172.21.15.116:0/58853488 >> [v2:172.21.15.142:6834/3133486359,v1:172.21.15.142:6837/3133486359] conn(0x556575c53570 0x556575c53950 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=92ce769a1662c0f server_cookie=590b9e4a2f5d42f9 in_seq=0 out_seq=0 2024-02-21T22:53:47.597 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.600+0000 7fb497fff640 1 -- 172.21.15.116:0/58853488 <== mds.0 v2:172.21.15.142:6834/3133486359 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x556575b76da0 con 0x556575c53570 2024-02-21T22:53:47.597 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.600+0000 7fb497fff640 10 client.5295 handle_command_reply: tid=0 2024-02-21T22:53:47.597 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.600+0000 7fb4c6817740 1 client.5295 shutdown 2024-02-21T22:53:47.597 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.600+0000 7fb4c6817740 1 -- 172.21.15.116:0/58853488 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556575c4b8c0 msgr2=0x556575c2dd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:47.598 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.600+0000 7fb4c6817740 1 --2- 172.21.15.116:0/58853488 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556575c4b8c0 0x556575c2dd60 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fb4b802c6a0 tx=0x7fb4b8019000 comp rx=0 tx=0).stop 2024-02-21T22:53:47.598 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.600+0000 7fb4c6817740 1 -- 172.21.15.116:0/58853488 shutdown_connections 2024-02-21T22:53:47.598 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.600+0000 7fb4c6817740 1 --2- 172.21.15.116:0/58853488 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556575c5f9d0 0x556575bff000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:47.598 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.600+0000 7fb4c6817740 1 --2- 172.21.15.116:0/58853488 >> [v2:172.21.15.142:6834/3133486359,v1:172.21.15.142:6837/3133486359] conn(0x556575c53570 0x556575c53950 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:47.598 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.600+0000 7fb4c6817740 1 --2- 172.21.15.116:0/58853488 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x556575c4dda0 0x556575c2e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:47.598 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.600+0000 7fb4c6817740 1 --2- 172.21.15.116:0/58853488 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556575c4b8c0 0x556575c2dd60 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:47.598 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.600+0000 7fb497fff640 0 client.5295 ms_handle_reset on v2:172.21.15.142:6834/3133486359 2024-02-21T22:53:47.598 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.600+0000 7fb4c6817740 1 -- 172.21.15.116:0/58853488 >> 172.21.15.116:0/58853488 conn(0x556575c2d4b0 msgr2=0x556575c29fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:47.598 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.601+0000 7fb4c6817740 1 -- 172.21.15.116:0/58853488 shutdown_connections 2024-02-21T22:53:47.598 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.601+0000 7fb4c6817740 1 -- 172.21.15.116:0/58853488 wait complete. 2024-02-21T22:53:47.598 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.601+0000 7fb4c6817740 20 client.5295 trim_cache size 0 max 16384 2024-02-21T22:53:47.599 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-02-21T22:53:47.599 INFO:teuthology.orchestra.run.smithi116.stdout: "cluster_fsid": "7c298660-5f63-4b5c-a800-58c5be9a8445", 2024-02-21T22:53:47.599 INFO:teuthology.orchestra.run.smithi116.stdout: "whoami": 0, 2024-02-21T22:53:47.599 INFO:teuthology.orchestra.run.smithi116.stdout: "id": 5098, 2024-02-21T22:53:47.599 INFO:teuthology.orchestra.run.smithi116.stdout: "want_state": "up:active", 2024-02-21T22:53:47.599 INFO:teuthology.orchestra.run.smithi116.stdout: "state": "up:active", 2024-02-21T22:53:47.599 INFO:teuthology.orchestra.run.smithi116.stdout: "fs_name": "cephfs", 2024-02-21T22:53:47.599 INFO:teuthology.orchestra.run.smithi116.stdout: "rank_uptime": 4.6143960179999999, 2024-02-21T22:53:47.599 INFO:teuthology.orchestra.run.smithi116.stdout: "mdsmap_epoch": 13, 2024-02-21T22:53:47.599 INFO:teuthology.orchestra.run.smithi116.stdout: "osdmap_epoch": 33, 2024-02-21T22:53:47.599 INFO:teuthology.orchestra.run.smithi116.stdout: "osdmap_epoch_barrier": 33, 2024-02-21T22:53:47.599 INFO:teuthology.orchestra.run.smithi116.stdout: "uptime": 11.503373025 2024-02-21T22:53:47.599 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-02-21T22:53:47.601 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.601+0000 7fb4c3a36640 1 -- 172.21.15.116:0/139513584 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fb4a006b4d0 msgr2=0x7fb4a006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:47.601 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.601+0000 7fb4c3a36640 1 --2- 172.21.15.116:0/139513584 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fb4a006b4d0 0x7fb4a006d990 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fb4b8009aa0 tx=0x7fb4b8009190 comp rx=0 tx=0).stop 2024-02-21T22:53:47.601 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.601+0000 7fb4c3a36640 1 -- 172.21.15.116:0/139513584 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb4bc071c90 msgr2=0x7fb4bc06d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:47.601 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.601+0000 7fb4c3a36640 1 --2- 172.21.15.116:0/139513584 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb4bc071c90 0x7fb4bc06d6c0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fb4ac00c430 tx=0x7fb4ac00c8f0 comp rx=0 tx=0).stop 2024-02-21T22:53:47.601 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.601+0000 7fb4c3a36640 1 -- 172.21.15.116:0/139513584 shutdown_connections 2024-02-21T22:53:47.601 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.601+0000 7fb4c3a36640 1 --2- 172.21.15.116:0/139513584 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fb4a006b4d0 0x7fb4a006d990 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:47.601 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.601+0000 7fb4c3a36640 1 --2- 172.21.15.116:0/139513584 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb4bc15afb0 0x7fb4bc14ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:47.601 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.601+0000 7fb4c3a36640 1 --2- 172.21.15.116:0/139513584 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb4bc071c90 0x7fb4bc06d6c0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:47.601 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.601+0000 7fb4c3a36640 1 --2- 172.21.15.116:0/139513584 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb4bc070b70 0x7fb4bc06d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:47.601 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.601+0000 7fb4c3a36640 1 -- 172.21.15.116:0/139513584 >> 172.21.15.116:0/139513584 conn(0x7fb4bc0b18e0 msgr2=0x7fb4bc0ae790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:47.601 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.601+0000 7fb4c3a36640 1 -- 172.21.15.116:0/139513584 shutdown_connections 2024-02-21T22:53:47.601 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.601+0000 7fb4c3a36640 1 -- 172.21.15.116:0/139513584 wait complete. 2024-02-21T22:53:47.603 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-02-21T22:53:47.702 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.712+0000 7fb5f1036640 1 Processor -- start 2024-02-21T22:53:47.703 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.712+0000 7fb5f1036640 1 -- start start 2024-02-21T22:53:47.705 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.713+0000 7fb5f1036640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fb5ec15afb0 0x7fb5ec0af080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:47.705 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.713+0000 7fb5f1036640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb5ec071c90 0x7fb5ec0b3860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:47.705 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.713+0000 7fb5f1036640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5ec0710e0 con 0x7fb5ec070b70 2024-02-21T22:53:47.706 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.713+0000 7fb5f1036640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5ec15b390 con 0x7fb5ec15afb0 2024-02-21T22:53:47.706 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.713+0000 7fb5f1036640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5ec0713c0 con 0x7fb5ec071c90 2024-02-21T22:53:47.706 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.713+0000 7fb5ead9d640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fb5ec15afb0 0x7fb5ec0af080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:47.706 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.713+0000 7fb5ea59c640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7fb5ec070b70 0x7fb5ec071580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:47330/0 (socket says 172.21.15.116:47330) 2024-02-21T22:53:47.706 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.713+0000 7fb5ea59c640 1 -- 172.21.15.116:0/1417457502 learned_addr learned my addr 172.21.15.116:0/1417457502 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-02-21T22:53:47.706 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.713+0000 7fb5eb59e640 1 --2- 172.21.15.116:0/1417457502 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb5ec071c90 0x7fb5ec0b3860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:47.706 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.713+0000 7fb5ead9d640 1 -- 172.21.15.116:0/1417457502 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb5ec071c90 msgr2=0x7fb5ec0b3860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:53:47.706 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.713+0000 7fb5ead9d640 1 --2- 172.21.15.116:0/1417457502 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb5ec071c90 0x7fb5ec0b3860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:47.706 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.713+0000 7fb5ead9d640 1 -- 172.21.15.116:0/1417457502 >> v1:172.21.15.116:6789/0 conn(0x7fb5ec070b70 legacy=0x7fb5ec071580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:47.706 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.713+0000 7fb5ead9d640 1 -- 172.21.15.116:0/1417457502 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5ec0b2d80 con 0x7fb5ec15afb0 2024-02-21T22:53:47.706 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.713+0000 7fb5e9d9b640 1 -- 172.21.15.116:0/1417457502 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2790022598 0 0) 0x7fb5ec0710e0 con 0x7fb5ec070b70 2024-02-21T22:53:47.706 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.714+0000 7fb5ead9d640 1 --2- 172.21.15.116:0/1417457502 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb5ec15afb0 0x7fb5ec0af080 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fb5dc0097d0 tx=0x7fb5dc02b930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9e6b608abdaba04 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:47.706 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.714+0000 7fb5e9d9b640 1 -- 172.21.15.116:0/1417457502 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5dc035020 con 0x7fb5ec15afb0 2024-02-21T22:53:47.707 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.714+0000 7fb5e9d9b640 1 -- 172.21.15.116:0/1417457502 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5dc031890 con 0x7fb5ec15afb0 2024-02-21T22:53:47.707 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.714+0000 7fb5e9d9b640 1 -- 172.21.15.116:0/1417457502 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5dc031c60 con 0x7fb5ec15afb0 2024-02-21T22:53:47.707 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.715+0000 7fb5f1036640 1 -- 172.21.15.116:0/1417457502 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb5ec15afb0 msgr2=0x7fb5ec0af080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:47.707 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.715+0000 7fb5f1036640 1 --2- 172.21.15.116:0/1417457502 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb5ec15afb0 0x7fb5ec0af080 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fb5dc0097d0 tx=0x7fb5dc02b930 comp rx=0 tx=0).stop 2024-02-21T22:53:47.707 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.715+0000 7fb5f1036640 1 -- 172.21.15.116:0/1417457502 shutdown_connections 2024-02-21T22:53:47.707 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.715+0000 7fb5f1036640 1 --2- 172.21.15.116:0/1417457502 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb5ec071c90 0x7fb5ec0b3860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:47.707 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.715+0000 7fb5f1036640 1 --2- 172.21.15.116:0/1417457502 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb5ec15afb0 0x7fb5ec0af080 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:47.707 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.715+0000 7fb5f1036640 1 -- 172.21.15.116:0/1417457502 >> 172.21.15.116:0/1417457502 conn(0x7fb5ec0b18e0 msgr2=0x7fb5ec0b1cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:47.707 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.715+0000 7fb5f1036640 1 -- 172.21.15.116:0/1417457502 shutdown_connections 2024-02-21T22:53:47.707 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.715+0000 7fb5f1036640 1 -- 172.21.15.116:0/1417457502 wait complete. 2024-02-21T22:53:47.710 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.716+0000 7fb5f1036640 1 Processor -- start 2024-02-21T22:53:47.710 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.716+0000 7fb5f1036640 1 -- start start 2024-02-21T22:53:47.710 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.717+0000 7fb5f1036640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb5ec070b70 0x7fb5ec09c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:47.710 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.717+0000 7fb5f1036640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb5ec071c90 0x7fb5ec0cbd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:47.710 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.717+0000 7fb5f1036640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb5ec15afb0 0x7fb5ec0cc260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:47.710 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.717+0000 7fb5f1036640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5ec0af5c0 con 0x7fb5ec15afb0 2024-02-21T22:53:47.710 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.717+0000 7fb5f1036640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5ec0b3340 con 0x7fb5ec071c90 2024-02-21T22:53:47.710 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.717+0000 7fb5f1036640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5ec0b3da0 con 0x7fb5ec070b70 2024-02-21T22:53:47.711 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.717+0000 7fb5eb59e640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb5ec15afb0 0x7fb5ec0cc260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:47.711 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.717+0000 7fb5eb59e640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb5ec15afb0 0x7fb5ec0cc260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:40028/0 (socket says 172.21.15.116:40028) 2024-02-21T22:53:47.711 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.717+0000 7fb5eb59e640 1 -- 172.21.15.116:0/4118878891 learned_addr learned my addr 172.21.15.116:0/4118878891 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:47.711 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.717+0000 7fb5ead9d640 1 --2- 172.21.15.116:0/4118878891 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb5ec070b70 0x7fb5ec09c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:47.711 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.717+0000 7fb5ea59c640 1 --2- 172.21.15.116:0/4118878891 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb5ec071c90 0x7fb5ec0cbd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:47.711 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.717+0000 7fb5eb59e640 1 -- 172.21.15.116:0/4118878891 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb5ec070b70 msgr2=0x7fb5ec09c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:47.711 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.717+0000 7fb5eb59e640 1 --2- 172.21.15.116:0/4118878891 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb5ec070b70 0x7fb5ec09c420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:47.711 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.717+0000 7fb5eb59e640 1 -- 172.21.15.116:0/4118878891 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb5ec071c90 msgr2=0x7fb5ec0cbd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:47.711 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.717+0000 7fb5eb59e640 1 --2- 172.21.15.116:0/4118878891 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb5ec071c90 0x7fb5ec0cbd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:47.711 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.718+0000 7fb5eb59e640 1 -- 172.21.15.116:0/4118878891 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5ec09b660 con 0x7fb5ec15afb0 2024-02-21T22:53:47.711 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.718+0000 7fb5eb59e640 1 --2- 172.21.15.116:0/4118878891 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb5ec15afb0 0x7fb5ec0cc260 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fb5e400efc0 tx=0x7fb5e400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:47.711 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.718+0000 7fb5d37fe640 1 -- 172.21.15.116:0/4118878891 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5e4018020 con 0x7fb5ec15afb0 2024-02-21T22:53:47.711 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.718+0000 7fb5d37fe640 1 -- 172.21.15.116:0/4118878891 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5e4014480 con 0x7fb5ec15afb0 2024-02-21T22:53:47.711 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.718+0000 7fb5d37fe640 1 -- 172.21.15.116:0/4118878891 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5e4014870 con 0x7fb5ec15afb0 2024-02-21T22:53:47.712 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.718+0000 7fb5f1036640 1 -- 172.21.15.116:0/4118878891 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5ec09b940 con 0x7fb5ec15afb0 2024-02-21T22:53:47.712 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.718+0000 7fb5f1036640 1 -- 172.21.15.116:0/4118878891 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5ec0ccac0 con 0x7fb5ec15afb0 2024-02-21T22:53:47.712 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.719+0000 7fb5f1036640 1 -- 172.21.15.116:0/4118878891 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5ec06ed30 con 0x7fb5ec15afb0 2024-02-21T22:53:47.712 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.719+0000 7fb5d37fe640 1 -- 172.21.15.116:0/4118878891 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fb5e4005d10 con 0x7fb5ec15afb0 2024-02-21T22:53:47.712 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.720+0000 7fb5d37fe640 1 --2- 172.21.15.116:0/4118878891 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fb5d806b500 0x7fb5d806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:47.712 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.720+0000 7fb5d37fe640 1 -- 172.21.15.116:0/4118878891 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb5e408aec0 con 0x7fb5ec15afb0 2024-02-21T22:53:47.713 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.720+0000 7fb5ead9d640 1 --2- 172.21.15.116:0/4118878891 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fb5d806b500 0x7fb5d806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:47.713 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.721+0000 7fb5ead9d640 1 --2- 172.21.15.116:0/4118878891 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fb5d806b500 0x7fb5d806d9c0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fb5dc036000 tx=0x7fb5dc008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:47.714 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.724+0000 7fb5d37fe640 1 -- 172.21.15.116:0/4118878891 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7fb5ec06ed30 con 0x7fb5ec15afb0 2024-02-21T22:53:47.922 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.932+0000 7fb5f1036640 1 -- 172.21.15.116:0/4118878891 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fb5ec0752f0 con 0x7fb5ec15afb0 2024-02-21T22:53:47.922 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.932+0000 7fb5d37fe640 1 -- 172.21.15.116:0/4118878891 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v13) v1 ==== 53+0+73 (secure 0 0 0) 0x7fb5e4022030 con 0x7fb5ec15afb0 2024-02-21T22:53:47.922 INFO:teuthology.orchestra.run.smithi116.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-02-21T22:53:47.925 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.934+0000 7fb5f1036640 1 -- 172.21.15.116:0/4118878891 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fb5d806b500 msgr2=0x7fb5d806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:47.925 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.934+0000 7fb5f1036640 1 --2- 172.21.15.116:0/4118878891 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fb5d806b500 0x7fb5d806d9c0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fb5dc036000 tx=0x7fb5dc008030 comp rx=0 tx=0).stop 2024-02-21T22:53:47.925 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.934+0000 7fb5f1036640 1 -- 172.21.15.116:0/4118878891 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb5ec15afb0 msgr2=0x7fb5ec0cc260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:47.925 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.934+0000 7fb5f1036640 1 --2- 172.21.15.116:0/4118878891 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb5ec15afb0 0x7fb5ec0cc260 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fb5e400efc0 tx=0x7fb5e400c490 comp rx=0 tx=0).stop 2024-02-21T22:53:47.925 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.934+0000 7fb5f1036640 1 -- 172.21.15.116:0/4118878891 shutdown_connections 2024-02-21T22:53:47.925 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.934+0000 7fb5f1036640 1 --2- 172.21.15.116:0/4118878891 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb5ec15afb0 0x7fb5ec0cc260 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:47.925 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.934+0000 7fb5f1036640 1 --2- 172.21.15.116:0/4118878891 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb5ec071c90 0x7fb5ec0cbd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:47.925 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.934+0000 7fb5f1036640 1 --2- 172.21.15.116:0/4118878891 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fb5d806b500 0x7fb5d806d9c0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:47.925 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.934+0000 7fb5f1036640 1 --2- 172.21.15.116:0/4118878891 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb5ec070b70 0x7fb5ec09c420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:47.925 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.934+0000 7fb5f1036640 1 -- 172.21.15.116:0/4118878891 >> 172.21.15.116:0/4118878891 conn(0x7fb5ec0b18e0 msgr2=0x7fb5ec151e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:47.925 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.934+0000 7fb5f1036640 1 -- 172.21.15.116:0/4118878891 shutdown_connections 2024-02-21T22:53:47.926 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:47.934+0000 7fb5f1036640 1 -- 172.21.15.116:0/4118878891 wait complete. 2024-02-21T22:53:47.935 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-02-21T22:53:47.935 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-02-21T22:53:47.935 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi116.front.sepia.ceph.com 2024-02-21T22:53:47.935 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-02-21T22:53:47.935 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-02-21T22:53:47.936 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-02-21T22:53:47.936 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-02-21T22:53:47.936 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-02-21T22:53:47.936 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-02-21T22:53:47.936 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T22:53:47.936 DEBUG:teuthology.orchestra.run.smithi116:> ip addr 2024-02-21T22:53:47.952 INFO:teuthology.orchestra.run.smithi116.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-02-21T22:53:47.952 INFO:teuthology.orchestra.run.smithi116.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-02-21T22:53:47.952 INFO:teuthology.orchestra.run.smithi116.stdout: inet 127.0.0.1/8 scope host lo 2024-02-21T22:53:47.952 INFO:teuthology.orchestra.run.smithi116.stdout: valid_lft forever preferred_lft forever 2024-02-21T22:53:47.952 INFO:teuthology.orchestra.run.smithi116.stdout: inet6 ::1/128 scope host 2024-02-21T22:53:47.953 INFO:teuthology.orchestra.run.smithi116.stdout: valid_lft forever preferred_lft forever 2024-02-21T22:53:47.953 INFO:teuthology.orchestra.run.smithi116.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-21T22:53:47.953 INFO:teuthology.orchestra.run.smithi116.stdout: link/ether 0c:c4:7a:d8:cb:90 brd ff:ff:ff:ff:ff:ff 2024-02-21T22:53:47.953 INFO:teuthology.orchestra.run.smithi116.stdout: altname enp7s0f0 2024-02-21T22:53:47.953 INFO:teuthology.orchestra.run.smithi116.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-21T22:53:47.953 INFO:teuthology.orchestra.run.smithi116.stdout: link/ether 0c:c4:7a:d8:cb:91 brd ff:ff:ff:ff:ff:ff 2024-02-21T22:53:47.953 INFO:teuthology.orchestra.run.smithi116.stdout: altname enp7s0f1 2024-02-21T22:53:47.953 INFO:teuthology.orchestra.run.smithi116.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-21T22:53:47.953 INFO:teuthology.orchestra.run.smithi116.stdout: link/ether 0c:c4:7a:8f:3f:66 brd ff:ff:ff:ff:ff:ff 2024-02-21T22:53:47.953 INFO:teuthology.orchestra.run.smithi116.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-02-21T22:53:47.953 INFO:teuthology.orchestra.run.smithi116.stdout: link/ether 0c:c4:7a:8f:3f:67 brd ff:ff:ff:ff:ff:ff 2024-02-21T22:53:47.953 INFO:teuthology.orchestra.run.smithi116.stdout: inet 172.21.15.116/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-02-21T22:53:47.954 INFO:teuthology.orchestra.run.smithi116.stdout: valid_lft 42485sec preferred_lft 42485sec 2024-02-21T22:53:47.954 INFO:teuthology.orchestra.run.smithi116.stdout: inet6 fe80::ec4:7aff:fe8f:3f67/64 scope link 2024-02-21T22:53:47.954 INFO:teuthology.orchestra.run.smithi116.stdout: valid_lft forever preferred_lft forever 2024-02-21T22:53:47.954 INFO:teuthology.orchestra.run.smithi116.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-02-21T22:53:47.954 INFO:teuthology.orchestra.run.smithi116.stdout: link/ether 6a:39:28:96:b7:d3 brd ff:ff:ff:ff:ff:ff 2024-02-21T22:53:47.954 INFO:teuthology.orchestra.run.smithi116.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-02-21T22:53:47.954 INFO:teuthology.orchestra.run.smithi116.stdout: valid_lft forever preferred_lft forever 2024-02-21T22:53:47.954 INFO:teuthology.orchestra.run.smithi116.stdout: inet6 fe80::f4cc:18ff:febe:37e0/64 scope link 2024-02-21T22:53:47.954 INFO:teuthology.orchestra.run.smithi116.stdout: valid_lft forever preferred_lft forever 2024-02-21T22:53:47.954 INFO:teuthology.orchestra.run.smithi116.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-02-21T22:53:47.954 INFO:teuthology.orchestra.run.smithi116.stdout: link/ether de:81:e7:70:c4:02 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-02-21T22:53:47.954 INFO:teuthology.orchestra.run.smithi116.stdout: inet6 fe80::dc81:e7ff:fe70:c402/64 scope link 2024-02-21T22:53:47.955 INFO:teuthology.orchestra.run.smithi116.stdout: valid_lft forever preferred_lft forever 2024-02-21T22:53:47.955 INFO:teuthology.orchestra.run.smithi116.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-02-21T22:53:47.955 INFO:teuthology.orchestra.run.smithi116.stdout: link/ether 6a:39:28:96:b7:d3 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-02-21T22:53:47.955 INFO:teuthology.orchestra.run.smithi116.stdout: inet6 fe80::6839:28ff:fe96:b7d3/64 scope link 2024-02-21T22:53:47.955 INFO:teuthology.orchestra.run.smithi116.stdout: valid_lft forever preferred_lft forever 2024-02-21T22:53:47.955 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T22:53:47.955 DEBUG:teuthology.orchestra.run.smithi116:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-02-21T22:53:47.961 INFO:tasks.ceph.mds.d.smithi142.stderr:2024-02-21T22:53:47.971+0000 7f38d65e5640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-02-21T22:53:48.019 INFO:teuthology.orchestra.run.smithi116.stdout:1 2024-02-21T22:53:48.021 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T22:53:48.021 DEBUG:teuthology.orchestra.run.smithi116:> route 2024-02-21T22:53:48.078 INFO:teuthology.orchestra.run.smithi116.stdout:Kernel IP routing table 2024-02-21T22:53:48.078 INFO:teuthology.orchestra.run.smithi116.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-02-21T22:53:48.078 INFO:teuthology.orchestra.run.smithi116.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-02-21T22:53:48.078 INFO:teuthology.orchestra.run.smithi116.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-02-21T22:53:48.078 INFO:teuthology.orchestra.run.smithi116.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-02-21T22:53:48.079 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T22:53:48.079 DEBUG:teuthology.orchestra.run.smithi116:> (cd / && exec bash -c ' 2024-02-21T22:53:48.079 DEBUG:teuthology.orchestra.run.smithi116:> set -e 2024-02-21T22:53:48.079 DEBUG:teuthology.orchestra.run.smithi116:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-02-21T22:53:48.079 DEBUG:teuthology.orchestra.run.smithi116:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-02-21T22:53:48.079 DEBUG:teuthology.orchestra.run.smithi116:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-02-21T22:53:48.079 DEBUG:teuthology.orchestra.run.smithi116:> ') 2024-02-21T22:53:48.174 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T22:53:48.174 DEBUG:teuthology.orchestra.run.smithi116:> ip netns list 2024-02-21T22:53:48.189 INFO:teuthology.orchestra.run.smithi116.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-02-21T22:53:48.189 INFO:teuthology.orchestra.run.smithi116.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-02-21T22:53:48.189 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-02-21T22:53:48.189 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T22:53:48.189 DEBUG:teuthology.orchestra.run.smithi116:> sudo ip link set brx.0 up 2024-02-21T22:53:48.257 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-02-21T22:53:48.257 DEBUG:teuthology.orchestra.run.smithi116:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-02-21T22:53:48.313 INFO:teuthology.orchestra.run.smithi116.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-02-21T22:53:48.314 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-02-21T22:53:48.314 DEBUG:teuthology.orchestra.run.smithi116:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-02-21T22:53:48.369 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-02-21T22:53:48.369 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T22:53:48.369 DEBUG:teuthology.orchestra.run.smithi116:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-02-21T22:53:48.453 INFO:teuthology.orchestra.run.smithi116.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-02-21T22:53:48.454 INFO:teuthology.orchestra.run.smithi116.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-02-21T22:53:48.462 INFO:teuthology.orchestra.run.smithi116.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-02-21T22:53:48.462 INFO:teuthology.orchestra.run.smithi116.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-02-21T22:53:48.462 INFO:teuthology.orchestra.run.smithi116.stdout:mount.ceph: resolved to: "172.21.15.116:3300,172.21.15.142:3300,172.21.15.142:3301" 2024-02-21T22:53:48.462 INFO:teuthology.orchestra.run.smithi116.stdout:mount.ceph: trying mount with new device syntax: 0@7c298660-5f63-4b5c-a800-58c5be9a8445.cephfs=/ 2024-02-21T22:53:48.462 INFO:teuthology.orchestra.run.smithi116.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.116:3300/172.21.15.142:3300/172.21.15.142:3301" will pass to kernel 2024-02-21T22:53:48.462 INFO:teuthology.orchestra.run.smithi116.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-02-21T22:53:48.463 INFO:teuthology.orchestra.run.smithi116.stdout: You just mounted a file system that supports labels which does not 2024-02-21T22:53:48.463 INFO:teuthology.orchestra.run.smithi116.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-02-21T22:53:48.463 INFO:teuthology.orchestra.run.smithi116.stdout: applications will generate AVC messages and not be allowed access to 2024-02-21T22:53:48.463 INFO:teuthology.orchestra.run.smithi116.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-02-21T22:53:48.465 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-02-21T22:53:48.465 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T22:53:48.465 DEBUG:teuthology.orchestra.run.smithi116:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-02-21T22:53:48.492 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T22:53:48.493 DEBUG:teuthology.orchestra.run.smithi116:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-02-21T22:53:48.554 INFO:teuthology.orchestra.run.smithi116.stdout:client4934 2024-02-21T22:53:48.554 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-02-21T22:53:48.554 DEBUG:teuthology.orchestra.run.smithi116:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-21T22:53:48.610 DEBUG:teuthology.orchestra.run.smithi116:> mktemp -d --suffix=xfstests-dev 2024-02-21T22:53:48.665 INFO:teuthology.orchestra.run.smithi116.stdout:/tmp/tmp.inknytwQo2xfstests-dev 2024-02-21T22:53:48.665 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T22:53:48.665 DEBUG:teuthology.orchestra.run.smithi116:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo chmod a+rx /tmp/tmp.inknytwQo2xfstests-dev) 2024-02-21T22:53:48.733 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T22:53:48.733 DEBUG:teuthology.orchestra.run.smithi116:> (cd /home/ubuntu/cephtest/mnt.0 && exec git clone https://git.ceph.com/xfstests-dev.git --depth 1 /tmp/tmp.inknytwQo2xfstests-dev) 2024-02-21T22:53:48.791 INFO:teuthology.orchestra.run.smithi116.stderr:Cloning into '/tmp/tmp.inknytwQo2xfstests-dev'... 2024-02-21T22:53:49.495 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T22:53:49.495 DEBUG:teuthology.orchestra.run.smithi116:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir test) 2024-02-21T22:53:49.554 DEBUG:teuthology.orchestra.run.smithi116:> mktemp -d --suffix=test 2024-02-21T22:53:49.610 INFO:teuthology.orchestra.run.smithi116.stdout:/tmp/tmp.EXGF1MAbSQtest 2024-02-21T22:53:49.610 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T22:53:49.610 DEBUG:teuthology.orchestra.run.smithi116:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir scratch) 2024-02-21T22:53:49.666 DEBUG:teuthology.orchestra.run.smithi116:> mktemp -d --suffix=scratch 2024-02-21T22:53:49.722 INFO:teuthology.orchestra.run.smithi116.stdout:/tmp/tmp.5JenwkEYaGscratch 2024-02-21T22:53:49.722 INFO:tasks.cephfs.xfstests_dev:distro and version detected is "centos" and "9". 2024-02-21T22:53:49.723 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum install -y acl attr automake bc dbench dump e2fsprogs fio gawk gcc gdbm-devel git indent kernel-devel libacl-devel libaio-devel libcap-devel libtool libuuid-devel lvm2 make psmisc python3 quota sed sqlite udftools xfsprogs 2024-02-21T22:53:50.380 INFO:teuthology.orchestra.run.smithi116.stdout:Last metadata expiration check: 0:03:28 ago on Wed 21 Feb 2024 10:50:22 PM UTC. 2024-02-21T22:53:50.682 INFO:teuthology.orchestra.run.smithi116.stderr:Modular dependency problems: 2024-02-21T22:53:50.683 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-02-21T22:53:50.683 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 1: conflicting requests 2024-02-21T22:53:50.683 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240219154654:20125149.x86_64 from CentOS-AppStream 2024-02-21T22:53:50.683 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 2: conflicting requests 2024-02-21T22:53:50.683 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-21T22:53:50.683 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 3: conflicting requests 2024-02-21T22:53:50.683 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-21T22:53:50.683 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 4: conflicting requests 2024-02-21T22:53:50.683 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-21T22:53:50.683 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 5: conflicting requests 2024-02-21T22:53:50.684 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-21T22:53:50.684 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 6: conflicting requests 2024-02-21T22:53:50.684 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-21T22:53:50.684 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 7: conflicting requests 2024-02-21T22:53:50.684 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-21T22:53:50.684 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 8: conflicting requests 2024-02-21T22:53:50.684 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-21T22:53:50.684 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 9: conflicting requests 2024-02-21T22:53:50.684 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-21T22:53:50.684 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 10: conflicting requests 2024-02-21T22:53:50.684 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-21T22:53:50.684 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 11: conflicting requests 2024-02-21T22:53:50.685 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-21T22:53:50.685 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 12: conflicting requests 2024-02-21T22:53:50.685 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-21T22:53:50.685 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 13: conflicting requests 2024-02-21T22:53:50.685 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-21T22:53:50.685 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 14: conflicting requests 2024-02-21T22:53:50.685 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-21T22:53:50.685 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 15: conflicting requests 2024-02-21T22:53:50.685 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-21T22:53:50.685 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 16: conflicting requests 2024-02-21T22:53:50.685 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-21T22:53:50.685 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 17: conflicting requests 2024-02-21T22:53:50.686 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-21T22:53:50.686 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 18: conflicting requests 2024-02-21T22:53:50.686 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-21T22:53:50.686 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 19: conflicting requests 2024-02-21T22:53:50.686 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-21T22:53:50.686 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 20: conflicting requests 2024-02-21T22:53:50.686 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-21T22:53:50.686 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 21: conflicting requests 2024-02-21T22:53:50.686 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-21T22:53:50.686 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 22: conflicting requests 2024-02-21T22:53:50.687 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-21T22:53:50.687 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 23: conflicting requests 2024-02-21T22:53:50.687 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-21T22:53:50.687 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 24: conflicting requests 2024-02-21T22:53:50.687 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-21T22:53:50.687 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 25: conflicting requests 2024-02-21T22:53:50.687 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-21T22:53:50.687 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 26: conflicting requests 2024-02-21T22:53:50.687 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-21T22:53:50.687 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 27: conflicting requests 2024-02-21T22:53:50.687 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-21T22:53:50.688 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 28: conflicting requests 2024-02-21T22:53:50.688 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-21T22:53:50.688 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 29: conflicting requests 2024-02-21T22:53:50.688 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-21T22:53:50.688 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 30: conflicting requests 2024-02-21T22:53:50.688 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-21T22:53:50.688 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 31: conflicting requests 2024-02-21T22:53:50.688 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-21T22:53:50.688 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 32: conflicting requests 2024-02-21T22:53:50.688 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-21T22:53:50.688 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 33: conflicting requests 2024-02-21T22:53:50.688 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-21T22:53:50.689 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 34: conflicting requests 2024-02-21T22:53:50.689 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-21T22:53:50.689 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 35: conflicting requests 2024-02-21T22:53:50.689 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240203221207:9edba152.x86_64 from CentOS-AppStream 2024-02-21T22:53:50.689 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 36: conflicting requests 2024-02-21T22:53:50.689 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-21T22:53:50.689 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-21T22:53:50.689 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-21T22:53:50.689 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 37: cannot install the best candidate for the job 2024-02-21T22:53:50.689 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-21T22:53:50.689 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-21T22:53:50.690 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-21T22:53:50.690 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-21T22:53:50.690 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 38: conflicting requests 2024-02-21T22:53:50.690 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-21T22:53:50.690 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-21T22:53:50.690 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-21T22:53:50.690 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-21T22:53:50.690 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-21T22:53:50.690 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-21T22:53:50.690 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 39: cannot install the best candidate for the job 2024-02-21T22:53:50.690 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-21T22:53:50.690 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-21T22:53:50.691 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-21T22:53:50.691 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-21T22:53:50.691 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 40: cannot install the best candidate for the job 2024-02-21T22:53:50.691 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-21T22:53:50.691 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-21T22:53:50.691 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-21T22:53:50.691 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-21T22:53:50.691 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 41: cannot install the best candidate for the job 2024-02-21T22:53:50.691 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-21T22:53:50.691 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-21T22:53:50.691 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-21T22:53:50.692 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-21T22:53:50.692 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 42: cannot install the best candidate for the job 2024-02-21T22:53:50.692 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-21T22:53:50.692 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-21T22:53:50.692 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-21T22:53:50.692 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-21T22:53:50.692 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 43: cannot install the best candidate for the job 2024-02-21T22:53:50.692 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-21T22:53:50.692 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-21T22:53:50.692 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-21T22:53:50.692 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-21T22:53:50.692 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 44: cannot install the best candidate for the job 2024-02-21T22:53:50.693 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-21T22:53:50.693 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-21T22:53:50.693 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-21T22:53:50.693 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-21T22:53:50.694 INFO:teuthology.orchestra.run.smithi116.stdout:Package acl-2.3.1-4.el9.x86_64 is already installed. 2024-02-21T22:53:50.694 INFO:teuthology.orchestra.run.smithi116.stdout:Package attr-2.5.1-3.el9.x86_64 is already installed. 2024-02-21T22:53:50.694 INFO:teuthology.orchestra.run.smithi116.stdout:Package automake-1.16.2-8.el9.noarch is already installed. 2024-02-21T22:53:50.694 INFO:teuthology.orchestra.run.smithi116.stdout:Package bc-1.07.1-14.el9.x86_64 is already installed. 2024-02-21T22:53:50.694 INFO:teuthology.orchestra.run.smithi116.stdout:Package dbench-4.0-25.el9.x86_64 is already installed. 2024-02-21T22:53:50.694 INFO:teuthology.orchestra.run.smithi116.stdout:Package e2fsprogs-1.46.5-3.el9.x86_64 is already installed. 2024-02-21T22:53:50.695 INFO:teuthology.orchestra.run.smithi116.stdout:Package gawk-5.1.0-6.el9.x86_64 is already installed. 2024-02-21T22:53:50.696 INFO:teuthology.orchestra.run.smithi116.stdout:Package gcc-11.4.1-2.1.el9.x86_64 is already installed. 2024-02-21T22:53:50.698 INFO:teuthology.orchestra.run.smithi116.stdout:Package git-2.39.3-1.el9.x86_64 is already installed. 2024-02-21T22:53:50.700 INFO:teuthology.orchestra.run.smithi116.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-02-21T22:53:50.701 INFO:teuthology.orchestra.run.smithi116.stdout:Package libaio-devel-0.3.112-1.el8.x86_64 is already installed. 2024-02-21T22:53:50.703 INFO:teuthology.orchestra.run.smithi116.stdout:Package libtool-2.4.6-45.el9.x86_64 is already installed. 2024-02-21T22:53:50.704 INFO:teuthology.orchestra.run.smithi116.stdout:Package libuuid-devel-2.37.4-15.el9.x86_64 is already installed. 2024-02-21T22:53:50.706 INFO:teuthology.orchestra.run.smithi116.stdout:Package lvm2-9:2.03.21-3.el9.x86_64 is already installed. 2024-02-21T22:53:50.707 INFO:teuthology.orchestra.run.smithi116.stdout:Package make-1:4.3-7.el9.x86_64 is already installed. 2024-02-21T22:53:50.708 INFO:teuthology.orchestra.run.smithi116.stdout:Package psmisc-23.4-3.el9.x86_64 is already installed. 2024-02-21T22:53:50.709 INFO:teuthology.orchestra.run.smithi116.stdout:Package python3-3.9.17-2.el9.x86_64 is already installed. 2024-02-21T22:53:50.710 INFO:teuthology.orchestra.run.smithi116.stdout:Package quota-1:4.06-6.el9.x86_64 is already installed. 2024-02-21T22:53:50.711 INFO:teuthology.orchestra.run.smithi116.stdout:Package sed-4.8-9.el9.x86_64 is already installed. 2024-02-21T22:53:50.714 INFO:teuthology.orchestra.run.smithi116.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-02-21T22:53:50.799 INFO:teuthology.orchestra.run.smithi116.stderr:Error: 2024-02-21T22:53:50.800 INFO:teuthology.orchestra.run.smithi116.stderr: Problem: package python3-libs-3.9.18-3.el9.x86_64 from baseos requires libreadline.so.8()(64bit), but none of the providers can be installed 2024-02-21T22:53:50.800 INFO:teuthology.orchestra.run.smithi116.stderr: - cannot install both readline-7.0-10.el8.x86_64 from CentOS-BaseOS and readline-8.1-4.el9.x86_64 from @System 2024-02-21T22:53:50.800 INFO:teuthology.orchestra.run.smithi116.stderr: - cannot install both readline-8.1-4.el9.x86_64 from baseos and readline-7.0-10.el8.x86_64 from CentOS-BaseOS 2024-02-21T22:53:50.800 INFO:teuthology.orchestra.run.smithi116.stderr: - package udftools-2.3-2.el8.x86_64 from CentOS-AppStream requires libreadline.so.7()(64bit), but none of the providers can be installed 2024-02-21T22:53:50.800 INFO:teuthology.orchestra.run.smithi116.stderr: - package python3-3.9.18-3.el9.x86_64 from baseos requires python3-libs(x86-64) = 3.9.18-3.el9, but none of the providers can be installed 2024-02-21T22:53:50.800 INFO:teuthology.orchestra.run.smithi116.stderr: - cannot install the best candidate for the job 2024-02-21T22:53:50.800 INFO:teuthology.orchestra.run.smithi116.stdout:(try to add '--allowerasing' to command line to replace conflicting packages or '--skip-broken' to skip uninstallable packages or '--nobest' to use not only best candidate packages) 2024-02-21T22:53:50.836 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-21T22:53:50.838 INFO:tasks.cephfs_test_runner:test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) ... ERROR 2024-02-21T22:53:50.838 INFO:tasks.cephfs_test_runner: 2024-02-21T22:53:50.839 INFO:tasks.cephfs_test_runner:====================================================================== 2024-02-21T22:53:50.839 INFO:tasks.cephfs_test_runner:ERROR: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2024-02-21T22:53:50.839 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-02-21T22:53:50.839 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-02-21T22:53:50.839 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_3bfc837d7b45ce8e095d92fa9c342964cea5e95f/qa/tasks/cephfs/xfstests_dev.py", line 29, in setUp 2024-02-21T22:53:50.839 INFO:tasks.cephfs_test_runner: self.prepare_xfstests_devs() 2024-02-21T22:53:50.839 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_3bfc837d7b45ce8e095d92fa9c342964cea5e95f/qa/tasks/cephfs/xfstests_dev.py", line 44, in prepare_xfstests_devs 2024-02-21T22:53:50.839 INFO:tasks.cephfs_test_runner: self.install_deps() 2024-02-21T22:53:50.839 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_3bfc837d7b45ce8e095d92fa9c342964cea5e95f/qa/tasks/cephfs/xfstests_dev.py", line 252, in install_deps 2024-02-21T22:53:50.839 INFO:tasks.cephfs_test_runner: self.mount_a.client_remote.run(args=args, omit_sudo=False) 2024-02-21T22:53:50.839 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/remote.py", line 523, in run 2024-02-21T22:53:50.839 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2024-02-21T22:53:50.839 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 455, in run 2024-02-21T22:53:50.839 INFO:tasks.cephfs_test_runner: r.wait() 2024-02-21T22:53:50.839 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 161, in wait 2024-02-21T22:53:50.839 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2024-02-21T22:53:50.840 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 181, in _raise_for_status 2024-02-21T22:53:50.840 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2024-02-21T22:53:50.840 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi116 with status 1: 'sudo yum install -y acl attr automake bc dbench dump e2fsprogs fio gawk gcc gdbm-devel git indent kernel-devel libacl-devel libaio-devel libcap-devel libtool libuuid-devel lvm2 make psmisc python3 quota sed sqlite udftools xfsprogs' 2024-02-21T22:53:50.840 INFO:tasks.cephfs_test_runner: 2024-02-21T22:53:50.840 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-02-21T22:53:50.840 INFO:tasks.cephfs_test_runner:Ran 1 test in 31.194s 2024-02-21T22:53:50.840 INFO:tasks.cephfs_test_runner: 2024-02-21T22:53:50.840 INFO:tasks.cephfs_test_runner:FAILED (errors=1) 2024-02-21T22:53:50.840 INFO:tasks.cephfs_test_runner: 2024-02-21T22:53:50.841 INFO:tasks.cephfs_test_runner:====================================================================== 2024-02-21T22:53:50.841 INFO:tasks.cephfs_test_runner:ERROR: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2024-02-21T22:53:50.841 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-02-21T22:53:50.841 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-02-21T22:53:50.841 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_3bfc837d7b45ce8e095d92fa9c342964cea5e95f/qa/tasks/cephfs/xfstests_dev.py", line 29, in setUp 2024-02-21T22:53:50.841 INFO:tasks.cephfs_test_runner: self.prepare_xfstests_devs() 2024-02-21T22:53:50.841 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_3bfc837d7b45ce8e095d92fa9c342964cea5e95f/qa/tasks/cephfs/xfstests_dev.py", line 44, in prepare_xfstests_devs 2024-02-21T22:53:50.841 INFO:tasks.cephfs_test_runner: self.install_deps() 2024-02-21T22:53:50.841 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_3bfc837d7b45ce8e095d92fa9c342964cea5e95f/qa/tasks/cephfs/xfstests_dev.py", line 252, in install_deps 2024-02-21T22:53:50.842 INFO:tasks.cephfs_test_runner: self.mount_a.client_remote.run(args=args, omit_sudo=False) 2024-02-21T22:53:50.842 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/remote.py", line 523, in run 2024-02-21T22:53:50.842 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2024-02-21T22:53:50.842 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 455, in run 2024-02-21T22:53:50.842 INFO:tasks.cephfs_test_runner: r.wait() 2024-02-21T22:53:50.842 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 161, in wait 2024-02-21T22:53:50.842 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2024-02-21T22:53:50.842 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 181, in _raise_for_status 2024-02-21T22:53:50.842 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2024-02-21T22:53:50.842 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi116 with status 1: 'sudo yum install -y acl attr automake bc dbench dump e2fsprogs fio gawk gcc gdbm-devel git indent kernel-devel libacl-devel libaio-devel libcap-devel libtool libuuid-devel lvm2 make psmisc python3 quota sed sqlite udftools xfsprogs' 2024-02-21T22:53:50.842 INFO:tasks.cephfs_test_runner: 2024-02-21T22:53:50.843 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_3bfc837d7b45ce8e095d92fa9c342964cea5e95f/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2024-02-21T22:53:51.121 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=b5029807d21e46418a3ae52b5ed55054 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_3bfc837d7b45ce8e095d92fa9c342964cea5e95f/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2024-02-21T22:53:51.123 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-02-21T22:53:51.133 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-02-21T22:53:51.154 INFO:tasks.kclient:Unmounting kernel clients... 2024-02-21T22:53:51.155 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-02-21T22:53:51.155 DEBUG:teuthology.orchestra.run.smithi116:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-21T22:53:51.184 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-02-21T22:53:51.184 DEBUG:teuthology.orchestra.run.smithi116:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-21T22:53:51.240 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-21T22:53:51.381 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.390+0000 7f2e8f036640 1 Processor -- start 2024-02-21T22:53:51.381 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.390+0000 7f2e8f036640 1 -- start start 2024-02-21T22:53:51.383 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.391+0000 7f2e8f036640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f2e8815e2d0 0x7f2e880d0930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:51.384 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.391+0000 7f2e8f036640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f2e8806fd30 0x7f2e8806cd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:51.384 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.391+0000 7f2e8f036640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e880d1180 con 0x7f2e8806ee20 2024-02-21T22:53:51.384 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.391+0000 7f2e8f036640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e8806bf50 con 0x7f2e8815e2d0 2024-02-21T22:53:51.384 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.391+0000 7f2e8f036640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e8806c230 con 0x7f2e8806fd30 2024-02-21T22:53:51.384 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.391+0000 7f2e8cdd2640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f2e8815e2d0 0x7f2e880d0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:51.384 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.391+0000 7f2e8cdd2640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f2e8815e2d0 0x7f2e880d0930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:40030/0 (socket says 172.21.15.116:40030) 2024-02-21T22:53:51.384 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.391+0000 7f2e8cdd2640 1 -- 172.21.15.116:0/2830246384 learned_addr learned my addr 172.21.15.116:0/2830246384 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:51.385 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.391+0000 7f2e8d5d3640 1 --2- 172.21.15.116:0/2830246384 >> v2:172.21.15.142:3300/0 conn(0x7f2e8806fd30 0x7f2e8806cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:51.385 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.392+0000 7f2e8cdd2640 1 -- 172.21.15.116:0/2830246384 >> v2:172.21.15.142:3300/0 conn(0x7f2e8806fd30 msgr2=0x7f2e8806cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:53:51.385 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.392+0000 7f2e8cdd2640 1 --2- 172.21.15.116:0/2830246384 >> v2:172.21.15.142:3300/0 conn(0x7f2e8806fd30 0x7f2e8806cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:51.386 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.392+0000 7f2e8cdd2640 1 -- 172.21.15.116:0/2830246384 >> v1:172.21.15.142:6789/0 conn(0x7f2e8806ee20 legacy=0x7f2e8806f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:51.386 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.392+0000 7f2e8cdd2640 1 -- 172.21.15.116:0/2830246384 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e8806c510 con 0x7f2e8815e2d0 2024-02-21T22:53:51.386 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.392+0000 7f2e8cdd2640 1 --2- 172.21.15.116:0/2830246384 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2e8815e2d0 0x7f2e880d0930 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f2e78009870 tx=0x7f2e7802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f92f23e027001222 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:51.386 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.392+0000 7f2e877fe640 1 -- 172.21.15.116:0/2830246384 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e78034070 con 0x7f2e8815e2d0 2024-02-21T22:53:51.386 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.392+0000 7f2e877fe640 1 -- 172.21.15.116:0/2830246384 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e78030860 con 0x7f2e8815e2d0 2024-02-21T22:53:51.386 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.392+0000 7f2e877fe640 1 -- 172.21.15.116:0/2830246384 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e78030c30 con 0x7f2e8815e2d0 2024-02-21T22:53:51.386 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.393+0000 7f2e8f036640 1 -- 172.21.15.116:0/2830246384 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2e8815e2d0 msgr2=0x7f2e880d0930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:51.386 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.393+0000 7f2e8f036640 1 --2- 172.21.15.116:0/2830246384 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2e8815e2d0 0x7f2e880d0930 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f2e78009870 tx=0x7f2e7802b9a0 comp rx=0 tx=0).stop 2024-02-21T22:53:51.387 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.393+0000 7f2e8f036640 1 -- 172.21.15.116:0/2830246384 shutdown_connections 2024-02-21T22:53:51.387 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.393+0000 7f2e8f036640 1 --2- 172.21.15.116:0/2830246384 >> v2:172.21.15.142:3300/0 conn(0x7f2e8806fd30 0x7f2e8806cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:51.387 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.393+0000 7f2e8f036640 1 --2- 172.21.15.116:0/2830246384 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2e8815e2d0 0x7f2e880d0930 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:51.387 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.393+0000 7f2e8f036640 1 -- 172.21.15.116:0/2830246384 >> 172.21.15.116:0/2830246384 conn(0x7f2e880b3730 msgr2=0x7f2e880b3b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:51.387 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.393+0000 7f2e8f036640 1 -- 172.21.15.116:0/2830246384 shutdown_connections 2024-02-21T22:53:51.387 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.393+0000 7f2e8f036640 1 -- 172.21.15.116:0/2830246384 wait complete. 2024-02-21T22:53:51.390 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.394+0000 7f2e8f036640 1 Processor -- start 2024-02-21T22:53:51.391 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.394+0000 7f2e8f036640 1 -- start start 2024-02-21T22:53:51.391 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.395+0000 7f2e8f036640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2e8806ee20 0x7f2e880b74d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:51.391 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.395+0000 7f2e8f036640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2e8806fd30 0x7f2e880b4710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:51.391 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.395+0000 7f2e8f036640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2e8815e2d0 0x7f2e880b2b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:51.391 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.395+0000 7f2e8f036640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e8806d250 con 0x7f2e8815e2d0 2024-02-21T22:53:51.391 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.395+0000 7f2e8f036640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e880d0e70 con 0x7f2e8806fd30 2024-02-21T22:53:51.391 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.395+0000 7f2e8f036640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e8806d3d0 con 0x7f2e8806ee20 2024-02-21T22:53:51.391 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.395+0000 7f2e8d5d3640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2e8815e2d0 0x7f2e880b2b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:51.392 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.395+0000 7f2e8d5d3640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2e8815e2d0 0x7f2e880b2b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:40042/0 (socket says 172.21.15.116:40042) 2024-02-21T22:53:51.392 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.395+0000 7f2e8d5d3640 1 -- 172.21.15.116:0/1303161303 learned_addr learned my addr 172.21.15.116:0/1303161303 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:51.392 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.395+0000 7f2e87fff640 1 --2- 172.21.15.116:0/1303161303 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2e8806fd30 0x7f2e880b4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:51.392 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.395+0000 7f2e8cdd2640 1 --2- 172.21.15.116:0/1303161303 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2e8806ee20 0x7f2e880b74d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:51.392 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.395+0000 7f2e8d5d3640 1 -- 172.21.15.116:0/1303161303 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2e8806ee20 msgr2=0x7f2e880b74d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:51.392 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.395+0000 7f2e8d5d3640 1 --2- 172.21.15.116:0/1303161303 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2e8806ee20 0x7f2e880b74d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:51.392 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.395+0000 7f2e8d5d3640 1 -- 172.21.15.116:0/1303161303 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2e8806fd30 msgr2=0x7f2e880b4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:51.392 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.395+0000 7f2e8d5d3640 1 --2- 172.21.15.116:0/1303161303 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2e8806fd30 0x7f2e880b4710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:51.393 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.395+0000 7f2e8d5d3640 1 -- 172.21.15.116:0/1303161303 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e880b4c50 con 0x7f2e8815e2d0 2024-02-21T22:53:51.393 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.395+0000 7f2e8d5d3640 1 --2- 172.21.15.116:0/1303161303 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2e8815e2d0 0x7f2e880b2b20 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f2e80009e30 tx=0x7f2e8000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:51.393 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.396+0000 7f2e857fa640 1 -- 172.21.15.116:0/1303161303 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e80018020 con 0x7f2e8815e2d0 2024-02-21T22:53:51.393 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.396+0000 7f2e857fa640 1 -- 172.21.15.116:0/1303161303 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e80014480 con 0x7f2e8815e2d0 2024-02-21T22:53:51.393 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.396+0000 7f2e857fa640 1 -- 172.21.15.116:0/1303161303 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e80014870 con 0x7f2e8815e2d0 2024-02-21T22:53:51.393 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.396+0000 7f2e8f036640 1 -- 172.21.15.116:0/1303161303 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e880b4f20 con 0x7f2e8815e2d0 2024-02-21T22:53:51.393 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.396+0000 7f2e8f036640 1 -- 172.21.15.116:0/1303161303 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e88158be0 con 0x7f2e8815e2d0 2024-02-21T22:53:51.393 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.397+0000 7f2e8f036640 1 -- 172.21.15.116:0/1303161303 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e880752f0 con 0x7f2e8815e2d0 2024-02-21T22:53:51.394 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.397+0000 7f2e857fa640 1 -- 172.21.15.116:0/1303161303 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f2e80005d10 con 0x7f2e8815e2d0 2024-02-21T22:53:51.394 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.397+0000 7f2e857fa640 1 --2- 172.21.15.116:0/1303161303 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f2e7406b4d0 0x7f2e7406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:51.394 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.397+0000 7f2e857fa640 1 -- 172.21.15.116:0/1303161303 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2e8008ae90 con 0x7f2e8815e2d0 2024-02-21T22:53:51.394 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.398+0000 7f2e8cdd2640 1 --2- 172.21.15.116:0/1303161303 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f2e7406b4d0 0x7f2e7406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:51.394 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.398+0000 7f2e8cdd2640 1 --2- 172.21.15.116:0/1303161303 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f2e7406b4d0 0x7f2e7406d990 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f2e78036000 tx=0x7f2e7803b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:51.395 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.402+0000 7f2e857fa640 1 -- 172.21.15.116:0/1303161303 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f2e80022030 con 0x7f2e8815e2d0 2024-02-21T22:53:51.563 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.573+0000 7f2e8f036640 1 -- 172.21.15.116:0/1303161303 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2e880b0fe0 con 0x7f2e8815e2d0 2024-02-21T22:53:51.565 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.574+0000 7f2e857fa640 1 -- 172.21.15.116:0/1303161303 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+16717 (secure 0 0 0) 0x7f2e80010040 con 0x7f2e8815e2d0 2024-02-21T22:53:51.565 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-02-21T22:53:51.565 INFO:teuthology.orchestra.run.smithi116.stdout:{"epoch":33,"fsid":"7c298660-5f63-4b5c-a800-58c5be9a8445","created":"2024-02-21T22:52:25.994613+0000","modified":"2024-02-21T22:53:43.986422+0000","last_up_change":"2024-02-21T22:52:37.313595+0000","last_in_change":"2024-02-21T22:52:28.176031+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-21T22:52:38.328796+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-02-21T22:53:40.752689+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-02-21T22:53:41.300199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4f09126b-b5e4-4876-8b08-f5cbb967388a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":1613202231},{"type":"v1","addr":"172.21.15.116:6809","nonce":1613202231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":1613202231},{"type":"v1","addr":"172.21.15.116:6811","nonce":1613202231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":1613202231},{"type":"v1","addr":"172.21.15.116:6815","nonce":1613202231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":1613202231},{"type":"v1","addr":"172.21.15.116:6813","nonce":1613202231}]},"public_addr":"172.21.15.116:6809/1613202231","cluster_addr":"172.21.15.116:6811/1613202231","heartbeat_back_addr":"172.21.15.116:6815/1613202231","heartbeat_front_addr":"172.21.15.116:6813/1613202231","state":["exists","up"]},{"osd":1,"uuid":"7272c51d-51f9-4536-931d-33ad7a4b377e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6816","nonce":172614746},{"type":"v1","addr":"172.21.15.116:6817","nonce":172614746}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":172614746},{"type":"v1","addr":"172.21.15.116:6819","nonce":172614746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":172614746},{"type":"v1","addr":"172.21.15.116:6823","nonce":172614746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":172614746},{"type":"v1","addr":"172.21.15.116:6821","nonce":172614746}]},"public_addr":"172.21.15.116:6817/172614746","cluster_addr":"172.21.15.116:6819/172614746","heartbeat_back_addr":"172.21.15.116:6823/172614746","heartbeat_front_addr":"172.21.15.116:6821/172614746","state":["exists","up"]},{"osd":2,"uuid":"2589616c-adf1-4187-aac3-735256cf624b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":1029280577},{"type":"v1","addr":"172.21.15.116:6825","nonce":1029280577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":1029280577},{"type":"v1","addr":"172.21.15.116:6827","nonce":1029280577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":1029280577},{"type":"v1","addr":"172.21.15.116:6831","nonce":1029280577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":1029280577},{"type":"v1","addr":"172.21.15.116:6829","nonce":1029280577}]},"public_addr":"172.21.15.116:6825/1029280577","cluster_addr":"172.21.15.116:6827/1029280577","heartbeat_back_addr":"172.21.15.116:6831/1029280577","heartbeat_front_addr":"172.21.15.116:6829/1029280577","state":["exists","up"]},{"osd":3,"uuid":"0fd2e563-7c5b-46f6-82c2-b60c86072c93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":3106627557},{"type":"v1","addr":"172.21.15.116:6801","nonce":3106627557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":3106627557},{"type":"v1","addr":"172.21.15.116:6803","nonce":3106627557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":3106627557},{"type":"v1","addr":"172.21.15.116:6807","nonce":3106627557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":3106627557},{"type":"v1","addr":"172.21.15.116:6805","nonce":3106627557}]},"public_addr":"172.21.15.116:6801/3106627557","cluster_addr":"172.21.15.116:6803/3106627557","heartbeat_back_addr":"172.21.15.116:6807/3106627557","heartbeat_front_addr":"172.21.15.116:6805/3106627557","state":["exists","up"]},{"osd":4,"uuid":"79ae35b7-dda8-4ab8-96ce-47515afde082","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":3231407772},{"type":"v1","addr":"172.21.15.142:6825","nonce":3231407772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":3231407772},{"type":"v1","addr":"172.21.15.142:6827","nonce":3231407772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":3231407772},{"type":"v1","addr":"172.21.15.142:6831","nonce":3231407772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":3231407772},{"type":"v1","addr":"172.21.15.142:6829","nonce":3231407772}]},"public_addr":"172.21.15.142:6825/3231407772","cluster_addr":"172.21.15.142:6827/3231407772","heartbeat_back_addr":"172.21.15.142:6831/3231407772","heartbeat_front_addr":"172.21.15.142:6829/3231407772","state":["exists","up"]},{"osd":5,"uuid":"3166eb2c-3fcf-41c8-9362-45bafaabaa39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":1184158716},{"type":"v1","addr":"172.21.15.142:6817","nonce":1184158716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":1184158716},{"type":"v1","addr":"172.21.15.142:6819","nonce":1184158716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":1184158716},{"type":"v1","addr":"172.21.15.142:6823","nonce":1184158716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":1184158716},{"type":"v1","addr":"172.21.15.142:6821","nonce":1184158716}]},"public_addr":"172.21.15.142:6817/1184158716","cluster_addr":"172.21.15.142:6819/1184158716","heartbeat_back_addr":"172.21.15.142:6823/1184158716","heartbeat_front_addr":"172.21.15.142:6821/1184158716","state":["exists","up"]},{"osd":6,"uuid":"f9aa9672-7527-43e2-963e-b61868e5e63f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":1987868911},{"type":"v1","addr":"172.21.15.142:6801","nonce":1987868911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":1987868911},{"type":"v1","addr":"172.21.15.142:6803","nonce":1987868911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":1987868911},{"type":"v1","addr":"172.21.15.142:6807","nonce":1987868911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":1987868911},{"type":"v1","addr":"172.21.15.142:6805","nonce":1987868911}]},"public_addr":"172.21.15.142:6801/1987868911","cluster_addr":"172.21.15.142:6803/1987868911","heartbeat_back_addr":"172.21.15.142:6807/1987868911","heartbeat_front_addr":"172.21.15.142:6805/1987868911","state":["exists","up"]},{"osd":7,"uuid":"7ed29226-fc42-4382-a91a-fa50f7ec5426","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":1272081937},{"type":"v1","addr":"172.21.15.142:6809","nonce":1272081937}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":1272081937},{"type":"v1","addr":"172.21.15.142:6811","nonce":1272081937}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":1272081937},{"type":"v1","addr":"172.21.15.142:6815","nonce":1272081937}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":1272081937},{"type":"v1","addr":"172.21.15.142:6813","nonce":1272081937}]},"public_addr":"172.21.15.142:6809/1272081937","cluster_addr":"172.21.15.142:6811/1272081937","heartbeat_back_addr":"172.21.15.142:6815/1272081937","heartbeat_front_addr":"172.21.15.142:6813/1272081937","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.350998+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.307201+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.289112+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.243888+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.312091+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.370472+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.275659+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.289297+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-21T22:53:51.567 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.576+0000 7f2e8f036640 1 -- 172.21.15.116:0/1303161303 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f2e7406b4d0 msgr2=0x7f2e7406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:51.567 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.576+0000 7f2e8f036640 1 --2- 172.21.15.116:0/1303161303 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f2e7406b4d0 0x7f2e7406d990 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f2e78036000 tx=0x7f2e7803b040 comp rx=0 tx=0).stop 2024-02-21T22:53:51.567 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.576+0000 7f2e8f036640 1 -- 172.21.15.116:0/1303161303 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2e8815e2d0 msgr2=0x7f2e880b2b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:51.567 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.576+0000 7f2e8f036640 1 --2- 172.21.15.116:0/1303161303 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2e8815e2d0 0x7f2e880b2b20 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f2e80009e30 tx=0x7f2e8000c490 comp rx=0 tx=0).stop 2024-02-21T22:53:51.567 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.576+0000 7f2e8f036640 1 -- 172.21.15.116:0/1303161303 shutdown_connections 2024-02-21T22:53:51.568 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.576+0000 7f2e8f036640 1 --2- 172.21.15.116:0/1303161303 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2e8815e2d0 0x7f2e880b2b20 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:51.568 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.576+0000 7f2e8f036640 1 --2- 172.21.15.116:0/1303161303 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2e8806fd30 0x7f2e880b4710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:51.568 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.576+0000 7f2e8f036640 1 --2- 172.21.15.116:0/1303161303 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f2e7406b4d0 0x7f2e7406d990 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:51.568 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.576+0000 7f2e8f036640 1 --2- 172.21.15.116:0/1303161303 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2e8806ee20 0x7f2e880b74d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:51.568 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.576+0000 7f2e8f036640 1 -- 172.21.15.116:0/1303161303 >> 172.21.15.116:0/1303161303 conn(0x7f2e880b3730 msgr2=0x7f2e880b1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:51.568 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.576+0000 7f2e8f036640 1 -- 172.21.15.116:0/1303161303 shutdown_connections 2024-02-21T22:53:51.568 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.576+0000 7f2e8f036640 1 -- 172.21.15.116:0/1303161303 wait complete. 2024-02-21T22:53:51.578 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-21T22:52:38.328796+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-02-21T22:53:40.752689+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '32', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-02-21T22:53:41.300199+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-21T22:53:51.578 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-21T22:53:51.683 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.692+0000 7fb569dcc640 1 Processor -- start 2024-02-21T22:53:51.683 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.692+0000 7fb569dcc640 1 -- start start 2024-02-21T22:53:51.685 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.693+0000 7fb569dcc640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fb56415c140 0x7fb5640cd590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:51.685 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.693+0000 7fb569dcc640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb5640cf260 0x7fb5640ce5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:51.685 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.693+0000 7fb569dcc640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5640cdde0 con 0x7fb5640ceb00 2024-02-21T22:53:51.685 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.693+0000 7fb569dcc640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5640ce0c0 con 0x7fb56415c140 2024-02-21T22:53:51.685 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.693+0000 7fb569dcc640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5640b4cf0 con 0x7fb5640cf260 2024-02-21T22:53:51.685 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.693+0000 7fb5637fe640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fb56415c140 0x7fb5640cd590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:51.685 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.693+0000 7fb5637fe640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fb56415c140 0x7fb5640cd590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:40046/0 (socket says 172.21.15.116:40046) 2024-02-21T22:53:51.686 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.693+0000 7fb5637fe640 1 -- 172.21.15.116:0/858416916 learned_addr learned my addr 172.21.15.116:0/858416916 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:51.686 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.693+0000 7fb562ffd640 1 --2- 172.21.15.116:0/858416916 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb5640cf260 0x7fb5640ce5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:51.686 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.694+0000 7fb5637fe640 1 -- 172.21.15.116:0/858416916 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb5640cf260 msgr2=0x7fb5640ce5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:53:51.686 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.694+0000 7fb5637fe640 1 --2- 172.21.15.116:0/858416916 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb5640cf260 0x7fb5640ce5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:51.686 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.694+0000 7fb5637fe640 1 -- 172.21.15.116:0/858416916 >> v1:172.21.15.142:6789/0 conn(0x7fb5640ceb00 legacy=0x7fb5640cfda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:51.686 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.694+0000 7fb5627fc640 1 -- 172.21.15.116:0/858416916 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3149224696 0 0) 0x7fb5640cdde0 con 0x7fb5640ceb00 2024-02-21T22:53:51.686 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.694+0000 7fb5637fe640 1 -- 172.21.15.116:0/858416916 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5640b4fd0 con 0x7fb56415c140 2024-02-21T22:53:51.686 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.694+0000 7fb5637fe640 1 --2- 172.21.15.116:0/858416916 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb56415c140 0x7fb5640cd590 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fb554009870 tx=0x7fb55402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=749b9f9d57ab7be2 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:51.686 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.694+0000 7fb5627fc640 1 -- 172.21.15.116:0/858416916 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb554034070 con 0x7fb56415c140 2024-02-21T22:53:51.687 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.695+0000 7fb5627fc640 1 -- 172.21.15.116:0/858416916 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb554030840 con 0x7fb56415c140 2024-02-21T22:53:51.687 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.695+0000 7fb5627fc640 1 -- 172.21.15.116:0/858416916 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb554030c10 con 0x7fb56415c140 2024-02-21T22:53:51.690 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.695+0000 7fb569dcc640 1 -- 172.21.15.116:0/858416916 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb56415c140 msgr2=0x7fb5640cd590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:51.691 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.695+0000 7fb569dcc640 1 --2- 172.21.15.116:0/858416916 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb56415c140 0x7fb5640cd590 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fb554009870 tx=0x7fb55402b980 comp rx=0 tx=0).stop 2024-02-21T22:53:51.691 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.695+0000 7fb569dcc640 1 -- 172.21.15.116:0/858416916 shutdown_connections 2024-02-21T22:53:51.691 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.695+0000 7fb569dcc640 1 --2- 172.21.15.116:0/858416916 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb5640cf260 0x7fb5640ce5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:51.691 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.695+0000 7fb569dcc640 1 --2- 172.21.15.116:0/858416916 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb56415c140 0x7fb5640cd590 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:51.691 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.695+0000 7fb569dcc640 1 -- 172.21.15.116:0/858416916 >> 172.21.15.116:0/858416916 conn(0x7fb5640d1c90 msgr2=0x7fb5640d20a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:51.691 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.695+0000 7fb569dcc640 1 -- 172.21.15.116:0/858416916 shutdown_connections 2024-02-21T22:53:51.691 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.695+0000 7fb569dcc640 1 -- 172.21.15.116:0/858416916 wait complete. 2024-02-21T22:53:51.691 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.696+0000 7fb569dcc640 1 Processor -- start 2024-02-21T22:53:51.692 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.696+0000 7fb569dcc640 1 -- start start 2024-02-21T22:53:51.692 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.697+0000 7fb569dcc640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb5640ceb00 0x7fb56406bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:51.692 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.697+0000 7fb569dcc640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb5640cf260 0x7fb5640c5460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:51.692 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.697+0000 7fb569dcc640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb56415c140 0x7fb5640c59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:51.692 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.697+0000 7fb569dcc640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5640b6500 con 0x7fb5640ceb00 2024-02-21T22:53:51.692 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.697+0000 7fb569dcc640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb56415c520 con 0x7fb5640cf260 2024-02-21T22:53:51.692 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.697+0000 7fb569dcc640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5640b6680 con 0x7fb56415c140 2024-02-21T22:53:51.692 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.697+0000 7fb5637fe640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb5640ceb00 0x7fb56406bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:51.693 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.697+0000 7fb5637fe640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb5640ceb00 0x7fb56406bf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:40056/0 (socket says 172.21.15.116:40056) 2024-02-21T22:53:51.693 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.697+0000 7fb5637fe640 1 -- 172.21.15.116:0/2367835923 learned_addr learned my addr 172.21.15.116:0/2367835923 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:51.693 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.697+0000 7fb562ffd640 1 --2- 172.21.15.116:0/2367835923 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb5640cf260 0x7fb5640c5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:51.693 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.697+0000 7fb563fff640 1 --2- 172.21.15.116:0/2367835923 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb56415c140 0x7fb5640c59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:51.693 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.697+0000 7fb5637fe640 1 -- 172.21.15.116:0/2367835923 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb56415c140 msgr2=0x7fb5640c59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:51.693 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.697+0000 7fb5637fe640 1 --2- 172.21.15.116:0/2367835923 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb56415c140 0x7fb5640c59a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:51.693 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.697+0000 7fb5637fe640 1 -- 172.21.15.116:0/2367835923 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb5640cf260 msgr2=0x7fb5640c5460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:51.693 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.697+0000 7fb5637fe640 1 --2- 172.21.15.116:0/2367835923 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb5640cf260 0x7fb5640c5460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:51.693 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.697+0000 7fb5637fe640 1 -- 172.21.15.116:0/2367835923 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb56406c650 con 0x7fb5640ceb00 2024-02-21T22:53:51.694 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.698+0000 7fb5637fe640 1 --2- 172.21.15.116:0/2367835923 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb5640ceb00 0x7fb56406bf50 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fb5540090b0 tx=0x7fb5540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:51.694 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.698+0000 7fb54bfff640 1 -- 172.21.15.116:0/2367835923 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb554034040 con 0x7fb5640ceb00 2024-02-21T22:53:51.694 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.698+0000 7fb54bfff640 1 -- 172.21.15.116:0/2367835923 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb554030640 con 0x7fb5640ceb00 2024-02-21T22:53:51.694 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.698+0000 7fb569dcc640 1 -- 172.21.15.116:0/2367835923 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb56406c930 con 0x7fb5640ceb00 2024-02-21T22:53:51.694 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.698+0000 7fb54bfff640 1 -- 172.21.15.116:0/2367835923 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb554039d40 con 0x7fb5640ceb00 2024-02-21T22:53:51.694 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.698+0000 7fb569dcc640 1 -- 172.21.15.116:0/2367835923 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb56406cef0 con 0x7fb5640ceb00 2024-02-21T22:53:51.694 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.699+0000 7fb569dcc640 1 -- 172.21.15.116:0/2367835923 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5640752f0 con 0x7fb5640ceb00 2024-02-21T22:53:51.694 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.699+0000 7fb54bfff640 1 -- 172.21.15.116:0/2367835923 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fb55404b060 con 0x7fb5640ceb00 2024-02-21T22:53:51.694 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.700+0000 7fb54bfff640 1 --2- 172.21.15.116:0/2367835923 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fb55006b4d0 0x7fb55006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:51.695 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.700+0000 7fb54bfff640 1 -- 172.21.15.116:0/2367835923 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb5540abd20 con 0x7fb5640ceb00 2024-02-21T22:53:51.695 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.700+0000 7fb562ffd640 1 --2- 172.21.15.116:0/2367835923 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fb55006b4d0 0x7fb55006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:51.695 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.700+0000 7fb562ffd640 1 --2- 172.21.15.116:0/2367835923 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fb55006b4d0 0x7fb55006d990 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fb5640b5bf0 tx=0x7fb558009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:51.695 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.704+0000 7fb54bfff640 1 -- 172.21.15.116:0/2367835923 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7fb55407a670 con 0x7fb5640ceb00 2024-02-21T22:53:51.865 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.875+0000 7fb569dcc640 1 -- 172.21.15.116:0/2367835923 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb5640b6fa0 con 0x7fb5640ceb00 2024-02-21T22:53:51.865 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.875+0000 7fb54bfff640 1 -- 172.21.15.116:0/2367835923 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v33) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb55407e710 con 0x7fb5640ceb00 2024-02-21T22:53:51.866 INFO:teuthology.orchestra.run.smithi116.stdout:pg_num: 1 2024-02-21T22:53:51.867 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.877+0000 7fb569dcc640 1 -- 172.21.15.116:0/2367835923 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fb55006b4d0 msgr2=0x7fb55006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:51.867 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.877+0000 7fb569dcc640 1 --2- 172.21.15.116:0/2367835923 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fb55006b4d0 0x7fb55006d990 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fb5640b5bf0 tx=0x7fb558009190 comp rx=0 tx=0).stop 2024-02-21T22:53:51.868 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.877+0000 7fb569dcc640 1 -- 172.21.15.116:0/2367835923 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb5640ceb00 msgr2=0x7fb56406bf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:51.868 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.877+0000 7fb569dcc640 1 --2- 172.21.15.116:0/2367835923 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb5640ceb00 0x7fb56406bf50 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fb5540090b0 tx=0x7fb5540046c0 comp rx=0 tx=0).stop 2024-02-21T22:53:51.868 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.877+0000 7fb569dcc640 1 -- 172.21.15.116:0/2367835923 shutdown_connections 2024-02-21T22:53:51.868 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.877+0000 7fb569dcc640 1 --2- 172.21.15.116:0/2367835923 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fb55006b4d0 0x7fb55006d990 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:51.868 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.877+0000 7fb569dcc640 1 --2- 172.21.15.116:0/2367835923 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb56415c140 0x7fb5640c59a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:51.868 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.877+0000 7fb569dcc640 1 --2- 172.21.15.116:0/2367835923 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb5640cf260 0x7fb5640c5460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:51.868 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.877+0000 7fb569dcc640 1 --2- 172.21.15.116:0/2367835923 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb5640ceb00 0x7fb56406bf50 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:51.868 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.877+0000 7fb569dcc640 1 -- 172.21.15.116:0/2367835923 >> 172.21.15.116:0/2367835923 conn(0x7fb5640d1c90 msgr2=0x7fb5640d0300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:51.868 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.877+0000 7fb569dcc640 1 -- 172.21.15.116:0/2367835923 shutdown_connections 2024-02-21T22:53:51.869 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.877+0000 7fb569dcc640 1 -- 172.21.15.116:0/2367835923 wait complete. 2024-02-21T22:53:51.878 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-02-21T22:53:51.982 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.991+0000 7fe5fe6d5640 1 Processor -- start 2024-02-21T22:53:51.982 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.991+0000 7fe5fe6d5640 1 -- start start 2024-02-21T22:53:51.984 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.992+0000 7fe5fe6d5640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fe5f80d0ca0 0x7fe5f80d4940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:51.984 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.992+0000 7fe5fe6d5640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fe5f80d2870 0x7fe5f815e180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:51.984 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.992+0000 7fe5fe6d5640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5f80ceea0 con 0x7fe5f80d2400 2024-02-21T22:53:51.984 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.992+0000 7fe5fe6d5640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5f80cf180 con 0x7fe5f80d0ca0 2024-02-21T22:53:51.984 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.992+0000 7fe5fe6d5640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5f80cf460 con 0x7fe5f80d2870 2024-02-21T22:53:51.985 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.992+0000 7fe5f7fff640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fe5f80d0ca0 0x7fe5f80d4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:51.985 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.992+0000 7fe5f77fe640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7fe5f80d2400 0x7fe5f815da70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:47346/0 (socket says 172.21.15.116:47346) 2024-02-21T22:53:51.985 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.992+0000 7fe5f77fe640 1 -- 172.21.15.116:0/4123834278 learned_addr learned my addr 172.21.15.116:0/4123834278 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-02-21T22:53:51.985 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.992+0000 7fe5fcc72640 1 --2- 172.21.15.116:0/4123834278 >> v2:172.21.15.142:3300/0 conn(0x7fe5f80d2870 0x7fe5f815e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:51.985 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.993+0000 7fe5f7fff640 1 -- 172.21.15.116:0/4123834278 >> v2:172.21.15.142:3300/0 conn(0x7fe5f80d2870 msgr2=0x7fe5f815e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:53:51.986 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.993+0000 7fe5f7fff640 1 --2- 172.21.15.116:0/4123834278 >> v2:172.21.15.142:3300/0 conn(0x7fe5f80d2870 0x7fe5f815e180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:51.986 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.993+0000 7fe5f7fff640 1 -- 172.21.15.116:0/4123834278 >> v1:172.21.15.116:6789/0 conn(0x7fe5f80d2400 legacy=0x7fe5f815da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:51.986 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.993+0000 7fe5f6ffd640 1 -- 172.21.15.116:0/4123834278 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3219063532 0 0) 0x7fe5f80ceea0 con 0x7fe5f80d2400 2024-02-21T22:53:51.986 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.993+0000 7fe5f7fff640 1 -- 172.21.15.116:0/4123834278 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5f80cf740 con 0x7fe5f80d0ca0 2024-02-21T22:53:51.986 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.993+0000 7fe5f7fff640 1 --2- 172.21.15.116:0/4123834278 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe5f80d0ca0 0x7fe5f80d4940 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fe5f80d2170 tx=0x7fe5e802b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d7058517faca280 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:51.986 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.993+0000 7fe5f6ffd640 1 -- 172.21.15.116:0/4123834278 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5e8034070 con 0x7fe5f80d0ca0 2024-02-21T22:53:51.986 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.993+0000 7fe5f6ffd640 1 -- 172.21.15.116:0/4123834278 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5e8030610 con 0x7fe5f80d0ca0 2024-02-21T22:53:51.986 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.993+0000 7fe5f6ffd640 1 -- 172.21.15.116:0/4123834278 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5e80309e0 con 0x7fe5f80d0ca0 2024-02-21T22:53:51.989 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.994+0000 7fe5fe6d5640 1 -- 172.21.15.116:0/4123834278 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe5f80d0ca0 msgr2=0x7fe5f80d4940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:51.990 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.994+0000 7fe5fe6d5640 1 --2- 172.21.15.116:0/4123834278 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe5f80d0ca0 0x7fe5f80d4940 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fe5f80d2170 tx=0x7fe5e802b960 comp rx=0 tx=0).stop 2024-02-21T22:53:51.990 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.994+0000 7fe5fe6d5640 1 -- 172.21.15.116:0/4123834278 shutdown_connections 2024-02-21T22:53:51.990 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.994+0000 7fe5fe6d5640 1 --2- 172.21.15.116:0/4123834278 >> v2:172.21.15.142:3300/0 conn(0x7fe5f80d2870 0x7fe5f815e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:51.990 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.994+0000 7fe5fe6d5640 1 --2- 172.21.15.116:0/4123834278 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe5f80d0ca0 0x7fe5f80d4940 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:51.990 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.994+0000 7fe5fe6d5640 1 -- 172.21.15.116:0/4123834278 >> 172.21.15.116:0/4123834278 conn(0x7fe5f80d3e20 msgr2=0x7fe5f80d4230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:51.990 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.994+0000 7fe5fe6d5640 1 -- 172.21.15.116:0/4123834278 shutdown_connections 2024-02-21T22:53:51.990 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.994+0000 7fe5fe6d5640 1 -- 172.21.15.116:0/4123834278 wait complete. 2024-02-21T22:53:51.990 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.995+0000 7fe5fe6d5640 1 Processor -- start 2024-02-21T22:53:51.991 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.995+0000 7fe5fe6d5640 1 -- start start 2024-02-21T22:53:51.991 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.996+0000 7fe5fe6d5640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe5f80d0ca0 0x7fe5f8153c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:51.991 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.996+0000 7fe5fe6d5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe5f80d2400 0x7fe5f8160a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:51.991 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.996+0000 7fe5fe6d5640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe5f80d2870 0x7fe5f8160f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:51.991 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.996+0000 7fe5fe6d5640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5f815e6c0 con 0x7fe5f80d2870 2024-02-21T22:53:51.991 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.996+0000 7fe5fe6d5640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5f80d2ce0 con 0x7fe5f80d2400 2024-02-21T22:53:51.991 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.996+0000 7fe5fe6d5640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5f80d1080 con 0x7fe5f80d0ca0 2024-02-21T22:53:51.991 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.996+0000 7fe5fcc72640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe5f80d2870 0x7fe5f8160f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:51.991 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.996+0000 7fe5fcc72640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe5f80d2870 0x7fe5f8160f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:40082/0 (socket says 172.21.15.116:40082) 2024-02-21T22:53:51.992 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.996+0000 7fe5fcc72640 1 -- 172.21.15.116:0/228270621 learned_addr learned my addr 172.21.15.116:0/228270621 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:51.994 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.996+0000 7fe5f77fe640 1 --2- 172.21.15.116:0/228270621 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe5f80d2400 0x7fe5f8160a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:51.995 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.996+0000 7fe5fcc72640 1 -- 172.21.15.116:0/228270621 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe5f80d0ca0 msgr2=0x7fe5f8153c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:51.995 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.996+0000 7fe5fcc72640 1 --2- 172.21.15.116:0/228270621 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe5f80d0ca0 0x7fe5f8153c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:51.995 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.996+0000 7fe5fcc72640 1 -- 172.21.15.116:0/228270621 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe5f80d2400 msgr2=0x7fe5f8160a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:51.995 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.996+0000 7fe5fcc72640 1 --2- 172.21.15.116:0/228270621 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe5f80d2400 0x7fe5f8160a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:51.995 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.996+0000 7fe5fcc72640 1 -- 172.21.15.116:0/228270621 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5f8157e90 con 0x7fe5f80d2870 2024-02-21T22:53:51.995 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.997+0000 7fe5fcc72640 1 --2- 172.21.15.116:0/228270621 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe5f80d2870 0x7fe5f8160f50 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fe5f000efc0 tx=0x7fe5f000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:51.995 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.997+0000 7fe5f4ff9640 1 -- 172.21.15.116:0/228270621 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5f0018020 con 0x7fe5f80d2870 2024-02-21T22:53:51.996 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.997+0000 7fe5f4ff9640 1 -- 172.21.15.116:0/228270621 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5f0014480 con 0x7fe5f80d2870 2024-02-21T22:53:51.997 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.997+0000 7fe5fe6d5640 1 -- 172.21.15.116:0/228270621 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5f80b6be0 con 0x7fe5f80d2870 2024-02-21T22:53:51.997 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.997+0000 7fe5f4ff9640 1 -- 172.21.15.116:0/228270621 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5f0014870 con 0x7fe5f80d2870 2024-02-21T22:53:51.997 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.997+0000 7fe5fe6d5640 1 -- 172.21.15.116:0/228270621 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5f80b71a0 con 0x7fe5f80d2870 2024-02-21T22:53:51.997 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.998+0000 7fe5fe6d5640 1 -- 172.21.15.116:0/228270621 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5f80752f0 con 0x7fe5f80d2870 2024-02-21T22:53:51.997 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.998+0000 7fe5f4ff9640 1 -- 172.21.15.116:0/228270621 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fe5f0005d10 con 0x7fe5f80d2870 2024-02-21T22:53:51.997 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.998+0000 7fe5f4ff9640 1 --2- 172.21.15.116:0/228270621 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fe5e406b500 0x7fe5e406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:51.997 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.999+0000 7fe5f4ff9640 1 -- 172.21.15.116:0/228270621 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe5f008af90 con 0x7fe5f80d2870 2024-02-21T22:53:51.997 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.999+0000 7fe5f7fff640 1 --2- 172.21.15.116:0/228270621 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fe5e406b500 0x7fe5e406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:51.998 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:51.999+0000 7fe5f7fff640 1 --2- 172.21.15.116:0/228270621 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fe5e406b500 0x7fe5e406d9c0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fe5e8036000 tx=0x7fe5e8030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:51.998 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:52.003+0000 7fe5f4ff9640 1 -- 172.21.15.116:0/228270621 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7fe5f0022030 con 0x7fe5f80d2870 2024-02-21T22:53:52.164 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:52.174+0000 7fe5fe6d5640 1 -- 172.21.15.116:0/228270621 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe5f808d560 con 0x7fe5f80d2870 2024-02-21T22:53:52.165 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:52.174+0000 7fe5f4ff9640 1 -- 172.21.15.116:0/228270621 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v33) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe5f0010040 con 0x7fe5f80d2870 2024-02-21T22:53:52.165 INFO:teuthology.orchestra.run.smithi116.stdout:pg_num: 32 2024-02-21T22:53:52.167 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:52.176+0000 7fe5fe6d5640 1 -- 172.21.15.116:0/228270621 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fe5e406b500 msgr2=0x7fe5e406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:52.167 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:52.176+0000 7fe5fe6d5640 1 --2- 172.21.15.116:0/228270621 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fe5e406b500 0x7fe5e406d9c0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fe5e8036000 tx=0x7fe5e8030000 comp rx=0 tx=0).stop 2024-02-21T22:53:52.167 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:52.176+0000 7fe5fe6d5640 1 -- 172.21.15.116:0/228270621 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe5f80d2870 msgr2=0x7fe5f8160f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:52.167 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:52.176+0000 7fe5fe6d5640 1 --2- 172.21.15.116:0/228270621 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe5f80d2870 0x7fe5f8160f50 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fe5f000efc0 tx=0x7fe5f000c490 comp rx=0 tx=0).stop 2024-02-21T22:53:52.167 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:52.176+0000 7fe5fe6d5640 1 -- 172.21.15.116:0/228270621 shutdown_connections 2024-02-21T22:53:52.167 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:52.176+0000 7fe5fe6d5640 1 --2- 172.21.15.116:0/228270621 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe5f80d2870 0x7fe5f8160f50 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:52.168 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:52.176+0000 7fe5fe6d5640 1 --2- 172.21.15.116:0/228270621 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe5f80d2400 0x7fe5f8160a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:52.168 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:52.176+0000 7fe5fe6d5640 1 --2- 172.21.15.116:0/228270621 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fe5e406b500 0x7fe5e406d9c0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:52.168 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:52.176+0000 7fe5fe6d5640 1 --2- 172.21.15.116:0/228270621 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe5f80d0ca0 0x7fe5f8153c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:52.168 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:52.176+0000 7fe5fe6d5640 1 -- 172.21.15.116:0/228270621 >> 172.21.15.116:0/228270621 conn(0x7fe5f80d3e20 msgr2=0x7fe5f80d4200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:52.168 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:52.176+0000 7fe5fe6d5640 1 -- 172.21.15.116:0/228270621 shutdown_connections 2024-02-21T22:53:52.168 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:52.176+0000 7fe5fe6d5640 1 -- 172.21.15.116:0/228270621 wait complete. 2024-02-21T22:53:52.177 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-02-21T22:53:52.279 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:52.289+0000 7fb0bffdc640 1 Processor -- start 2024-02-21T22:53:52.280 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:52.289+0000 7fb0bffdc640 1 -- start start 2024-02-21T22:53:52.282 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:52.290+0000 7fb0bffdc640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb0b80b4160 0x7fb0b8168cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:52.282 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:52.290+0000 7fb0bffdc640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0b80b5d50 con 0x7fb0b81445c0 2024-02-21T22:53:52.282 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:52.290+0000 7fb0bffdc640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0b81449a0 con 0x7fb0b80720a0 2024-02-21T22:53:52.282 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:52.290+0000 7fb0bffdc640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0b806de00 con 0x7fb0b80b4160 2024-02-21T22:53:52.282 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:52.290+0000 7fb0bdd78640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7fb0b81445c0 0x7fb0b8071990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:47348/0 (socket says 172.21.15.116:47348) 2024-02-21T22:53:52.282 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:52.290+0000 7fb0bdd78640 1 -- 172.21.15.116:0/519738256 learned_addr learned my addr 172.21.15.116:0/519738256 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-02-21T22:53:52.283 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:52.290+0000 7fb0be579640 1 --2- 172.21.15.116:0/519738256 >> v2:172.21.15.142:3300/0 conn(0x7fb0b80b4160 0x7fb0b8168cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:52.283 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:52.290+0000 7fb0bcd76640 1 -- 172.21.15.116:0/519738256 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 337483017 0 0) 0x7fb0b80b5d50 con 0x7fb0b81445c0 2024-02-21T22:53:52.283 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:52.290+0000 7fb0bcd76640 1 -- 172.21.15.116:0/519738256 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb0a4003520 con 0x7fb0b81445c0 2024-02-21T22:53:52.283 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:52.290+0000 7fb0bcd76640 1 -- 172.21.15.116:0/519738256 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1301137214 0 0) 0x7fb0b81449a0 con 0x7fb0b80720a0 2024-02-21T22:53:52.283 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:52.291+0000 7fb0bcd76640 1 -- 172.21.15.116:0/519738256 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb0b80b5d50 con 0x7fb0b80720a0 2024-02-21T22:53:52.283 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:52.291+0000 7fb0be579640 1 -- 172.21.15.116:0/519738256 >> v1:172.21.15.142:6789/0 conn(0x7fb0b80720a0 legacy=0x7fb0b80b3a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:52.283 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:52.291+0000 7fb0be579640 1 -- 172.21.15.116:0/519738256 >> v1:172.21.15.116:6789/0 conn(0x7fb0b81445c0 legacy=0x7fb0b8071990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:52.283 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:52.291+0000 7fb0be579640 1 -- 172.21.15.116:0/519738256 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0b8072550 con 0x7fb0b80b4160 2024-02-21T22:53:52.283 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:52.291+0000 7fb0be579640 1 --2- 172.21.15.116:0/519738256 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb0b80b4160 0x7fb0b8168cf0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fb0b00097a0 tx=0x7fb0b002b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6832350ecfab74d0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:52.284 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:52.292+0000 7fb0bcd76640 1 -- 172.21.15.116:0/519738256 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0b0034070 con 0x7fb0b80b4160 2024-02-21T22:53:52.284 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:52.292+0000 7fb0bcd76640 1 -- 172.21.15.116:0/519738256 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0b0030610 con 0x7fb0b80b4160 2024-02-21T22:53:52.284 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:52.292+0000 7fb0bcd76640 1 -- 172.21.15.116:0/519738256 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0b00309e0 con 0x7fb0b80b4160 2024-02-21T22:53:52.287 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:52.292+0000 7fb0bffdc640 1 -- 172.21.15.116:0/519738256 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb0b80b4160 msgr2=0x7fb0b8168cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:52.287 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:52.292+0000 7fb0bffdc640 1 --2- 172.21.15.116:0/519738256 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb0b80b4160 0x7fb0b8168cf0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fb0b00097a0 tx=0x7fb0b002b960 comp rx=0 tx=0).stop 2024-02-21T22:53:52.288 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:52.292+0000 7fb0bffdc640 1 -- 172.21.15.116:0/519738256 shutdown_connections 2024-02-21T22:53:52.288 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:52.292+0000 7fb0bffdc640 1 --2- 172.21.15.116:0/519738256 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb0b80b4160 0x7fb0b8168cf0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:52.288 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:52.292+0000 7fb0bffdc640 1 -- 172.21.15.116:0/519738256 >> 172.21.15.116:0/519738256 conn(0x7fb0b80b2750 msgr2=0x7fb0b80b2b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:52.288 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:52.292+0000 7fb0bffdc640 1 -- 172.21.15.116:0/519738256 shutdown_connections 2024-02-21T22:53:52.288 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:52.292+0000 7fb0bffdc640 1 -- 172.21.15.116:0/519738256 wait complete. 2024-02-21T22:53:52.288 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:52.293+0000 7fb0bffdc640 1 Processor -- start 2024-02-21T22:53:52.288 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:52.293+0000 7fb0bffdc640 1 -- start start 2024-02-21T22:53:52.288 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:52.294+0000 7fb0bffdc640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb0b80720a0 0x7fb0b815dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:52.289 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:52.294+0000 7fb0bffdc640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb0b80b4160 0x7fb0b8146bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:52.289 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:52.294+0000 7fb0bffdc640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb0b81445c0 0x7fb0b80c7470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:52.289 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:52.294+0000 7fb0bffdc640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0b806da90 con 0x7fb0b80b4160 2024-02-21T22:53:52.289 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:52.294+0000 7fb0bffdc640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0b806d7b0 con 0x7fb0b81445c0 2024-02-21T22:53:52.289 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:52.294+0000 7fb0bffdc640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0b806f2a0 con 0x7fb0b80720a0 2024-02-21T22:53:52.289 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:52.294+0000 7fb0bd577640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb0b80b4160 0x7fb0b8146bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:52.289 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:52.294+0000 7fb0bd577640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb0b80b4160 0x7fb0b8146bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:40092/0 (socket says 172.21.15.116:40092) 2024-02-21T22:53:52.289 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:52.294+0000 7fb0bd577640 1 -- 172.21.15.116:0/3396281398 learned_addr learned my addr 172.21.15.116:0/3396281398 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:52.289 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:52.294+0000 7fb0bdd78640 1 --2- 172.21.15.116:0/3396281398 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb0b80720a0 0x7fb0b815dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:52.289 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:52.294+0000 7fb0be579640 1 --2- 172.21.15.116:0/3396281398 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb0b81445c0 0x7fb0b80c7470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:52.290 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:52.294+0000 7fb0bd577640 1 -- 172.21.15.116:0/3396281398 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb0b80720a0 msgr2=0x7fb0b815dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:52.290 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:52.294+0000 7fb0bd577640 1 --2- 172.21.15.116:0/3396281398 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb0b80720a0 0x7fb0b815dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:52.290 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:52.294+0000 7fb0bd577640 1 -- 172.21.15.116:0/3396281398 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb0b81445c0 msgr2=0x7fb0b80c7470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:52.290 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:52.294+0000 7fb0bd577640 1 --2- 172.21.15.116:0/3396281398 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb0b81445c0 0x7fb0b80c7470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:52.290 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:52.294+0000 7fb0bd577640 1 -- 172.21.15.116:0/3396281398 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0b80c63d0 con 0x7fb0b80b4160 2024-02-21T22:53:52.290 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:52.294+0000 7fb0be579640 1 --2- 172.21.15.116:0/3396281398 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb0b81445c0 0x7fb0b80c7470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T22:53:52.290 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:52.295+0000 7fb0bd577640 1 --2- 172.21.15.116:0/3396281398 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb0b80b4160 0x7fb0b8146bc0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fb0a800c450 tx=0x7fb0a800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:52.290 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:52.295+0000 7fb0ae7fc640 1 -- 172.21.15.116:0/3396281398 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0a80052d0 con 0x7fb0b80b4160 2024-02-21T22:53:52.291 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:52.295+0000 7fb0ae7fc640 1 -- 172.21.15.116:0/3396281398 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0a8005470 con 0x7fb0b80b4160 2024-02-21T22:53:52.291 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:52.295+0000 7fb0bffdc640 1 -- 172.21.15.116:0/3396281398 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0b80c66b0 con 0x7fb0b80b4160 2024-02-21T22:53:52.291 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:52.295+0000 7fb0ae7fc640 1 -- 172.21.15.116:0/3396281398 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0a8012870 con 0x7fb0b80b4160 2024-02-21T22:53:52.291 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:52.295+0000 7fb0bffdc640 1 -- 172.21.15.116:0/3396281398 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0b80c6c70 con 0x7fb0b80b4160 2024-02-21T22:53:52.291 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:52.296+0000 7fb0bffdc640 1 -- 172.21.15.116:0/3396281398 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0b80752f0 con 0x7fb0b80b4160 2024-02-21T22:53:52.291 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:52.296+0000 7fb0ae7fc640 1 -- 172.21.15.116:0/3396281398 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fb0a8012a10 con 0x7fb0b80b4160 2024-02-21T22:53:52.291 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:52.297+0000 7fb0ae7fc640 1 --2- 172.21.15.116:0/3396281398 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fb09c06b4d0 0x7fb09c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:52.291 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:52.297+0000 7fb0ae7fc640 1 -- 172.21.15.116:0/3396281398 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb0a8089d30 con 0x7fb0b80b4160 2024-02-21T22:53:52.292 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:52.297+0000 7fb0bdd78640 1 --2- 172.21.15.116:0/3396281398 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fb09c06b4d0 0x7fb09c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:52.292 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:52.297+0000 7fb0bdd78640 1 --2- 172.21.15.116:0/3396281398 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fb09c06b4d0 0x7fb09c06d990 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fb0b4005c00 tx=0x7fb0b4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:52.292 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:52.301+0000 7fb0ae7fc640 1 -- 172.21.15.116:0/3396281398 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7fb0a8058620 con 0x7fb0b80b4160 2024-02-21T22:53:52.461 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:52.471+0000 7fb0bffdc640 1 -- 172.21.15.116:0/3396281398 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb0b80b3dd0 con 0x7fb0b80b4160 2024-02-21T22:53:52.462 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:52.471+0000 7fb0ae7fc640 1 -- 172.21.15.116:0/3396281398 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v33) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb0a805c6c0 con 0x7fb0b80b4160 2024-02-21T22:53:52.462 INFO:teuthology.orchestra.run.smithi116.stdout:pg_num: 64 2024-02-21T22:53:52.464 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:52.473+0000 7fb0bffdc640 1 -- 172.21.15.116:0/3396281398 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fb09c06b4d0 msgr2=0x7fb09c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:52.464 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:52.473+0000 7fb0bffdc640 1 --2- 172.21.15.116:0/3396281398 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fb09c06b4d0 0x7fb09c06d990 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fb0b4005c00 tx=0x7fb0b4009040 comp rx=0 tx=0).stop 2024-02-21T22:53:52.464 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:52.473+0000 7fb0bffdc640 1 -- 172.21.15.116:0/3396281398 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb0b80b4160 msgr2=0x7fb0b8146bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:52.464 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:52.473+0000 7fb0bffdc640 1 --2- 172.21.15.116:0/3396281398 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb0b80b4160 0x7fb0b8146bc0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fb0a800c450 tx=0x7fb0a800c910 comp rx=0 tx=0).stop 2024-02-21T22:53:52.464 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:52.473+0000 7fb0bffdc640 1 -- 172.21.15.116:0/3396281398 shutdown_connections 2024-02-21T22:53:52.465 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:52.473+0000 7fb0bffdc640 1 --2- 172.21.15.116:0/3396281398 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb0b81445c0 0x7fb0b80c7470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:52.465 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:52.473+0000 7fb0bffdc640 1 --2- 172.21.15.116:0/3396281398 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb0b80b4160 0x7fb0b8146bc0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:52.465 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:52.473+0000 7fb0bffdc640 1 --2- 172.21.15.116:0/3396281398 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fb09c06b4d0 0x7fb09c06d990 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:52.465 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:52.473+0000 7fb0bffdc640 1 --2- 172.21.15.116:0/3396281398 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb0b80720a0 0x7fb0b815dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:52.465 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:52.473+0000 7fb0bffdc640 1 -- 172.21.15.116:0/3396281398 >> 172.21.15.116:0/3396281398 conn(0x7fb0b80b2750 msgr2=0x7fb0b80af610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:52.465 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:52.473+0000 7fb0bffdc640 1 -- 172.21.15.116:0/3396281398 shutdown_connections 2024-02-21T22:53:52.465 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:52.473+0000 7fb0bffdc640 1 -- 172.21.15.116:0/3396281398 wait complete. 2024-02-21T22:53:52.475 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-02-21T22:53:52.575 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:52.585+0000 7f2a4fe36640 1 Processor -- start 2024-02-21T22:53:52.576 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:52.585+0000 7f2a4fe36640 1 -- start start 2024-02-21T22:53:52.577 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:52.586+0000 7f2a4fe36640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2a480b3f90 0x7f2a4806ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:52.577 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:52.586+0000 7f2a4fe36640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f2a4806b380 0x7f2a48071c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:52.577 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:52.586+0000 7f2a4fe36640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a4815f570 con 0x7f2a480b0290 2024-02-21T22:53:52.577 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:52.586+0000 7f2a4fe36640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a4806b7d0 con 0x7f2a4806b380 2024-02-21T22:53:52.577 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:52.586+0000 7f2a4fe36640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a4815f0e0 con 0x7f2a480b3f90 2024-02-21T22:53:52.578 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:52.586+0000 7f2a4e3d3640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f2a4806b380 0x7f2a48071c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:52.578 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:52.586+0000 7f2a4d3d1640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2a480b3f90 0x7f2a4806ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:52.578 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:52.586+0000 7f2a4e3d3640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f2a4806b380 0x7f2a48071c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.116:57088/0 (socket says 172.21.15.116:57088) 2024-02-21T22:53:52.578 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:52.586+0000 7f2a4e3d3640 1 -- 172.21.15.116:0/235977936 learned_addr learned my addr 172.21.15.116:0/235977936 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:52.578 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:52.586+0000 7f2a4dbd2640 1 --1- 172.21.15.116:0/235977936 >> v1:172.21.15.142:6789/0 conn(0x7f2a480b0290 0x7f2a4806f290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.116:43402/0 (socket says 172.21.15.116:43402) 2024-02-21T22:53:52.578 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:52.586+0000 7f2a4d3d1640 1 -- 172.21.15.116:0/235977936 >> v2:172.21.15.142:3300/0 conn(0x7f2a4806b380 msgr2=0x7f2a48071c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:53:52.578 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:52.587+0000 7f2a4d3d1640 1 --2- 172.21.15.116:0/235977936 >> v2:172.21.15.142:3300/0 conn(0x7f2a4806b380 0x7f2a48071c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:52.578 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:52.587+0000 7f2a4d3d1640 1 -- 172.21.15.116:0/235977936 >> v1:172.21.15.142:6789/0 conn(0x7f2a480b0290 legacy=0x7f2a4806f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:52.578 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:52.587+0000 7f2a4d3d1640 1 -- 172.21.15.116:0/235977936 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a4815e7b0 con 0x7f2a480b3f90 2024-02-21T22:53:52.582 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:52.587+0000 7f2a4d3d1640 1 --2- 172.21.15.116:0/235977936 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2a480b3f90 0x7f2a4806ae40 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2a380097a0 tx=0x7f2a3802b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f236caab8d9022a9 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:52.582 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:52.587+0000 7f2a4cbd0640 1 -- 172.21.15.116:0/235977936 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a380315a0 con 0x7f2a480b3f90 2024-02-21T22:53:52.582 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:52.587+0000 7f2a4cbd0640 1 -- 172.21.15.116:0/235977936 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a38037070 con 0x7f2a480b3f90 2024-02-21T22:53:52.582 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:52.588+0000 7f2a4cbd0640 1 -- 172.21.15.116:0/235977936 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a38031960 con 0x7f2a480b3f90 2024-02-21T22:53:52.582 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:52.588+0000 7f2a4fe36640 1 -- 172.21.15.116:0/235977936 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2a480b3f90 msgr2=0x7f2a4806ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:52.582 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:52.588+0000 7f2a4fe36640 1 --2- 172.21.15.116:0/235977936 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2a480b3f90 0x7f2a4806ae40 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2a380097a0 tx=0x7f2a3802b840 comp rx=0 tx=0).stop 2024-02-21T22:53:52.582 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:52.588+0000 7f2a4fe36640 1 -- 172.21.15.116:0/235977936 shutdown_connections 2024-02-21T22:53:52.583 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:52.588+0000 7f2a4fe36640 1 --2- 172.21.15.116:0/235977936 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2a480b3f90 0x7f2a4806ae40 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:52.583 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:52.588+0000 7f2a4fe36640 1 --2- 172.21.15.116:0/235977936 >> v2:172.21.15.142:3300/0 conn(0x7f2a4806b380 0x7f2a48071c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:52.583 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:52.588+0000 7f2a4fe36640 1 -- 172.21.15.116:0/235977936 >> 172.21.15.116:0/235977936 conn(0x7f2a480b29f0 msgr2=0x7f2a480b2e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:52.583 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:52.588+0000 7f2a4fe36640 1 -- 172.21.15.116:0/235977936 shutdown_connections 2024-02-21T22:53:52.583 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:52.588+0000 7f2a4fe36640 1 -- 172.21.15.116:0/235977936 wait complete. 2024-02-21T22:53:52.583 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:52.589+0000 7f2a4fe36640 1 Processor -- start 2024-02-21T22:53:52.583 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:52.589+0000 7f2a4fe36640 1 -- start start 2024-02-21T22:53:52.583 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:52.590+0000 7f2a4fe36640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a4806b380 0x7f2a481f6fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:52.583 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:52.590+0000 7f2a4fe36640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2a480b0290 0x7f2a48155150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:52.584 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:52.590+0000 7f2a4fe36640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2a480b3f90 0x7f2a481525c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:52.584 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:52.590+0000 7f2a4fe36640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a480b0670 con 0x7f2a480b0290 2024-02-21T22:53:52.584 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:52.590+0000 7f2a4fe36640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a4815ed70 con 0x7f2a4806b380 2024-02-21T22:53:52.584 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:52.590+0000 7f2a4fe36640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a480721c0 con 0x7f2a480b3f90 2024-02-21T22:53:52.584 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:52.590+0000 7f2a4d3d1640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2a480b0290 0x7f2a48155150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:52.584 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:52.590+0000 7f2a4d3d1640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2a480b0290 0x7f2a48155150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:40106/0 (socket says 172.21.15.116:40106) 2024-02-21T22:53:52.584 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:52.590+0000 7f2a4e3d3640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2a480b3f90 0x7f2a481525c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:52.584 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:52.590+0000 7f2a4d3d1640 1 -- 172.21.15.116:0/3830519024 learned_addr learned my addr 172.21.15.116:0/3830519024 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:52.585 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:52.590+0000 7f2a4dbd2640 1 --2- 172.21.15.116:0/3830519024 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a4806b380 0x7f2a481f6fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:52.585 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:52.590+0000 7f2a4e3d3640 1 -- 172.21.15.116:0/3830519024 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a4806b380 msgr2=0x7f2a481f6fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:52.585 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:52.590+0000 7f2a4e3d3640 1 --2- 172.21.15.116:0/3830519024 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a4806b380 0x7f2a481f6fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:52.585 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:52.590+0000 7f2a4e3d3640 1 -- 172.21.15.116:0/3830519024 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2a480b0290 msgr2=0x7f2a48155150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:52.585 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:52.590+0000 7f2a4e3d3640 1 --2- 172.21.15.116:0/3830519024 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2a480b0290 0x7f2a48155150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:52.585 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:52.590+0000 7f2a4e3d3640 1 -- 172.21.15.116:0/3830519024 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a4815cb20 con 0x7f2a480b3f90 2024-02-21T22:53:52.585 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:52.590+0000 7f2a4d3d1640 1 --2- 172.21.15.116:0/3830519024 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2a480b0290 0x7f2a48155150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T22:53:52.585 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:52.591+0000 7f2a4e3d3640 1 --2- 172.21.15.116:0/3830519024 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2a480b3f90 0x7f2a481525c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f2a4000efc0 tx=0x7f2a4000c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:52.585 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:52.591+0000 7f2a3e7fc640 1 -- 172.21.15.116:0/3830519024 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a4000cd20 con 0x7f2a480b3f90 2024-02-21T22:53:52.586 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:52.591+0000 7f2a3e7fc640 1 -- 172.21.15.116:0/3830519024 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a40003990 con 0x7f2a480b3f90 2024-02-21T22:53:52.586 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:52.591+0000 7f2a4fe36640 1 -- 172.21.15.116:0/3830519024 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a4815ce00 con 0x7f2a480b3f90 2024-02-21T22:53:52.586 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:52.591+0000 7f2a3e7fc640 1 -- 172.21.15.116:0/3830519024 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a40003d80 con 0x7f2a480b3f90 2024-02-21T22:53:52.586 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:52.591+0000 7f2a4fe36640 1 -- 172.21.15.116:0/3830519024 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a4815d3c0 con 0x7f2a480b3f90 2024-02-21T22:53:52.586 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:52.592+0000 7f2a4fe36640 1 -- 172.21.15.116:0/3830519024 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a480752f0 con 0x7f2a480b3f90 2024-02-21T22:53:52.587 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:52.592+0000 7f2a3e7fc640 1 -- 172.21.15.116:0/3830519024 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f2a40012050 con 0x7f2a480b3f90 2024-02-21T22:53:52.587 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:52.592+0000 7f2a3e7fc640 1 --2- 172.21.15.116:0/3830519024 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f2a2c06b4d0 0x7f2a2c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:52.587 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:52.593+0000 7f2a3e7fc640 1 -- 172.21.15.116:0/3830519024 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2a4008a620 con 0x7f2a480b3f90 2024-02-21T22:53:52.587 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:52.593+0000 7f2a4dbd2640 1 --2- 172.21.15.116:0/3830519024 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f2a2c06b4d0 0x7f2a2c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:52.587 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:52.593+0000 7f2a4dbd2640 1 --2- 172.21.15.116:0/3830519024 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f2a2c06b4d0 0x7f2a2c06d990 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f2a44007fd0 tx=0x7f2a44007e80 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:52.588 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:52.597+0000 7f2a3e7fc640 1 -- 172.21.15.116:0/3830519024 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f2a40010040 con 0x7f2a480b3f90 2024-02-21T22:53:52.770 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:52.780+0000 7f2a4fe36640 1 -- 172.21.15.116:0/3830519024 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f2a4806d390 con 0x7f2a480b3f90 2024-02-21T22:53:52.771 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:52.780+0000 7f2a3e7fc640 1 -- 172.21.15.116:0/3830519024 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v33) v1 ==== 80+0+0 (secure 0 0 0) 0x7f2a40058e40 con 0x7f2a480b3f90 2024-02-21T22:53:52.771 INFO:teuthology.orchestra.run.smithi116.stderr:listed 0 entries 2024-02-21T22:53:52.772 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:52.782+0000 7f2a4fe36640 1 -- 172.21.15.116:0/3830519024 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f2a2c06b4d0 msgr2=0x7f2a2c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:52.773 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:52.782+0000 7f2a4fe36640 1 --2- 172.21.15.116:0/3830519024 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f2a2c06b4d0 0x7f2a2c06d990 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f2a44007fd0 tx=0x7f2a44007e80 comp rx=0 tx=0).stop 2024-02-21T22:53:52.773 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:52.782+0000 7f2a4fe36640 1 -- 172.21.15.116:0/3830519024 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2a480b3f90 msgr2=0x7f2a481525c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:52.773 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:52.782+0000 7f2a4fe36640 1 --2- 172.21.15.116:0/3830519024 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2a480b3f90 0x7f2a481525c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f2a4000efc0 tx=0x7f2a4000c490 comp rx=0 tx=0).stop 2024-02-21T22:53:52.773 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:52.782+0000 7f2a4fe36640 1 -- 172.21.15.116:0/3830519024 shutdown_connections 2024-02-21T22:53:52.773 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:52.782+0000 7f2a4fe36640 1 --2- 172.21.15.116:0/3830519024 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f2a2c06b4d0 0x7f2a2c06d990 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:52.773 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:52.782+0000 7f2a4fe36640 1 --2- 172.21.15.116:0/3830519024 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2a480b3f90 0x7f2a481525c0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:52.773 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:52.782+0000 7f2a4fe36640 1 --2- 172.21.15.116:0/3830519024 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2a480b0290 0x7f2a48155150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:52.773 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:52.782+0000 7f2a4fe36640 1 --2- 172.21.15.116:0/3830519024 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a4806b380 0x7f2a481f6fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:52.774 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:52.782+0000 7f2a4fe36640 1 -- 172.21.15.116:0/3830519024 >> 172.21.15.116:0/3830519024 conn(0x7f2a480b29f0 msgr2=0x7f2a480b5ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:52.774 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:52.782+0000 7f2a4fe36640 1 -- 172.21.15.116:0/3830519024 shutdown_connections 2024-02-21T22:53:52.774 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:52.782+0000 7f2a4fe36640 1 -- 172.21.15.116:0/3830519024 wait complete. 2024-02-21T22:53:52.783 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-02-21T22:53:52.784 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T22:53:52.784 DEBUG:teuthology.orchestra.run.smithi116:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-02-21T22:53:52.813 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi116.front.sepia.ceph.com 2024-02-21T22:53:52.814 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T22:53:52.814 DEBUG:teuthology.orchestra.run.smithi116:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-02-21T22:53:52.870 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-02-21T22:53:52.871 DEBUG:teuthology.orchestra.run.smithi116:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-21T22:53:52.926 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056370,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3378 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-02-21T22:53:52.926 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-02-21T22:53:52.926 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-21T22:53:52.942 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056361,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=13619 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-02-21T22:53:52.943 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-02-21T22:53:52.943 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-21T22:53:52.997 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056361,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=13619 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-02-21T22:53:52.997 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T22:53:52.998 DEBUG:teuthology.orchestra.run.smithi116:> ip netns list 2024-02-21T22:53:53.012 INFO:teuthology.orchestra.run.smithi116.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-02-21T22:53:53.012 INFO:teuthology.orchestra.run.smithi116.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-02-21T22:53:53.013 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T22:53:53.013 DEBUG:teuthology.orchestra.run.smithi116:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-02-21T22:53:53.080 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T22:53:53.080 DEBUG:teuthology.orchestra.run.smithi116:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-02-21T22:53:53.148 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T22:53:53.148 DEBUG:teuthology.orchestra.run.smithi116:> sudo ip link delete ceph-brx 2024-02-21T22:53:53.242 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T22:53:53.242 DEBUG:teuthology.orchestra.run.smithi116:> ip netns list 2024-02-21T22:53:53.256 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T22:53:53.257 DEBUG:teuthology.orchestra.run.smithi116:> sudo ip link delete ceph-brx 2024-02-21T22:53:53.327 INFO:teuthology.orchestra.run.smithi116.stderr:Cannot find device "ceph-brx" 2024-02-21T22:53:53.328 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-21T22:53:53.328 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T22:53:53.329 DEBUG:teuthology.orchestra.run.smithi142:> ip netns list 2024-02-21T22:53:53.343 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-02-21T22:53:53.344 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-02-21T22:53:53.344 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T22:53:53.344 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-02-21T22:53:53.412 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T22:53:53.413 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-02-21T22:53:53.480 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T22:53:53.481 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link delete ceph-brx 2024-02-21T22:53:53.579 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T22:53:53.580 DEBUG:teuthology.orchestra.run.smithi142:> ip netns list 2024-02-21T22:53:53.595 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T22:53:53.595 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link delete ceph-brx 2024-02-21T22:53:53.665 INFO:teuthology.orchestra.run.smithi142.stderr:Cannot find device "ceph-brx" 2024-02-21T22:53:53.666 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-21T22:53:53.667 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-02-21T22:53:53.683 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-02-21T22:53:53.684 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-21T22:53:53.788 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:53.798+0000 7f274d9cc640 1 Processor -- start 2024-02-21T22:53:53.789 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:53.798+0000 7f274d9cc640 1 -- start start 2024-02-21T22:53:53.790 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:53.799+0000 7f274d9cc640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f27480d0fc0 0x7f27480d1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:53.790 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:53.799+0000 7f274d9cc640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27480ce8f0 con 0x7f274815e560 2024-02-21T22:53:53.790 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:53.799+0000 7f274d9cc640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27480d1530 con 0x7f274815e180 2024-02-21T22:53:53.790 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:53.799+0000 7f274d9cc640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27480b31b0 con 0x7f27480d0fc0 2024-02-21T22:53:53.790 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:53.799+0000 7f27477fe640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f27480d0fc0 0x7f27480d1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:53.790 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:53.799+0000 7f27467fc640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f274815e560 0x7f27480b0a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:47354/0 (socket says 172.21.15.116:47354) 2024-02-21T22:53:53.791 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:53.799+0000 7f27467fc640 1 -- 172.21.15.116:0/1723429514 learned_addr learned my addr 172.21.15.116:0/1723429514 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-02-21T22:53:53.791 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:53.799+0000 7f27477fe640 1 -- 172.21.15.116:0/1723429514 >> v1:172.21.15.142:6789/0 conn(0x7f274815e180 legacy=0x7f27480cf650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:53:53.791 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:53.799+0000 7f27477fe640 1 -- 172.21.15.116:0/1723429514 >> v1:172.21.15.116:6789/0 conn(0x7f274815e560 legacy=0x7f27480b0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:53.791 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:53.799+0000 7f2745ffb640 1 -- 172.21.15.116:0/1723429514 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 486380544 0 0) 0x7f273c001110 con 0x7f274815e560 2024-02-21T22:53:53.791 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:53.799+0000 7f27477fe640 1 -- 172.21.15.116:0/1723429514 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27480ceb70 con 0x7f27480d0fc0 2024-02-21T22:53:53.792 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:53.800+0000 7f27477fe640 1 --2- 172.21.15.116:0/1723429514 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f27480d0fc0 0x7f27480d1bc0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f2740009d90 tx=0x7f274002beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b4bbcf6c59c103 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:53.793 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:53.800+0000 7f2745ffb640 1 -- 172.21.15.116:0/1723429514 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2740039070 con 0x7f27480d0fc0 2024-02-21T22:53:53.793 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:53.800+0000 7f2745ffb640 1 -- 172.21.15.116:0/1723429514 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f274002cc60 con 0x7f27480d0fc0 2024-02-21T22:53:53.793 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:53.800+0000 7f2745ffb640 1 -- 172.21.15.116:0/1723429514 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2740034660 con 0x7f27480d0fc0 2024-02-21T22:53:53.793 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:53.801+0000 7f274d9cc640 1 -- 172.21.15.116:0/1723429514 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f27480d0fc0 msgr2=0x7f27480d1bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:53.793 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:53.801+0000 7f274d9cc640 1 --2- 172.21.15.116:0/1723429514 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f27480d0fc0 0x7f27480d1bc0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f2740009d90 tx=0x7f274002beb0 comp rx=0 tx=0).stop 2024-02-21T22:53:53.793 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:53.801+0000 7f274d9cc640 1 -- 172.21.15.116:0/1723429514 shutdown_connections 2024-02-21T22:53:53.793 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:53.801+0000 7f274d9cc640 1 --2- 172.21.15.116:0/1723429514 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f27480d0fc0 0x7f27480d1bc0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:53.793 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:53.801+0000 7f274d9cc640 1 -- 172.21.15.116:0/1723429514 >> 172.21.15.116:0/1723429514 conn(0x7f27480d3de0 msgr2=0x7f27480d41f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:53.794 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:53.801+0000 7f274d9cc640 1 -- 172.21.15.116:0/1723429514 shutdown_connections 2024-02-21T22:53:53.794 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:53.801+0000 7f274d9cc640 1 -- 172.21.15.116:0/1723429514 wait complete. 2024-02-21T22:53:53.794 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:53.802+0000 7f274d9cc640 1 Processor -- start 2024-02-21T22:53:53.794 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:53.802+0000 7f274d9cc640 1 -- start start 2024-02-21T22:53:53.796 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:53.803+0000 7f274d9cc640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f27480d0fc0 0x7f274815fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:53.797 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:53.803+0000 7f274d9cc640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f274815e180 0x7f27480cb8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:53.797 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:53.803+0000 7f274d9cc640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f274815e560 0x7f27480c9a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:53.797 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:53.803+0000 7f274d9cc640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27480cf1c0 con 0x7f274815e560 2024-02-21T22:53:53.797 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:53.803+0000 7f274d9cc640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27480d2100 con 0x7f274815e180 2024-02-21T22:53:53.797 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:53.803+0000 7f274d9cc640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27480cfd60 con 0x7f27480d0fc0 2024-02-21T22:53:53.797 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:53.803+0000 7f27477fe640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f274815e560 0x7f27480c9a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:53.797 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:53.803+0000 7f27477fe640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f274815e560 0x7f27480c9a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:40124/0 (socket says 172.21.15.116:40124) 2024-02-21T22:53:53.797 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:53.803+0000 7f27477fe640 1 -- 172.21.15.116:0/1396608071 learned_addr learned my addr 172.21.15.116:0/1396608071 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:53.798 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:53.803+0000 7f2746ffd640 1 --2- 172.21.15.116:0/1396608071 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f27480d0fc0 0x7f274815fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:53.798 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:53.803+0000 7f27467fc640 1 --2- 172.21.15.116:0/1396608071 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f274815e180 0x7f27480cb8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:53.798 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:53.803+0000 7f27477fe640 1 -- 172.21.15.116:0/1396608071 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f27480d0fc0 msgr2=0x7f274815fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:53.798 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:53.803+0000 7f27477fe640 1 --2- 172.21.15.116:0/1396608071 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f27480d0fc0 0x7f274815fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:53.798 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:53.803+0000 7f27477fe640 1 -- 172.21.15.116:0/1396608071 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f274815e180 msgr2=0x7f27480cb8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:53.798 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:53.803+0000 7f27477fe640 1 --2- 172.21.15.116:0/1396608071 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f274815e180 0x7f27480cb8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:53.798 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:53.803+0000 7f27477fe640 1 -- 172.21.15.116:0/1396608071 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27480b94a0 con 0x7f274815e560 2024-02-21T22:53:53.798 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:53.803+0000 7f27477fe640 1 --2- 172.21.15.116:0/1396608071 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f274815e560 0x7f27480c9a40 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f2740037040 tx=0x7f2740004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:53.799 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:53.803+0000 7f272ffff640 1 -- 172.21.15.116:0/1396608071 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2740044030 con 0x7f274815e560 2024-02-21T22:53:53.799 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:53.803+0000 7f272ffff640 1 -- 172.21.15.116:0/1396608071 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f274002ca60 con 0x7f274815e560 2024-02-21T22:53:53.799 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:53.803+0000 7f274d9cc640 1 -- 172.21.15.116:0/1396608071 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27480c89e0 con 0x7f274815e560 2024-02-21T22:53:53.799 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:53.803+0000 7f272ffff640 1 -- 172.21.15.116:0/1396608071 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2740039040 con 0x7f274815e560 2024-02-21T22:53:53.799 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:53.803+0000 7f274d9cc640 1 -- 172.21.15.116:0/1396608071 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27480c8f60 con 0x7f274815e560 2024-02-21T22:53:53.799 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:53.804+0000 7f274d9cc640 1 -- 172.21.15.116:0/1396608071 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27480752f0 con 0x7f274815e560 2024-02-21T22:53:53.799 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:53.805+0000 7f272ffff640 1 -- 172.21.15.116:0/1396608071 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f2740047070 con 0x7f274815e560 2024-02-21T22:53:53.799 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:53.805+0000 7f272ffff640 1 --2- 172.21.15.116:0/1396608071 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f273406b4d0 0x7f273406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:53.799 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:53.805+0000 7f272ffff640 1 -- 172.21.15.116:0/1396608071 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f27400ac920 con 0x7f274815e560 2024-02-21T22:53:53.800 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:53.805+0000 7f2746ffd640 1 --2- 172.21.15.116:0/1396608071 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f273406b4d0 0x7f273406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:53.800 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:53.806+0000 7f2746ffd640 1 --2- 172.21.15.116:0/1396608071 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f273406b4d0 0x7f273406d990 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f27380017f0 tx=0x7f2738009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:53.800 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:53.809+0000 7f272ffff640 1 -- 172.21.15.116:0/1396608071 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f274004e070 con 0x7f274815e560 2024-02-21T22:53:53.967 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:53.976+0000 7f274d9cc640 1 -- 172.21.15.116:0/1396608071 --> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f274815d6f0 con 0x7f273406b4d0 2024-02-21T22:53:53.973 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:53.983+0000 7f272ffff640 1 -- 172.21.15.116:0/1396608071 <== mgr.4103 v2:172.21.15.142:6832/1381484782 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251863 (secure 0 0 0) 0x7f274815d6f0 con 0x7f273406b4d0 2024-02-21T22:53:53.975 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-02-21T22:53:53.977 INFO:teuthology.orchestra.run.smithi116.stderr:dumped all 2024-02-21T22:53:53.978 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:53.985+0000 7f274d9cc640 1 -- 172.21.15.116:0/1396608071 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f273406b4d0 msgr2=0x7f273406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:53.978 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:53.985+0000 7f274d9cc640 1 --2- 172.21.15.116:0/1396608071 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f273406b4d0 0x7f273406d990 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f27380017f0 tx=0x7f2738009040 comp rx=0 tx=0).stop 2024-02-21T22:53:53.978 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:53.985+0000 7f274d9cc640 1 -- 172.21.15.116:0/1396608071 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f274815e560 msgr2=0x7f27480c9a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:53.978 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:53.985+0000 7f274d9cc640 1 --2- 172.21.15.116:0/1396608071 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f274815e560 0x7f27480c9a40 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f2740037040 tx=0x7f2740004a40 comp rx=0 tx=0).stop 2024-02-21T22:53:53.978 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:53.985+0000 7f274d9cc640 1 -- 172.21.15.116:0/1396608071 shutdown_connections 2024-02-21T22:53:53.979 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:53.985+0000 7f274d9cc640 1 --2- 172.21.15.116:0/1396608071 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f274815e560 0x7f27480c9a40 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:53.979 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:53.985+0000 7f274d9cc640 1 --2- 172.21.15.116:0/1396608071 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f274815e180 0x7f27480cb8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:53.979 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:53.985+0000 7f274d9cc640 1 --2- 172.21.15.116:0/1396608071 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f273406b4d0 0x7f273406d990 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:53.979 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:53.985+0000 7f274d9cc640 1 --2- 172.21.15.116:0/1396608071 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f27480d0fc0 0x7f274815fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:53.979 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:53.985+0000 7f274d9cc640 1 -- 172.21.15.116:0/1396608071 >> 172.21.15.116:0/1396608071 conn(0x7f27480d3de0 msgr2=0x7f27480b1c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:53.979 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:53.985+0000 7f274d9cc640 1 -- 172.21.15.116:0/1396608071 shutdown_connections 2024-02-21T22:53:53.979 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:53.986+0000 7f274d9cc640 1 -- 172.21.15.116:0/1396608071 wait complete. 2024-02-21T22:53:53.987 INFO:teuthology.orchestra.run.smithi116.stdout:{"pg_ready":true,"pg_map":{"version":63,"stamp":"2024-02-21T22:53:52.298494+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220360,"kb_used_data":4136,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754360,"statfs":{"total":773094113280,"available":772868464640,"internally_reserved":0,"allocated":4235264,"data_stored":2358484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.311026"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.323002+0000","last_change":"2024-02-21T22:53:43.002525+0000","last_active":"2024-02-21T22:53:44.323002+0000","last_peered":"2024-02-21T22:53:44.323002+0000","last_clean":"2024-02-21T22:53:44.323002+0000","last_became_active":"2024-02-21T22:53:43.002238+0000","last_became_peered":"2024-02-21T22:53:43.002238+0000","last_unstale":"2024-02-21T22:53:44.323002+0000","last_undegraded":"2024-02-21T22:53:44.323002+0000","last_fullsized":"2024-02-21T22:53:44.323002+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:26:25.990337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.340424+0000","last_change":"2024-02-21T22:53:43.000671+0000","last_active":"2024-02-21T22:53:44.340424+0000","last_peered":"2024-02-21T22:53:44.340424+0000","last_clean":"2024-02-21T22:53:44.340424+0000","last_became_active":"2024-02-21T22:53:43.000396+0000","last_became_peered":"2024-02-21T22:53:43.000396+0000","last_unstale":"2024-02-21T22:53:44.340424+0000","last_undegraded":"2024-02-21T22:53:44.340424+0000","last_fullsized":"2024-02-21T22:53:44.340424+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:54:49.339689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.340666+0000","last_change":"2024-02-21T22:53:43.004625+0000","last_active":"2024-02-21T22:53:44.340666+0000","last_peered":"2024-02-21T22:53:44.340666+0000","last_clean":"2024-02-21T22:53:44.340666+0000","last_became_active":"2024-02-21T22:53:43.004321+0000","last_became_peered":"2024-02-21T22:53:43.004321+0000","last_unstale":"2024-02-21T22:53:44.340666+0000","last_undegraded":"2024-02-21T22:53:44.340666+0000","last_fullsized":"2024-02-21T22:53:44.340666+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:34:47.098047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.989775+0000","last_change":"2024-02-21T22:53:43.010931+0000","last_active":"2024-02-21T22:53:43.989775+0000","last_peered":"2024-02-21T22:53:43.989775+0000","last_clean":"2024-02-21T22:53:43.989775+0000","last_became_active":"2024-02-21T22:53:43.010683+0000","last_became_peered":"2024-02-21T22:53:43.010683+0000","last_unstale":"2024-02-21T22:53:43.989775+0000","last_undegraded":"2024-02-21T22:53:43.989775+0000","last_fullsized":"2024-02-21T22:53:43.989775+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:38:31.580364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.236363+0000","last_change":"2024-02-21T22:53:43.006662+0000","last_active":"2024-02-21T22:53:44.236363+0000","last_peered":"2024-02-21T22:53:44.236363+0000","last_clean":"2024-02-21T22:53:44.236363+0000","last_became_active":"2024-02-21T22:53:43.006405+0000","last_became_peered":"2024-02-21T22:53:43.006405+0000","last_unstale":"2024-02-21T22:53:44.236363+0000","last_undegraded":"2024-02-21T22:53:44.236363+0000","last_fullsized":"2024-02-21T22:53:44.236363+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:38:23.681255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.340162+0000","last_change":"2024-02-21T22:53:42.997969+0000","last_active":"2024-02-21T22:53:44.340162+0000","last_peered":"2024-02-21T22:53:44.340162+0000","last_clean":"2024-02-21T22:53:44.340162+0000","last_became_active":"2024-02-21T22:53:42.997719+0000","last_became_peered":"2024-02-21T22:53:42.997719+0000","last_unstale":"2024-02-21T22:53:44.340162+0000","last_undegraded":"2024-02-21T22:53:44.340162+0000","last_fullsized":"2024-02-21T22:53:44.340162+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:09:41.280308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.340372+0000","last_change":"2024-02-21T22:53:43.007930+0000","last_active":"2024-02-21T22:53:44.340372+0000","last_peered":"2024-02-21T22:53:44.340372+0000","last_clean":"2024-02-21T22:53:44.340372+0000","last_became_active":"2024-02-21T22:53:43.007675+0000","last_became_peered":"2024-02-21T22:53:43.007675+0000","last_unstale":"2024-02-21T22:53:44.340372+0000","last_undegraded":"2024-02-21T22:53:44.340372+0000","last_fullsized":"2024-02-21T22:53:44.340372+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:09:41.280308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.340102+0000","last_change":"2024-02-21T22:53:43.001108+0000","last_active":"2024-02-21T22:53:44.340102+0000","last_peered":"2024-02-21T22:53:44.340102+0000","last_clean":"2024-02-21T22:53:44.340102+0000","last_became_active":"2024-02-21T22:53:43.000729+0000","last_became_peered":"2024-02-21T22:53:43.000729+0000","last_unstale":"2024-02-21T22:53:44.340102+0000","last_undegraded":"2024-02-21T22:53:44.340102+0000","last_fullsized":"2024-02-21T22:53:44.340102+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:53:37.531108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.991662+0000","last_change":"2024-02-21T22:53:43.016364+0000","last_active":"2024-02-21T22:53:43.991662+0000","last_peered":"2024-02-21T22:53:43.991662+0000","last_clean":"2024-02-21T22:53:43.991662+0000","last_became_active":"2024-02-21T22:53:43.015907+0000","last_became_peered":"2024-02-21T22:53:43.015907+0000","last_unstale":"2024-02-21T22:53:43.991662+0000","last_undegraded":"2024-02-21T22:53:43.991662+0000","last_fullsized":"2024-02-21T22:53:43.991662+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:53:37.531108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.990165+0000","last_change":"2024-02-21T22:53:43.005373+0000","last_active":"2024-02-21T22:53:43.990165+0000","last_peered":"2024-02-21T22:53:43.990165+0000","last_clean":"2024-02-21T22:53:43.990165+0000","last_became_active":"2024-02-21T22:53:43.005035+0000","last_became_peered":"2024-02-21T22:53:43.005035+0000","last_unstale":"2024-02-21T22:53:43.990165+0000","last_undegraded":"2024-02-21T22:53:43.990165+0000","last_fullsized":"2024-02-21T22:53:43.990165+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:03:52.457060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.341174+0000","last_change":"2024-02-21T22:53:43.011309+0000","last_active":"2024-02-21T22:53:44.341174+0000","last_peered":"2024-02-21T22:53:44.341174+0000","last_clean":"2024-02-21T22:53:44.341174+0000","last_became_active":"2024-02-21T22:53:43.010956+0000","last_became_peered":"2024-02-21T22:53:43.010956+0000","last_unstale":"2024-02-21T22:53:44.341174+0000","last_undegraded":"2024-02-21T22:53:44.341174+0000","last_fullsized":"2024-02-21T22:53:44.341174+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:24:37.189670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.340545+0000","last_change":"2024-02-21T22:53:43.007326+0000","last_active":"2024-02-21T22:53:44.340545+0000","last_peered":"2024-02-21T22:53:44.340545+0000","last_clean":"2024-02-21T22:53:44.340545+0000","last_became_active":"2024-02-21T22:53:43.007022+0000","last_became_peered":"2024-02-21T22:53:43.007022+0000","last_unstale":"2024-02-21T22:53:44.340545+0000","last_undegraded":"2024-02-21T22:53:44.340545+0000","last_fullsized":"2024-02-21T22:53:44.340545+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:09:41.280308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.236376+0000","last_change":"2024-02-21T22:53:42.999643+0000","last_active":"2024-02-21T22:53:44.236376+0000","last_peered":"2024-02-21T22:53:44.236376+0000","last_clean":"2024-02-21T22:53:44.236376+0000","last_became_active":"2024-02-21T22:53:42.999406+0000","last_became_peered":"2024-02-21T22:53:42.999406+0000","last_unstale":"2024-02-21T22:53:44.236376+0000","last_undegraded":"2024-02-21T22:53:44.236376+0000","last_fullsized":"2024-02-21T22:53:44.236376+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:44:43.049562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.340324+0000","last_change":"2024-02-21T22:53:43.005346+0000","last_active":"2024-02-21T22:53:44.340324+0000","last_peered":"2024-02-21T22:53:44.340324+0000","last_clean":"2024-02-21T22:53:44.340324+0000","last_became_active":"2024-02-21T22:53:43.004383+0000","last_became_peered":"2024-02-21T22:53:43.004383+0000","last_unstale":"2024-02-21T22:53:44.340324+0000","last_undegraded":"2024-02-21T22:53:44.340324+0000","last_fullsized":"2024-02-21T22:53:44.340324+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:24:37.189670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.340241+0000","last_change":"2024-02-21T22:53:42.995690+0000","last_active":"2024-02-21T22:53:44.340241+0000","last_peered":"2024-02-21T22:53:44.340241+0000","last_clean":"2024-02-21T22:53:44.340241+0000","last_became_active":"2024-02-21T22:53:42.995407+0000","last_became_peered":"2024-02-21T22:53:42.995407+0000","last_unstale":"2024-02-21T22:53:44.340241+0000","last_undegraded":"2024-02-21T22:53:44.340241+0000","last_fullsized":"2024-02-21T22:53:44.340241+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:41:56.581902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.340256+0000","last_change":"2024-02-21T22:53:43.009355+0000","last_active":"2024-02-21T22:53:44.340256+0000","last_peered":"2024-02-21T22:53:44.340256+0000","last_clean":"2024-02-21T22:53:44.340256+0000","last_became_active":"2024-02-21T22:53:43.009073+0000","last_became_peered":"2024-02-21T22:53:43.009073+0000","last_unstale":"2024-02-21T22:53:44.340256+0000","last_undegraded":"2024-02-21T22:53:44.340256+0000","last_fullsized":"2024-02-21T22:53:44.340256+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:03:52.457060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.341204+0000","last_change":"2024-02-21T22:53:43.008675+0000","last_active":"2024-02-21T22:53:44.341204+0000","last_peered":"2024-02-21T22:53:44.341204+0000","last_clean":"2024-02-21T22:53:44.341204+0000","last_became_active":"2024-02-21T22:53:43.008404+0000","last_became_peered":"2024-02-21T22:53:43.008404+0000","last_unstale":"2024-02-21T22:53:44.341204+0000","last_undegraded":"2024-02-21T22:53:44.341204+0000","last_fullsized":"2024-02-21T22:53:44.341204+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:00:32.372505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.340466+0000","last_change":"2024-02-21T22:53:42.999615+0000","last_active":"2024-02-21T22:53:44.340466+0000","last_peered":"2024-02-21T22:53:44.340466+0000","last_clean":"2024-02-21T22:53:44.340466+0000","last_became_active":"2024-02-21T22:53:42.999362+0000","last_became_peered":"2024-02-21T22:53:42.999362+0000","last_unstale":"2024-02-21T22:53:44.340466+0000","last_undegraded":"2024-02-21T22:53:44.340466+0000","last_fullsized":"2024-02-21T22:53:44.340466+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:36:43.932976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.340333+0000","last_change":"2024-02-21T22:53:43.010970+0000","last_active":"2024-02-21T22:53:44.340333+0000","last_peered":"2024-02-21T22:53:44.340333+0000","last_clean":"2024-02-21T22:53:44.340333+0000","last_became_active":"2024-02-21T22:53:43.010702+0000","last_became_peered":"2024-02-21T22:53:43.010702+0000","last_unstale":"2024-02-21T22:53:44.340333+0000","last_undegraded":"2024-02-21T22:53:44.340333+0000","last_fullsized":"2024-02-21T22:53:44.340333+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:00:32.372505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.236456+0000","last_change":"2024-02-21T22:53:43.006258+0000","last_active":"2024-02-21T22:53:44.236456+0000","last_peered":"2024-02-21T22:53:44.236456+0000","last_clean":"2024-02-21T22:53:44.236456+0000","last_became_active":"2024-02-21T22:53:43.005993+0000","last_became_peered":"2024-02-21T22:53:43.005993+0000","last_unstale":"2024-02-21T22:53:44.236456+0000","last_undegraded":"2024-02-21T22:53:44.236456+0000","last_fullsized":"2024-02-21T22:53:44.236456+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:27:19.189008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.991192+0000","last_change":"2024-02-21T22:53:43.015003+0000","last_active":"2024-02-21T22:53:43.991192+0000","last_peered":"2024-02-21T22:53:43.991192+0000","last_clean":"2024-02-21T22:53:43.991192+0000","last_became_active":"2024-02-21T22:53:43.014712+0000","last_became_peered":"2024-02-21T22:53:43.014712+0000","last_unstale":"2024-02-21T22:53:43.991192+0000","last_undegraded":"2024-02-21T22:53:43.991192+0000","last_fullsized":"2024-02-21T22:53:43.991192+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:15:36.152598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.991098+0000","last_change":"2024-02-21T22:53:43.014845+0000","last_active":"2024-02-21T22:53:43.991098+0000","last_peered":"2024-02-21T22:53:43.991098+0000","last_clean":"2024-02-21T22:53:43.991098+0000","last_became_active":"2024-02-21T22:53:43.014570+0000","last_became_peered":"2024-02-21T22:53:43.014570+0000","last_unstale":"2024-02-21T22:53:43.991098+0000","last_undegraded":"2024-02-21T22:53:43.991098+0000","last_fullsized":"2024-02-21T22:53:43.991098+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:26:25.990337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.990453+0000","last_change":"2024-02-21T22:53:43.002518+0000","last_active":"2024-02-21T22:53:43.990453+0000","last_peered":"2024-02-21T22:53:43.990453+0000","last_clean":"2024-02-21T22:53:43.990453+0000","last_became_active":"2024-02-21T22:53:43.002254+0000","last_became_peered":"2024-02-21T22:53:43.002254+0000","last_unstale":"2024-02-21T22:53:43.990453+0000","last_undegraded":"2024-02-21T22:53:43.990453+0000","last_fullsized":"2024-02-21T22:53:43.990453+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:06:03.706623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.340072+0000","last_change":"2024-02-21T22:53:42.996552+0000","last_active":"2024-02-21T22:53:44.340072+0000","last_peered":"2024-02-21T22:53:44.340072+0000","last_clean":"2024-02-21T22:53:44.340072+0000","last_became_active":"2024-02-21T22:53:42.996208+0000","last_became_peered":"2024-02-21T22:53:42.996208+0000","last_unstale":"2024-02-21T22:53:44.340072+0000","last_undegraded":"2024-02-21T22:53:44.340072+0000","last_fullsized":"2024-02-21T22:53:44.340072+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:31:54.235302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.990349+0000","last_change":"2024-02-21T22:53:43.003996+0000","last_active":"2024-02-21T22:53:43.990349+0000","last_peered":"2024-02-21T22:53:43.990349+0000","last_clean":"2024-02-21T22:53:43.990349+0000","last_became_active":"2024-02-21T22:53:43.003710+0000","last_became_peered":"2024-02-21T22:53:43.003710+0000","last_unstale":"2024-02-21T22:53:43.990349+0000","last_undegraded":"2024-02-21T22:53:43.990349+0000","last_fullsized":"2024-02-21T22:53:43.990349+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T02:25:22.385393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.340570+0000","last_change":"2024-02-21T22:53:43.000854+0000","last_active":"2024-02-21T22:53:44.340570+0000","last_peered":"2024-02-21T22:53:44.340570+0000","last_clean":"2024-02-21T22:53:44.340570+0000","last_became_active":"2024-02-21T22:53:43.000575+0000","last_became_peered":"2024-02-21T22:53:43.000575+0000","last_unstale":"2024-02-21T22:53:44.340570+0000","last_undegraded":"2024-02-21T22:53:44.340570+0000","last_fullsized":"2024-02-21T22:53:44.340570+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:03:16.607197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.990344+0000","last_change":"2024-02-21T22:53:43.011416+0000","last_active":"2024-02-21T22:53:43.990344+0000","last_peered":"2024-02-21T22:53:43.990344+0000","last_clean":"2024-02-21T22:53:43.990344+0000","last_became_active":"2024-02-21T22:53:43.010808+0000","last_became_peered":"2024-02-21T22:53:43.010808+0000","last_unstale":"2024-02-21T22:53:43.990344+0000","last_undegraded":"2024-02-21T22:53:43.990344+0000","last_fullsized":"2024-02-21T22:53:43.990344+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:09:41.280308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.340672+0000","last_change":"2024-02-21T22:53:42.999624+0000","last_active":"2024-02-21T22:53:44.340672+0000","last_peered":"2024-02-21T22:53:44.340672+0000","last_clean":"2024-02-21T22:53:44.340672+0000","last_became_active":"2024-02-21T22:53:42.999295+0000","last_became_peered":"2024-02-21T22:53:42.999295+0000","last_unstale":"2024-02-21T22:53:44.340672+0000","last_undegraded":"2024-02-21T22:53:44.340672+0000","last_fullsized":"2024-02-21T22:53:44.340672+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:24:37.189670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.991295+0000","last_change":"2024-02-21T22:53:43.016081+0000","last_active":"2024-02-21T22:53:43.991295+0000","last_peered":"2024-02-21T22:53:43.991295+0000","last_clean":"2024-02-21T22:53:43.991295+0000","last_became_active":"2024-02-21T22:53:43.015533+0000","last_became_peered":"2024-02-21T22:53:43.015533+0000","last_unstale":"2024-02-21T22:53:43.991295+0000","last_undegraded":"2024-02-21T22:53:43.991295+0000","last_fullsized":"2024-02-21T22:53:43.991295+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:13:51.231189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.340327+0000","last_change":"2024-02-21T22:53:43.007179+0000","last_active":"2024-02-21T22:53:44.340327+0000","last_peered":"2024-02-21T22:53:44.340327+0000","last_clean":"2024-02-21T22:53:44.340327+0000","last_became_active":"2024-02-21T22:53:43.006982+0000","last_became_peered":"2024-02-21T22:53:43.006982+0000","last_unstale":"2024-02-21T22:53:44.340327+0000","last_undegraded":"2024-02-21T22:53:44.340327+0000","last_fullsized":"2024-02-21T22:53:44.340327+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:41:56.581902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.322838+0000","last_change":"2024-02-21T22:53:43.000423+0000","last_active":"2024-02-21T22:53:44.322838+0000","last_peered":"2024-02-21T22:53:44.322838+0000","last_clean":"2024-02-21T22:53:44.322838+0000","last_became_active":"2024-02-21T22:53:43.000179+0000","last_became_peered":"2024-02-21T22:53:43.000179+0000","last_unstale":"2024-02-21T22:53:44.322838+0000","last_undegraded":"2024-02-21T22:53:44.322838+0000","last_fullsized":"2024-02-21T22:53:44.322838+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:06:03.706623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.340129+0000","last_change":"2024-02-21T22:53:43.013244+0000","last_active":"2024-02-21T22:53:44.340129+0000","last_peered":"2024-02-21T22:53:44.340129+0000","last_clean":"2024-02-21T22:53:44.340129+0000","last_became_active":"2024-02-21T22:53:43.012985+0000","last_became_peered":"2024-02-21T22:53:43.012985+0000","last_unstale":"2024-02-21T22:53:44.340129+0000","last_undegraded":"2024-02-21T22:53:44.340129+0000","last_fullsized":"2024-02-21T22:53:44.340129+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:38:31.580364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.990598+0000","last_change":"2024-02-21T22:53:43.001816+0000","last_active":"2024-02-21T22:53:43.990598+0000","last_peered":"2024-02-21T22:53:43.990598+0000","last_clean":"2024-02-21T22:53:43.990598+0000","last_became_active":"2024-02-21T22:53:43.001564+0000","last_became_peered":"2024-02-21T22:53:43.001564+0000","last_unstale":"2024-02-21T22:53:43.990598+0000","last_undegraded":"2024-02-21T22:53:43.990598+0000","last_fullsized":"2024-02-21T22:53:43.990598+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:26:25.990337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"32'4","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.323094+0000","last_change":"2024-02-21T22:53:41.994843+0000","last_active":"2024-02-21T22:53:44.323094+0000","last_peered":"2024-02-21T22:53:44.323094+0000","last_clean":"2024-02-21T22:53:44.323094+0000","last_became_active":"2024-02-21T22:53:41.994468+0000","last_became_peered":"2024-02-21T22:53:41.994468+0000","last_unstale":"2024-02-21T22:53:44.323094+0000","last_undegraded":"2024-02-21T22:53:44.323094+0000","last_fullsized":"2024-02-21T22:53:44.323094+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:27:18.184658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.323022+0000","last_change":"2024-02-21T22:53:43.008294+0000","last_active":"2024-02-21T22:53:44.323022+0000","last_peered":"2024-02-21T22:53:44.323022+0000","last_clean":"2024-02-21T22:53:44.323022+0000","last_became_active":"2024-02-21T22:53:43.008021+0000","last_became_peered":"2024-02-21T22:53:43.008021+0000","last_unstale":"2024-02-21T22:53:44.323022+0000","last_undegraded":"2024-02-21T22:53:44.323022+0000","last_fullsized":"2024-02-21T22:53:44.323022+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:15:36.152598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"32'1","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.990599+0000","last_change":"2024-02-21T22:53:41.987067+0000","last_active":"2024-02-21T22:53:43.990599+0000","last_peered":"2024-02-21T22:53:43.990599+0000","last_clean":"2024-02-21T22:53:43.990599+0000","last_became_active":"2024-02-21T22:53:41.986784+0000","last_became_peered":"2024-02-21T22:53:41.986784+0000","last_unstale":"2024-02-21T22:53:43.990599+0000","last_undegraded":"2024-02-21T22:53:43.990599+0000","last_fullsized":"2024-02-21T22:53:43.990599+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:34:59.792432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.991412+0000","last_change":"2024-02-21T22:53:43.016649+0000","last_active":"2024-02-21T22:53:43.991412+0000","last_peered":"2024-02-21T22:53:43.991412+0000","last_clean":"2024-02-21T22:53:43.991412+0000","last_became_active":"2024-02-21T22:53:43.016339+0000","last_became_peered":"2024-02-21T22:53:43.016339+0000","last_unstale":"2024-02-21T22:53:43.991412+0000","last_undegraded":"2024-02-21T22:53:43.991412+0000","last_fullsized":"2024-02-21T22:53:43.991412+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:40:05.306862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"32'2","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.340263+0000","last_change":"2024-02-21T22:53:41.991758+0000","last_active":"2024-02-21T22:53:44.340263+0000","last_peered":"2024-02-21T22:53:44.340263+0000","last_clean":"2024-02-21T22:53:44.340263+0000","last_became_active":"2024-02-21T22:53:41.990213+0000","last_became_peered":"2024-02-21T22:53:41.990213+0000","last_unstale":"2024-02-21T22:53:44.340263+0000","last_undegraded":"2024-02-21T22:53:44.340263+0000","last_fullsized":"2024-02-21T22:53:44.340263+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:54:00.352993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.990191+0000","last_change":"2024-02-21T22:53:43.011534+0000","last_active":"2024-02-21T22:53:43.990191+0000","last_peered":"2024-02-21T22:53:43.990191+0000","last_clean":"2024-02-21T22:53:43.990191+0000","last_became_active":"2024-02-21T22:53:43.011165+0000","last_became_peered":"2024-02-21T22:53:43.011165+0000","last_unstale":"2024-02-21T22:53:43.990191+0000","last_undegraded":"2024-02-21T22:53:43.990191+0000","last_fullsized":"2024-02-21T22:53:43.990191+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:41:56.581902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"32'2","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.236551+0000","last_change":"2024-02-21T22:53:41.989989+0000","last_active":"2024-02-21T22:53:44.236551+0000","last_peered":"2024-02-21T22:53:44.236551+0000","last_clean":"2024-02-21T22:53:44.236551+0000","last_became_active":"2024-02-21T22:53:41.989105+0000","last_became_peered":"2024-02-21T22:53:41.989105+0000","last_unstale":"2024-02-21T22:53:44.236551+0000","last_undegraded":"2024-02-21T22:53:44.236551+0000","last_fullsized":"2024-02-21T22:53:44.236551+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:22:53.606008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.340540+0000","last_change":"2024-02-21T22:53:43.012670+0000","last_active":"2024-02-21T22:53:44.340540+0000","last_peered":"2024-02-21T22:53:44.340540+0000","last_clean":"2024-02-21T22:53:44.340540+0000","last_became_active":"2024-02-21T22:53:43.012407+0000","last_became_peered":"2024-02-21T22:53:43.012407+0000","last_unstale":"2024-02-21T22:53:44.340540+0000","last_undegraded":"2024-02-21T22:53:44.340540+0000","last_fullsized":"2024-02-21T22:53:44.340540+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T02:25:22.385393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"32'1","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.991294+0000","last_change":"2024-02-21T22:53:41.992560+0000","last_active":"2024-02-21T22:53:43.991294+0000","last_peered":"2024-02-21T22:53:43.991294+0000","last_clean":"2024-02-21T22:53:43.991294+0000","last_became_active":"2024-02-21T22:53:41.992200+0000","last_became_peered":"2024-02-21T22:53:41.992200+0000","last_unstale":"2024-02-21T22:53:43.991294+0000","last_undegraded":"2024-02-21T22:53:43.991294+0000","last_fullsized":"2024-02-21T22:53:43.991294+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:47:38.675797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.340453+0000","last_change":"2024-02-21T22:53:43.003713+0000","last_active":"2024-02-21T22:53:44.340453+0000","last_peered":"2024-02-21T22:53:44.340453+0000","last_clean":"2024-02-21T22:53:44.340453+0000","last_became_active":"2024-02-21T22:53:43.003448+0000","last_became_peered":"2024-02-21T22:53:43.003448+0000","last_unstale":"2024-02-21T22:53:44.340453+0000","last_undegraded":"2024-02-21T22:53:44.340453+0000","last_fullsized":"2024-02-21T22:53:44.340453+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T02:25:22.385393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"32'1","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.991129+0000","last_change":"2024-02-21T22:53:41.989888+0000","last_active":"2024-02-21T22:53:43.991129+0000","last_peered":"2024-02-21T22:53:43.991129+0000","last_clean":"2024-02-21T22:53:43.991129+0000","last_became_active":"2024-02-21T22:53:41.989605+0000","last_became_peered":"2024-02-21T22:53:41.989605+0000","last_unstale":"2024-02-21T22:53:43.991129+0000","last_undegraded":"2024-02-21T22:53:43.991129+0000","last_fullsized":"2024-02-21T22:53:43.991129+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:28:50.954719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.990957+0000","last_change":"2024-02-21T22:53:43.011697+0000","last_active":"2024-02-21T22:53:43.990957+0000","last_peered":"2024-02-21T22:53:43.990957+0000","last_clean":"2024-02-21T22:53:43.990957+0000","last_became_active":"2024-02-21T22:53:43.011446+0000","last_became_peered":"2024-02-21T22:53:43.011446+0000","last_unstale":"2024-02-21T22:53:43.990957+0000","last_undegraded":"2024-02-21T22:53:43.990957+0000","last_fullsized":"2024-02-21T22:53:43.990957+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:53:37.219886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.340098+0000","last_change":"2024-02-21T22:53:41.990198+0000","last_active":"2024-02-21T22:53:44.340098+0000","last_peered":"2024-02-21T22:53:44.340098+0000","last_clean":"2024-02-21T22:53:44.340098+0000","last_became_active":"2024-02-21T22:53:41.989927+0000","last_became_peered":"2024-02-21T22:53:41.989927+0000","last_unstale":"2024-02-21T22:53:44.340098+0000","last_undegraded":"2024-02-21T22:53:44.340098+0000","last_fullsized":"2024-02-21T22:53:44.340098+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:08:08.137842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.989576+0000","last_change":"2024-02-21T22:53:43.008825+0000","last_active":"2024-02-21T22:53:43.989576+0000","last_peered":"2024-02-21T22:53:43.989576+0000","last_clean":"2024-02-21T22:53:43.989576+0000","last_became_active":"2024-02-21T22:53:43.008486+0000","last_became_peered":"2024-02-21T22:53:43.008486+0000","last_unstale":"2024-02-21T22:53:43.989576+0000","last_undegraded":"2024-02-21T22:53:43.989576+0000","last_fullsized":"2024-02-21T22:53:43.989576+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:02:41.596861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.990903+0000","last_change":"2024-02-21T22:53:41.985526+0000","last_active":"2024-02-21T22:53:43.990903+0000","last_peered":"2024-02-21T22:53:43.990903+0000","last_clean":"2024-02-21T22:53:43.990903+0000","last_became_active":"2024-02-21T22:53:41.985232+0000","last_became_peered":"2024-02-21T22:53:41.985232+0000","last_unstale":"2024-02-21T22:53:43.990903+0000","last_undegraded":"2024-02-21T22:53:43.990903+0000","last_fullsized":"2024-02-21T22:53:43.990903+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:46:31.483732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.340853+0000","last_change":"2024-02-21T22:53:43.005931+0000","last_active":"2024-02-21T22:53:44.340853+0000","last_peered":"2024-02-21T22:53:44.340853+0000","last_clean":"2024-02-21T22:53:44.340853+0000","last_became_active":"2024-02-21T22:53:43.005375+0000","last_became_peered":"2024-02-21T22:53:43.005375+0000","last_unstale":"2024-02-21T22:53:44.340853+0000","last_undegraded":"2024-02-21T22:53:44.340853+0000","last_fullsized":"2024-02-21T22:53:44.340853+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:00:32.372505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.340503+0000","last_change":"2024-02-21T22:53:41.987065+0000","last_active":"2024-02-21T22:53:44.340503+0000","last_peered":"2024-02-21T22:53:44.340503+0000","last_clean":"2024-02-21T22:53:44.340503+0000","last_became_active":"2024-02-21T22:53:41.986873+0000","last_became_peered":"2024-02-21T22:53:41.986873+0000","last_unstale":"2024-02-21T22:53:44.340503+0000","last_undegraded":"2024-02-21T22:53:44.340503+0000","last_fullsized":"2024-02-21T22:53:44.340503+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:53:36.215536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.340464+0000","last_change":"2024-02-21T22:53:43.010123+0000","last_active":"2024-02-21T22:53:44.340464+0000","last_peered":"2024-02-21T22:53:44.340464+0000","last_clean":"2024-02-21T22:53:44.340464+0000","last_became_active":"2024-02-21T22:53:43.009846+0000","last_became_peered":"2024-02-21T22:53:43.009846+0000","last_unstale":"2024-02-21T22:53:44.340464+0000","last_undegraded":"2024-02-21T22:53:44.340464+0000","last_fullsized":"2024-02-21T22:53:44.340464+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:18:34.897900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.990694+0000","last_change":"2024-02-21T22:53:41.987725+0000","last_active":"2024-02-21T22:53:43.990694+0000","last_peered":"2024-02-21T22:53:43.990694+0000","last_clean":"2024-02-21T22:53:43.990694+0000","last_became_active":"2024-02-21T22:53:41.987448+0000","last_became_peered":"2024-02-21T22:53:41.987448+0000","last_unstale":"2024-02-21T22:53:43.990694+0000","last_undegraded":"2024-02-21T22:53:43.990694+0000","last_fullsized":"2024-02-21T22:53:43.990694+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:52:02.783816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.340463+0000","last_change":"2024-02-21T22:53:42.997365+0000","last_active":"2024-02-21T22:53:44.340463+0000","last_peered":"2024-02-21T22:53:44.340463+0000","last_clean":"2024-02-21T22:53:44.340463+0000","last_became_active":"2024-02-21T22:53:42.997104+0000","last_became_peered":"2024-02-21T22:53:42.997104+0000","last_unstale":"2024-02-21T22:53:44.340463+0000","last_undegraded":"2024-02-21T22:53:44.340463+0000","last_fullsized":"2024-02-21T22:53:44.340463+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T10:22:33.646484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"32'3","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.340752+0000","last_change":"2024-02-21T22:53:41.994505+0000","last_active":"2024-02-21T22:53:44.340752+0000","last_peered":"2024-02-21T22:53:44.340752+0000","last_clean":"2024-02-21T22:53:44.340752+0000","last_became_active":"2024-02-21T22:53:41.994214+0000","last_became_peered":"2024-02-21T22:53:41.994214+0000","last_unstale":"2024-02-21T22:53:44.340752+0000","last_undegraded":"2024-02-21T22:53:44.340752+0000","last_fullsized":"2024-02-21T22:53:44.340752+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:10:09.126154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.340155+0000","last_change":"2024-02-21T22:53:43.005537+0000","last_active":"2024-02-21T22:53:44.340155+0000","last_peered":"2024-02-21T22:53:44.340155+0000","last_clean":"2024-02-21T22:53:44.340155+0000","last_became_active":"2024-02-21T22:53:43.004978+0000","last_became_peered":"2024-02-21T22:53:43.004978+0000","last_unstale":"2024-02-21T22:53:44.340155+0000","last_undegraded":"2024-02-21T22:53:44.340155+0000","last_fullsized":"2024-02-21T22:53:44.340155+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:03:52.457060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"32'6","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.340471+0000","last_change":"2024-02-21T22:53:41.989878+0000","last_active":"2024-02-21T22:53:44.340471+0000","last_peered":"2024-02-21T22:53:44.340471+0000","last_clean":"2024-02-21T22:53:44.340471+0000","last_became_active":"2024-02-21T22:53:41.989590+0000","last_became_peered":"2024-02-21T22:53:41.989590+0000","last_unstale":"2024-02-21T22:53:44.340471+0000","last_undegraded":"2024-02-21T22:53:44.340471+0000","last_fullsized":"2024-02-21T22:53:44.340471+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:06:02.702272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.989607+0000","last_change":"2024-02-21T22:53:43.008192+0000","last_active":"2024-02-21T22:53:43.989607+0000","last_peered":"2024-02-21T22:53:43.989607+0000","last_clean":"2024-02-21T22:53:43.989607+0000","last_became_active":"2024-02-21T22:53:43.007923+0000","last_became_peered":"2024-02-21T22:53:43.007923+0000","last_unstale":"2024-02-21T22:53:43.989607+0000","last_undegraded":"2024-02-21T22:53:43.989607+0000","last_fullsized":"2024-02-21T22:53:43.989607+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:53:37.531108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"32'2","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.991477+0000","last_change":"2024-02-21T22:53:41.986805+0000","last_active":"2024-02-21T22:53:43.991477+0000","last_peered":"2024-02-21T22:53:43.991477+0000","last_clean":"2024-02-21T22:53:43.991477+0000","last_became_active":"2024-02-21T22:53:41.985220+0000","last_became_peered":"2024-02-21T22:53:41.985220+0000","last_unstale":"2024-02-21T22:53:43.991477+0000","last_undegraded":"2024-02-21T22:53:43.991477+0000","last_fullsized":"2024-02-21T22:53:43.991477+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:21:25.274383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.340308+0000","last_change":"2024-02-21T22:53:43.003557+0000","last_active":"2024-02-21T22:53:44.340308+0000","last_peered":"2024-02-21T22:53:44.340308+0000","last_clean":"2024-02-21T22:53:44.340308+0000","last_became_active":"2024-02-21T22:53:43.003293+0000","last_became_peered":"2024-02-21T22:53:43.003293+0000","last_unstale":"2024-02-21T22:53:44.340308+0000","last_undegraded":"2024-02-21T22:53:44.340308+0000","last_fullsized":"2024-02-21T22:53:44.340308+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:34:47.098047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.989593+0000","last_change":"2024-02-21T22:53:41.987760+0000","last_active":"2024-02-21T22:53:43.989593+0000","last_peered":"2024-02-21T22:53:43.989593+0000","last_clean":"2024-02-21T22:53:43.989593+0000","last_became_active":"2024-02-21T22:53:41.987379+0000","last_became_peered":"2024-02-21T22:53:41.987379+0000","last_unstale":"2024-02-21T22:53:43.989593+0000","last_undegraded":"2024-02-21T22:53:43.989593+0000","last_fullsized":"2024-02-21T22:53:43.989593+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:28:09.845765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.340250+0000","last_change":"2024-02-21T22:53:43.014121+0000","last_active":"2024-02-21T22:53:44.340250+0000","last_peered":"2024-02-21T22:53:44.340250+0000","last_clean":"2024-02-21T22:53:44.340250+0000","last_became_active":"2024-02-21T22:53:43.013636+0000","last_became_peered":"2024-02-21T22:53:43.013636+0000","last_unstale":"2024-02-21T22:53:44.340250+0000","last_undegraded":"2024-02-21T22:53:44.340250+0000","last_fullsized":"2024-02-21T22:53:44.340250+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:31:54.235302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.340024+0000","last_change":"2024-02-21T22:53:41.989414+0000","last_active":"2024-02-21T22:53:44.340024+0000","last_peered":"2024-02-21T22:53:44.340024+0000","last_clean":"2024-02-21T22:53:44.340024+0000","last_became_active":"2024-02-21T22:53:41.988958+0000","last_became_peered":"2024-02-21T22:53:41.988958+0000","last_unstale":"2024-02-21T22:53:44.340024+0000","last_undegraded":"2024-02-21T22:53:44.340024+0000","last_fullsized":"2024-02-21T22:53:44.340024+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:09:00.593509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.322897+0000","last_change":"2024-02-21T22:53:43.010267+0000","last_active":"2024-02-21T22:53:44.322897+0000","last_peered":"2024-02-21T22:53:44.322897+0000","last_clean":"2024-02-21T22:53:44.322897+0000","last_became_active":"2024-02-21T22:53:43.010007+0000","last_became_peered":"2024-02-21T22:53:43.010007+0000","last_unstale":"2024-02-21T22:53:44.322897+0000","last_undegraded":"2024-02-21T22:53:44.322897+0000","last_fullsized":"2024-02-21T22:53:44.322897+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:53:37.219886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"32'8","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.340161+0000","last_change":"2024-02-21T22:53:41.990362+0000","last_active":"2024-02-21T22:53:44.340161+0000","last_peered":"2024-02-21T22:53:44.340161+0000","last_clean":"2024-02-21T22:53:44.340161+0000","last_became_active":"2024-02-21T22:53:41.989531+0000","last_became_peered":"2024-02-21T22:53:41.989531+0000","last_unstale":"2024-02-21T22:53:44.340161+0000","last_undegraded":"2024-02-21T22:53:44.340161+0000","last_fullsized":"2024-02-21T22:53:44.340161+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:10:09.126154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.991581+0000","last_change":"2024-02-21T22:53:43.010224+0000","last_active":"2024-02-21T22:53:43.991581+0000","last_peered":"2024-02-21T22:53:43.991581+0000","last_clean":"2024-02-21T22:53:43.991581+0000","last_became_active":"2024-02-21T22:53:43.009914+0000","last_became_peered":"2024-02-21T22:53:43.009914+0000","last_unstale":"2024-02-21T22:53:43.991581+0000","last_undegraded":"2024-02-21T22:53:43.991581+0000","last_fullsized":"2024-02-21T22:53:43.991581+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:02:41.596861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"32'1","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.990394+0000","last_change":"2024-02-21T22:53:41.988393+0000","last_active":"2024-02-21T22:53:43.990394+0000","last_peered":"2024-02-21T22:53:43.990394+0000","last_clean":"2024-02-21T22:53:43.990394+0000","last_became_active":"2024-02-21T22:53:41.987692+0000","last_became_peered":"2024-02-21T22:53:41.987692+0000","last_unstale":"2024-02-21T22:53:43.990394+0000","last_undegraded":"2024-02-21T22:53:43.990394+0000","last_fullsized":"2024-02-21T22:53:43.990394+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:08:08.137842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.340924+0000","last_change":"2024-02-21T22:53:43.009888+0000","last_active":"2024-02-21T22:53:44.340924+0000","last_peered":"2024-02-21T22:53:44.340924+0000","last_clean":"2024-02-21T22:53:44.340924+0000","last_became_active":"2024-02-21T22:53:43.009536+0000","last_became_peered":"2024-02-21T22:53:43.009536+0000","last_unstale":"2024-02-21T22:53:44.340924+0000","last_undegraded":"2024-02-21T22:53:44.340924+0000","last_fullsized":"2024-02-21T22:53:44.340924+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:54:49.339689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"32'2","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.991607+0000","last_change":"2024-02-21T22:53:41.986266+0000","last_active":"2024-02-21T22:53:43.991607+0000","last_peered":"2024-02-21T22:53:43.991607+0000","last_clean":"2024-02-21T22:53:43.991607+0000","last_became_active":"2024-02-21T22:53:41.985942+0000","last_became_peered":"2024-02-21T22:53:41.985942+0000","last_unstale":"2024-02-21T22:53:43.991607+0000","last_undegraded":"2024-02-21T22:53:43.991607+0000","last_fullsized":"2024-02-21T22:53:43.991607+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:29:52.528059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.989804+0000","last_change":"2024-02-21T22:53:43.010964+0000","last_active":"2024-02-21T22:53:43.989804+0000","last_peered":"2024-02-21T22:53:43.989804+0000","last_clean":"2024-02-21T22:53:43.989804+0000","last_became_active":"2024-02-21T22:53:43.010739+0000","last_became_peered":"2024-02-21T22:53:43.010739+0000","last_unstale":"2024-02-21T22:53:43.989804+0000","last_undegraded":"2024-02-21T22:53:43.989804+0000","last_fullsized":"2024-02-21T22:53:43.989804+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:31:54.235302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"32'1","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.991526+0000","last_change":"2024-02-21T22:53:41.987516+0000","last_active":"2024-02-21T22:53:43.991526+0000","last_peered":"2024-02-21T22:53:43.991526+0000","last_clean":"2024-02-21T22:53:43.991526+0000","last_became_active":"2024-02-21T22:53:41.986968+0000","last_became_peered":"2024-02-21T22:53:41.986968+0000","last_unstale":"2024-02-21T22:53:43.991526+0000","last_undegraded":"2024-02-21T22:53:43.991526+0000","last_fullsized":"2024-02-21T22:53:43.991526+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:08:36.876969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.236512+0000","last_change":"2024-02-21T22:53:43.001927+0000","last_active":"2024-02-21T22:53:44.236512+0000","last_peered":"2024-02-21T22:53:44.236512+0000","last_clean":"2024-02-21T22:53:44.236512+0000","last_became_active":"2024-02-21T22:53:43.001668+0000","last_became_peered":"2024-02-21T22:53:43.001668+0000","last_unstale":"2024-02-21T22:53:44.236512+0000","last_undegraded":"2024-02-21T22:53:44.236512+0000","last_fullsized":"2024-02-21T22:53:44.236512+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:52:03.788166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.991343+0000","last_change":"2024-02-21T22:53:41.990148+0000","last_active":"2024-02-21T22:53:43.991343+0000","last_peered":"2024-02-21T22:53:43.991343+0000","last_clean":"2024-02-21T22:53:43.991343+0000","last_became_active":"2024-02-21T22:53:41.989146+0000","last_became_peered":"2024-02-21T22:53:41.989146+0000","last_unstale":"2024-02-21T22:53:43.991343+0000","last_undegraded":"2024-02-21T22:53:43.991343+0000","last_fullsized":"2024-02-21T22:53:43.991343+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:13:43.209250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.236324+0000","last_change":"2024-02-21T22:53:43.011129+0000","last_active":"2024-02-21T22:53:44.236324+0000","last_peered":"2024-02-21T22:53:44.236324+0000","last_clean":"2024-02-21T22:53:44.236324+0000","last_became_active":"2024-02-21T22:53:43.010865+0000","last_became_peered":"2024-02-21T22:53:43.010865+0000","last_unstale":"2024-02-21T22:53:44.236324+0000","last_undegraded":"2024-02-21T22:53:44.236324+0000","last_fullsized":"2024-02-21T22:53:44.236324+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:21:26.278733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"32'2","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.990759+0000","last_change":"2024-02-21T22:53:41.984829+0000","last_active":"2024-02-21T22:53:43.990759+0000","last_peered":"2024-02-21T22:53:43.990759+0000","last_clean":"2024-02-21T22:53:43.990759+0000","last_became_active":"2024-02-21T22:53:41.984573+0000","last_became_peered":"2024-02-21T22:53:41.984573+0000","last_unstale":"2024-02-21T22:53:43.990759+0000","last_undegraded":"2024-02-21T22:53:43.990759+0000","last_fullsized":"2024-02-21T22:53:43.990759+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:44:42.045212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.236514+0000","last_change":"2024-02-21T22:53:43.001820+0000","last_active":"2024-02-21T22:53:44.236514+0000","last_peered":"2024-02-21T22:53:44.236514+0000","last_clean":"2024-02-21T22:53:44.236514+0000","last_became_active":"2024-02-21T22:53:43.001513+0000","last_became_peered":"2024-02-21T22:53:43.001513+0000","last_unstale":"2024-02-21T22:53:44.236514+0000","last_undegraded":"2024-02-21T22:53:44.236514+0000","last_fullsized":"2024-02-21T22:53:44.236514+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:28:10.850115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.322908+0000","last_change":"2024-02-21T22:53:41.991544+0000","last_active":"2024-02-21T22:53:44.322908+0000","last_peered":"2024-02-21T22:53:44.322908+0000","last_clean":"2024-02-21T22:53:44.322908+0000","last_became_active":"2024-02-21T22:53:41.991247+0000","last_became_peered":"2024-02-21T22:53:41.991247+0000","last_unstale":"2024-02-21T22:53:44.322908+0000","last_undegraded":"2024-02-21T22:53:44.322908+0000","last_fullsized":"2024-02-21T22:53:44.322908+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:44:42.045212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.236291+0000","last_change":"2024-02-21T22:53:43.000454+0000","last_active":"2024-02-21T22:53:44.236291+0000","last_peered":"2024-02-21T22:53:44.236291+0000","last_clean":"2024-02-21T22:53:44.236291+0000","last_became_active":"2024-02-21T22:53:43.000172+0000","last_became_peered":"2024-02-21T22:53:43.000172+0000","last_unstale":"2024-02-21T22:53:44.236291+0000","last_undegraded":"2024-02-21T22:53:44.236291+0000","last_fullsized":"2024-02-21T22:53:44.236291+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:29:53.532409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.990890+0000","last_change":"2024-02-21T22:53:41.988349+0000","last_active":"2024-02-21T22:53:43.990890+0000","last_peered":"2024-02-21T22:53:43.990890+0000","last_clean":"2024-02-21T22:53:43.990890+0000","last_became_active":"2024-02-21T22:53:41.987202+0000","last_became_peered":"2024-02-21T22:53:41.987202+0000","last_unstale":"2024-02-21T22:53:43.990890+0000","last_undegraded":"2024-02-21T22:53:43.990890+0000","last_fullsized":"2024-02-21T22:53:43.990890+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:38:22.676905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.340090+0000","last_change":"2024-02-21T22:53:43.008590+0000","last_active":"2024-02-21T22:53:44.340090+0000","last_peered":"2024-02-21T22:53:44.340090+0000","last_clean":"2024-02-21T22:53:44.340090+0000","last_became_active":"2024-02-21T22:53:43.007502+0000","last_became_peered":"2024-02-21T22:53:43.007502+0000","last_unstale":"2024-02-21T22:53:44.340090+0000","last_undegraded":"2024-02-21T22:53:44.340090+0000","last_fullsized":"2024-02-21T22:53:44.340090+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:02:41.596861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.340170+0000","last_change":"2024-02-21T22:53:41.993199+0000","last_active":"2024-02-21T22:53:44.340170+0000","last_peered":"2024-02-21T22:53:44.340170+0000","last_clean":"2024-02-21T22:53:44.340170+0000","last_became_active":"2024-02-21T22:53:41.992944+0000","last_became_peered":"2024-02-21T22:53:41.992944+0000","last_unstale":"2024-02-21T22:53:44.340170+0000","last_undegraded":"2024-02-21T22:53:44.340170+0000","last_fullsized":"2024-02-21T22:53:44.340170+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:09:00.593509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.236482+0000","last_change":"2024-02-21T22:53:43.007504+0000","last_active":"2024-02-21T22:53:44.236482+0000","last_peered":"2024-02-21T22:53:44.236482+0000","last_clean":"2024-02-21T22:53:44.236482+0000","last_became_active":"2024-02-21T22:53:43.007283+0000","last_became_peered":"2024-02-21T22:53:43.007283+0000","last_unstale":"2024-02-21T22:53:44.236482+0000","last_undegraded":"2024-02-21T22:53:44.236482+0000","last_fullsized":"2024-02-21T22:53:44.236482+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:35:00.796782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"32'2","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.990438+0000","last_change":"2024-02-21T22:53:41.994504+0000","last_active":"2024-02-21T22:53:43.990438+0000","last_peered":"2024-02-21T22:53:43.990438+0000","last_clean":"2024-02-21T22:53:43.990438+0000","last_became_active":"2024-02-21T22:53:41.994229+0000","last_became_peered":"2024-02-21T22:53:41.994229+0000","last_unstale":"2024-02-21T22:53:43.990438+0000","last_undegraded":"2024-02-21T22:53:43.990438+0000","last_fullsized":"2024-02-21T22:53:43.990438+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:09:00.593509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.340937+0000","last_change":"2024-02-21T22:53:43.006538+0000","last_active":"2024-02-21T22:53:44.340937+0000","last_peered":"2024-02-21T22:53:44.340937+0000","last_clean":"2024-02-21T22:53:44.340937+0000","last_became_active":"2024-02-21T22:53:43.006058+0000","last_became_peered":"2024-02-21T22:53:43.006058+0000","last_unstale":"2024-02-21T22:53:44.340937+0000","last_undegraded":"2024-02-21T22:53:44.340937+0000","last_fullsized":"2024-02-21T22:53:44.340937+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:18:34.897900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"33'1","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.990746+0000","last_change":"2024-02-21T22:53:41.985703+0000","last_active":"2024-02-21T22:53:43.990746+0000","last_peered":"2024-02-21T22:53:43.990746+0000","last_clean":"2024-02-21T22:53:43.990746+0000","last_became_active":"2024-02-21T22:53:41.985263+0000","last_became_peered":"2024-02-21T22:53:41.985263+0000","last_unstale":"2024-02-21T22:53:43.990746+0000","last_undegraded":"2024-02-21T22:53:43.990746+0000","last_fullsized":"2024-02-21T22:53:43.990746+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:28:09.845765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.990580+0000","last_change":"2024-02-21T22:53:43.005317+0000","last_active":"2024-02-21T22:53:43.990580+0000","last_peered":"2024-02-21T22:53:43.990580+0000","last_clean":"2024-02-21T22:53:43.990580+0000","last_became_active":"2024-02-21T22:53:43.005033+0000","last_became_peered":"2024-02-21T22:53:43.005033+0000","last_unstale":"2024-02-21T22:53:43.990580+0000","last_undegraded":"2024-02-21T22:53:43.990580+0000","last_fullsized":"2024-02-21T22:53:43.990580+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:53:37.219886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.989830+0000","last_change":"2024-02-21T22:53:41.986296+0000","last_active":"2024-02-21T22:53:43.989830+0000","last_peered":"2024-02-21T22:53:43.989830+0000","last_clean":"2024-02-21T22:53:43.989830+0000","last_became_active":"2024-02-21T22:53:41.985909+0000","last_became_peered":"2024-02-21T22:53:41.985909+0000","last_unstale":"2024-02-21T22:53:43.989830+0000","last_undegraded":"2024-02-21T22:53:43.989830+0000","last_fullsized":"2024-02-21T22:53:43.989830+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:34:59.792432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.322818+0000","last_change":"2024-02-21T22:53:43.000226+0000","last_active":"2024-02-21T22:53:44.322818+0000","last_peered":"2024-02-21T22:53:44.322818+0000","last_clean":"2024-02-21T22:53:44.322818+0000","last_became_active":"2024-02-21T22:53:42.999987+0000","last_became_peered":"2024-02-21T22:53:42.999987+0000","last_unstale":"2024-02-21T22:53:44.322818+0000","last_undegraded":"2024-02-21T22:53:44.322818+0000","last_fullsized":"2024-02-21T22:53:44.322818+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:54:01.357343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.990812+0000","last_change":"2024-02-21T22:53:41.991285+0000","last_active":"2024-02-21T22:53:43.990812+0000","last_peered":"2024-02-21T22:53:43.990812+0000","last_clean":"2024-02-21T22:53:43.990812+0000","last_became_active":"2024-02-21T22:53:41.990977+0000","last_became_peered":"2024-02-21T22:53:41.990977+0000","last_unstale":"2024-02-21T22:53:43.990812+0000","last_undegraded":"2024-02-21T22:53:43.990812+0000","last_fullsized":"2024-02-21T22:53:43.990812+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:27:18.184658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.990731+0000","last_change":"2024-02-21T22:53:42.999736+0000","last_active":"2024-02-21T22:53:43.990731+0000","last_peered":"2024-02-21T22:53:43.990731+0000","last_clean":"2024-02-21T22:53:43.990731+0000","last_became_active":"2024-02-21T22:53:42.999472+0000","last_became_peered":"2024-02-21T22:53:42.999472+0000","last_unstale":"2024-02-21T22:53:43.990731+0000","last_undegraded":"2024-02-21T22:53:43.990731+0000","last_fullsized":"2024-02-21T22:53:43.990731+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:15:36.152598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.989686+0000","last_change":"2024-02-21T22:53:41.991062+0000","last_active":"2024-02-21T22:53:43.989686+0000","last_peered":"2024-02-21T22:53:43.989686+0000","last_clean":"2024-02-21T22:53:43.989686+0000","last_became_active":"2024-02-21T22:53:41.990791+0000","last_became_peered":"2024-02-21T22:53:41.990791+0000","last_unstale":"2024-02-21T22:53:43.989686+0000","last_undegraded":"2024-02-21T22:53:43.989686+0000","last_fullsized":"2024-02-21T22:53:43.989686+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:52:02.783816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.340056+0000","last_change":"2024-02-21T22:53:42.999431+0000","last_active":"2024-02-21T22:53:44.340056+0000","last_peered":"2024-02-21T22:53:44.340056+0000","last_clean":"2024-02-21T22:53:44.340056+0000","last_became_active":"2024-02-21T22:53:42.999170+0000","last_became_peered":"2024-02-21T22:53:42.999170+0000","last_unstale":"2024-02-21T22:53:44.340056+0000","last_undegraded":"2024-02-21T22:53:44.340056+0000","last_fullsized":"2024-02-21T22:53:44.340056+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T02:25:22.385393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.991018+0000","last_change":"2024-02-21T22:53:41.995139+0000","last_active":"2024-02-21T22:53:43.991018+0000","last_peered":"2024-02-21T22:53:43.991018+0000","last_clean":"2024-02-21T22:53:43.991018+0000","last_became_active":"2024-02-21T22:53:41.994560+0000","last_became_peered":"2024-02-21T22:53:41.994560+0000","last_unstale":"2024-02-21T22:53:43.991018+0000","last_undegraded":"2024-02-21T22:53:43.991018+0000","last_fullsized":"2024-02-21T22:53:43.991018+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:44:42.045212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.990932+0000","last_change":"2024-02-21T22:53:43.015964+0000","last_active":"2024-02-21T22:53:43.990932+0000","last_peered":"2024-02-21T22:53:43.990932+0000","last_clean":"2024-02-21T22:53:43.990932+0000","last_became_active":"2024-02-21T22:53:43.015685+0000","last_became_peered":"2024-02-21T22:53:43.015685+0000","last_unstale":"2024-02-21T22:53:43.990932+0000","last_undegraded":"2024-02-21T22:53:43.990932+0000","last_fullsized":"2024-02-21T22:53:43.990932+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:06:03.706623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.340065+0000","last_change":"2024-02-21T22:53:41.988521+0000","last_active":"2024-02-21T22:53:44.340065+0000","last_peered":"2024-02-21T22:53:44.340065+0000","last_clean":"2024-02-21T22:53:44.340065+0000","last_became_active":"2024-02-21T22:53:41.987907+0000","last_became_peered":"2024-02-21T22:53:41.987907+0000","last_unstale":"2024-02-21T22:53:44.340065+0000","last_undegraded":"2024-02-21T22:53:44.340065+0000","last_fullsized":"2024-02-21T22:53:44.340065+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:52:02.783816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.340633+0000","last_change":"2024-02-21T22:53:43.001964+0000","last_active":"2024-02-21T22:53:44.340633+0000","last_peered":"2024-02-21T22:53:44.340633+0000","last_clean":"2024-02-21T22:53:44.340633+0000","last_became_active":"2024-02-21T22:53:43.001671+0000","last_became_peered":"2024-02-21T22:53:43.001671+0000","last_unstale":"2024-02-21T22:53:44.340633+0000","last_undegraded":"2024-02-21T22:53:44.340633+0000","last_fullsized":"2024-02-21T22:53:44.340633+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:34:47.098047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.322830+0000","last_change":"2024-02-21T22:53:41.991783+0000","last_active":"2024-02-21T22:53:44.322830+0000","last_peered":"2024-02-21T22:53:44.322830+0000","last_clean":"2024-02-21T22:53:44.322830+0000","last_became_active":"2024-02-21T22:53:41.991530+0000","last_became_peered":"2024-02-21T22:53:41.991530+0000","last_unstale":"2024-02-21T22:53:44.322830+0000","last_undegraded":"2024-02-21T22:53:44.322830+0000","last_fullsized":"2024-02-21T22:53:44.322830+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:38:22.676905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":194,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.339918+0000","last_change":"2024-02-21T22:52:40.336187+0000","last_active":"2024-02-21T22:53:44.339918+0000","last_peered":"2024-02-21T22:53:44.339918+0000","last_clean":"2024-02-21T22:53:44.339918+0000","last_became_active":"2024-02-21T22:52:40.335061+0000","last_became_peered":"2024-02-21T22:52:40.335061+0000","last_unstale":"2024-02-21T22:53:44.339918+0000","last_undegraded":"2024-02-21T22:53:44.339918+0000","last_fullsized":"2024-02-21T22:53:44.339918+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:38.328863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:38.328863+0000","last_clean_scrub_stamp":"2024-02-21T22:52:38.328863+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:33:53.012414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574865,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27976,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343864,"statfs":{"total":96636764160,"available":96608116736,"internally_reserved":0,"allocated":970752,"data_stored":737074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574866,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":380928,"data_stored":147232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574867,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":380928,"data_stored":147288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574866,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":380928,"data_stored":146720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574866,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":389120,"data_stored":148250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574866,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":376832,"data_stored":146686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574867,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":389120,"data_stored":148250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574865,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27972,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343868,"statfs":{"total":96636764160,"available":96608120832,"internally_reserved":0,"allocated":966656,"data_stored":736984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-21T22:53:53.991 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-21T22:53:54.127 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.137+0000 7f7bc8220640 1 Processor -- start 2024-02-21T22:53:54.127 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.137+0000 7f7bc8220640 1 -- start start 2024-02-21T22:53:54.129 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.138+0000 7f7bc8220640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f7bc015f9b0 0x7f7bc0166b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:54.129 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.138+0000 7f7bc8220640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bc015feb0 con 0x7f7bc006c8f0 2024-02-21T22:53:54.129 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.138+0000 7f7bc8220640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bc0160190 con 0x7f7bc0145210 2024-02-21T22:53:54.129 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.138+0000 7f7bc8220640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bc0160470 con 0x7f7bc015f9b0 2024-02-21T22:53:54.129 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.138+0000 7f7bc67bd640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f7bc015f9b0 0x7f7bc0166b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:54.129 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.138+0000 7f7bc57bb640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f7bc006c8f0 0x7f7bc00716d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:47360/0 (socket says 172.21.15.116:47360) 2024-02-21T22:53:54.129 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.138+0000 7f7bc67bd640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f7bc015f9b0 0x7f7bc0166b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:40132/0 (socket says 172.21.15.116:40132) 2024-02-21T22:53:54.129 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.138+0000 7f7bc57bb640 1 -- 172.21.15.116:0/3053018991 learned_addr learned my addr 172.21.15.116:0/3053018991 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-02-21T22:53:54.130 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.138+0000 7f7bc67bd640 1 -- 172.21.15.116:0/3053018991 >> v1:172.21.15.142:6789/0 conn(0x7f7bc0145210 legacy=0x7f7bc0070fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:54.130 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.138+0000 7f7bc67bd640 1 -- 172.21.15.116:0/3053018991 >> v1:172.21.15.116:6789/0 conn(0x7f7bc006c8f0 legacy=0x7f7bc00716d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:54.130 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.138+0000 7f7bc67bd640 1 -- 172.21.15.116:0/3053018991 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bc0160750 con 0x7f7bc015f9b0 2024-02-21T22:53:54.130 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.138+0000 7f7bc4fba640 1 -- 172.21.15.116:0/3053018991 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1409445712 0 0) 0x7f7bc015feb0 con 0x7f7bc006c8f0 2024-02-21T22:53:54.133 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.139+0000 7f7bc67bd640 1 --2- 172.21.15.116:0/3053018991 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7bc015f9b0 0x7f7bc0166b30 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f7bb8009d90 tx=0x7f7bb802bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdfcacb93770b0c9 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:54.134 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.139+0000 7f7bc4fba640 1 -- 172.21.15.116:0/3053018991 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bb8039070 con 0x7f7bc015f9b0 2024-02-21T22:53:54.134 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.139+0000 7f7bc4fba640 1 -- 172.21.15.116:0/3053018991 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bb802cd00 con 0x7f7bc015f9b0 2024-02-21T22:53:54.134 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.139+0000 7f7bc4fba640 1 -- 172.21.15.116:0/3053018991 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bb8034660 con 0x7f7bc015f9b0 2024-02-21T22:53:54.134 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.139+0000 7f7bc8220640 1 -- 172.21.15.116:0/3053018991 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7bc015f9b0 msgr2=0x7f7bc0166b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:54.134 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.139+0000 7f7bc8220640 1 --2- 172.21.15.116:0/3053018991 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7bc015f9b0 0x7f7bc0166b30 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f7bb8009d90 tx=0x7f7bb802bf50 comp rx=0 tx=0).stop 2024-02-21T22:53:54.134 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.140+0000 7f7bc8220640 1 -- 172.21.15.116:0/3053018991 shutdown_connections 2024-02-21T22:53:54.134 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.140+0000 7f7bc8220640 1 --2- 172.21.15.116:0/3053018991 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7bc015f9b0 0x7f7bc0166b30 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:54.134 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.140+0000 7f7bc8220640 1 -- 172.21.15.116:0/3053018991 >> 172.21.15.116:0/3053018991 conn(0x7f7bc00b18e0 msgr2=0x7f7bc00b1cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:54.135 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.140+0000 7f7bc8220640 1 -- 172.21.15.116:0/3053018991 shutdown_connections 2024-02-21T22:53:54.135 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.140+0000 7f7bc8220640 1 -- 172.21.15.116:0/3053018991 wait complete. 2024-02-21T22:53:54.135 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.141+0000 7f7bc8220640 1 Processor -- start 2024-02-21T22:53:54.135 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.141+0000 7f7bc8220640 1 -- start start 2024-02-21T22:53:54.135 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.141+0000 7f7bc8220640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7bc006c8f0 0x7f7bc01343d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:54.135 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.141+0000 7f7bc8220640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7bc0145210 0x7f7bc013bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:54.135 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.141+0000 7f7bc8220640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7bc015f9b0 0x7f7bc0136590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:54.135 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.141+0000 7f7bc8220640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bc0167070 con 0x7f7bc006c8f0 2024-02-21T22:53:54.135 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.141+0000 7f7bc8220640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bc0145900 con 0x7f7bc015f9b0 2024-02-21T22:53:54.136 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.141+0000 7f7bc8220640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bc01671f0 con 0x7f7bc0145210 2024-02-21T22:53:54.136 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.141+0000 7f7bc5fbc640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7bc006c8f0 0x7f7bc01343d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:54.136 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.142+0000 7f7bc5fbc640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7bc006c8f0 0x7f7bc01343d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:40146/0 (socket says 172.21.15.116:40146) 2024-02-21T22:53:54.136 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.142+0000 7f7bc5fbc640 1 -- 172.21.15.116:0/108344223 learned_addr learned my addr 172.21.15.116:0/108344223 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:54.136 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.142+0000 7f7bc57bb640 1 --2- 172.21.15.116:0/108344223 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7bc0145210 0x7f7bc013bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:54.136 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.142+0000 7f7bc67bd640 1 --2- 172.21.15.116:0/108344223 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7bc015f9b0 0x7f7bc0136590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:54.136 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.142+0000 7f7bc5fbc640 1 -- 172.21.15.116:0/108344223 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7bc0145210 msgr2=0x7f7bc013bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:54.136 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.142+0000 7f7bc5fbc640 1 --2- 172.21.15.116:0/108344223 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7bc0145210 0x7f7bc013bb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:54.137 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.142+0000 7f7bc5fbc640 1 -- 172.21.15.116:0/108344223 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7bc015f9b0 msgr2=0x7f7bc0136590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:54.137 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.142+0000 7f7bc5fbc640 1 --2- 172.21.15.116:0/108344223 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7bc015f9b0 0x7f7bc0136590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:54.137 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.142+0000 7f7bc5fbc640 1 -- 172.21.15.116:0/108344223 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bc0134a20 con 0x7f7bc006c8f0 2024-02-21T22:53:54.137 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.142+0000 7f7bc5fbc640 1 --2- 172.21.15.116:0/108344223 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7bc006c8f0 0x7f7bc01343d0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f7bbc00c450 tx=0x7f7bbc00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:54.137 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.142+0000 7f7bb67fc640 1 -- 172.21.15.116:0/108344223 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bbc017070 con 0x7f7bc006c8f0 2024-02-21T22:53:54.137 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.142+0000 7f7bb67fc640 1 -- 172.21.15.116:0/108344223 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bbc0052d0 con 0x7f7bc006c8f0 2024-02-21T22:53:54.137 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.142+0000 7f7bc8220640 1 -- 172.21.15.116:0/108344223 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bc013adc0 con 0x7f7bc006c8f0 2024-02-21T22:53:54.137 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.142+0000 7f7bb67fc640 1 -- 172.21.15.116:0/108344223 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bbc003830 con 0x7f7bc006c8f0 2024-02-21T22:53:54.137 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.142+0000 7f7bc8220640 1 -- 172.21.15.116:0/108344223 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bc013b380 con 0x7f7bc006c8f0 2024-02-21T22:53:54.137 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.143+0000 7f7bc8220640 1 -- 172.21.15.116:0/108344223 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bc00752f0 con 0x7f7bc006c8f0 2024-02-21T22:53:54.138 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.143+0000 7f7bb67fc640 1 -- 172.21.15.116:0/108344223 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f7bbc01a070 con 0x7f7bc006c8f0 2024-02-21T22:53:54.138 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.144+0000 7f7bb67fc640 1 --2- 172.21.15.116:0/108344223 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f7ba406b4d0 0x7f7ba406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:54.139 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.144+0000 7f7bb67fc640 1 -- 172.21.15.116:0/108344223 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7bbc089490 con 0x7f7bc006c8f0 2024-02-21T22:53:54.139 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.144+0000 7f7bc57bb640 1 --2- 172.21.15.116:0/108344223 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f7ba406b4d0 0x7f7ba406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:54.139 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.144+0000 7f7bc57bb640 1 --2- 172.21.15.116:0/108344223 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f7ba406b4d0 0x7f7ba406d990 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f7bb0007f70 tx=0x7f7bb0007f00 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:54.139 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.148+0000 7f7bb67fc640 1 -- 172.21.15.116:0/108344223 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f7bbc057d50 con 0x7f7bc006c8f0 2024-02-21T22:53:54.305 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.314+0000 7f7bc8220640 1 -- 172.21.15.116:0/108344223 --> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7bc00723a0 con 0x7f7ba406b4d0 2024-02-21T22:53:54.311 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.321+0000 7f7bb67fc640 1 -- 172.21.15.116:0/108344223 <== mgr.4103 v2:172.21.15.142:6832/1381484782 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251840 (secure 0 0 0) 0x7f7bc00723a0 con 0x7f7ba406b4d0 2024-02-21T22:53:54.314 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-02-21T22:53:54.315 INFO:teuthology.orchestra.run.smithi116.stderr:dumped all 2024-02-21T22:53:54.317 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.323+0000 7f7bc8220640 1 -- 172.21.15.116:0/108344223 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f7ba406b4d0 msgr2=0x7f7ba406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:54.317 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.323+0000 7f7bc8220640 1 --2- 172.21.15.116:0/108344223 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f7ba406b4d0 0x7f7ba406d990 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f7bb0007f70 tx=0x7f7bb0007f00 comp rx=0 tx=0).stop 2024-02-21T22:53:54.317 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.323+0000 7f7bc8220640 1 -- 172.21.15.116:0/108344223 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7bc006c8f0 msgr2=0x7f7bc01343d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:54.317 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.323+0000 7f7bc8220640 1 --2- 172.21.15.116:0/108344223 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7bc006c8f0 0x7f7bc01343d0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f7bbc00c450 tx=0x7f7bbc00c910 comp rx=0 tx=0).stop 2024-02-21T22:53:54.318 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.323+0000 7f7bc8220640 1 -- 172.21.15.116:0/108344223 shutdown_connections 2024-02-21T22:53:54.318 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.323+0000 7f7bc8220640 1 --2- 172.21.15.116:0/108344223 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7bc015f9b0 0x7f7bc0136590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:54.318 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.323+0000 7f7bc8220640 1 --2- 172.21.15.116:0/108344223 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f7ba406b4d0 0x7f7ba406d990 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:54.318 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.323+0000 7f7bc8220640 1 --2- 172.21.15.116:0/108344223 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7bc0145210 0x7f7bc013bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:54.318 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.323+0000 7f7bc8220640 1 --2- 172.21.15.116:0/108344223 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7bc006c8f0 0x7f7bc01343d0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:54.318 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.323+0000 7f7bc8220640 1 -- 172.21.15.116:0/108344223 >> 172.21.15.116:0/108344223 conn(0x7f7bc00b18e0 msgr2=0x7f7bc013fc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:54.318 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.324+0000 7f7bc8220640 1 -- 172.21.15.116:0/108344223 shutdown_connections 2024-02-21T22:53:54.318 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.324+0000 7f7bc8220640 1 -- 172.21.15.116:0/108344223 wait complete. 2024-02-21T22:53:54.325 INFO:teuthology.orchestra.run.smithi116.stdout:{"pg_ready":true,"pg_map":{"version":64,"stamp":"2024-02-21T22:53:54.298750+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":598311,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":212,"num_write_kb":2439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":162,"ondisk_log_size":162,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220332,"kb_used_data":4144,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754388,"statfs":{"total":773094113280,"available":772868493312,"internally_reserved":0,"allocated":4243456,"data_stored":2369393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5533,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.309583"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.323002+0000","last_change":"2024-02-21T22:53:43.002525+0000","last_active":"2024-02-21T22:53:44.323002+0000","last_peered":"2024-02-21T22:53:44.323002+0000","last_clean":"2024-02-21T22:53:44.323002+0000","last_became_active":"2024-02-21T22:53:43.002238+0000","last_became_peered":"2024-02-21T22:53:43.002238+0000","last_unstale":"2024-02-21T22:53:44.323002+0000","last_undegraded":"2024-02-21T22:53:44.323002+0000","last_fullsized":"2024-02-21T22:53:44.323002+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:26:25.990337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.340424+0000","last_change":"2024-02-21T22:53:43.000671+0000","last_active":"2024-02-21T22:53:44.340424+0000","last_peered":"2024-02-21T22:53:44.340424+0000","last_clean":"2024-02-21T22:53:44.340424+0000","last_became_active":"2024-02-21T22:53:43.000396+0000","last_became_peered":"2024-02-21T22:53:43.000396+0000","last_unstale":"2024-02-21T22:53:44.340424+0000","last_undegraded":"2024-02-21T22:53:44.340424+0000","last_fullsized":"2024-02-21T22:53:44.340424+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:54:49.339689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.340666+0000","last_change":"2024-02-21T22:53:43.004625+0000","last_active":"2024-02-21T22:53:44.340666+0000","last_peered":"2024-02-21T22:53:44.340666+0000","last_clean":"2024-02-21T22:53:44.340666+0000","last_became_active":"2024-02-21T22:53:43.004321+0000","last_became_peered":"2024-02-21T22:53:43.004321+0000","last_unstale":"2024-02-21T22:53:44.340666+0000","last_undegraded":"2024-02-21T22:53:44.340666+0000","last_fullsized":"2024-02-21T22:53:44.340666+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:34:47.098047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.989775+0000","last_change":"2024-02-21T22:53:43.010931+0000","last_active":"2024-02-21T22:53:43.989775+0000","last_peered":"2024-02-21T22:53:43.989775+0000","last_clean":"2024-02-21T22:53:43.989775+0000","last_became_active":"2024-02-21T22:53:43.010683+0000","last_became_peered":"2024-02-21T22:53:43.010683+0000","last_unstale":"2024-02-21T22:53:43.989775+0000","last_undegraded":"2024-02-21T22:53:43.989775+0000","last_fullsized":"2024-02-21T22:53:43.989775+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:38:31.580364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.236363+0000","last_change":"2024-02-21T22:53:43.006662+0000","last_active":"2024-02-21T22:53:44.236363+0000","last_peered":"2024-02-21T22:53:44.236363+0000","last_clean":"2024-02-21T22:53:44.236363+0000","last_became_active":"2024-02-21T22:53:43.006405+0000","last_became_peered":"2024-02-21T22:53:43.006405+0000","last_unstale":"2024-02-21T22:53:44.236363+0000","last_undegraded":"2024-02-21T22:53:44.236363+0000","last_fullsized":"2024-02-21T22:53:44.236363+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:38:23.681255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.340162+0000","last_change":"2024-02-21T22:53:42.997969+0000","last_active":"2024-02-21T22:53:44.340162+0000","last_peered":"2024-02-21T22:53:44.340162+0000","last_clean":"2024-02-21T22:53:44.340162+0000","last_became_active":"2024-02-21T22:53:42.997719+0000","last_became_peered":"2024-02-21T22:53:42.997719+0000","last_unstale":"2024-02-21T22:53:44.340162+0000","last_undegraded":"2024-02-21T22:53:44.340162+0000","last_fullsized":"2024-02-21T22:53:44.340162+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:09:41.280308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.340372+0000","last_change":"2024-02-21T22:53:43.007930+0000","last_active":"2024-02-21T22:53:44.340372+0000","last_peered":"2024-02-21T22:53:44.340372+0000","last_clean":"2024-02-21T22:53:44.340372+0000","last_became_active":"2024-02-21T22:53:43.007675+0000","last_became_peered":"2024-02-21T22:53:43.007675+0000","last_unstale":"2024-02-21T22:53:44.340372+0000","last_undegraded":"2024-02-21T22:53:44.340372+0000","last_fullsized":"2024-02-21T22:53:44.340372+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:09:41.280308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.340102+0000","last_change":"2024-02-21T22:53:43.001108+0000","last_active":"2024-02-21T22:53:44.340102+0000","last_peered":"2024-02-21T22:53:44.340102+0000","last_clean":"2024-02-21T22:53:44.340102+0000","last_became_active":"2024-02-21T22:53:43.000729+0000","last_became_peered":"2024-02-21T22:53:43.000729+0000","last_unstale":"2024-02-21T22:53:44.340102+0000","last_undegraded":"2024-02-21T22:53:44.340102+0000","last_fullsized":"2024-02-21T22:53:44.340102+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:53:37.531108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.991662+0000","last_change":"2024-02-21T22:53:43.016364+0000","last_active":"2024-02-21T22:53:43.991662+0000","last_peered":"2024-02-21T22:53:43.991662+0000","last_clean":"2024-02-21T22:53:43.991662+0000","last_became_active":"2024-02-21T22:53:43.015907+0000","last_became_peered":"2024-02-21T22:53:43.015907+0000","last_unstale":"2024-02-21T22:53:43.991662+0000","last_undegraded":"2024-02-21T22:53:43.991662+0000","last_fullsized":"2024-02-21T22:53:43.991662+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:53:37.531108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.990165+0000","last_change":"2024-02-21T22:53:43.005373+0000","last_active":"2024-02-21T22:53:43.990165+0000","last_peered":"2024-02-21T22:53:43.990165+0000","last_clean":"2024-02-21T22:53:43.990165+0000","last_became_active":"2024-02-21T22:53:43.005035+0000","last_became_peered":"2024-02-21T22:53:43.005035+0000","last_unstale":"2024-02-21T22:53:43.990165+0000","last_undegraded":"2024-02-21T22:53:43.990165+0000","last_fullsized":"2024-02-21T22:53:43.990165+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:03:52.457060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.341174+0000","last_change":"2024-02-21T22:53:43.011309+0000","last_active":"2024-02-21T22:53:44.341174+0000","last_peered":"2024-02-21T22:53:44.341174+0000","last_clean":"2024-02-21T22:53:44.341174+0000","last_became_active":"2024-02-21T22:53:43.010956+0000","last_became_peered":"2024-02-21T22:53:43.010956+0000","last_unstale":"2024-02-21T22:53:44.341174+0000","last_undegraded":"2024-02-21T22:53:44.341174+0000","last_fullsized":"2024-02-21T22:53:44.341174+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:24:37.189670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.340545+0000","last_change":"2024-02-21T22:53:43.007326+0000","last_active":"2024-02-21T22:53:44.340545+0000","last_peered":"2024-02-21T22:53:44.340545+0000","last_clean":"2024-02-21T22:53:44.340545+0000","last_became_active":"2024-02-21T22:53:43.007022+0000","last_became_peered":"2024-02-21T22:53:43.007022+0000","last_unstale":"2024-02-21T22:53:44.340545+0000","last_undegraded":"2024-02-21T22:53:44.340545+0000","last_fullsized":"2024-02-21T22:53:44.340545+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:09:41.280308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.236376+0000","last_change":"2024-02-21T22:53:42.999643+0000","last_active":"2024-02-21T22:53:44.236376+0000","last_peered":"2024-02-21T22:53:44.236376+0000","last_clean":"2024-02-21T22:53:44.236376+0000","last_became_active":"2024-02-21T22:53:42.999406+0000","last_became_peered":"2024-02-21T22:53:42.999406+0000","last_unstale":"2024-02-21T22:53:44.236376+0000","last_undegraded":"2024-02-21T22:53:44.236376+0000","last_fullsized":"2024-02-21T22:53:44.236376+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:44:43.049562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.340324+0000","last_change":"2024-02-21T22:53:43.005346+0000","last_active":"2024-02-21T22:53:44.340324+0000","last_peered":"2024-02-21T22:53:44.340324+0000","last_clean":"2024-02-21T22:53:44.340324+0000","last_became_active":"2024-02-21T22:53:43.004383+0000","last_became_peered":"2024-02-21T22:53:43.004383+0000","last_unstale":"2024-02-21T22:53:44.340324+0000","last_undegraded":"2024-02-21T22:53:44.340324+0000","last_fullsized":"2024-02-21T22:53:44.340324+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:24:37.189670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.340241+0000","last_change":"2024-02-21T22:53:42.995690+0000","last_active":"2024-02-21T22:53:44.340241+0000","last_peered":"2024-02-21T22:53:44.340241+0000","last_clean":"2024-02-21T22:53:44.340241+0000","last_became_active":"2024-02-21T22:53:42.995407+0000","last_became_peered":"2024-02-21T22:53:42.995407+0000","last_unstale":"2024-02-21T22:53:44.340241+0000","last_undegraded":"2024-02-21T22:53:44.340241+0000","last_fullsized":"2024-02-21T22:53:44.340241+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:41:56.581902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.340256+0000","last_change":"2024-02-21T22:53:43.009355+0000","last_active":"2024-02-21T22:53:44.340256+0000","last_peered":"2024-02-21T22:53:44.340256+0000","last_clean":"2024-02-21T22:53:44.340256+0000","last_became_active":"2024-02-21T22:53:43.009073+0000","last_became_peered":"2024-02-21T22:53:43.009073+0000","last_unstale":"2024-02-21T22:53:44.340256+0000","last_undegraded":"2024-02-21T22:53:44.340256+0000","last_fullsized":"2024-02-21T22:53:44.340256+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:03:52.457060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.341204+0000","last_change":"2024-02-21T22:53:43.008675+0000","last_active":"2024-02-21T22:53:44.341204+0000","last_peered":"2024-02-21T22:53:44.341204+0000","last_clean":"2024-02-21T22:53:44.341204+0000","last_became_active":"2024-02-21T22:53:43.008404+0000","last_became_peered":"2024-02-21T22:53:43.008404+0000","last_unstale":"2024-02-21T22:53:44.341204+0000","last_undegraded":"2024-02-21T22:53:44.341204+0000","last_fullsized":"2024-02-21T22:53:44.341204+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:00:32.372505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.340466+0000","last_change":"2024-02-21T22:53:42.999615+0000","last_active":"2024-02-21T22:53:44.340466+0000","last_peered":"2024-02-21T22:53:44.340466+0000","last_clean":"2024-02-21T22:53:44.340466+0000","last_became_active":"2024-02-21T22:53:42.999362+0000","last_became_peered":"2024-02-21T22:53:42.999362+0000","last_unstale":"2024-02-21T22:53:44.340466+0000","last_undegraded":"2024-02-21T22:53:44.340466+0000","last_fullsized":"2024-02-21T22:53:44.340466+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:36:43.932976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.340333+0000","last_change":"2024-02-21T22:53:43.010970+0000","last_active":"2024-02-21T22:53:44.340333+0000","last_peered":"2024-02-21T22:53:44.340333+0000","last_clean":"2024-02-21T22:53:44.340333+0000","last_became_active":"2024-02-21T22:53:43.010702+0000","last_became_peered":"2024-02-21T22:53:43.010702+0000","last_unstale":"2024-02-21T22:53:44.340333+0000","last_undegraded":"2024-02-21T22:53:44.340333+0000","last_fullsized":"2024-02-21T22:53:44.340333+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:00:32.372505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.236456+0000","last_change":"2024-02-21T22:53:43.006258+0000","last_active":"2024-02-21T22:53:44.236456+0000","last_peered":"2024-02-21T22:53:44.236456+0000","last_clean":"2024-02-21T22:53:44.236456+0000","last_became_active":"2024-02-21T22:53:43.005993+0000","last_became_peered":"2024-02-21T22:53:43.005993+0000","last_unstale":"2024-02-21T22:53:44.236456+0000","last_undegraded":"2024-02-21T22:53:44.236456+0000","last_fullsized":"2024-02-21T22:53:44.236456+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:27:19.189008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.991192+0000","last_change":"2024-02-21T22:53:43.015003+0000","last_active":"2024-02-21T22:53:43.991192+0000","last_peered":"2024-02-21T22:53:43.991192+0000","last_clean":"2024-02-21T22:53:43.991192+0000","last_became_active":"2024-02-21T22:53:43.014712+0000","last_became_peered":"2024-02-21T22:53:43.014712+0000","last_unstale":"2024-02-21T22:53:43.991192+0000","last_undegraded":"2024-02-21T22:53:43.991192+0000","last_fullsized":"2024-02-21T22:53:43.991192+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:15:36.152598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.991098+0000","last_change":"2024-02-21T22:53:43.014845+0000","last_active":"2024-02-21T22:53:43.991098+0000","last_peered":"2024-02-21T22:53:43.991098+0000","last_clean":"2024-02-21T22:53:43.991098+0000","last_became_active":"2024-02-21T22:53:43.014570+0000","last_became_peered":"2024-02-21T22:53:43.014570+0000","last_unstale":"2024-02-21T22:53:43.991098+0000","last_undegraded":"2024-02-21T22:53:43.991098+0000","last_fullsized":"2024-02-21T22:53:43.991098+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:26:25.990337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.990453+0000","last_change":"2024-02-21T22:53:43.002518+0000","last_active":"2024-02-21T22:53:43.990453+0000","last_peered":"2024-02-21T22:53:43.990453+0000","last_clean":"2024-02-21T22:53:43.990453+0000","last_became_active":"2024-02-21T22:53:43.002254+0000","last_became_peered":"2024-02-21T22:53:43.002254+0000","last_unstale":"2024-02-21T22:53:43.990453+0000","last_undegraded":"2024-02-21T22:53:43.990453+0000","last_fullsized":"2024-02-21T22:53:43.990453+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:06:03.706623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.340072+0000","last_change":"2024-02-21T22:53:42.996552+0000","last_active":"2024-02-21T22:53:44.340072+0000","last_peered":"2024-02-21T22:53:44.340072+0000","last_clean":"2024-02-21T22:53:44.340072+0000","last_became_active":"2024-02-21T22:53:42.996208+0000","last_became_peered":"2024-02-21T22:53:42.996208+0000","last_unstale":"2024-02-21T22:53:44.340072+0000","last_undegraded":"2024-02-21T22:53:44.340072+0000","last_fullsized":"2024-02-21T22:53:44.340072+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:31:54.235302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.990349+0000","last_change":"2024-02-21T22:53:43.003996+0000","last_active":"2024-02-21T22:53:43.990349+0000","last_peered":"2024-02-21T22:53:43.990349+0000","last_clean":"2024-02-21T22:53:43.990349+0000","last_became_active":"2024-02-21T22:53:43.003710+0000","last_became_peered":"2024-02-21T22:53:43.003710+0000","last_unstale":"2024-02-21T22:53:43.990349+0000","last_undegraded":"2024-02-21T22:53:43.990349+0000","last_fullsized":"2024-02-21T22:53:43.990349+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T02:25:22.385393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.340570+0000","last_change":"2024-02-21T22:53:43.000854+0000","last_active":"2024-02-21T22:53:44.340570+0000","last_peered":"2024-02-21T22:53:44.340570+0000","last_clean":"2024-02-21T22:53:44.340570+0000","last_became_active":"2024-02-21T22:53:43.000575+0000","last_became_peered":"2024-02-21T22:53:43.000575+0000","last_unstale":"2024-02-21T22:53:44.340570+0000","last_undegraded":"2024-02-21T22:53:44.340570+0000","last_fullsized":"2024-02-21T22:53:44.340570+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:03:16.607197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.990344+0000","last_change":"2024-02-21T22:53:43.011416+0000","last_active":"2024-02-21T22:53:43.990344+0000","last_peered":"2024-02-21T22:53:43.990344+0000","last_clean":"2024-02-21T22:53:43.990344+0000","last_became_active":"2024-02-21T22:53:43.010808+0000","last_became_peered":"2024-02-21T22:53:43.010808+0000","last_unstale":"2024-02-21T22:53:43.990344+0000","last_undegraded":"2024-02-21T22:53:43.990344+0000","last_fullsized":"2024-02-21T22:53:43.990344+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:09:41.280308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.340672+0000","last_change":"2024-02-21T22:53:42.999624+0000","last_active":"2024-02-21T22:53:44.340672+0000","last_peered":"2024-02-21T22:53:44.340672+0000","last_clean":"2024-02-21T22:53:44.340672+0000","last_became_active":"2024-02-21T22:53:42.999295+0000","last_became_peered":"2024-02-21T22:53:42.999295+0000","last_unstale":"2024-02-21T22:53:44.340672+0000","last_undegraded":"2024-02-21T22:53:44.340672+0000","last_fullsized":"2024-02-21T22:53:44.340672+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:24:37.189670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.991295+0000","last_change":"2024-02-21T22:53:43.016081+0000","last_active":"2024-02-21T22:53:43.991295+0000","last_peered":"2024-02-21T22:53:43.991295+0000","last_clean":"2024-02-21T22:53:43.991295+0000","last_became_active":"2024-02-21T22:53:43.015533+0000","last_became_peered":"2024-02-21T22:53:43.015533+0000","last_unstale":"2024-02-21T22:53:43.991295+0000","last_undegraded":"2024-02-21T22:53:43.991295+0000","last_fullsized":"2024-02-21T22:53:43.991295+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:13:51.231189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.340327+0000","last_change":"2024-02-21T22:53:43.007179+0000","last_active":"2024-02-21T22:53:44.340327+0000","last_peered":"2024-02-21T22:53:44.340327+0000","last_clean":"2024-02-21T22:53:44.340327+0000","last_became_active":"2024-02-21T22:53:43.006982+0000","last_became_peered":"2024-02-21T22:53:43.006982+0000","last_unstale":"2024-02-21T22:53:44.340327+0000","last_undegraded":"2024-02-21T22:53:44.340327+0000","last_fullsized":"2024-02-21T22:53:44.340327+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:41:56.581902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.322838+0000","last_change":"2024-02-21T22:53:43.000423+0000","last_active":"2024-02-21T22:53:44.322838+0000","last_peered":"2024-02-21T22:53:44.322838+0000","last_clean":"2024-02-21T22:53:44.322838+0000","last_became_active":"2024-02-21T22:53:43.000179+0000","last_became_peered":"2024-02-21T22:53:43.000179+0000","last_unstale":"2024-02-21T22:53:44.322838+0000","last_undegraded":"2024-02-21T22:53:44.322838+0000","last_fullsized":"2024-02-21T22:53:44.322838+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:06:03.706623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.340129+0000","last_change":"2024-02-21T22:53:43.013244+0000","last_active":"2024-02-21T22:53:44.340129+0000","last_peered":"2024-02-21T22:53:44.340129+0000","last_clean":"2024-02-21T22:53:44.340129+0000","last_became_active":"2024-02-21T22:53:43.012985+0000","last_became_peered":"2024-02-21T22:53:43.012985+0000","last_unstale":"2024-02-21T22:53:44.340129+0000","last_undegraded":"2024-02-21T22:53:44.340129+0000","last_fullsized":"2024-02-21T22:53:44.340129+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:38:31.580364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.990598+0000","last_change":"2024-02-21T22:53:43.001816+0000","last_active":"2024-02-21T22:53:43.990598+0000","last_peered":"2024-02-21T22:53:43.990598+0000","last_clean":"2024-02-21T22:53:43.990598+0000","last_became_active":"2024-02-21T22:53:43.001564+0000","last_became_peered":"2024-02-21T22:53:43.001564+0000","last_unstale":"2024-02-21T22:53:43.990598+0000","last_undegraded":"2024-02-21T22:53:43.990598+0000","last_fullsized":"2024-02-21T22:53:43.990598+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:26:25.990337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"32'4","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.323094+0000","last_change":"2024-02-21T22:53:41.994843+0000","last_active":"2024-02-21T22:53:44.323094+0000","last_peered":"2024-02-21T22:53:44.323094+0000","last_clean":"2024-02-21T22:53:44.323094+0000","last_became_active":"2024-02-21T22:53:41.994468+0000","last_became_peered":"2024-02-21T22:53:41.994468+0000","last_unstale":"2024-02-21T22:53:44.323094+0000","last_undegraded":"2024-02-21T22:53:44.323094+0000","last_fullsized":"2024-02-21T22:53:44.323094+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:27:18.184658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.323022+0000","last_change":"2024-02-21T22:53:43.008294+0000","last_active":"2024-02-21T22:53:44.323022+0000","last_peered":"2024-02-21T22:53:44.323022+0000","last_clean":"2024-02-21T22:53:44.323022+0000","last_became_active":"2024-02-21T22:53:43.008021+0000","last_became_peered":"2024-02-21T22:53:43.008021+0000","last_unstale":"2024-02-21T22:53:44.323022+0000","last_undegraded":"2024-02-21T22:53:44.323022+0000","last_fullsized":"2024-02-21T22:53:44.323022+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:15:36.152598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"32'1","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.990599+0000","last_change":"2024-02-21T22:53:41.987067+0000","last_active":"2024-02-21T22:53:43.990599+0000","last_peered":"2024-02-21T22:53:43.990599+0000","last_clean":"2024-02-21T22:53:43.990599+0000","last_became_active":"2024-02-21T22:53:41.986784+0000","last_became_peered":"2024-02-21T22:53:41.986784+0000","last_unstale":"2024-02-21T22:53:43.990599+0000","last_undegraded":"2024-02-21T22:53:43.990599+0000","last_fullsized":"2024-02-21T22:53:43.990599+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:34:59.792432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.991412+0000","last_change":"2024-02-21T22:53:43.016649+0000","last_active":"2024-02-21T22:53:43.991412+0000","last_peered":"2024-02-21T22:53:43.991412+0000","last_clean":"2024-02-21T22:53:43.991412+0000","last_became_active":"2024-02-21T22:53:43.016339+0000","last_became_peered":"2024-02-21T22:53:43.016339+0000","last_unstale":"2024-02-21T22:53:43.991412+0000","last_undegraded":"2024-02-21T22:53:43.991412+0000","last_fullsized":"2024-02-21T22:53:43.991412+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:40:05.306862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"32'2","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.340263+0000","last_change":"2024-02-21T22:53:41.991758+0000","last_active":"2024-02-21T22:53:44.340263+0000","last_peered":"2024-02-21T22:53:44.340263+0000","last_clean":"2024-02-21T22:53:44.340263+0000","last_became_active":"2024-02-21T22:53:41.990213+0000","last_became_peered":"2024-02-21T22:53:41.990213+0000","last_unstale":"2024-02-21T22:53:44.340263+0000","last_undegraded":"2024-02-21T22:53:44.340263+0000","last_fullsized":"2024-02-21T22:53:44.340263+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:54:00.352993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.990191+0000","last_change":"2024-02-21T22:53:43.011534+0000","last_active":"2024-02-21T22:53:43.990191+0000","last_peered":"2024-02-21T22:53:43.990191+0000","last_clean":"2024-02-21T22:53:43.990191+0000","last_became_active":"2024-02-21T22:53:43.011165+0000","last_became_peered":"2024-02-21T22:53:43.011165+0000","last_unstale":"2024-02-21T22:53:43.990191+0000","last_undegraded":"2024-02-21T22:53:43.990191+0000","last_fullsized":"2024-02-21T22:53:43.990191+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:41:56.581902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"32'2","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.236551+0000","last_change":"2024-02-21T22:53:41.989989+0000","last_active":"2024-02-21T22:53:44.236551+0000","last_peered":"2024-02-21T22:53:44.236551+0000","last_clean":"2024-02-21T22:53:44.236551+0000","last_became_active":"2024-02-21T22:53:41.989105+0000","last_became_peered":"2024-02-21T22:53:41.989105+0000","last_unstale":"2024-02-21T22:53:44.236551+0000","last_undegraded":"2024-02-21T22:53:44.236551+0000","last_fullsized":"2024-02-21T22:53:44.236551+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:22:53.606008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.340540+0000","last_change":"2024-02-21T22:53:43.012670+0000","last_active":"2024-02-21T22:53:44.340540+0000","last_peered":"2024-02-21T22:53:44.340540+0000","last_clean":"2024-02-21T22:53:44.340540+0000","last_became_active":"2024-02-21T22:53:43.012407+0000","last_became_peered":"2024-02-21T22:53:43.012407+0000","last_unstale":"2024-02-21T22:53:44.340540+0000","last_undegraded":"2024-02-21T22:53:44.340540+0000","last_fullsized":"2024-02-21T22:53:44.340540+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T02:25:22.385393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"32'1","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.991294+0000","last_change":"2024-02-21T22:53:41.992560+0000","last_active":"2024-02-21T22:53:43.991294+0000","last_peered":"2024-02-21T22:53:43.991294+0000","last_clean":"2024-02-21T22:53:43.991294+0000","last_became_active":"2024-02-21T22:53:41.992200+0000","last_became_peered":"2024-02-21T22:53:41.992200+0000","last_unstale":"2024-02-21T22:53:43.991294+0000","last_undegraded":"2024-02-21T22:53:43.991294+0000","last_fullsized":"2024-02-21T22:53:43.991294+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:47:38.675797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.340453+0000","last_change":"2024-02-21T22:53:43.003713+0000","last_active":"2024-02-21T22:53:44.340453+0000","last_peered":"2024-02-21T22:53:44.340453+0000","last_clean":"2024-02-21T22:53:44.340453+0000","last_became_active":"2024-02-21T22:53:43.003448+0000","last_became_peered":"2024-02-21T22:53:43.003448+0000","last_unstale":"2024-02-21T22:53:44.340453+0000","last_undegraded":"2024-02-21T22:53:44.340453+0000","last_fullsized":"2024-02-21T22:53:44.340453+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T02:25:22.385393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"32'1","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.991129+0000","last_change":"2024-02-21T22:53:41.989888+0000","last_active":"2024-02-21T22:53:43.991129+0000","last_peered":"2024-02-21T22:53:43.991129+0000","last_clean":"2024-02-21T22:53:43.991129+0000","last_became_active":"2024-02-21T22:53:41.989605+0000","last_became_peered":"2024-02-21T22:53:41.989605+0000","last_unstale":"2024-02-21T22:53:43.991129+0000","last_undegraded":"2024-02-21T22:53:43.991129+0000","last_fullsized":"2024-02-21T22:53:43.991129+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:28:50.954719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.990957+0000","last_change":"2024-02-21T22:53:43.011697+0000","last_active":"2024-02-21T22:53:43.990957+0000","last_peered":"2024-02-21T22:53:43.990957+0000","last_clean":"2024-02-21T22:53:43.990957+0000","last_became_active":"2024-02-21T22:53:43.011446+0000","last_became_peered":"2024-02-21T22:53:43.011446+0000","last_unstale":"2024-02-21T22:53:43.990957+0000","last_undegraded":"2024-02-21T22:53:43.990957+0000","last_fullsized":"2024-02-21T22:53:43.990957+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:53:37.219886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.340098+0000","last_change":"2024-02-21T22:53:41.990198+0000","last_active":"2024-02-21T22:53:44.340098+0000","last_peered":"2024-02-21T22:53:44.340098+0000","last_clean":"2024-02-21T22:53:44.340098+0000","last_became_active":"2024-02-21T22:53:41.989927+0000","last_became_peered":"2024-02-21T22:53:41.989927+0000","last_unstale":"2024-02-21T22:53:44.340098+0000","last_undegraded":"2024-02-21T22:53:44.340098+0000","last_fullsized":"2024-02-21T22:53:44.340098+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:08:08.137842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.989576+0000","last_change":"2024-02-21T22:53:43.008825+0000","last_active":"2024-02-21T22:53:43.989576+0000","last_peered":"2024-02-21T22:53:43.989576+0000","last_clean":"2024-02-21T22:53:43.989576+0000","last_became_active":"2024-02-21T22:53:43.008486+0000","last_became_peered":"2024-02-21T22:53:43.008486+0000","last_unstale":"2024-02-21T22:53:43.989576+0000","last_undegraded":"2024-02-21T22:53:43.989576+0000","last_fullsized":"2024-02-21T22:53:43.989576+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:02:41.596861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.990903+0000","last_change":"2024-02-21T22:53:41.985526+0000","last_active":"2024-02-21T22:53:43.990903+0000","last_peered":"2024-02-21T22:53:43.990903+0000","last_clean":"2024-02-21T22:53:43.990903+0000","last_became_active":"2024-02-21T22:53:41.985232+0000","last_became_peered":"2024-02-21T22:53:41.985232+0000","last_unstale":"2024-02-21T22:53:43.990903+0000","last_undegraded":"2024-02-21T22:53:43.990903+0000","last_fullsized":"2024-02-21T22:53:43.990903+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:46:31.483732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.340853+0000","last_change":"2024-02-21T22:53:43.005931+0000","last_active":"2024-02-21T22:53:44.340853+0000","last_peered":"2024-02-21T22:53:44.340853+0000","last_clean":"2024-02-21T22:53:44.340853+0000","last_became_active":"2024-02-21T22:53:43.005375+0000","last_became_peered":"2024-02-21T22:53:43.005375+0000","last_unstale":"2024-02-21T22:53:44.340853+0000","last_undegraded":"2024-02-21T22:53:44.340853+0000","last_fullsized":"2024-02-21T22:53:44.340853+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:00:32.372505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.340503+0000","last_change":"2024-02-21T22:53:41.987065+0000","last_active":"2024-02-21T22:53:44.340503+0000","last_peered":"2024-02-21T22:53:44.340503+0000","last_clean":"2024-02-21T22:53:44.340503+0000","last_became_active":"2024-02-21T22:53:41.986873+0000","last_became_peered":"2024-02-21T22:53:41.986873+0000","last_unstale":"2024-02-21T22:53:44.340503+0000","last_undegraded":"2024-02-21T22:53:44.340503+0000","last_fullsized":"2024-02-21T22:53:44.340503+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:53:36.215536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.340464+0000","last_change":"2024-02-21T22:53:43.010123+0000","last_active":"2024-02-21T22:53:44.340464+0000","last_peered":"2024-02-21T22:53:44.340464+0000","last_clean":"2024-02-21T22:53:44.340464+0000","last_became_active":"2024-02-21T22:53:43.009846+0000","last_became_peered":"2024-02-21T22:53:43.009846+0000","last_unstale":"2024-02-21T22:53:44.340464+0000","last_undegraded":"2024-02-21T22:53:44.340464+0000","last_fullsized":"2024-02-21T22:53:44.340464+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:18:34.897900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.990694+0000","last_change":"2024-02-21T22:53:41.987725+0000","last_active":"2024-02-21T22:53:43.990694+0000","last_peered":"2024-02-21T22:53:43.990694+0000","last_clean":"2024-02-21T22:53:43.990694+0000","last_became_active":"2024-02-21T22:53:41.987448+0000","last_became_peered":"2024-02-21T22:53:41.987448+0000","last_unstale":"2024-02-21T22:53:43.990694+0000","last_undegraded":"2024-02-21T22:53:43.990694+0000","last_fullsized":"2024-02-21T22:53:43.990694+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:52:02.783816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.340463+0000","last_change":"2024-02-21T22:53:42.997365+0000","last_active":"2024-02-21T22:53:44.340463+0000","last_peered":"2024-02-21T22:53:44.340463+0000","last_clean":"2024-02-21T22:53:44.340463+0000","last_became_active":"2024-02-21T22:53:42.997104+0000","last_became_peered":"2024-02-21T22:53:42.997104+0000","last_unstale":"2024-02-21T22:53:44.340463+0000","last_undegraded":"2024-02-21T22:53:44.340463+0000","last_fullsized":"2024-02-21T22:53:44.340463+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T10:22:33.646484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"32'3","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.340752+0000","last_change":"2024-02-21T22:53:41.994505+0000","last_active":"2024-02-21T22:53:44.340752+0000","last_peered":"2024-02-21T22:53:44.340752+0000","last_clean":"2024-02-21T22:53:44.340752+0000","last_became_active":"2024-02-21T22:53:41.994214+0000","last_became_peered":"2024-02-21T22:53:41.994214+0000","last_unstale":"2024-02-21T22:53:44.340752+0000","last_undegraded":"2024-02-21T22:53:44.340752+0000","last_fullsized":"2024-02-21T22:53:44.340752+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:10:09.126154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.340155+0000","last_change":"2024-02-21T22:53:43.005537+0000","last_active":"2024-02-21T22:53:44.340155+0000","last_peered":"2024-02-21T22:53:44.340155+0000","last_clean":"2024-02-21T22:53:44.340155+0000","last_became_active":"2024-02-21T22:53:43.004978+0000","last_became_peered":"2024-02-21T22:53:43.004978+0000","last_unstale":"2024-02-21T22:53:44.340155+0000","last_undegraded":"2024-02-21T22:53:44.340155+0000","last_fullsized":"2024-02-21T22:53:44.340155+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:03:52.457060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"33'10","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:51.101817+0000","last_change":"2024-02-21T22:53:41.989878+0000","last_active":"2024-02-21T22:53:51.101817+0000","last_peered":"2024-02-21T22:53:51.101817+0000","last_clean":"2024-02-21T22:53:51.101817+0000","last_became_active":"2024-02-21T22:53:41.989590+0000","last_became_peered":"2024-02-21T22:53:41.989590+0000","last_unstale":"2024-02-21T22:53:51.101817+0000","last_undegraded":"2024-02-21T22:53:51.101817+0000","last_fullsized":"2024-02-21T22:53:51.101817+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:06:02.702272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7145,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.989607+0000","last_change":"2024-02-21T22:53:43.008192+0000","last_active":"2024-02-21T22:53:43.989607+0000","last_peered":"2024-02-21T22:53:43.989607+0000","last_clean":"2024-02-21T22:53:43.989607+0000","last_became_active":"2024-02-21T22:53:43.007923+0000","last_became_peered":"2024-02-21T22:53:43.007923+0000","last_unstale":"2024-02-21T22:53:43.989607+0000","last_undegraded":"2024-02-21T22:53:43.989607+0000","last_fullsized":"2024-02-21T22:53:43.989607+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:53:37.531108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"32'2","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.991477+0000","last_change":"2024-02-21T22:53:41.986805+0000","last_active":"2024-02-21T22:53:43.991477+0000","last_peered":"2024-02-21T22:53:43.991477+0000","last_clean":"2024-02-21T22:53:43.991477+0000","last_became_active":"2024-02-21T22:53:41.985220+0000","last_became_peered":"2024-02-21T22:53:41.985220+0000","last_unstale":"2024-02-21T22:53:43.991477+0000","last_undegraded":"2024-02-21T22:53:43.991477+0000","last_fullsized":"2024-02-21T22:53:43.991477+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:21:25.274383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.340308+0000","last_change":"2024-02-21T22:53:43.003557+0000","last_active":"2024-02-21T22:53:44.340308+0000","last_peered":"2024-02-21T22:53:44.340308+0000","last_clean":"2024-02-21T22:53:44.340308+0000","last_became_active":"2024-02-21T22:53:43.003293+0000","last_became_peered":"2024-02-21T22:53:43.003293+0000","last_unstale":"2024-02-21T22:53:44.340308+0000","last_undegraded":"2024-02-21T22:53:44.340308+0000","last_fullsized":"2024-02-21T22:53:44.340308+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:34:47.098047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.989593+0000","last_change":"2024-02-21T22:53:41.987760+0000","last_active":"2024-02-21T22:53:43.989593+0000","last_peered":"2024-02-21T22:53:43.989593+0000","last_clean":"2024-02-21T22:53:43.989593+0000","last_became_active":"2024-02-21T22:53:41.987379+0000","last_became_peered":"2024-02-21T22:53:41.987379+0000","last_unstale":"2024-02-21T22:53:43.989593+0000","last_undegraded":"2024-02-21T22:53:43.989593+0000","last_fullsized":"2024-02-21T22:53:43.989593+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:28:09.845765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.340250+0000","last_change":"2024-02-21T22:53:43.014121+0000","last_active":"2024-02-21T22:53:44.340250+0000","last_peered":"2024-02-21T22:53:44.340250+0000","last_clean":"2024-02-21T22:53:44.340250+0000","last_became_active":"2024-02-21T22:53:43.013636+0000","last_became_peered":"2024-02-21T22:53:43.013636+0000","last_unstale":"2024-02-21T22:53:44.340250+0000","last_undegraded":"2024-02-21T22:53:44.340250+0000","last_fullsized":"2024-02-21T22:53:44.340250+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:31:54.235302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.340024+0000","last_change":"2024-02-21T22:53:41.989414+0000","last_active":"2024-02-21T22:53:44.340024+0000","last_peered":"2024-02-21T22:53:44.340024+0000","last_clean":"2024-02-21T22:53:44.340024+0000","last_became_active":"2024-02-21T22:53:41.988958+0000","last_became_peered":"2024-02-21T22:53:41.988958+0000","last_unstale":"2024-02-21T22:53:44.340024+0000","last_undegraded":"2024-02-21T22:53:44.340024+0000","last_fullsized":"2024-02-21T22:53:44.340024+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:09:00.593509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.322897+0000","last_change":"2024-02-21T22:53:43.010267+0000","last_active":"2024-02-21T22:53:44.322897+0000","last_peered":"2024-02-21T22:53:44.322897+0000","last_clean":"2024-02-21T22:53:44.322897+0000","last_became_active":"2024-02-21T22:53:43.010007+0000","last_became_peered":"2024-02-21T22:53:43.010007+0000","last_unstale":"2024-02-21T22:53:44.322897+0000","last_undegraded":"2024-02-21T22:53:44.322897+0000","last_fullsized":"2024-02-21T22:53:44.322897+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:53:37.219886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"32'8","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.340161+0000","last_change":"2024-02-21T22:53:41.990362+0000","last_active":"2024-02-21T22:53:44.340161+0000","last_peered":"2024-02-21T22:53:44.340161+0000","last_clean":"2024-02-21T22:53:44.340161+0000","last_became_active":"2024-02-21T22:53:41.989531+0000","last_became_peered":"2024-02-21T22:53:41.989531+0000","last_unstale":"2024-02-21T22:53:44.340161+0000","last_undegraded":"2024-02-21T22:53:44.340161+0000","last_fullsized":"2024-02-21T22:53:44.340161+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:10:09.126154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.991581+0000","last_change":"2024-02-21T22:53:43.010224+0000","last_active":"2024-02-21T22:53:43.991581+0000","last_peered":"2024-02-21T22:53:43.991581+0000","last_clean":"2024-02-21T22:53:43.991581+0000","last_became_active":"2024-02-21T22:53:43.009914+0000","last_became_peered":"2024-02-21T22:53:43.009914+0000","last_unstale":"2024-02-21T22:53:43.991581+0000","last_undegraded":"2024-02-21T22:53:43.991581+0000","last_fullsized":"2024-02-21T22:53:43.991581+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:02:41.596861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"32'1","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.990394+0000","last_change":"2024-02-21T22:53:41.988393+0000","last_active":"2024-02-21T22:53:43.990394+0000","last_peered":"2024-02-21T22:53:43.990394+0000","last_clean":"2024-02-21T22:53:43.990394+0000","last_became_active":"2024-02-21T22:53:41.987692+0000","last_became_peered":"2024-02-21T22:53:41.987692+0000","last_unstale":"2024-02-21T22:53:43.990394+0000","last_undegraded":"2024-02-21T22:53:43.990394+0000","last_fullsized":"2024-02-21T22:53:43.990394+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:08:08.137842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.340924+0000","last_change":"2024-02-21T22:53:43.009888+0000","last_active":"2024-02-21T22:53:44.340924+0000","last_peered":"2024-02-21T22:53:44.340924+0000","last_clean":"2024-02-21T22:53:44.340924+0000","last_became_active":"2024-02-21T22:53:43.009536+0000","last_became_peered":"2024-02-21T22:53:43.009536+0000","last_unstale":"2024-02-21T22:53:44.340924+0000","last_undegraded":"2024-02-21T22:53:44.340924+0000","last_fullsized":"2024-02-21T22:53:44.340924+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:54:49.339689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"32'2","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.991607+0000","last_change":"2024-02-21T22:53:41.986266+0000","last_active":"2024-02-21T22:53:43.991607+0000","last_peered":"2024-02-21T22:53:43.991607+0000","last_clean":"2024-02-21T22:53:43.991607+0000","last_became_active":"2024-02-21T22:53:41.985942+0000","last_became_peered":"2024-02-21T22:53:41.985942+0000","last_unstale":"2024-02-21T22:53:43.991607+0000","last_undegraded":"2024-02-21T22:53:43.991607+0000","last_fullsized":"2024-02-21T22:53:43.991607+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:29:52.528059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.989804+0000","last_change":"2024-02-21T22:53:43.010964+0000","last_active":"2024-02-21T22:53:43.989804+0000","last_peered":"2024-02-21T22:53:43.989804+0000","last_clean":"2024-02-21T22:53:43.989804+0000","last_became_active":"2024-02-21T22:53:43.010739+0000","last_became_peered":"2024-02-21T22:53:43.010739+0000","last_unstale":"2024-02-21T22:53:43.989804+0000","last_undegraded":"2024-02-21T22:53:43.989804+0000","last_fullsized":"2024-02-21T22:53:43.989804+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:31:54.235302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"32'1","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.991526+0000","last_change":"2024-02-21T22:53:41.987516+0000","last_active":"2024-02-21T22:53:43.991526+0000","last_peered":"2024-02-21T22:53:43.991526+0000","last_clean":"2024-02-21T22:53:43.991526+0000","last_became_active":"2024-02-21T22:53:41.986968+0000","last_became_peered":"2024-02-21T22:53:41.986968+0000","last_unstale":"2024-02-21T22:53:43.991526+0000","last_undegraded":"2024-02-21T22:53:43.991526+0000","last_fullsized":"2024-02-21T22:53:43.991526+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:08:36.876969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.236512+0000","last_change":"2024-02-21T22:53:43.001927+0000","last_active":"2024-02-21T22:53:44.236512+0000","last_peered":"2024-02-21T22:53:44.236512+0000","last_clean":"2024-02-21T22:53:44.236512+0000","last_became_active":"2024-02-21T22:53:43.001668+0000","last_became_peered":"2024-02-21T22:53:43.001668+0000","last_unstale":"2024-02-21T22:53:44.236512+0000","last_undegraded":"2024-02-21T22:53:44.236512+0000","last_fullsized":"2024-02-21T22:53:44.236512+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:52:03.788166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.991343+0000","last_change":"2024-02-21T22:53:41.990148+0000","last_active":"2024-02-21T22:53:43.991343+0000","last_peered":"2024-02-21T22:53:43.991343+0000","last_clean":"2024-02-21T22:53:43.991343+0000","last_became_active":"2024-02-21T22:53:41.989146+0000","last_became_peered":"2024-02-21T22:53:41.989146+0000","last_unstale":"2024-02-21T22:53:43.991343+0000","last_undegraded":"2024-02-21T22:53:43.991343+0000","last_fullsized":"2024-02-21T22:53:43.991343+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:13:43.209250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.236324+0000","last_change":"2024-02-21T22:53:43.011129+0000","last_active":"2024-02-21T22:53:44.236324+0000","last_peered":"2024-02-21T22:53:44.236324+0000","last_clean":"2024-02-21T22:53:44.236324+0000","last_became_active":"2024-02-21T22:53:43.010865+0000","last_became_peered":"2024-02-21T22:53:43.010865+0000","last_unstale":"2024-02-21T22:53:44.236324+0000","last_undegraded":"2024-02-21T22:53:44.236324+0000","last_fullsized":"2024-02-21T22:53:44.236324+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:21:26.278733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"32'2","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.990759+0000","last_change":"2024-02-21T22:53:41.984829+0000","last_active":"2024-02-21T22:53:43.990759+0000","last_peered":"2024-02-21T22:53:43.990759+0000","last_clean":"2024-02-21T22:53:43.990759+0000","last_became_active":"2024-02-21T22:53:41.984573+0000","last_became_peered":"2024-02-21T22:53:41.984573+0000","last_unstale":"2024-02-21T22:53:43.990759+0000","last_undegraded":"2024-02-21T22:53:43.990759+0000","last_fullsized":"2024-02-21T22:53:43.990759+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:44:42.045212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.236514+0000","last_change":"2024-02-21T22:53:43.001820+0000","last_active":"2024-02-21T22:53:44.236514+0000","last_peered":"2024-02-21T22:53:44.236514+0000","last_clean":"2024-02-21T22:53:44.236514+0000","last_became_active":"2024-02-21T22:53:43.001513+0000","last_became_peered":"2024-02-21T22:53:43.001513+0000","last_unstale":"2024-02-21T22:53:44.236514+0000","last_undegraded":"2024-02-21T22:53:44.236514+0000","last_fullsized":"2024-02-21T22:53:44.236514+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:28:10.850115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.322908+0000","last_change":"2024-02-21T22:53:41.991544+0000","last_active":"2024-02-21T22:53:44.322908+0000","last_peered":"2024-02-21T22:53:44.322908+0000","last_clean":"2024-02-21T22:53:44.322908+0000","last_became_active":"2024-02-21T22:53:41.991247+0000","last_became_peered":"2024-02-21T22:53:41.991247+0000","last_unstale":"2024-02-21T22:53:44.322908+0000","last_undegraded":"2024-02-21T22:53:44.322908+0000","last_fullsized":"2024-02-21T22:53:44.322908+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:44:42.045212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.236291+0000","last_change":"2024-02-21T22:53:43.000454+0000","last_active":"2024-02-21T22:53:44.236291+0000","last_peered":"2024-02-21T22:53:44.236291+0000","last_clean":"2024-02-21T22:53:44.236291+0000","last_became_active":"2024-02-21T22:53:43.000172+0000","last_became_peered":"2024-02-21T22:53:43.000172+0000","last_unstale":"2024-02-21T22:53:44.236291+0000","last_undegraded":"2024-02-21T22:53:44.236291+0000","last_fullsized":"2024-02-21T22:53:44.236291+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:29:53.532409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.990890+0000","last_change":"2024-02-21T22:53:41.988349+0000","last_active":"2024-02-21T22:53:43.990890+0000","last_peered":"2024-02-21T22:53:43.990890+0000","last_clean":"2024-02-21T22:53:43.990890+0000","last_became_active":"2024-02-21T22:53:41.987202+0000","last_became_peered":"2024-02-21T22:53:41.987202+0000","last_unstale":"2024-02-21T22:53:43.990890+0000","last_undegraded":"2024-02-21T22:53:43.990890+0000","last_fullsized":"2024-02-21T22:53:43.990890+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:38:22.676905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.340090+0000","last_change":"2024-02-21T22:53:43.008590+0000","last_active":"2024-02-21T22:53:44.340090+0000","last_peered":"2024-02-21T22:53:44.340090+0000","last_clean":"2024-02-21T22:53:44.340090+0000","last_became_active":"2024-02-21T22:53:43.007502+0000","last_became_peered":"2024-02-21T22:53:43.007502+0000","last_unstale":"2024-02-21T22:53:44.340090+0000","last_undegraded":"2024-02-21T22:53:44.340090+0000","last_fullsized":"2024-02-21T22:53:44.340090+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:02:41.596861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.340170+0000","last_change":"2024-02-21T22:53:41.993199+0000","last_active":"2024-02-21T22:53:44.340170+0000","last_peered":"2024-02-21T22:53:44.340170+0000","last_clean":"2024-02-21T22:53:44.340170+0000","last_became_active":"2024-02-21T22:53:41.992944+0000","last_became_peered":"2024-02-21T22:53:41.992944+0000","last_unstale":"2024-02-21T22:53:44.340170+0000","last_undegraded":"2024-02-21T22:53:44.340170+0000","last_fullsized":"2024-02-21T22:53:44.340170+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:09:00.593509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.236482+0000","last_change":"2024-02-21T22:53:43.007504+0000","last_active":"2024-02-21T22:53:44.236482+0000","last_peered":"2024-02-21T22:53:44.236482+0000","last_clean":"2024-02-21T22:53:44.236482+0000","last_became_active":"2024-02-21T22:53:43.007283+0000","last_became_peered":"2024-02-21T22:53:43.007283+0000","last_unstale":"2024-02-21T22:53:44.236482+0000","last_undegraded":"2024-02-21T22:53:44.236482+0000","last_fullsized":"2024-02-21T22:53:44.236482+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:35:00.796782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"32'2","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.990438+0000","last_change":"2024-02-21T22:53:41.994504+0000","last_active":"2024-02-21T22:53:43.990438+0000","last_peered":"2024-02-21T22:53:43.990438+0000","last_clean":"2024-02-21T22:53:43.990438+0000","last_became_active":"2024-02-21T22:53:41.994229+0000","last_became_peered":"2024-02-21T22:53:41.994229+0000","last_unstale":"2024-02-21T22:53:43.990438+0000","last_undegraded":"2024-02-21T22:53:43.990438+0000","last_fullsized":"2024-02-21T22:53:43.990438+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:09:00.593509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.340937+0000","last_change":"2024-02-21T22:53:43.006538+0000","last_active":"2024-02-21T22:53:44.340937+0000","last_peered":"2024-02-21T22:53:44.340937+0000","last_clean":"2024-02-21T22:53:44.340937+0000","last_became_active":"2024-02-21T22:53:43.006058+0000","last_became_peered":"2024-02-21T22:53:43.006058+0000","last_unstale":"2024-02-21T22:53:44.340937+0000","last_undegraded":"2024-02-21T22:53:44.340937+0000","last_fullsized":"2024-02-21T22:53:44.340937+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:18:34.897900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"33'3","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:49.994415+0000","last_change":"2024-02-21T22:53:41.985703+0000","last_active":"2024-02-21T22:53:49.994415+0000","last_peered":"2024-02-21T22:53:49.994415+0000","last_clean":"2024-02-21T22:53:49.994415+0000","last_became_active":"2024-02-21T22:53:41.985263+0000","last_became_peered":"2024-02-21T22:53:41.985263+0000","last_unstale":"2024-02-21T22:53:49.994415+0000","last_undegraded":"2024-02-21T22:53:49.994415+0000","last_fullsized":"2024-02-21T22:53:49.994415+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:28:09.845765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.990580+0000","last_change":"2024-02-21T22:53:43.005317+0000","last_active":"2024-02-21T22:53:43.990580+0000","last_peered":"2024-02-21T22:53:43.990580+0000","last_clean":"2024-02-21T22:53:43.990580+0000","last_became_active":"2024-02-21T22:53:43.005033+0000","last_became_peered":"2024-02-21T22:53:43.005033+0000","last_unstale":"2024-02-21T22:53:43.990580+0000","last_undegraded":"2024-02-21T22:53:43.990580+0000","last_fullsized":"2024-02-21T22:53:43.990580+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:53:37.219886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.989830+0000","last_change":"2024-02-21T22:53:41.986296+0000","last_active":"2024-02-21T22:53:43.989830+0000","last_peered":"2024-02-21T22:53:43.989830+0000","last_clean":"2024-02-21T22:53:43.989830+0000","last_became_active":"2024-02-21T22:53:41.985909+0000","last_became_peered":"2024-02-21T22:53:41.985909+0000","last_unstale":"2024-02-21T22:53:43.989830+0000","last_undegraded":"2024-02-21T22:53:43.989830+0000","last_fullsized":"2024-02-21T22:53:43.989830+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:34:59.792432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.322818+0000","last_change":"2024-02-21T22:53:43.000226+0000","last_active":"2024-02-21T22:53:44.322818+0000","last_peered":"2024-02-21T22:53:44.322818+0000","last_clean":"2024-02-21T22:53:44.322818+0000","last_became_active":"2024-02-21T22:53:42.999987+0000","last_became_peered":"2024-02-21T22:53:42.999987+0000","last_unstale":"2024-02-21T22:53:44.322818+0000","last_undegraded":"2024-02-21T22:53:44.322818+0000","last_fullsized":"2024-02-21T22:53:44.322818+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:54:01.357343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.990812+0000","last_change":"2024-02-21T22:53:41.991285+0000","last_active":"2024-02-21T22:53:43.990812+0000","last_peered":"2024-02-21T22:53:43.990812+0000","last_clean":"2024-02-21T22:53:43.990812+0000","last_became_active":"2024-02-21T22:53:41.990977+0000","last_became_peered":"2024-02-21T22:53:41.990977+0000","last_unstale":"2024-02-21T22:53:43.990812+0000","last_undegraded":"2024-02-21T22:53:43.990812+0000","last_fullsized":"2024-02-21T22:53:43.990812+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:27:18.184658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.990731+0000","last_change":"2024-02-21T22:53:42.999736+0000","last_active":"2024-02-21T22:53:43.990731+0000","last_peered":"2024-02-21T22:53:43.990731+0000","last_clean":"2024-02-21T22:53:43.990731+0000","last_became_active":"2024-02-21T22:53:42.999472+0000","last_became_peered":"2024-02-21T22:53:42.999472+0000","last_unstale":"2024-02-21T22:53:43.990731+0000","last_undegraded":"2024-02-21T22:53:43.990731+0000","last_fullsized":"2024-02-21T22:53:43.990731+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:15:36.152598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.989686+0000","last_change":"2024-02-21T22:53:41.991062+0000","last_active":"2024-02-21T22:53:43.989686+0000","last_peered":"2024-02-21T22:53:43.989686+0000","last_clean":"2024-02-21T22:53:43.989686+0000","last_became_active":"2024-02-21T22:53:41.990791+0000","last_became_peered":"2024-02-21T22:53:41.990791+0000","last_unstale":"2024-02-21T22:53:43.989686+0000","last_undegraded":"2024-02-21T22:53:43.989686+0000","last_fullsized":"2024-02-21T22:53:43.989686+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:52:02.783816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.340056+0000","last_change":"2024-02-21T22:53:42.999431+0000","last_active":"2024-02-21T22:53:44.340056+0000","last_peered":"2024-02-21T22:53:44.340056+0000","last_clean":"2024-02-21T22:53:44.340056+0000","last_became_active":"2024-02-21T22:53:42.999170+0000","last_became_peered":"2024-02-21T22:53:42.999170+0000","last_unstale":"2024-02-21T22:53:44.340056+0000","last_undegraded":"2024-02-21T22:53:44.340056+0000","last_fullsized":"2024-02-21T22:53:44.340056+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T02:25:22.385393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.991018+0000","last_change":"2024-02-21T22:53:41.995139+0000","last_active":"2024-02-21T22:53:43.991018+0000","last_peered":"2024-02-21T22:53:43.991018+0000","last_clean":"2024-02-21T22:53:43.991018+0000","last_became_active":"2024-02-21T22:53:41.994560+0000","last_became_peered":"2024-02-21T22:53:41.994560+0000","last_unstale":"2024-02-21T22:53:43.991018+0000","last_undegraded":"2024-02-21T22:53:43.991018+0000","last_fullsized":"2024-02-21T22:53:43.991018+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:44:42.045212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.990932+0000","last_change":"2024-02-21T22:53:43.015964+0000","last_active":"2024-02-21T22:53:43.990932+0000","last_peered":"2024-02-21T22:53:43.990932+0000","last_clean":"2024-02-21T22:53:43.990932+0000","last_became_active":"2024-02-21T22:53:43.015685+0000","last_became_peered":"2024-02-21T22:53:43.015685+0000","last_unstale":"2024-02-21T22:53:43.990932+0000","last_undegraded":"2024-02-21T22:53:43.990932+0000","last_fullsized":"2024-02-21T22:53:43.990932+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:06:03.706623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.340065+0000","last_change":"2024-02-21T22:53:41.988521+0000","last_active":"2024-02-21T22:53:44.340065+0000","last_peered":"2024-02-21T22:53:44.340065+0000","last_clean":"2024-02-21T22:53:44.340065+0000","last_became_active":"2024-02-21T22:53:41.987907+0000","last_became_peered":"2024-02-21T22:53:41.987907+0000","last_unstale":"2024-02-21T22:53:44.340065+0000","last_undegraded":"2024-02-21T22:53:44.340065+0000","last_fullsized":"2024-02-21T22:53:44.340065+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:52:02.783816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.340633+0000","last_change":"2024-02-21T22:53:43.001964+0000","last_active":"2024-02-21T22:53:44.340633+0000","last_peered":"2024-02-21T22:53:44.340633+0000","last_clean":"2024-02-21T22:53:44.340633+0000","last_became_active":"2024-02-21T22:53:43.001671+0000","last_became_peered":"2024-02-21T22:53:43.001671+0000","last_unstale":"2024-02-21T22:53:44.340633+0000","last_undegraded":"2024-02-21T22:53:44.340633+0000","last_fullsized":"2024-02-21T22:53:44.340633+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:34:47.098047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.322830+0000","last_change":"2024-02-21T22:53:41.991783+0000","last_active":"2024-02-21T22:53:44.322830+0000","last_peered":"2024-02-21T22:53:44.322830+0000","last_clean":"2024-02-21T22:53:44.322830+0000","last_became_active":"2024-02-21T22:53:41.991530+0000","last_became_peered":"2024-02-21T22:53:41.991530+0000","last_unstale":"2024-02-21T22:53:44.322830+0000","last_undegraded":"2024-02-21T22:53:44.322830+0000","last_fullsized":"2024-02-21T22:53:44.322830+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:38:22.676905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":194,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.339918+0000","last_change":"2024-02-21T22:52:40.336187+0000","last_active":"2024-02-21T22:53:44.339918+0000","last_peered":"2024-02-21T22:53:44.339918+0000","last_clean":"2024-02-21T22:53:44.339918+0000","last_became_active":"2024-02-21T22:52:40.335061+0000","last_became_peered":"2024-02-21T22:52:40.335061+0000","last_unstale":"2024-02-21T22:53:44.339918+0000","last_undegraded":"2024-02-21T22:53:44.339918+0000","last_fullsized":"2024-02-21T22:53:44.339918+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:38.328863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:38.328863+0000","last_clean_scrub_stamp":"2024-02-21T22:52:38.328863+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:33:53.012414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":7943,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":15886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":45,"ondisk_log_size":45,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574866,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27976,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343864,"statfs":{"total":96636764160,"available":96608116736,"internally_reserved":0,"allocated":970752,"data_stored":737074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574867,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":380928,"data_stored":147232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574868,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":380928,"data_stored":147288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574867,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":380928,"data_stored":146720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574867,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":393216,"data_stored":153783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574867,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":376832,"data_stored":146686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574868,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":393216,"data_stored":153626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574866,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27960,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343880,"statfs":{"total":96636764160,"available":96608133120,"internally_reserved":0,"allocated":966656,"data_stored":736984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":7167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":7167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-21T22:53:54.329 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-02-21T22:53:54.329 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-21T22:53:54.465 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.474+0000 7f2786b5e640 1 Processor -- start 2024-02-21T22:53:54.465 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.474+0000 7f2786b5e640 1 -- start start 2024-02-21T22:53:54.467 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.475+0000 7f2786b5e640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f2780070b70 0x7f2780071580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:54.467 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.475+0000 7f2786b5e640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f2780071ac0 0x7f27800b3860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:54.467 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.475+0000 7f2786b5e640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27800710e0 con 0x7f278015afb0 2024-02-21T22:53:54.467 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.475+0000 7f2786b5e640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f278015b390 con 0x7f2780070b70 2024-02-21T22:53:54.467 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.475+0000 7f2786b5e640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2780071f30 con 0x7f2780071ac0 2024-02-21T22:53:54.467 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.475+0000 7f277ffff640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f2780070b70 0x7f2780071580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:54.468 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.475+0000 7f27850fb640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f2780071ac0 0x7f27800b3860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:54.468 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.475+0000 7f27848fa640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f278015afb0 0x7f27800af080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.116:43410/0 (socket says 172.21.15.116:43410) 2024-02-21T22:53:54.468 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.475+0000 7f277ffff640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f2780070b70 0x7f2780071580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:40158/0 (socket says 172.21.15.116:40158) 2024-02-21T22:53:54.468 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.475+0000 7f27848fa640 1 -- 172.21.15.116:0/2165343931 learned_addr learned my addr 172.21.15.116:0/2165343931 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-02-21T22:53:54.468 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.476+0000 7f277f7fe640 1 -- 172.21.15.116:0/2165343931 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4079150316 0 0) 0x7f27800710e0 con 0x7f278015afb0 2024-02-21T22:53:54.468 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.476+0000 7f277ffff640 1 -- 172.21.15.116:0/2165343931 >> v2:172.21.15.142:3300/0 conn(0x7f2780071ac0 msgr2=0x7f27800b3860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:53:54.468 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.476+0000 7f277ffff640 1 --2- 172.21.15.116:0/2165343931 >> v2:172.21.15.142:3300/0 conn(0x7f2780071ac0 0x7f27800b3860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:54.468 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.476+0000 7f277ffff640 1 -- 172.21.15.116:0/2165343931 >> v1:172.21.15.142:6789/0 conn(0x7f278015afb0 legacy=0x7f27800af080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:54.469 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.476+0000 7f277ffff640 1 -- 172.21.15.116:0/2165343931 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27800b2d80 con 0x7f2780070b70 2024-02-21T22:53:54.469 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.476+0000 7f27850fb640 1 --2- 172.21.15.116:0/2165343931 >> v2:172.21.15.142:3300/0 conn(0x7f2780071ac0 0x7f27800b3860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T22:53:54.469 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.476+0000 7f277ffff640 1 --2- 172.21.15.116:0/2165343931 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2780070b70 0x7f2780071580 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f277400ba40 tx=0x7f277402e130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f0468aa78d74b51 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:54.469 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.476+0000 7f277f7fe640 1 -- 172.21.15.116:0/2165343931 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f277403b070 con 0x7f2780070b70 2024-02-21T22:53:54.470 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.477+0000 7f277f7fe640 1 -- 172.21.15.116:0/2165343931 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2774036440 con 0x7f2780070b70 2024-02-21T22:53:54.470 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.477+0000 7f277f7fe640 1 -- 172.21.15.116:0/2165343931 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2774036810 con 0x7f2780070b70 2024-02-21T22:53:54.474 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.477+0000 7f2786b5e640 1 -- 172.21.15.116:0/2165343931 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2780070b70 msgr2=0x7f2780071580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:54.474 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.477+0000 7f2786b5e640 1 --2- 172.21.15.116:0/2165343931 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2780070b70 0x7f2780071580 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f277400ba40 tx=0x7f277402e130 comp rx=0 tx=0).stop 2024-02-21T22:53:54.474 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.477+0000 7f2786b5e640 1 -- 172.21.15.116:0/2165343931 shutdown_connections 2024-02-21T22:53:54.474 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.477+0000 7f2786b5e640 1 --2- 172.21.15.116:0/2165343931 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2780070b70 0x7f2780071580 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:54.474 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.477+0000 7f2786b5e640 1 --2- 172.21.15.116:0/2165343931 >> v2:172.21.15.142:3300/0 conn(0x7f2780071ac0 0x7f27800b3860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:54.474 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.477+0000 7f2786b5e640 1 -- 172.21.15.116:0/2165343931 >> 172.21.15.116:0/2165343931 conn(0x7f27800b18e0 msgr2=0x7f27800b1cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:54.474 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.477+0000 7f2786b5e640 1 -- 172.21.15.116:0/2165343931 shutdown_connections 2024-02-21T22:53:54.474 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.477+0000 7f2786b5e640 1 -- 172.21.15.116:0/2165343931 wait complete. 2024-02-21T22:53:54.475 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.478+0000 7f2786b5e640 1 Processor -- start 2024-02-21T22:53:54.475 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.478+0000 7f2786b5e640 1 -- start start 2024-02-21T22:53:54.475 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.479+0000 7f2786b5e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2780070b70 0x7f27800cc560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:54.475 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.479+0000 7f2786b5e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2780071ac0 0x7f278009c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:54.475 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.479+0000 7f2786b5e640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f278015afb0 0x7f278009b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:54.475 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.479+0000 7f2786b5e640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27800b3340 con 0x7f278015afb0 2024-02-21T22:53:54.475 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.479+0000 7f2786b5e640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27800713c0 con 0x7f2780070b70 2024-02-21T22:53:54.475 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.479+0000 7f2786b5e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27800b3da0 con 0x7f2780071ac0 2024-02-21T22:53:54.475 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.479+0000 7f27850fb640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f278015afb0 0x7f278009b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:54.476 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.479+0000 7f27850fb640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f278015afb0 0x7f278009b530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:40164/0 (socket says 172.21.15.116:40164) 2024-02-21T22:53:54.476 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.479+0000 7f27850fb640 1 -- 172.21.15.116:0/2818003136 learned_addr learned my addr 172.21.15.116:0/2818003136 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:54.476 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.479+0000 7f27848fa640 1 --2- 172.21.15.116:0/2818003136 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2780070b70 0x7f27800cc560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:54.476 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.479+0000 7f277ffff640 1 --2- 172.21.15.116:0/2818003136 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2780071ac0 0x7f278009c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:54.476 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.479+0000 7f27850fb640 1 -- 172.21.15.116:0/2818003136 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2780071ac0 msgr2=0x7f278009c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:54.476 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.479+0000 7f27850fb640 1 --2- 172.21.15.116:0/2818003136 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2780071ac0 0x7f278009c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:54.476 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.479+0000 7f27850fb640 1 -- 172.21.15.116:0/2818003136 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2780070b70 msgr2=0x7f27800cc560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:54.476 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.479+0000 7f27850fb640 1 --2- 172.21.15.116:0/2818003136 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2780070b70 0x7f27800cc560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:54.477 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.479+0000 7f27850fb640 1 -- 172.21.15.116:0/2818003136 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2780156030 con 0x7f278015afb0 2024-02-21T22:53:54.477 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.480+0000 7f27848fa640 1 --2- 172.21.15.116:0/2818003136 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2780070b70 0x7f27800cc560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T22:53:54.477 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.480+0000 7f27850fb640 1 --2- 172.21.15.116:0/2818003136 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f278015afb0 0x7f278009b530 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f2778009f00 tx=0x7f277800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:54.477 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.480+0000 7f277d7fa640 1 -- 172.21.15.116:0/2818003136 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2778018030 con 0x7f278015afb0 2024-02-21T22:53:54.477 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.480+0000 7f277d7fa640 1 -- 172.21.15.116:0/2818003136 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f277800cdf0 con 0x7f278015afb0 2024-02-21T22:53:54.477 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.480+0000 7f2786b5e640 1 -- 172.21.15.116:0/2818003136 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2780156310 con 0x7f278015afb0 2024-02-21T22:53:54.477 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.480+0000 7f277d7fa640 1 -- 172.21.15.116:0/2818003136 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2778003bb0 con 0x7f278015afb0 2024-02-21T22:53:54.477 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.480+0000 7f2786b5e640 1 -- 172.21.15.116:0/2818003136 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27801568d0 con 0x7f278015afb0 2024-02-21T22:53:54.478 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.481+0000 7f2786b5e640 1 -- 172.21.15.116:0/2818003136 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2780156db0 con 0x7f278015afb0 2024-02-21T22:53:54.478 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.481+0000 7f277d7fa640 1 -- 172.21.15.116:0/2818003136 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f277801b070 con 0x7f278015afb0 2024-02-21T22:53:54.478 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.481+0000 7f277d7fa640 1 --2- 172.21.15.116:0/2818003136 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f276c06b4d0 0x7f276c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:54.478 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.482+0000 7f277d7fa640 1 -- 172.21.15.116:0/2818003136 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f277808ab60 con 0x7f278015afb0 2024-02-21T22:53:54.478 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.482+0000 7f27848fa640 1 --2- 172.21.15.116:0/2818003136 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f276c06b4d0 0x7f276c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:54.478 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.482+0000 7f27848fa640 1 --2- 172.21.15.116:0/2818003136 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f276c06b4d0 0x7f276c06d990 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f2770000f60 tx=0x7f2770007ca0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:54.479 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.486+0000 7f277d7fa640 1 -- 172.21.15.116:0/2818003136 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f2780156db0 con 0x7f278015afb0 2024-02-21T22:53:54.644 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.653+0000 7f2786b5e640 1 -- 172.21.15.116:0/2818003136 --> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f27800752f0 con 0x7f276c06b4d0 2024-02-21T22:53:54.649 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.659+0000 7f277d7fa640 1 -- 172.21.15.116:0/2818003136 <== mgr.4103 v2:172.21.15.142:6832/1381484782 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251840 (secure 0 0 0) 0x7f27800752f0 con 0x7f276c06b4d0 2024-02-21T22:53:54.652 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-02-21T22:53:54.653 INFO:teuthology.orchestra.run.smithi116.stderr:dumped all 2024-02-21T22:53:54.655 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.662+0000 7f2786b5e640 1 -- 172.21.15.116:0/2818003136 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f276c06b4d0 msgr2=0x7f276c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:54.655 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.662+0000 7f2786b5e640 1 --2- 172.21.15.116:0/2818003136 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f276c06b4d0 0x7f276c06d990 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f2770000f60 tx=0x7f2770007ca0 comp rx=0 tx=0).stop 2024-02-21T22:53:54.655 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.662+0000 7f2786b5e640 1 -- 172.21.15.116:0/2818003136 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f278015afb0 msgr2=0x7f278009b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:54.655 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.662+0000 7f2786b5e640 1 --2- 172.21.15.116:0/2818003136 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f278015afb0 0x7f278009b530 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f2778009f00 tx=0x7f277800c490 comp rx=0 tx=0).stop 2024-02-21T22:53:54.656 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.662+0000 7f2786b5e640 1 -- 172.21.15.116:0/2818003136 shutdown_connections 2024-02-21T22:53:54.656 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.662+0000 7f2786b5e640 1 --2- 172.21.15.116:0/2818003136 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f278015afb0 0x7f278009b530 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:54.656 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.662+0000 7f2786b5e640 1 --2- 172.21.15.116:0/2818003136 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f276c06b4d0 0x7f276c06d990 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:54.656 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.662+0000 7f2786b5e640 1 --2- 172.21.15.116:0/2818003136 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2780071ac0 0x7f278009c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:54.656 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.662+0000 7f2786b5e640 1 --2- 172.21.15.116:0/2818003136 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2780070b70 0x7f27800cc560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:54.656 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.662+0000 7f2786b5e640 1 -- 172.21.15.116:0/2818003136 >> 172.21.15.116:0/2818003136 conn(0x7f27800b18e0 msgr2=0x7f278006d180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:54.656 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.662+0000 7f2786b5e640 1 -- 172.21.15.116:0/2818003136 shutdown_connections 2024-02-21T22:53:54.656 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.662+0000 7f2786b5e640 1 -- 172.21.15.116:0/2818003136 wait complete. 2024-02-21T22:53:54.663 INFO:teuthology.orchestra.run.smithi116.stdout:{"pg_ready":true,"pg_map":{"version":64,"stamp":"2024-02-21T22:53:54.298750+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":598311,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":212,"num_write_kb":2439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":162,"ondisk_log_size":162,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220332,"kb_used_data":4144,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754388,"statfs":{"total":773094113280,"available":772868493312,"internally_reserved":0,"allocated":4243456,"data_stored":2369393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5533,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.309583"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.323002+0000","last_change":"2024-02-21T22:53:43.002525+0000","last_active":"2024-02-21T22:53:44.323002+0000","last_peered":"2024-02-21T22:53:44.323002+0000","last_clean":"2024-02-21T22:53:44.323002+0000","last_became_active":"2024-02-21T22:53:43.002238+0000","last_became_peered":"2024-02-21T22:53:43.002238+0000","last_unstale":"2024-02-21T22:53:44.323002+0000","last_undegraded":"2024-02-21T22:53:44.323002+0000","last_fullsized":"2024-02-21T22:53:44.323002+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:26:25.990337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.340424+0000","last_change":"2024-02-21T22:53:43.000671+0000","last_active":"2024-02-21T22:53:44.340424+0000","last_peered":"2024-02-21T22:53:44.340424+0000","last_clean":"2024-02-21T22:53:44.340424+0000","last_became_active":"2024-02-21T22:53:43.000396+0000","last_became_peered":"2024-02-21T22:53:43.000396+0000","last_unstale":"2024-02-21T22:53:44.340424+0000","last_undegraded":"2024-02-21T22:53:44.340424+0000","last_fullsized":"2024-02-21T22:53:44.340424+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:54:49.339689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.340666+0000","last_change":"2024-02-21T22:53:43.004625+0000","last_active":"2024-02-21T22:53:44.340666+0000","last_peered":"2024-02-21T22:53:44.340666+0000","last_clean":"2024-02-21T22:53:44.340666+0000","last_became_active":"2024-02-21T22:53:43.004321+0000","last_became_peered":"2024-02-21T22:53:43.004321+0000","last_unstale":"2024-02-21T22:53:44.340666+0000","last_undegraded":"2024-02-21T22:53:44.340666+0000","last_fullsized":"2024-02-21T22:53:44.340666+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:34:47.098047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.989775+0000","last_change":"2024-02-21T22:53:43.010931+0000","last_active":"2024-02-21T22:53:43.989775+0000","last_peered":"2024-02-21T22:53:43.989775+0000","last_clean":"2024-02-21T22:53:43.989775+0000","last_became_active":"2024-02-21T22:53:43.010683+0000","last_became_peered":"2024-02-21T22:53:43.010683+0000","last_unstale":"2024-02-21T22:53:43.989775+0000","last_undegraded":"2024-02-21T22:53:43.989775+0000","last_fullsized":"2024-02-21T22:53:43.989775+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:38:31.580364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.236363+0000","last_change":"2024-02-21T22:53:43.006662+0000","last_active":"2024-02-21T22:53:44.236363+0000","last_peered":"2024-02-21T22:53:44.236363+0000","last_clean":"2024-02-21T22:53:44.236363+0000","last_became_active":"2024-02-21T22:53:43.006405+0000","last_became_peered":"2024-02-21T22:53:43.006405+0000","last_unstale":"2024-02-21T22:53:44.236363+0000","last_undegraded":"2024-02-21T22:53:44.236363+0000","last_fullsized":"2024-02-21T22:53:44.236363+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:38:23.681255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.340162+0000","last_change":"2024-02-21T22:53:42.997969+0000","last_active":"2024-02-21T22:53:44.340162+0000","last_peered":"2024-02-21T22:53:44.340162+0000","last_clean":"2024-02-21T22:53:44.340162+0000","last_became_active":"2024-02-21T22:53:42.997719+0000","last_became_peered":"2024-02-21T22:53:42.997719+0000","last_unstale":"2024-02-21T22:53:44.340162+0000","last_undegraded":"2024-02-21T22:53:44.340162+0000","last_fullsized":"2024-02-21T22:53:44.340162+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:09:41.280308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.340372+0000","last_change":"2024-02-21T22:53:43.007930+0000","last_active":"2024-02-21T22:53:44.340372+0000","last_peered":"2024-02-21T22:53:44.340372+0000","last_clean":"2024-02-21T22:53:44.340372+0000","last_became_active":"2024-02-21T22:53:43.007675+0000","last_became_peered":"2024-02-21T22:53:43.007675+0000","last_unstale":"2024-02-21T22:53:44.340372+0000","last_undegraded":"2024-02-21T22:53:44.340372+0000","last_fullsized":"2024-02-21T22:53:44.340372+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:09:41.280308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.340102+0000","last_change":"2024-02-21T22:53:43.001108+0000","last_active":"2024-02-21T22:53:44.340102+0000","last_peered":"2024-02-21T22:53:44.340102+0000","last_clean":"2024-02-21T22:53:44.340102+0000","last_became_active":"2024-02-21T22:53:43.000729+0000","last_became_peered":"2024-02-21T22:53:43.000729+0000","last_unstale":"2024-02-21T22:53:44.340102+0000","last_undegraded":"2024-02-21T22:53:44.340102+0000","last_fullsized":"2024-02-21T22:53:44.340102+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:53:37.531108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.991662+0000","last_change":"2024-02-21T22:53:43.016364+0000","last_active":"2024-02-21T22:53:43.991662+0000","last_peered":"2024-02-21T22:53:43.991662+0000","last_clean":"2024-02-21T22:53:43.991662+0000","last_became_active":"2024-02-21T22:53:43.015907+0000","last_became_peered":"2024-02-21T22:53:43.015907+0000","last_unstale":"2024-02-21T22:53:43.991662+0000","last_undegraded":"2024-02-21T22:53:43.991662+0000","last_fullsized":"2024-02-21T22:53:43.991662+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:53:37.531108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.990165+0000","last_change":"2024-02-21T22:53:43.005373+0000","last_active":"2024-02-21T22:53:43.990165+0000","last_peered":"2024-02-21T22:53:43.990165+0000","last_clean":"2024-02-21T22:53:43.990165+0000","last_became_active":"2024-02-21T22:53:43.005035+0000","last_became_peered":"2024-02-21T22:53:43.005035+0000","last_unstale":"2024-02-21T22:53:43.990165+0000","last_undegraded":"2024-02-21T22:53:43.990165+0000","last_fullsized":"2024-02-21T22:53:43.990165+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:03:52.457060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.341174+0000","last_change":"2024-02-21T22:53:43.011309+0000","last_active":"2024-02-21T22:53:44.341174+0000","last_peered":"2024-02-21T22:53:44.341174+0000","last_clean":"2024-02-21T22:53:44.341174+0000","last_became_active":"2024-02-21T22:53:43.010956+0000","last_became_peered":"2024-02-21T22:53:43.010956+0000","last_unstale":"2024-02-21T22:53:44.341174+0000","last_undegraded":"2024-02-21T22:53:44.341174+0000","last_fullsized":"2024-02-21T22:53:44.341174+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:24:37.189670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.340545+0000","last_change":"2024-02-21T22:53:43.007326+0000","last_active":"2024-02-21T22:53:44.340545+0000","last_peered":"2024-02-21T22:53:44.340545+0000","last_clean":"2024-02-21T22:53:44.340545+0000","last_became_active":"2024-02-21T22:53:43.007022+0000","last_became_peered":"2024-02-21T22:53:43.007022+0000","last_unstale":"2024-02-21T22:53:44.340545+0000","last_undegraded":"2024-02-21T22:53:44.340545+0000","last_fullsized":"2024-02-21T22:53:44.340545+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:09:41.280308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.236376+0000","last_change":"2024-02-21T22:53:42.999643+0000","last_active":"2024-02-21T22:53:44.236376+0000","last_peered":"2024-02-21T22:53:44.236376+0000","last_clean":"2024-02-21T22:53:44.236376+0000","last_became_active":"2024-02-21T22:53:42.999406+0000","last_became_peered":"2024-02-21T22:53:42.999406+0000","last_unstale":"2024-02-21T22:53:44.236376+0000","last_undegraded":"2024-02-21T22:53:44.236376+0000","last_fullsized":"2024-02-21T22:53:44.236376+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:44:43.049562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.340324+0000","last_change":"2024-02-21T22:53:43.005346+0000","last_active":"2024-02-21T22:53:44.340324+0000","last_peered":"2024-02-21T22:53:44.340324+0000","last_clean":"2024-02-21T22:53:44.340324+0000","last_became_active":"2024-02-21T22:53:43.004383+0000","last_became_peered":"2024-02-21T22:53:43.004383+0000","last_unstale":"2024-02-21T22:53:44.340324+0000","last_undegraded":"2024-02-21T22:53:44.340324+0000","last_fullsized":"2024-02-21T22:53:44.340324+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:24:37.189670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.340241+0000","last_change":"2024-02-21T22:53:42.995690+0000","last_active":"2024-02-21T22:53:44.340241+0000","last_peered":"2024-02-21T22:53:44.340241+0000","last_clean":"2024-02-21T22:53:44.340241+0000","last_became_active":"2024-02-21T22:53:42.995407+0000","last_became_peered":"2024-02-21T22:53:42.995407+0000","last_unstale":"2024-02-21T22:53:44.340241+0000","last_undegraded":"2024-02-21T22:53:44.340241+0000","last_fullsized":"2024-02-21T22:53:44.340241+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:41:56.581902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.340256+0000","last_change":"2024-02-21T22:53:43.009355+0000","last_active":"2024-02-21T22:53:44.340256+0000","last_peered":"2024-02-21T22:53:44.340256+0000","last_clean":"2024-02-21T22:53:44.340256+0000","last_became_active":"2024-02-21T22:53:43.009073+0000","last_became_peered":"2024-02-21T22:53:43.009073+0000","last_unstale":"2024-02-21T22:53:44.340256+0000","last_undegraded":"2024-02-21T22:53:44.340256+0000","last_fullsized":"2024-02-21T22:53:44.340256+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:03:52.457060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.341204+0000","last_change":"2024-02-21T22:53:43.008675+0000","last_active":"2024-02-21T22:53:44.341204+0000","last_peered":"2024-02-21T22:53:44.341204+0000","last_clean":"2024-02-21T22:53:44.341204+0000","last_became_active":"2024-02-21T22:53:43.008404+0000","last_became_peered":"2024-02-21T22:53:43.008404+0000","last_unstale":"2024-02-21T22:53:44.341204+0000","last_undegraded":"2024-02-21T22:53:44.341204+0000","last_fullsized":"2024-02-21T22:53:44.341204+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:00:32.372505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.340466+0000","last_change":"2024-02-21T22:53:42.999615+0000","last_active":"2024-02-21T22:53:44.340466+0000","last_peered":"2024-02-21T22:53:44.340466+0000","last_clean":"2024-02-21T22:53:44.340466+0000","last_became_active":"2024-02-21T22:53:42.999362+0000","last_became_peered":"2024-02-21T22:53:42.999362+0000","last_unstale":"2024-02-21T22:53:44.340466+0000","last_undegraded":"2024-02-21T22:53:44.340466+0000","last_fullsized":"2024-02-21T22:53:44.340466+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:36:43.932976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.340333+0000","last_change":"2024-02-21T22:53:43.010970+0000","last_active":"2024-02-21T22:53:44.340333+0000","last_peered":"2024-02-21T22:53:44.340333+0000","last_clean":"2024-02-21T22:53:44.340333+0000","last_became_active":"2024-02-21T22:53:43.010702+0000","last_became_peered":"2024-02-21T22:53:43.010702+0000","last_unstale":"2024-02-21T22:53:44.340333+0000","last_undegraded":"2024-02-21T22:53:44.340333+0000","last_fullsized":"2024-02-21T22:53:44.340333+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:00:32.372505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.236456+0000","last_change":"2024-02-21T22:53:43.006258+0000","last_active":"2024-02-21T22:53:44.236456+0000","last_peered":"2024-02-21T22:53:44.236456+0000","last_clean":"2024-02-21T22:53:44.236456+0000","last_became_active":"2024-02-21T22:53:43.005993+0000","last_became_peered":"2024-02-21T22:53:43.005993+0000","last_unstale":"2024-02-21T22:53:44.236456+0000","last_undegraded":"2024-02-21T22:53:44.236456+0000","last_fullsized":"2024-02-21T22:53:44.236456+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:27:19.189008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.991192+0000","last_change":"2024-02-21T22:53:43.015003+0000","last_active":"2024-02-21T22:53:43.991192+0000","last_peered":"2024-02-21T22:53:43.991192+0000","last_clean":"2024-02-21T22:53:43.991192+0000","last_became_active":"2024-02-21T22:53:43.014712+0000","last_became_peered":"2024-02-21T22:53:43.014712+0000","last_unstale":"2024-02-21T22:53:43.991192+0000","last_undegraded":"2024-02-21T22:53:43.991192+0000","last_fullsized":"2024-02-21T22:53:43.991192+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:15:36.152598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.991098+0000","last_change":"2024-02-21T22:53:43.014845+0000","last_active":"2024-02-21T22:53:43.991098+0000","last_peered":"2024-02-21T22:53:43.991098+0000","last_clean":"2024-02-21T22:53:43.991098+0000","last_became_active":"2024-02-21T22:53:43.014570+0000","last_became_peered":"2024-02-21T22:53:43.014570+0000","last_unstale":"2024-02-21T22:53:43.991098+0000","last_undegraded":"2024-02-21T22:53:43.991098+0000","last_fullsized":"2024-02-21T22:53:43.991098+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:26:25.990337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.990453+0000","last_change":"2024-02-21T22:53:43.002518+0000","last_active":"2024-02-21T22:53:43.990453+0000","last_peered":"2024-02-21T22:53:43.990453+0000","last_clean":"2024-02-21T22:53:43.990453+0000","last_became_active":"2024-02-21T22:53:43.002254+0000","last_became_peered":"2024-02-21T22:53:43.002254+0000","last_unstale":"2024-02-21T22:53:43.990453+0000","last_undegraded":"2024-02-21T22:53:43.990453+0000","last_fullsized":"2024-02-21T22:53:43.990453+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:06:03.706623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.340072+0000","last_change":"2024-02-21T22:53:42.996552+0000","last_active":"2024-02-21T22:53:44.340072+0000","last_peered":"2024-02-21T22:53:44.340072+0000","last_clean":"2024-02-21T22:53:44.340072+0000","last_became_active":"2024-02-21T22:53:42.996208+0000","last_became_peered":"2024-02-21T22:53:42.996208+0000","last_unstale":"2024-02-21T22:53:44.340072+0000","last_undegraded":"2024-02-21T22:53:44.340072+0000","last_fullsized":"2024-02-21T22:53:44.340072+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:31:54.235302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.990349+0000","last_change":"2024-02-21T22:53:43.003996+0000","last_active":"2024-02-21T22:53:43.990349+0000","last_peered":"2024-02-21T22:53:43.990349+0000","last_clean":"2024-02-21T22:53:43.990349+0000","last_became_active":"2024-02-21T22:53:43.003710+0000","last_became_peered":"2024-02-21T22:53:43.003710+0000","last_unstale":"2024-02-21T22:53:43.990349+0000","last_undegraded":"2024-02-21T22:53:43.990349+0000","last_fullsized":"2024-02-21T22:53:43.990349+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T02:25:22.385393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.340570+0000","last_change":"2024-02-21T22:53:43.000854+0000","last_active":"2024-02-21T22:53:44.340570+0000","last_peered":"2024-02-21T22:53:44.340570+0000","last_clean":"2024-02-21T22:53:44.340570+0000","last_became_active":"2024-02-21T22:53:43.000575+0000","last_became_peered":"2024-02-21T22:53:43.000575+0000","last_unstale":"2024-02-21T22:53:44.340570+0000","last_undegraded":"2024-02-21T22:53:44.340570+0000","last_fullsized":"2024-02-21T22:53:44.340570+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:03:16.607197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.990344+0000","last_change":"2024-02-21T22:53:43.011416+0000","last_active":"2024-02-21T22:53:43.990344+0000","last_peered":"2024-02-21T22:53:43.990344+0000","last_clean":"2024-02-21T22:53:43.990344+0000","last_became_active":"2024-02-21T22:53:43.010808+0000","last_became_peered":"2024-02-21T22:53:43.010808+0000","last_unstale":"2024-02-21T22:53:43.990344+0000","last_undegraded":"2024-02-21T22:53:43.990344+0000","last_fullsized":"2024-02-21T22:53:43.990344+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:09:41.280308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.340672+0000","last_change":"2024-02-21T22:53:42.999624+0000","last_active":"2024-02-21T22:53:44.340672+0000","last_peered":"2024-02-21T22:53:44.340672+0000","last_clean":"2024-02-21T22:53:44.340672+0000","last_became_active":"2024-02-21T22:53:42.999295+0000","last_became_peered":"2024-02-21T22:53:42.999295+0000","last_unstale":"2024-02-21T22:53:44.340672+0000","last_undegraded":"2024-02-21T22:53:44.340672+0000","last_fullsized":"2024-02-21T22:53:44.340672+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:24:37.189670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.991295+0000","last_change":"2024-02-21T22:53:43.016081+0000","last_active":"2024-02-21T22:53:43.991295+0000","last_peered":"2024-02-21T22:53:43.991295+0000","last_clean":"2024-02-21T22:53:43.991295+0000","last_became_active":"2024-02-21T22:53:43.015533+0000","last_became_peered":"2024-02-21T22:53:43.015533+0000","last_unstale":"2024-02-21T22:53:43.991295+0000","last_undegraded":"2024-02-21T22:53:43.991295+0000","last_fullsized":"2024-02-21T22:53:43.991295+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:13:51.231189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.340327+0000","last_change":"2024-02-21T22:53:43.007179+0000","last_active":"2024-02-21T22:53:44.340327+0000","last_peered":"2024-02-21T22:53:44.340327+0000","last_clean":"2024-02-21T22:53:44.340327+0000","last_became_active":"2024-02-21T22:53:43.006982+0000","last_became_peered":"2024-02-21T22:53:43.006982+0000","last_unstale":"2024-02-21T22:53:44.340327+0000","last_undegraded":"2024-02-21T22:53:44.340327+0000","last_fullsized":"2024-02-21T22:53:44.340327+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:41:56.581902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.322838+0000","last_change":"2024-02-21T22:53:43.000423+0000","last_active":"2024-02-21T22:53:44.322838+0000","last_peered":"2024-02-21T22:53:44.322838+0000","last_clean":"2024-02-21T22:53:44.322838+0000","last_became_active":"2024-02-21T22:53:43.000179+0000","last_became_peered":"2024-02-21T22:53:43.000179+0000","last_unstale":"2024-02-21T22:53:44.322838+0000","last_undegraded":"2024-02-21T22:53:44.322838+0000","last_fullsized":"2024-02-21T22:53:44.322838+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:06:03.706623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.340129+0000","last_change":"2024-02-21T22:53:43.013244+0000","last_active":"2024-02-21T22:53:44.340129+0000","last_peered":"2024-02-21T22:53:44.340129+0000","last_clean":"2024-02-21T22:53:44.340129+0000","last_became_active":"2024-02-21T22:53:43.012985+0000","last_became_peered":"2024-02-21T22:53:43.012985+0000","last_unstale":"2024-02-21T22:53:44.340129+0000","last_undegraded":"2024-02-21T22:53:44.340129+0000","last_fullsized":"2024-02-21T22:53:44.340129+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:38:31.580364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.990598+0000","last_change":"2024-02-21T22:53:43.001816+0000","last_active":"2024-02-21T22:53:43.990598+0000","last_peered":"2024-02-21T22:53:43.990598+0000","last_clean":"2024-02-21T22:53:43.990598+0000","last_became_active":"2024-02-21T22:53:43.001564+0000","last_became_peered":"2024-02-21T22:53:43.001564+0000","last_unstale":"2024-02-21T22:53:43.990598+0000","last_undegraded":"2024-02-21T22:53:43.990598+0000","last_fullsized":"2024-02-21T22:53:43.990598+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:26:25.990337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"32'4","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.323094+0000","last_change":"2024-02-21T22:53:41.994843+0000","last_active":"2024-02-21T22:53:44.323094+0000","last_peered":"2024-02-21T22:53:44.323094+0000","last_clean":"2024-02-21T22:53:44.323094+0000","last_became_active":"2024-02-21T22:53:41.994468+0000","last_became_peered":"2024-02-21T22:53:41.994468+0000","last_unstale":"2024-02-21T22:53:44.323094+0000","last_undegraded":"2024-02-21T22:53:44.323094+0000","last_fullsized":"2024-02-21T22:53:44.323094+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:27:18.184658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.323022+0000","last_change":"2024-02-21T22:53:43.008294+0000","last_active":"2024-02-21T22:53:44.323022+0000","last_peered":"2024-02-21T22:53:44.323022+0000","last_clean":"2024-02-21T22:53:44.323022+0000","last_became_active":"2024-02-21T22:53:43.008021+0000","last_became_peered":"2024-02-21T22:53:43.008021+0000","last_unstale":"2024-02-21T22:53:44.323022+0000","last_undegraded":"2024-02-21T22:53:44.323022+0000","last_fullsized":"2024-02-21T22:53:44.323022+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:15:36.152598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"32'1","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.990599+0000","last_change":"2024-02-21T22:53:41.987067+0000","last_active":"2024-02-21T22:53:43.990599+0000","last_peered":"2024-02-21T22:53:43.990599+0000","last_clean":"2024-02-21T22:53:43.990599+0000","last_became_active":"2024-02-21T22:53:41.986784+0000","last_became_peered":"2024-02-21T22:53:41.986784+0000","last_unstale":"2024-02-21T22:53:43.990599+0000","last_undegraded":"2024-02-21T22:53:43.990599+0000","last_fullsized":"2024-02-21T22:53:43.990599+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:34:59.792432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.991412+0000","last_change":"2024-02-21T22:53:43.016649+0000","last_active":"2024-02-21T22:53:43.991412+0000","last_peered":"2024-02-21T22:53:43.991412+0000","last_clean":"2024-02-21T22:53:43.991412+0000","last_became_active":"2024-02-21T22:53:43.016339+0000","last_became_peered":"2024-02-21T22:53:43.016339+0000","last_unstale":"2024-02-21T22:53:43.991412+0000","last_undegraded":"2024-02-21T22:53:43.991412+0000","last_fullsized":"2024-02-21T22:53:43.991412+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:40:05.306862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"32'2","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.340263+0000","last_change":"2024-02-21T22:53:41.991758+0000","last_active":"2024-02-21T22:53:44.340263+0000","last_peered":"2024-02-21T22:53:44.340263+0000","last_clean":"2024-02-21T22:53:44.340263+0000","last_became_active":"2024-02-21T22:53:41.990213+0000","last_became_peered":"2024-02-21T22:53:41.990213+0000","last_unstale":"2024-02-21T22:53:44.340263+0000","last_undegraded":"2024-02-21T22:53:44.340263+0000","last_fullsized":"2024-02-21T22:53:44.340263+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:54:00.352993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.990191+0000","last_change":"2024-02-21T22:53:43.011534+0000","last_active":"2024-02-21T22:53:43.990191+0000","last_peered":"2024-02-21T22:53:43.990191+0000","last_clean":"2024-02-21T22:53:43.990191+0000","last_became_active":"2024-02-21T22:53:43.011165+0000","last_became_peered":"2024-02-21T22:53:43.011165+0000","last_unstale":"2024-02-21T22:53:43.990191+0000","last_undegraded":"2024-02-21T22:53:43.990191+0000","last_fullsized":"2024-02-21T22:53:43.990191+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:41:56.581902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"32'2","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.236551+0000","last_change":"2024-02-21T22:53:41.989989+0000","last_active":"2024-02-21T22:53:44.236551+0000","last_peered":"2024-02-21T22:53:44.236551+0000","last_clean":"2024-02-21T22:53:44.236551+0000","last_became_active":"2024-02-21T22:53:41.989105+0000","last_became_peered":"2024-02-21T22:53:41.989105+0000","last_unstale":"2024-02-21T22:53:44.236551+0000","last_undegraded":"2024-02-21T22:53:44.236551+0000","last_fullsized":"2024-02-21T22:53:44.236551+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:22:53.606008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.340540+0000","last_change":"2024-02-21T22:53:43.012670+0000","last_active":"2024-02-21T22:53:44.340540+0000","last_peered":"2024-02-21T22:53:44.340540+0000","last_clean":"2024-02-21T22:53:44.340540+0000","last_became_active":"2024-02-21T22:53:43.012407+0000","last_became_peered":"2024-02-21T22:53:43.012407+0000","last_unstale":"2024-02-21T22:53:44.340540+0000","last_undegraded":"2024-02-21T22:53:44.340540+0000","last_fullsized":"2024-02-21T22:53:44.340540+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T02:25:22.385393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"32'1","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.991294+0000","last_change":"2024-02-21T22:53:41.992560+0000","last_active":"2024-02-21T22:53:43.991294+0000","last_peered":"2024-02-21T22:53:43.991294+0000","last_clean":"2024-02-21T22:53:43.991294+0000","last_became_active":"2024-02-21T22:53:41.992200+0000","last_became_peered":"2024-02-21T22:53:41.992200+0000","last_unstale":"2024-02-21T22:53:43.991294+0000","last_undegraded":"2024-02-21T22:53:43.991294+0000","last_fullsized":"2024-02-21T22:53:43.991294+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:47:38.675797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.340453+0000","last_change":"2024-02-21T22:53:43.003713+0000","last_active":"2024-02-21T22:53:44.340453+0000","last_peered":"2024-02-21T22:53:44.340453+0000","last_clean":"2024-02-21T22:53:44.340453+0000","last_became_active":"2024-02-21T22:53:43.003448+0000","last_became_peered":"2024-02-21T22:53:43.003448+0000","last_unstale":"2024-02-21T22:53:44.340453+0000","last_undegraded":"2024-02-21T22:53:44.340453+0000","last_fullsized":"2024-02-21T22:53:44.340453+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T02:25:22.385393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"32'1","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.991129+0000","last_change":"2024-02-21T22:53:41.989888+0000","last_active":"2024-02-21T22:53:43.991129+0000","last_peered":"2024-02-21T22:53:43.991129+0000","last_clean":"2024-02-21T22:53:43.991129+0000","last_became_active":"2024-02-21T22:53:41.989605+0000","last_became_peered":"2024-02-21T22:53:41.989605+0000","last_unstale":"2024-02-21T22:53:43.991129+0000","last_undegraded":"2024-02-21T22:53:43.991129+0000","last_fullsized":"2024-02-21T22:53:43.991129+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:28:50.954719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.990957+0000","last_change":"2024-02-21T22:53:43.011697+0000","last_active":"2024-02-21T22:53:43.990957+0000","last_peered":"2024-02-21T22:53:43.990957+0000","last_clean":"2024-02-21T22:53:43.990957+0000","last_became_active":"2024-02-21T22:53:43.011446+0000","last_became_peered":"2024-02-21T22:53:43.011446+0000","last_unstale":"2024-02-21T22:53:43.990957+0000","last_undegraded":"2024-02-21T22:53:43.990957+0000","last_fullsized":"2024-02-21T22:53:43.990957+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:53:37.219886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.340098+0000","last_change":"2024-02-21T22:53:41.990198+0000","last_active":"2024-02-21T22:53:44.340098+0000","last_peered":"2024-02-21T22:53:44.340098+0000","last_clean":"2024-02-21T22:53:44.340098+0000","last_became_active":"2024-02-21T22:53:41.989927+0000","last_became_peered":"2024-02-21T22:53:41.989927+0000","last_unstale":"2024-02-21T22:53:44.340098+0000","last_undegraded":"2024-02-21T22:53:44.340098+0000","last_fullsized":"2024-02-21T22:53:44.340098+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:08:08.137842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.989576+0000","last_change":"2024-02-21T22:53:43.008825+0000","last_active":"2024-02-21T22:53:43.989576+0000","last_peered":"2024-02-21T22:53:43.989576+0000","last_clean":"2024-02-21T22:53:43.989576+0000","last_became_active":"2024-02-21T22:53:43.008486+0000","last_became_peered":"2024-02-21T22:53:43.008486+0000","last_unstale":"2024-02-21T22:53:43.989576+0000","last_undegraded":"2024-02-21T22:53:43.989576+0000","last_fullsized":"2024-02-21T22:53:43.989576+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:02:41.596861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.990903+0000","last_change":"2024-02-21T22:53:41.985526+0000","last_active":"2024-02-21T22:53:43.990903+0000","last_peered":"2024-02-21T22:53:43.990903+0000","last_clean":"2024-02-21T22:53:43.990903+0000","last_became_active":"2024-02-21T22:53:41.985232+0000","last_became_peered":"2024-02-21T22:53:41.985232+0000","last_unstale":"2024-02-21T22:53:43.990903+0000","last_undegraded":"2024-02-21T22:53:43.990903+0000","last_fullsized":"2024-02-21T22:53:43.990903+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:46:31.483732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.340853+0000","last_change":"2024-02-21T22:53:43.005931+0000","last_active":"2024-02-21T22:53:44.340853+0000","last_peered":"2024-02-21T22:53:44.340853+0000","last_clean":"2024-02-21T22:53:44.340853+0000","last_became_active":"2024-02-21T22:53:43.005375+0000","last_became_peered":"2024-02-21T22:53:43.005375+0000","last_unstale":"2024-02-21T22:53:44.340853+0000","last_undegraded":"2024-02-21T22:53:44.340853+0000","last_fullsized":"2024-02-21T22:53:44.340853+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:00:32.372505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.340503+0000","last_change":"2024-02-21T22:53:41.987065+0000","last_active":"2024-02-21T22:53:44.340503+0000","last_peered":"2024-02-21T22:53:44.340503+0000","last_clean":"2024-02-21T22:53:44.340503+0000","last_became_active":"2024-02-21T22:53:41.986873+0000","last_became_peered":"2024-02-21T22:53:41.986873+0000","last_unstale":"2024-02-21T22:53:44.340503+0000","last_undegraded":"2024-02-21T22:53:44.340503+0000","last_fullsized":"2024-02-21T22:53:44.340503+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:53:36.215536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.340464+0000","last_change":"2024-02-21T22:53:43.010123+0000","last_active":"2024-02-21T22:53:44.340464+0000","last_peered":"2024-02-21T22:53:44.340464+0000","last_clean":"2024-02-21T22:53:44.340464+0000","last_became_active":"2024-02-21T22:53:43.009846+0000","last_became_peered":"2024-02-21T22:53:43.009846+0000","last_unstale":"2024-02-21T22:53:44.340464+0000","last_undegraded":"2024-02-21T22:53:44.340464+0000","last_fullsized":"2024-02-21T22:53:44.340464+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:18:34.897900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.990694+0000","last_change":"2024-02-21T22:53:41.987725+0000","last_active":"2024-02-21T22:53:43.990694+0000","last_peered":"2024-02-21T22:53:43.990694+0000","last_clean":"2024-02-21T22:53:43.990694+0000","last_became_active":"2024-02-21T22:53:41.987448+0000","last_became_peered":"2024-02-21T22:53:41.987448+0000","last_unstale":"2024-02-21T22:53:43.990694+0000","last_undegraded":"2024-02-21T22:53:43.990694+0000","last_fullsized":"2024-02-21T22:53:43.990694+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:52:02.783816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.340463+0000","last_change":"2024-02-21T22:53:42.997365+0000","last_active":"2024-02-21T22:53:44.340463+0000","last_peered":"2024-02-21T22:53:44.340463+0000","last_clean":"2024-02-21T22:53:44.340463+0000","last_became_active":"2024-02-21T22:53:42.997104+0000","last_became_peered":"2024-02-21T22:53:42.997104+0000","last_unstale":"2024-02-21T22:53:44.340463+0000","last_undegraded":"2024-02-21T22:53:44.340463+0000","last_fullsized":"2024-02-21T22:53:44.340463+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T10:22:33.646484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"32'3","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.340752+0000","last_change":"2024-02-21T22:53:41.994505+0000","last_active":"2024-02-21T22:53:44.340752+0000","last_peered":"2024-02-21T22:53:44.340752+0000","last_clean":"2024-02-21T22:53:44.340752+0000","last_became_active":"2024-02-21T22:53:41.994214+0000","last_became_peered":"2024-02-21T22:53:41.994214+0000","last_unstale":"2024-02-21T22:53:44.340752+0000","last_undegraded":"2024-02-21T22:53:44.340752+0000","last_fullsized":"2024-02-21T22:53:44.340752+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:10:09.126154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.340155+0000","last_change":"2024-02-21T22:53:43.005537+0000","last_active":"2024-02-21T22:53:44.340155+0000","last_peered":"2024-02-21T22:53:44.340155+0000","last_clean":"2024-02-21T22:53:44.340155+0000","last_became_active":"2024-02-21T22:53:43.004978+0000","last_became_peered":"2024-02-21T22:53:43.004978+0000","last_unstale":"2024-02-21T22:53:44.340155+0000","last_undegraded":"2024-02-21T22:53:44.340155+0000","last_fullsized":"2024-02-21T22:53:44.340155+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:03:52.457060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"33'10","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:51.101817+0000","last_change":"2024-02-21T22:53:41.989878+0000","last_active":"2024-02-21T22:53:51.101817+0000","last_peered":"2024-02-21T22:53:51.101817+0000","last_clean":"2024-02-21T22:53:51.101817+0000","last_became_active":"2024-02-21T22:53:41.989590+0000","last_became_peered":"2024-02-21T22:53:41.989590+0000","last_unstale":"2024-02-21T22:53:51.101817+0000","last_undegraded":"2024-02-21T22:53:51.101817+0000","last_fullsized":"2024-02-21T22:53:51.101817+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:06:02.702272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7145,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.989607+0000","last_change":"2024-02-21T22:53:43.008192+0000","last_active":"2024-02-21T22:53:43.989607+0000","last_peered":"2024-02-21T22:53:43.989607+0000","last_clean":"2024-02-21T22:53:43.989607+0000","last_became_active":"2024-02-21T22:53:43.007923+0000","last_became_peered":"2024-02-21T22:53:43.007923+0000","last_unstale":"2024-02-21T22:53:43.989607+0000","last_undegraded":"2024-02-21T22:53:43.989607+0000","last_fullsized":"2024-02-21T22:53:43.989607+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:53:37.531108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"32'2","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.991477+0000","last_change":"2024-02-21T22:53:41.986805+0000","last_active":"2024-02-21T22:53:43.991477+0000","last_peered":"2024-02-21T22:53:43.991477+0000","last_clean":"2024-02-21T22:53:43.991477+0000","last_became_active":"2024-02-21T22:53:41.985220+0000","last_became_peered":"2024-02-21T22:53:41.985220+0000","last_unstale":"2024-02-21T22:53:43.991477+0000","last_undegraded":"2024-02-21T22:53:43.991477+0000","last_fullsized":"2024-02-21T22:53:43.991477+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:21:25.274383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.340308+0000","last_change":"2024-02-21T22:53:43.003557+0000","last_active":"2024-02-21T22:53:44.340308+0000","last_peered":"2024-02-21T22:53:44.340308+0000","last_clean":"2024-02-21T22:53:44.340308+0000","last_became_active":"2024-02-21T22:53:43.003293+0000","last_became_peered":"2024-02-21T22:53:43.003293+0000","last_unstale":"2024-02-21T22:53:44.340308+0000","last_undegraded":"2024-02-21T22:53:44.340308+0000","last_fullsized":"2024-02-21T22:53:44.340308+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:34:47.098047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.989593+0000","last_change":"2024-02-21T22:53:41.987760+0000","last_active":"2024-02-21T22:53:43.989593+0000","last_peered":"2024-02-21T22:53:43.989593+0000","last_clean":"2024-02-21T22:53:43.989593+0000","last_became_active":"2024-02-21T22:53:41.987379+0000","last_became_peered":"2024-02-21T22:53:41.987379+0000","last_unstale":"2024-02-21T22:53:43.989593+0000","last_undegraded":"2024-02-21T22:53:43.989593+0000","last_fullsized":"2024-02-21T22:53:43.989593+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:28:09.845765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.340250+0000","last_change":"2024-02-21T22:53:43.014121+0000","last_active":"2024-02-21T22:53:44.340250+0000","last_peered":"2024-02-21T22:53:44.340250+0000","last_clean":"2024-02-21T22:53:44.340250+0000","last_became_active":"2024-02-21T22:53:43.013636+0000","last_became_peered":"2024-02-21T22:53:43.013636+0000","last_unstale":"2024-02-21T22:53:44.340250+0000","last_undegraded":"2024-02-21T22:53:44.340250+0000","last_fullsized":"2024-02-21T22:53:44.340250+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:31:54.235302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.340024+0000","last_change":"2024-02-21T22:53:41.989414+0000","last_active":"2024-02-21T22:53:44.340024+0000","last_peered":"2024-02-21T22:53:44.340024+0000","last_clean":"2024-02-21T22:53:44.340024+0000","last_became_active":"2024-02-21T22:53:41.988958+0000","last_became_peered":"2024-02-21T22:53:41.988958+0000","last_unstale":"2024-02-21T22:53:44.340024+0000","last_undegraded":"2024-02-21T22:53:44.340024+0000","last_fullsized":"2024-02-21T22:53:44.340024+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:09:00.593509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.322897+0000","last_change":"2024-02-21T22:53:43.010267+0000","last_active":"2024-02-21T22:53:44.322897+0000","last_peered":"2024-02-21T22:53:44.322897+0000","last_clean":"2024-02-21T22:53:44.322897+0000","last_became_active":"2024-02-21T22:53:43.010007+0000","last_became_peered":"2024-02-21T22:53:43.010007+0000","last_unstale":"2024-02-21T22:53:44.322897+0000","last_undegraded":"2024-02-21T22:53:44.322897+0000","last_fullsized":"2024-02-21T22:53:44.322897+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:53:37.219886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"32'8","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.340161+0000","last_change":"2024-02-21T22:53:41.990362+0000","last_active":"2024-02-21T22:53:44.340161+0000","last_peered":"2024-02-21T22:53:44.340161+0000","last_clean":"2024-02-21T22:53:44.340161+0000","last_became_active":"2024-02-21T22:53:41.989531+0000","last_became_peered":"2024-02-21T22:53:41.989531+0000","last_unstale":"2024-02-21T22:53:44.340161+0000","last_undegraded":"2024-02-21T22:53:44.340161+0000","last_fullsized":"2024-02-21T22:53:44.340161+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:10:09.126154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.991581+0000","last_change":"2024-02-21T22:53:43.010224+0000","last_active":"2024-02-21T22:53:43.991581+0000","last_peered":"2024-02-21T22:53:43.991581+0000","last_clean":"2024-02-21T22:53:43.991581+0000","last_became_active":"2024-02-21T22:53:43.009914+0000","last_became_peered":"2024-02-21T22:53:43.009914+0000","last_unstale":"2024-02-21T22:53:43.991581+0000","last_undegraded":"2024-02-21T22:53:43.991581+0000","last_fullsized":"2024-02-21T22:53:43.991581+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:02:41.596861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"32'1","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.990394+0000","last_change":"2024-02-21T22:53:41.988393+0000","last_active":"2024-02-21T22:53:43.990394+0000","last_peered":"2024-02-21T22:53:43.990394+0000","last_clean":"2024-02-21T22:53:43.990394+0000","last_became_active":"2024-02-21T22:53:41.987692+0000","last_became_peered":"2024-02-21T22:53:41.987692+0000","last_unstale":"2024-02-21T22:53:43.990394+0000","last_undegraded":"2024-02-21T22:53:43.990394+0000","last_fullsized":"2024-02-21T22:53:43.990394+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:08:08.137842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.340924+0000","last_change":"2024-02-21T22:53:43.009888+0000","last_active":"2024-02-21T22:53:44.340924+0000","last_peered":"2024-02-21T22:53:44.340924+0000","last_clean":"2024-02-21T22:53:44.340924+0000","last_became_active":"2024-02-21T22:53:43.009536+0000","last_became_peered":"2024-02-21T22:53:43.009536+0000","last_unstale":"2024-02-21T22:53:44.340924+0000","last_undegraded":"2024-02-21T22:53:44.340924+0000","last_fullsized":"2024-02-21T22:53:44.340924+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:54:49.339689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"32'2","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.991607+0000","last_change":"2024-02-21T22:53:41.986266+0000","last_active":"2024-02-21T22:53:43.991607+0000","last_peered":"2024-02-21T22:53:43.991607+0000","last_clean":"2024-02-21T22:53:43.991607+0000","last_became_active":"2024-02-21T22:53:41.985942+0000","last_became_peered":"2024-02-21T22:53:41.985942+0000","last_unstale":"2024-02-21T22:53:43.991607+0000","last_undegraded":"2024-02-21T22:53:43.991607+0000","last_fullsized":"2024-02-21T22:53:43.991607+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:29:52.528059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.989804+0000","last_change":"2024-02-21T22:53:43.010964+0000","last_active":"2024-02-21T22:53:43.989804+0000","last_peered":"2024-02-21T22:53:43.989804+0000","last_clean":"2024-02-21T22:53:43.989804+0000","last_became_active":"2024-02-21T22:53:43.010739+0000","last_became_peered":"2024-02-21T22:53:43.010739+0000","last_unstale":"2024-02-21T22:53:43.989804+0000","last_undegraded":"2024-02-21T22:53:43.989804+0000","last_fullsized":"2024-02-21T22:53:43.989804+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:31:54.235302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"32'1","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.991526+0000","last_change":"2024-02-21T22:53:41.987516+0000","last_active":"2024-02-21T22:53:43.991526+0000","last_peered":"2024-02-21T22:53:43.991526+0000","last_clean":"2024-02-21T22:53:43.991526+0000","last_became_active":"2024-02-21T22:53:41.986968+0000","last_became_peered":"2024-02-21T22:53:41.986968+0000","last_unstale":"2024-02-21T22:53:43.991526+0000","last_undegraded":"2024-02-21T22:53:43.991526+0000","last_fullsized":"2024-02-21T22:53:43.991526+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:08:36.876969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.236512+0000","last_change":"2024-02-21T22:53:43.001927+0000","last_active":"2024-02-21T22:53:44.236512+0000","last_peered":"2024-02-21T22:53:44.236512+0000","last_clean":"2024-02-21T22:53:44.236512+0000","last_became_active":"2024-02-21T22:53:43.001668+0000","last_became_peered":"2024-02-21T22:53:43.001668+0000","last_unstale":"2024-02-21T22:53:44.236512+0000","last_undegraded":"2024-02-21T22:53:44.236512+0000","last_fullsized":"2024-02-21T22:53:44.236512+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:52:03.788166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.991343+0000","last_change":"2024-02-21T22:53:41.990148+0000","last_active":"2024-02-21T22:53:43.991343+0000","last_peered":"2024-02-21T22:53:43.991343+0000","last_clean":"2024-02-21T22:53:43.991343+0000","last_became_active":"2024-02-21T22:53:41.989146+0000","last_became_peered":"2024-02-21T22:53:41.989146+0000","last_unstale":"2024-02-21T22:53:43.991343+0000","last_undegraded":"2024-02-21T22:53:43.991343+0000","last_fullsized":"2024-02-21T22:53:43.991343+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:13:43.209250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.236324+0000","last_change":"2024-02-21T22:53:43.011129+0000","last_active":"2024-02-21T22:53:44.236324+0000","last_peered":"2024-02-21T22:53:44.236324+0000","last_clean":"2024-02-21T22:53:44.236324+0000","last_became_active":"2024-02-21T22:53:43.010865+0000","last_became_peered":"2024-02-21T22:53:43.010865+0000","last_unstale":"2024-02-21T22:53:44.236324+0000","last_undegraded":"2024-02-21T22:53:44.236324+0000","last_fullsized":"2024-02-21T22:53:44.236324+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:21:26.278733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"32'2","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.990759+0000","last_change":"2024-02-21T22:53:41.984829+0000","last_active":"2024-02-21T22:53:43.990759+0000","last_peered":"2024-02-21T22:53:43.990759+0000","last_clean":"2024-02-21T22:53:43.990759+0000","last_became_active":"2024-02-21T22:53:41.984573+0000","last_became_peered":"2024-02-21T22:53:41.984573+0000","last_unstale":"2024-02-21T22:53:43.990759+0000","last_undegraded":"2024-02-21T22:53:43.990759+0000","last_fullsized":"2024-02-21T22:53:43.990759+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:44:42.045212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.236514+0000","last_change":"2024-02-21T22:53:43.001820+0000","last_active":"2024-02-21T22:53:44.236514+0000","last_peered":"2024-02-21T22:53:44.236514+0000","last_clean":"2024-02-21T22:53:44.236514+0000","last_became_active":"2024-02-21T22:53:43.001513+0000","last_became_peered":"2024-02-21T22:53:43.001513+0000","last_unstale":"2024-02-21T22:53:44.236514+0000","last_undegraded":"2024-02-21T22:53:44.236514+0000","last_fullsized":"2024-02-21T22:53:44.236514+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:28:10.850115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.322908+0000","last_change":"2024-02-21T22:53:41.991544+0000","last_active":"2024-02-21T22:53:44.322908+0000","last_peered":"2024-02-21T22:53:44.322908+0000","last_clean":"2024-02-21T22:53:44.322908+0000","last_became_active":"2024-02-21T22:53:41.991247+0000","last_became_peered":"2024-02-21T22:53:41.991247+0000","last_unstale":"2024-02-21T22:53:44.322908+0000","last_undegraded":"2024-02-21T22:53:44.322908+0000","last_fullsized":"2024-02-21T22:53:44.322908+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:44:42.045212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.236291+0000","last_change":"2024-02-21T22:53:43.000454+0000","last_active":"2024-02-21T22:53:44.236291+0000","last_peered":"2024-02-21T22:53:44.236291+0000","last_clean":"2024-02-21T22:53:44.236291+0000","last_became_active":"2024-02-21T22:53:43.000172+0000","last_became_peered":"2024-02-21T22:53:43.000172+0000","last_unstale":"2024-02-21T22:53:44.236291+0000","last_undegraded":"2024-02-21T22:53:44.236291+0000","last_fullsized":"2024-02-21T22:53:44.236291+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:29:53.532409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.990890+0000","last_change":"2024-02-21T22:53:41.988349+0000","last_active":"2024-02-21T22:53:43.990890+0000","last_peered":"2024-02-21T22:53:43.990890+0000","last_clean":"2024-02-21T22:53:43.990890+0000","last_became_active":"2024-02-21T22:53:41.987202+0000","last_became_peered":"2024-02-21T22:53:41.987202+0000","last_unstale":"2024-02-21T22:53:43.990890+0000","last_undegraded":"2024-02-21T22:53:43.990890+0000","last_fullsized":"2024-02-21T22:53:43.990890+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:38:22.676905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.340090+0000","last_change":"2024-02-21T22:53:43.008590+0000","last_active":"2024-02-21T22:53:44.340090+0000","last_peered":"2024-02-21T22:53:44.340090+0000","last_clean":"2024-02-21T22:53:44.340090+0000","last_became_active":"2024-02-21T22:53:43.007502+0000","last_became_peered":"2024-02-21T22:53:43.007502+0000","last_unstale":"2024-02-21T22:53:44.340090+0000","last_undegraded":"2024-02-21T22:53:44.340090+0000","last_fullsized":"2024-02-21T22:53:44.340090+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:02:41.596861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.340170+0000","last_change":"2024-02-21T22:53:41.993199+0000","last_active":"2024-02-21T22:53:44.340170+0000","last_peered":"2024-02-21T22:53:44.340170+0000","last_clean":"2024-02-21T22:53:44.340170+0000","last_became_active":"2024-02-21T22:53:41.992944+0000","last_became_peered":"2024-02-21T22:53:41.992944+0000","last_unstale":"2024-02-21T22:53:44.340170+0000","last_undegraded":"2024-02-21T22:53:44.340170+0000","last_fullsized":"2024-02-21T22:53:44.340170+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:09:00.593509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.236482+0000","last_change":"2024-02-21T22:53:43.007504+0000","last_active":"2024-02-21T22:53:44.236482+0000","last_peered":"2024-02-21T22:53:44.236482+0000","last_clean":"2024-02-21T22:53:44.236482+0000","last_became_active":"2024-02-21T22:53:43.007283+0000","last_became_peered":"2024-02-21T22:53:43.007283+0000","last_unstale":"2024-02-21T22:53:44.236482+0000","last_undegraded":"2024-02-21T22:53:44.236482+0000","last_fullsized":"2024-02-21T22:53:44.236482+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:35:00.796782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"32'2","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.990438+0000","last_change":"2024-02-21T22:53:41.994504+0000","last_active":"2024-02-21T22:53:43.990438+0000","last_peered":"2024-02-21T22:53:43.990438+0000","last_clean":"2024-02-21T22:53:43.990438+0000","last_became_active":"2024-02-21T22:53:41.994229+0000","last_became_peered":"2024-02-21T22:53:41.994229+0000","last_unstale":"2024-02-21T22:53:43.990438+0000","last_undegraded":"2024-02-21T22:53:43.990438+0000","last_fullsized":"2024-02-21T22:53:43.990438+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:09:00.593509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.340937+0000","last_change":"2024-02-21T22:53:43.006538+0000","last_active":"2024-02-21T22:53:44.340937+0000","last_peered":"2024-02-21T22:53:44.340937+0000","last_clean":"2024-02-21T22:53:44.340937+0000","last_became_active":"2024-02-21T22:53:43.006058+0000","last_became_peered":"2024-02-21T22:53:43.006058+0000","last_unstale":"2024-02-21T22:53:44.340937+0000","last_undegraded":"2024-02-21T22:53:44.340937+0000","last_fullsized":"2024-02-21T22:53:44.340937+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:18:34.897900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"33'3","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:49.994415+0000","last_change":"2024-02-21T22:53:41.985703+0000","last_active":"2024-02-21T22:53:49.994415+0000","last_peered":"2024-02-21T22:53:49.994415+0000","last_clean":"2024-02-21T22:53:49.994415+0000","last_became_active":"2024-02-21T22:53:41.985263+0000","last_became_peered":"2024-02-21T22:53:41.985263+0000","last_unstale":"2024-02-21T22:53:49.994415+0000","last_undegraded":"2024-02-21T22:53:49.994415+0000","last_fullsized":"2024-02-21T22:53:49.994415+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:28:09.845765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.990580+0000","last_change":"2024-02-21T22:53:43.005317+0000","last_active":"2024-02-21T22:53:43.990580+0000","last_peered":"2024-02-21T22:53:43.990580+0000","last_clean":"2024-02-21T22:53:43.990580+0000","last_became_active":"2024-02-21T22:53:43.005033+0000","last_became_peered":"2024-02-21T22:53:43.005033+0000","last_unstale":"2024-02-21T22:53:43.990580+0000","last_undegraded":"2024-02-21T22:53:43.990580+0000","last_fullsized":"2024-02-21T22:53:43.990580+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:53:37.219886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.989830+0000","last_change":"2024-02-21T22:53:41.986296+0000","last_active":"2024-02-21T22:53:43.989830+0000","last_peered":"2024-02-21T22:53:43.989830+0000","last_clean":"2024-02-21T22:53:43.989830+0000","last_became_active":"2024-02-21T22:53:41.985909+0000","last_became_peered":"2024-02-21T22:53:41.985909+0000","last_unstale":"2024-02-21T22:53:43.989830+0000","last_undegraded":"2024-02-21T22:53:43.989830+0000","last_fullsized":"2024-02-21T22:53:43.989830+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:34:59.792432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.322818+0000","last_change":"2024-02-21T22:53:43.000226+0000","last_active":"2024-02-21T22:53:44.322818+0000","last_peered":"2024-02-21T22:53:44.322818+0000","last_clean":"2024-02-21T22:53:44.322818+0000","last_became_active":"2024-02-21T22:53:42.999987+0000","last_became_peered":"2024-02-21T22:53:42.999987+0000","last_unstale":"2024-02-21T22:53:44.322818+0000","last_undegraded":"2024-02-21T22:53:44.322818+0000","last_fullsized":"2024-02-21T22:53:44.322818+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:54:01.357343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.990812+0000","last_change":"2024-02-21T22:53:41.991285+0000","last_active":"2024-02-21T22:53:43.990812+0000","last_peered":"2024-02-21T22:53:43.990812+0000","last_clean":"2024-02-21T22:53:43.990812+0000","last_became_active":"2024-02-21T22:53:41.990977+0000","last_became_peered":"2024-02-21T22:53:41.990977+0000","last_unstale":"2024-02-21T22:53:43.990812+0000","last_undegraded":"2024-02-21T22:53:43.990812+0000","last_fullsized":"2024-02-21T22:53:43.990812+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:27:18.184658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.990731+0000","last_change":"2024-02-21T22:53:42.999736+0000","last_active":"2024-02-21T22:53:43.990731+0000","last_peered":"2024-02-21T22:53:43.990731+0000","last_clean":"2024-02-21T22:53:43.990731+0000","last_became_active":"2024-02-21T22:53:42.999472+0000","last_became_peered":"2024-02-21T22:53:42.999472+0000","last_unstale":"2024-02-21T22:53:43.990731+0000","last_undegraded":"2024-02-21T22:53:43.990731+0000","last_fullsized":"2024-02-21T22:53:43.990731+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:15:36.152598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.989686+0000","last_change":"2024-02-21T22:53:41.991062+0000","last_active":"2024-02-21T22:53:43.989686+0000","last_peered":"2024-02-21T22:53:43.989686+0000","last_clean":"2024-02-21T22:53:43.989686+0000","last_became_active":"2024-02-21T22:53:41.990791+0000","last_became_peered":"2024-02-21T22:53:41.990791+0000","last_unstale":"2024-02-21T22:53:43.989686+0000","last_undegraded":"2024-02-21T22:53:43.989686+0000","last_fullsized":"2024-02-21T22:53:43.989686+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:52:02.783816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.340056+0000","last_change":"2024-02-21T22:53:42.999431+0000","last_active":"2024-02-21T22:53:44.340056+0000","last_peered":"2024-02-21T22:53:44.340056+0000","last_clean":"2024-02-21T22:53:44.340056+0000","last_became_active":"2024-02-21T22:53:42.999170+0000","last_became_peered":"2024-02-21T22:53:42.999170+0000","last_unstale":"2024-02-21T22:53:44.340056+0000","last_undegraded":"2024-02-21T22:53:44.340056+0000","last_fullsized":"2024-02-21T22:53:44.340056+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T02:25:22.385393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.991018+0000","last_change":"2024-02-21T22:53:41.995139+0000","last_active":"2024-02-21T22:53:43.991018+0000","last_peered":"2024-02-21T22:53:43.991018+0000","last_clean":"2024-02-21T22:53:43.991018+0000","last_became_active":"2024-02-21T22:53:41.994560+0000","last_became_peered":"2024-02-21T22:53:41.994560+0000","last_unstale":"2024-02-21T22:53:43.991018+0000","last_undegraded":"2024-02-21T22:53:43.991018+0000","last_fullsized":"2024-02-21T22:53:43.991018+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:44:42.045212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.990932+0000","last_change":"2024-02-21T22:53:43.015964+0000","last_active":"2024-02-21T22:53:43.990932+0000","last_peered":"2024-02-21T22:53:43.990932+0000","last_clean":"2024-02-21T22:53:43.990932+0000","last_became_active":"2024-02-21T22:53:43.015685+0000","last_became_peered":"2024-02-21T22:53:43.015685+0000","last_unstale":"2024-02-21T22:53:43.990932+0000","last_undegraded":"2024-02-21T22:53:43.990932+0000","last_fullsized":"2024-02-21T22:53:43.990932+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:06:03.706623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.340065+0000","last_change":"2024-02-21T22:53:41.988521+0000","last_active":"2024-02-21T22:53:44.340065+0000","last_peered":"2024-02-21T22:53:44.340065+0000","last_clean":"2024-02-21T22:53:44.340065+0000","last_became_active":"2024-02-21T22:53:41.987907+0000","last_became_peered":"2024-02-21T22:53:41.987907+0000","last_unstale":"2024-02-21T22:53:44.340065+0000","last_undegraded":"2024-02-21T22:53:44.340065+0000","last_fullsized":"2024-02-21T22:53:44.340065+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:52:02.783816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.340633+0000","last_change":"2024-02-21T22:53:43.001964+0000","last_active":"2024-02-21T22:53:44.340633+0000","last_peered":"2024-02-21T22:53:44.340633+0000","last_clean":"2024-02-21T22:53:44.340633+0000","last_became_active":"2024-02-21T22:53:43.001671+0000","last_became_peered":"2024-02-21T22:53:43.001671+0000","last_unstale":"2024-02-21T22:53:44.340633+0000","last_undegraded":"2024-02-21T22:53:44.340633+0000","last_fullsized":"2024-02-21T22:53:44.340633+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:34:47.098047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.322830+0000","last_change":"2024-02-21T22:53:41.991783+0000","last_active":"2024-02-21T22:53:44.322830+0000","last_peered":"2024-02-21T22:53:44.322830+0000","last_clean":"2024-02-21T22:53:44.322830+0000","last_became_active":"2024-02-21T22:53:41.991530+0000","last_became_peered":"2024-02-21T22:53:41.991530+0000","last_unstale":"2024-02-21T22:53:44.322830+0000","last_undegraded":"2024-02-21T22:53:44.322830+0000","last_fullsized":"2024-02-21T22:53:44.322830+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:38:22.676905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":194,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.339918+0000","last_change":"2024-02-21T22:52:40.336187+0000","last_active":"2024-02-21T22:53:44.339918+0000","last_peered":"2024-02-21T22:53:44.339918+0000","last_clean":"2024-02-21T22:53:44.339918+0000","last_became_active":"2024-02-21T22:52:40.335061+0000","last_became_peered":"2024-02-21T22:52:40.335061+0000","last_unstale":"2024-02-21T22:53:44.339918+0000","last_undegraded":"2024-02-21T22:53:44.339918+0000","last_fullsized":"2024-02-21T22:53:44.339918+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:38.328863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:38.328863+0000","last_clean_scrub_stamp":"2024-02-21T22:52:38.328863+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:33:53.012414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":7943,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":15886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":45,"ondisk_log_size":45,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574866,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27976,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343864,"statfs":{"total":96636764160,"available":96608116736,"internally_reserved":0,"allocated":970752,"data_stored":737074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574867,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":380928,"data_stored":147232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574868,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":380928,"data_stored":147288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574867,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":380928,"data_stored":146720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574867,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":393216,"data_stored":153783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574867,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":376832,"data_stored":146686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574868,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":393216,"data_stored":153626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574866,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27960,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343880,"statfs":{"total":96636764160,"available":96608133120,"internally_reserved":0,"allocated":966656,"data_stored":736984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":7167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":7167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-21T22:53:54.667 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-21T22:53:54.804 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.814+0000 7f50435dc640 1 Processor -- start 2024-02-21T22:53:54.805 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.814+0000 7f50435dc640 1 -- start start 2024-02-21T22:53:54.806 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.815+0000 7f50435dc640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f503c0afa80 0x7f503c0b5990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:54.806 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.815+0000 7f50435dc640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f503c0b5ed0 0x7f503c06ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:54.806 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.815+0000 7f50435dc640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f503c0afe60 con 0x7f503c06b380 2024-02-21T22:53:54.806 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.815+0000 7f50435dc640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f503c0b5500 con 0x7f503c0b5ed0 2024-02-21T22:53:54.807 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.815+0000 7f50435dc640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f503c15f510 con 0x7f503c0afa80 2024-02-21T22:53:54.807 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.815+0000 7f5040b77640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f503c0b5ed0 0x7f503c06ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:54.807 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.815+0000 7f5041b79640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f503c06b380 0x7f503c0b0220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:47368/0 (socket says 172.21.15.116:47368) 2024-02-21T22:53:54.807 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.815+0000 7f5041b79640 1 -- 172.21.15.116:0/3832853061 learned_addr learned my addr 172.21.15.116:0/3832853061 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-02-21T22:53:54.807 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.815+0000 7f5041378640 1 --2- 172.21.15.116:0/3832853061 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f503c0afa80 0x7f503c0b5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:54.807 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.815+0000 7f5040b77640 1 -- 172.21.15.116:0/3832853061 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f503c0afa80 msgr2=0x7f503c0b5990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:53:54.807 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.815+0000 7f5040b77640 1 --2- 172.21.15.116:0/3832853061 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f503c0afa80 0x7f503c0b5990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:54.807 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.815+0000 7f5040b77640 1 -- 172.21.15.116:0/3832853061 >> v1:172.21.15.116:6789/0 conn(0x7f503c06b380 legacy=0x7f503c0b0220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:54.807 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.815+0000 7f5040b77640 1 -- 172.21.15.116:0/3832853061 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f503c15f7f0 con 0x7f503c0b5ed0 2024-02-21T22:53:54.808 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.815+0000 7f5033fff640 1 -- 172.21.15.116:0/3832853061 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2701869704 0 0) 0x7f5034001490 con 0x7f503c06b380 2024-02-21T22:53:54.808 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.815+0000 7f5041378640 1 --2- 172.21.15.116:0/3832853061 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f503c0afa80 0x7f503c0b5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T22:53:54.811 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.816+0000 7f5040b77640 1 --2- 172.21.15.116:0/3832853061 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f503c0b5ed0 0x7f503c06ae40 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f502c0097a0 tx=0x7f502c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96419119fc36a52f server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:54.811 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.816+0000 7f5033fff640 1 -- 172.21.15.116:0/3832853061 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f502c035020 con 0x7f503c0b5ed0 2024-02-21T22:53:54.812 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.816+0000 7f5033fff640 1 -- 172.21.15.116:0/3832853061 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f502c031830 con 0x7f503c0b5ed0 2024-02-21T22:53:54.812 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.816+0000 7f5033fff640 1 -- 172.21.15.116:0/3832853061 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f502c031c00 con 0x7f503c0b5ed0 2024-02-21T22:53:54.812 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.817+0000 7f50435dc640 1 -- 172.21.15.116:0/3832853061 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f503c0b5ed0 msgr2=0x7f503c06ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:54.812 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.817+0000 7f50435dc640 1 --2- 172.21.15.116:0/3832853061 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f503c0b5ed0 0x7f503c06ae40 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f502c0097a0 tx=0x7f502c02b8d0 comp rx=0 tx=0).stop 2024-02-21T22:53:54.812 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.817+0000 7f50435dc640 1 -- 172.21.15.116:0/3832853061 shutdown_connections 2024-02-21T22:53:54.812 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.817+0000 7f50435dc640 1 --2- 172.21.15.116:0/3832853061 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f503c0b5ed0 0x7f503c06ae40 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:54.813 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.817+0000 7f50435dc640 1 --2- 172.21.15.116:0/3832853061 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f503c0afa80 0x7f503c0b5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:54.813 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.817+0000 7f50435dc640 1 -- 172.21.15.116:0/3832853061 >> 172.21.15.116:0/3832853061 conn(0x7f503c0724f0 msgr2=0x7f503c072900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:54.813 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.817+0000 7f50435dc640 1 -- 172.21.15.116:0/3832853061 shutdown_connections 2024-02-21T22:53:54.813 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.817+0000 7f50435dc640 1 -- 172.21.15.116:0/3832853061 wait complete. 2024-02-21T22:53:54.813 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.818+0000 7f50435dc640 1 Processor -- start 2024-02-21T22:53:54.813 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.818+0000 7f50435dc640 1 -- start start 2024-02-21T22:53:54.813 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.819+0000 7f50435dc640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f503c06b380 0x7f503c09dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:54.813 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.819+0000 7f50435dc640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f503c0afa80 0x7f503c15ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:54.813 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.819+0000 7f50435dc640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f503c0b5ed0 0x7f503c1f6a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:54.813 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.819+0000 7f50435dc640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f503c0b0ab0 con 0x7f503c06b380 2024-02-21T22:53:54.814 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.819+0000 7f50435dc640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f503c0b0930 con 0x7f503c0b5ed0 2024-02-21T22:53:54.814 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.819+0000 7f50435dc640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f503c0b0c30 con 0x7f503c0afa80 2024-02-21T22:53:54.814 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.819+0000 7f5041378640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f503c06b380 0x7f503c09dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:54.814 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.819+0000 7f5041378640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f503c06b380 0x7f503c09dc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:40182/0 (socket says 172.21.15.116:40182) 2024-02-21T22:53:54.814 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.819+0000 7f5041378640 1 -- 172.21.15.116:0/3756044487 learned_addr learned my addr 172.21.15.116:0/3756044487 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:54.814 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.819+0000 7f5040b77640 1 --2- 172.21.15.116:0/3756044487 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f503c0afa80 0x7f503c15ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:54.814 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.819+0000 7f5041b79640 1 --2- 172.21.15.116:0/3756044487 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f503c0b5ed0 0x7f503c1f6a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:54.814 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.819+0000 7f5041378640 1 -- 172.21.15.116:0/3756044487 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f503c0afa80 msgr2=0x7f503c15ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:54.815 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.819+0000 7f5041378640 1 --2- 172.21.15.116:0/3756044487 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f503c0afa80 0x7f503c15ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:54.815 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.819+0000 7f5041378640 1 -- 172.21.15.116:0/3756044487 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f503c0b5ed0 msgr2=0x7f503c1f6a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:54.815 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.819+0000 7f5041378640 1 --2- 172.21.15.116:0/3756044487 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f503c0b5ed0 0x7f503c1f6a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:54.815 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.819+0000 7f5041378640 1 -- 172.21.15.116:0/3756044487 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f503c09c1a0 con 0x7f503c06b380 2024-02-21T22:53:54.815 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.819+0000 7f5041378640 1 --2- 172.21.15.116:0/3756044487 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f503c06b380 0x7f503c09dc10 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f503800ebe0 tx=0x7f503800c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:54.815 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.819+0000 7f5031ffb640 1 -- 172.21.15.116:0/3756044487 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5038017070 con 0x7f503c06b380 2024-02-21T22:53:54.815 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.820+0000 7f5031ffb640 1 -- 172.21.15.116:0/3756044487 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f503800cc30 con 0x7f503c06b380 2024-02-21T22:53:54.816 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.820+0000 7f50435dc640 1 -- 172.21.15.116:0/3756044487 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f503c09c480 con 0x7f503c06b380 2024-02-21T22:53:54.816 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.820+0000 7f5031ffb640 1 -- 172.21.15.116:0/3756044487 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5038013470 con 0x7f503c06b380 2024-02-21T22:53:54.816 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.820+0000 7f50435dc640 1 -- 172.21.15.116:0/3756044487 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f503c09ca40 con 0x7f503c06b380 2024-02-21T22:53:54.816 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.821+0000 7f50435dc640 1 -- 172.21.15.116:0/3756044487 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f503c0752f0 con 0x7f503c06b380 2024-02-21T22:53:54.816 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.821+0000 7f5031ffb640 1 -- 172.21.15.116:0/3756044487 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f503801a070 con 0x7f503c06b380 2024-02-21T22:53:54.817 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.822+0000 7f5031ffb640 1 --2- 172.21.15.116:0/3756044487 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f502006b4d0 0x7f502006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:54.817 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.822+0000 7f5031ffb640 1 -- 172.21.15.116:0/3756044487 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f503808a3c0 con 0x7f503c06b380 2024-02-21T22:53:54.817 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.822+0000 7f5040b77640 1 --2- 172.21.15.116:0/3756044487 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f502006b4d0 0x7f502006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:54.817 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.822+0000 7f5040b77640 1 --2- 172.21.15.116:0/3756044487 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f502006b4d0 0x7f502006d990 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f502c036000 tx=0x7f502c03c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:54.817 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.826+0000 7f5031ffb640 1 -- 172.21.15.116:0/3756044487 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f5038058c80 con 0x7f503c06b380 2024-02-21T22:53:54.988 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.998+0000 7f50435dc640 1 -- 172.21.15.116:0/3756044487 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f503c0b5b30 con 0x7f503c06b380 2024-02-21T22:53:54.989 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:54.999+0000 7f5031ffb640 1 -- 172.21.15.116:0/3756044487 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+16717 (secure 0 0 0) 0x7f503805cd20 con 0x7f503c06b380 2024-02-21T22:53:54.989 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-02-21T22:53:54.990 INFO:teuthology.orchestra.run.smithi116.stdout:{"epoch":33,"fsid":"7c298660-5f63-4b5c-a800-58c5be9a8445","created":"2024-02-21T22:52:25.994613+0000","modified":"2024-02-21T22:53:43.986422+0000","last_up_change":"2024-02-21T22:52:37.313595+0000","last_in_change":"2024-02-21T22:52:28.176031+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-21T22:52:38.328796+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-02-21T22:53:40.752689+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-02-21T22:53:41.300199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4f09126b-b5e4-4876-8b08-f5cbb967388a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":1613202231},{"type":"v1","addr":"172.21.15.116:6809","nonce":1613202231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":1613202231},{"type":"v1","addr":"172.21.15.116:6811","nonce":1613202231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":1613202231},{"type":"v1","addr":"172.21.15.116:6815","nonce":1613202231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":1613202231},{"type":"v1","addr":"172.21.15.116:6813","nonce":1613202231}]},"public_addr":"172.21.15.116:6809/1613202231","cluster_addr":"172.21.15.116:6811/1613202231","heartbeat_back_addr":"172.21.15.116:6815/1613202231","heartbeat_front_addr":"172.21.15.116:6813/1613202231","state":["exists","up"]},{"osd":1,"uuid":"7272c51d-51f9-4536-931d-33ad7a4b377e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6816","nonce":172614746},{"type":"v1","addr":"172.21.15.116:6817","nonce":172614746}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":172614746},{"type":"v1","addr":"172.21.15.116:6819","nonce":172614746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":172614746},{"type":"v1","addr":"172.21.15.116:6823","nonce":172614746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":172614746},{"type":"v1","addr":"172.21.15.116:6821","nonce":172614746}]},"public_addr":"172.21.15.116:6817/172614746","cluster_addr":"172.21.15.116:6819/172614746","heartbeat_back_addr":"172.21.15.116:6823/172614746","heartbeat_front_addr":"172.21.15.116:6821/172614746","state":["exists","up"]},{"osd":2,"uuid":"2589616c-adf1-4187-aac3-735256cf624b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":1029280577},{"type":"v1","addr":"172.21.15.116:6825","nonce":1029280577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":1029280577},{"type":"v1","addr":"172.21.15.116:6827","nonce":1029280577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":1029280577},{"type":"v1","addr":"172.21.15.116:6831","nonce":1029280577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":1029280577},{"type":"v1","addr":"172.21.15.116:6829","nonce":1029280577}]},"public_addr":"172.21.15.116:6825/1029280577","cluster_addr":"172.21.15.116:6827/1029280577","heartbeat_back_addr":"172.21.15.116:6831/1029280577","heartbeat_front_addr":"172.21.15.116:6829/1029280577","state":["exists","up"]},{"osd":3,"uuid":"0fd2e563-7c5b-46f6-82c2-b60c86072c93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":3106627557},{"type":"v1","addr":"172.21.15.116:6801","nonce":3106627557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":3106627557},{"type":"v1","addr":"172.21.15.116:6803","nonce":3106627557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":3106627557},{"type":"v1","addr":"172.21.15.116:6807","nonce":3106627557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":3106627557},{"type":"v1","addr":"172.21.15.116:6805","nonce":3106627557}]},"public_addr":"172.21.15.116:6801/3106627557","cluster_addr":"172.21.15.116:6803/3106627557","heartbeat_back_addr":"172.21.15.116:6807/3106627557","heartbeat_front_addr":"172.21.15.116:6805/3106627557","state":["exists","up"]},{"osd":4,"uuid":"79ae35b7-dda8-4ab8-96ce-47515afde082","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":3231407772},{"type":"v1","addr":"172.21.15.142:6825","nonce":3231407772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":3231407772},{"type":"v1","addr":"172.21.15.142:6827","nonce":3231407772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":3231407772},{"type":"v1","addr":"172.21.15.142:6831","nonce":3231407772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":3231407772},{"type":"v1","addr":"172.21.15.142:6829","nonce":3231407772}]},"public_addr":"172.21.15.142:6825/3231407772","cluster_addr":"172.21.15.142:6827/3231407772","heartbeat_back_addr":"172.21.15.142:6831/3231407772","heartbeat_front_addr":"172.21.15.142:6829/3231407772","state":["exists","up"]},{"osd":5,"uuid":"3166eb2c-3fcf-41c8-9362-45bafaabaa39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":1184158716},{"type":"v1","addr":"172.21.15.142:6817","nonce":1184158716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":1184158716},{"type":"v1","addr":"172.21.15.142:6819","nonce":1184158716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":1184158716},{"type":"v1","addr":"172.21.15.142:6823","nonce":1184158716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":1184158716},{"type":"v1","addr":"172.21.15.142:6821","nonce":1184158716}]},"public_addr":"172.21.15.142:6817/1184158716","cluster_addr":"172.21.15.142:6819/1184158716","heartbeat_back_addr":"172.21.15.142:6823/1184158716","heartbeat_front_addr":"172.21.15.142:6821/1184158716","state":["exists","up"]},{"osd":6,"uuid":"f9aa9672-7527-43e2-963e-b61868e5e63f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":1987868911},{"type":"v1","addr":"172.21.15.142:6801","nonce":1987868911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":1987868911},{"type":"v1","addr":"172.21.15.142:6803","nonce":1987868911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":1987868911},{"type":"v1","addr":"172.21.15.142:6807","nonce":1987868911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":1987868911},{"type":"v1","addr":"172.21.15.142:6805","nonce":1987868911}]},"public_addr":"172.21.15.142:6801/1987868911","cluster_addr":"172.21.15.142:6803/1987868911","heartbeat_back_addr":"172.21.15.142:6807/1987868911","heartbeat_front_addr":"172.21.15.142:6805/1987868911","state":["exists","up"]},{"osd":7,"uuid":"7ed29226-fc42-4382-a91a-fa50f7ec5426","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":1272081937},{"type":"v1","addr":"172.21.15.142:6809","nonce":1272081937}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":1272081937},{"type":"v1","addr":"172.21.15.142:6811","nonce":1272081937}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":1272081937},{"type":"v1","addr":"172.21.15.142:6815","nonce":1272081937}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":1272081937},{"type":"v1","addr":"172.21.15.142:6813","nonce":1272081937}]},"public_addr":"172.21.15.142:6809/1272081937","cluster_addr":"172.21.15.142:6811/1272081937","heartbeat_back_addr":"172.21.15.142:6815/1272081937","heartbeat_front_addr":"172.21.15.142:6813/1272081937","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.350998+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.307201+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.289112+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.243888+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.312091+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.370472+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.275659+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T22:52:33.289297+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-21T22:53:54.992 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:55.001+0000 7f50435dc640 1 -- 172.21.15.116:0/3756044487 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f502006b4d0 msgr2=0x7f502006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:54.992 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:55.001+0000 7f50435dc640 1 --2- 172.21.15.116:0/3756044487 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f502006b4d0 0x7f502006d990 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f502c036000 tx=0x7f502c03c040 comp rx=0 tx=0).stop 2024-02-21T22:53:54.992 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:55.001+0000 7f50435dc640 1 -- 172.21.15.116:0/3756044487 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f503c06b380 msgr2=0x7f503c09dc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:54.992 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:55.001+0000 7f50435dc640 1 --2- 172.21.15.116:0/3756044487 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f503c06b380 0x7f503c09dc10 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f503800ebe0 tx=0x7f503800c520 comp rx=0 tx=0).stop 2024-02-21T22:53:54.992 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:55.001+0000 7f50435dc640 1 -- 172.21.15.116:0/3756044487 shutdown_connections 2024-02-21T22:53:54.992 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:55.001+0000 7f50435dc640 1 --2- 172.21.15.116:0/3756044487 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f503c0b5ed0 0x7f503c1f6a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:54.993 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:55.001+0000 7f50435dc640 1 --2- 172.21.15.116:0/3756044487 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f502006b4d0 0x7f502006d990 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:54.993 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:55.001+0000 7f50435dc640 1 --2- 172.21.15.116:0/3756044487 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f503c0afa80 0x7f503c15ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:54.993 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:55.001+0000 7f50435dc640 1 --2- 172.21.15.116:0/3756044487 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f503c06b380 0x7f503c09dc10 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:54.993 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:55.001+0000 7f50435dc640 1 -- 172.21.15.116:0/3756044487 >> 172.21.15.116:0/3756044487 conn(0x7f503c0724f0 msgr2=0x7f503c0b01e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:54.993 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:55.001+0000 7f50435dc640 1 -- 172.21.15.116:0/3756044487 shutdown_connections 2024-02-21T22:53:54.993 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:55.001+0000 7f50435dc640 1 -- 172.21.15.116:0/3756044487 wait complete. 2024-02-21T22:53:56.003 INFO:tasks.ceph:Scrubbing osd.0 2024-02-21T22:53:56.004 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-02-21T22:53:56.114 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.123+0000 7f9fc8477640 1 Processor -- start 2024-02-21T22:53:56.114 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.123+0000 7f9fc8477640 1 -- start start 2024-02-21T22:53:56.116 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.124+0000 7f9fc8477640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9fc00aedb0 0x7f9fc00cd7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:56.116 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.124+0000 7f9fc8477640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fc0158390 con 0x7f9fc00ca150 2024-02-21T22:53:56.116 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.124+0000 7f9fc8477640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fc00ce140 con 0x7f9fc00ca5b0 2024-02-21T22:53:56.117 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.124+0000 7f9fc8477640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fc006c780 con 0x7f9fc00aedb0 2024-02-21T22:53:56.117 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.125+0000 7f9fc5a12640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f9fc00ca150 0x7f9fc0157570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:40018/0 (socket says 172.21.15.116:40018) 2024-02-21T22:53:56.117 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.125+0000 7f9fc5a12640 1 -- 172.21.15.116:0/2973959079 learned_addr learned my addr 172.21.15.116:0/2973959079 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-02-21T22:53:56.117 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.125+0000 7f9fc6213640 1 --2- 172.21.15.116:0/2973959079 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9fc00aedb0 0x7f9fc00cd7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:56.117 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.125+0000 7f9fc5211640 1 -- 172.21.15.116:0/2973959079 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3303890020 0 0) 0x7f9fbc001110 con 0x7f9fc00ca150 2024-02-21T22:53:56.117 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.125+0000 7f9fc5211640 1 -- 172.21.15.116:0/2973959079 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9fac003520 con 0x7f9fc00ca150 2024-02-21T22:53:56.117 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.125+0000 7f9fc5211640 1 -- 172.21.15.116:0/2973959079 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 84536360 0 0) 0x7f9fc00ce140 con 0x7f9fc00ca5b0 2024-02-21T22:53:56.117 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.125+0000 7f9fc5211640 1 -- 172.21.15.116:0/2973959079 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9fbc001110 con 0x7f9fc00ca5b0 2024-02-21T22:53:56.118 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.125+0000 7f9fc6213640 1 -- 172.21.15.116:0/2973959079 >> v1:172.21.15.142:6789/0 conn(0x7f9fc00ca5b0 legacy=0x7f9fc0157c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:56.118 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.125+0000 7f9fc6213640 1 -- 172.21.15.116:0/2973959079 >> v1:172.21.15.116:6789/0 conn(0x7f9fc00ca150 legacy=0x7f9fc0157570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:56.118 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.125+0000 7f9fc6213640 1 -- 172.21.15.116:0/2973959079 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fc00ce420 con 0x7f9fc00aedb0 2024-02-21T22:53:56.118 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.126+0000 7f9fc6213640 1 --2- 172.21.15.116:0/2973959079 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9fc00aedb0 0x7f9fc00cd7d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f9fb00097d0 tx=0x7f9fb002b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=44bd424cb7a39cb8 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:56.118 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.126+0000 7f9fc5211640 1 -- 172.21.15.116:0/2973959079 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fb0035020 con 0x7f9fc00aedb0 2024-02-21T22:53:56.118 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.126+0000 7f9fc5211640 1 -- 172.21.15.116:0/2973959079 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fb0031890 con 0x7f9fc00aedb0 2024-02-21T22:53:56.118 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.126+0000 7f9fc5211640 1 -- 172.21.15.116:0/2973959079 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fb0031c60 con 0x7f9fc00aedb0 2024-02-21T22:53:56.123 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.126+0000 7f9fc8477640 1 -- 172.21.15.116:0/2973959079 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9fc00aedb0 msgr2=0x7f9fc00cd7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:56.123 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.126+0000 7f9fc8477640 1 --2- 172.21.15.116:0/2973959079 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9fc00aedb0 0x7f9fc00cd7d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f9fb00097d0 tx=0x7f9fb002b930 comp rx=0 tx=0).stop 2024-02-21T22:53:56.123 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.126+0000 7f9fc8477640 1 -- 172.21.15.116:0/2973959079 shutdown_connections 2024-02-21T22:53:56.123 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.126+0000 7f9fc8477640 1 --2- 172.21.15.116:0/2973959079 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9fc00aedb0 0x7f9fc00cd7d0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:56.123 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.126+0000 7f9fc8477640 1 -- 172.21.15.116:0/2973959079 >> 172.21.15.116:0/2973959079 conn(0x7f9fc00b1510 msgr2=0x7f9fc00b18f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:56.123 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.127+0000 7f9fc8477640 1 -- 172.21.15.116:0/2973959079 shutdown_connections 2024-02-21T22:53:56.123 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.127+0000 7f9fc8477640 1 -- 172.21.15.116:0/2973959079 wait complete. 2024-02-21T22:53:56.123 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.128+0000 7f9fc8477640 1 Processor -- start 2024-02-21T22:53:56.124 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.128+0000 7f9fc8477640 1 -- start start 2024-02-21T22:53:56.124 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.128+0000 7f9fc8477640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9fc00aedb0 0x7f9fc0150f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:56.124 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.128+0000 7f9fc8477640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9fc00ca150 0x7f9fc014ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:56.124 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.128+0000 7f9fc8477640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9fc00ca5b0 0x7f9fc00c61b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:56.124 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.128+0000 7f9fc8477640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fc00caa40 con 0x7f9fc00ca150 2024-02-21T22:53:56.124 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.128+0000 7f9fc8477640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fc00ce9e0 con 0x7f9fc00aedb0 2024-02-21T22:53:56.124 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.128+0000 7f9fc8477640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fc00cdd10 con 0x7f9fc00ca5b0 2024-02-21T22:53:56.124 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.128+0000 7f9fc5a12640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9fc00ca150 0x7f9fc014ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:56.125 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.128+0000 7f9fc5a12640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9fc00ca150 0x7f9fc014ba70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:56416/0 (socket says 172.21.15.116:56416) 2024-02-21T22:53:56.125 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.128+0000 7f9fc5a12640 1 -- 172.21.15.116:0/1227133648 learned_addr learned my addr 172.21.15.116:0/1227133648 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:56.125 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.129+0000 7f9fc6a14640 1 --2- 172.21.15.116:0/1227133648 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9fc00ca5b0 0x7f9fc00c61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:56.125 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.129+0000 7f9fc6213640 1 --2- 172.21.15.116:0/1227133648 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9fc00aedb0 0x7f9fc0150f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:56.125 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.129+0000 7f9fc5a12640 1 -- 172.21.15.116:0/1227133648 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9fc00ca5b0 msgr2=0x7f9fc00c61b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:56.125 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.129+0000 7f9fc5a12640 1 --2- 172.21.15.116:0/1227133648 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9fc00ca5b0 0x7f9fc00c61b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:56.125 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.129+0000 7f9fc5a12640 1 -- 172.21.15.116:0/1227133648 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9fc00aedb0 msgr2=0x7f9fc0150f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:56.125 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.129+0000 7f9fc5a12640 1 --2- 172.21.15.116:0/1227133648 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9fc00aedb0 0x7f9fc0150f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:56.126 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.129+0000 7f9fc5a12640 1 -- 172.21.15.116:0/1227133648 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fc014fee0 con 0x7f9fc00ca150 2024-02-21T22:53:56.126 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.129+0000 7f9fc5a12640 1 --2- 172.21.15.116:0/1227133648 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9fc00ca150 0x7f9fc014ba70 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f9fbc00c680 tx=0x7f9fbc00cb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:56.126 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.129+0000 7f9fb6ffd640 1 -- 172.21.15.116:0/1227133648 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fbc017070 con 0x7f9fc00ca150 2024-02-21T22:53:56.126 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.129+0000 7f9fb6ffd640 1 -- 172.21.15.116:0/1227133648 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fbc005ab0 con 0x7f9fc00ca150 2024-02-21T22:53:56.126 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.129+0000 7f9fc8477640 1 -- 172.21.15.116:0/1227133648 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fc01501c0 con 0x7f9fc00ca150 2024-02-21T22:53:56.126 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.129+0000 7f9fb6ffd640 1 -- 172.21.15.116:0/1227133648 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fbc007070 con 0x7f9fc00ca150 2024-02-21T22:53:56.126 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.129+0000 7f9fc8477640 1 -- 172.21.15.116:0/1227133648 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fc0150780 con 0x7f9fc00ca150 2024-02-21T22:53:56.126 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.130+0000 7f9fc8477640 1 -- 172.21.15.116:0/1227133648 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9fc00752f0 con 0x7f9fc00ca150 2024-02-21T22:53:56.126 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.130+0000 7f9fb6ffd640 1 -- 172.21.15.116:0/1227133648 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f9fbc01a070 con 0x7f9fc00ca150 2024-02-21T22:53:56.127 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.131+0000 7f9fb6ffd640 1 --2- 172.21.15.116:0/1227133648 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f9fa406b4d0 0x7f9fa406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:56.127 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.131+0000 7f9fb6ffd640 1 -- 172.21.15.116:0/1227133648 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9fbc0897b0 con 0x7f9fc00ca150 2024-02-21T22:53:56.127 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.131+0000 7f9fb6ffd640 1 --2- 172.21.15.116:0/1227133648 >> [v2:172.21.15.116:6808/1613202231,v1:172.21.15.116:6809/1613202231] conn(0x7f9fa40736d0 0x7f9fa4075af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:56.127 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.131+0000 7f9fc6213640 1 --2- 172.21.15.116:0/1227133648 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f9fa406b4d0 0x7f9fa406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:56.127 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.131+0000 7f9fb6ffd640 1 -- 172.21.15.116:0/1227133648 --> [v2:172.21.15.116:6808/1613202231,v1:172.21.15.116:6809/1613202231] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9fbc015e70 con 0x7f9fa40736d0 2024-02-21T22:53:56.127 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.131+0000 7f9fb6ffd640 1 -- 172.21.15.116:0/1227133648 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9fbc08e2c0 con 0x7f9fc00ca150 2024-02-21T22:53:56.127 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.131+0000 7f9fc6a14640 1 --2- 172.21.15.116:0/1227133648 >> [v2:172.21.15.116:6808/1613202231,v1:172.21.15.116:6809/1613202231] conn(0x7f9fa40736d0 0x7f9fa4075af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:56.127 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.131+0000 7f9fc6a14640 1 --2- 172.21.15.116:0/1227133648 >> [v2:172.21.15.116:6808/1613202231,v1:172.21.15.116:6809/1613202231] conn(0x7f9fa40736d0 0x7f9fa4075af0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:56.128 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.131+0000 7f9fc6213640 1 --2- 172.21.15.116:0/1227133648 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f9fa406b4d0 0x7f9fa406d990 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f9fb0036000 tx=0x7f9fb003c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:56.128 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.132+0000 7f9fb6ffd640 1 -- 172.21.15.116:0/1227133648 <== osd.0 v2:172.21.15.116:6808/1613202231 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f9fbc015e70 con 0x7f9fa40736d0 2024-02-21T22:53:56.135 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.145+0000 7f9fc8477640 1 -- 172.21.15.116:0/1227133648 --> [v2:172.21.15.116:6808/1613202231,v1:172.21.15.116:6809/1613202231] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f9fc00cd2d0 con 0x7f9fa40736d0 2024-02-21T22:53:56.135 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.145+0000 7f9fb6ffd640 1 -- 172.21.15.116:0/1227133648 <== osd.0 v2:172.21.15.116:6808/1613202231 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f9fc00cd2d0 con 0x7f9fa40736d0 2024-02-21T22:53:56.136 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-02-21T22:53:56.136 INFO:teuthology.orchestra.run.smithi116.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-02-21T22:53:56.136 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-02-21T22:53:56.137 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.145+0000 7f9fc8477640 1 -- 172.21.15.116:0/1227133648 >> [v2:172.21.15.116:6808/1613202231,v1:172.21.15.116:6809/1613202231] conn(0x7f9fa40736d0 msgr2=0x7f9fa4075af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:56.137 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.145+0000 7f9fc8477640 1 --2- 172.21.15.116:0/1227133648 >> [v2:172.21.15.116:6808/1613202231,v1:172.21.15.116:6809/1613202231] conn(0x7f9fa40736d0 0x7f9fa4075af0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:56.137 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.145+0000 7f9fc8477640 1 -- 172.21.15.116:0/1227133648 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f9fa406b4d0 msgr2=0x7f9fa406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:56.138 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.145+0000 7f9fc8477640 1 --2- 172.21.15.116:0/1227133648 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f9fa406b4d0 0x7f9fa406d990 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f9fb0036000 tx=0x7f9fb003c040 comp rx=0 tx=0).stop 2024-02-21T22:53:56.138 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.145+0000 7f9fc8477640 1 -- 172.21.15.116:0/1227133648 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9fc00ca150 msgr2=0x7f9fc014ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:56.138 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.145+0000 7f9fc8477640 1 --2- 172.21.15.116:0/1227133648 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9fc00ca150 0x7f9fc014ba70 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f9fbc00c680 tx=0x7f9fbc00cb40 comp rx=0 tx=0).stop 2024-02-21T22:53:56.138 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.145+0000 7f9fc6a14640 1 -- 172.21.15.116:0/1227133648 reap_dead start 2024-02-21T22:53:56.138 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.146+0000 7f9fc8477640 1 -- 172.21.15.116:0/1227133648 shutdown_connections 2024-02-21T22:53:56.138 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.146+0000 7f9fc8477640 1 -- 172.21.15.116:0/1227133648 >> 172.21.15.116:0/1227133648 conn(0x7f9fc00b1510 msgr2=0x7f9fc0157c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:56.138 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.146+0000 7f9fc8477640 1 -- 172.21.15.116:0/1227133648 shutdown_connections 2024-02-21T22:53:56.138 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.146+0000 7f9fc8477640 1 -- 172.21.15.116:0/1227133648 wait complete. 2024-02-21T22:53:56.146 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-02-21T22:53:56.248 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.257+0000 7f3917daa640 1 Processor -- start 2024-02-21T22:53:56.248 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.258+0000 7f3917daa640 1 -- start start 2024-02-21T22:53:56.250 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.258+0000 7f3917daa640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f39100d1c30 0x7f39100d2430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:56.250 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.258+0000 7f3917daa640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f39100cb930 0x7f39100cbda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:56.250 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.258+0000 7f3917daa640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39100cfa50 con 0x7f39100d0510 2024-02-21T22:53:56.250 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.258+0000 7f3917daa640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39100d1450 con 0x7f39100cb930 2024-02-21T22:53:56.250 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.258+0000 7f3917daa640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39100cfcc0 con 0x7f39100d1c30 2024-02-21T22:53:56.251 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.259+0000 7f3916347640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f39100cb930 0x7f39100cbda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:56.251 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.259+0000 7f3916347640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f39100cb930 0x7f39100cbda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:56420/0 (socket says 172.21.15.116:56420) 2024-02-21T22:53:56.251 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.259+0000 7f3915b46640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f39100d0510 0x7f39100d08f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:40032/0 (socket says 172.21.15.116:40032) 2024-02-21T22:53:56.251 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.259+0000 7f3916347640 1 -- 172.21.15.116:0/740393971 learned_addr learned my addr 172.21.15.116:0/740393971 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:56.251 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.259+0000 7f3915345640 1 --2- 172.21.15.116:0/740393971 >> v2:172.21.15.142:3300/0 conn(0x7f39100d1c30 0x7f39100d2430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:56.251 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.259+0000 7f3916347640 1 -- 172.21.15.116:0/740393971 >> v2:172.21.15.142:3300/0 conn(0x7f39100d1c30 msgr2=0x7f39100d2430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:53:56.251 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.259+0000 7f3916347640 1 --2- 172.21.15.116:0/740393971 >> v2:172.21.15.142:3300/0 conn(0x7f39100d1c30 0x7f39100d2430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:56.251 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.259+0000 7f3916347640 1 -- 172.21.15.116:0/740393971 >> v1:172.21.15.116:6789/0 conn(0x7f39100d0510 legacy=0x7f39100d08f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:56.252 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.259+0000 7f3916347640 1 -- 172.21.15.116:0/740393971 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39100cffa0 con 0x7f39100cb930 2024-02-21T22:53:56.252 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.259+0000 7f3914b44640 1 -- 172.21.15.116:0/740393971 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1987725421 0 0) 0x7f39100cfa50 con 0x7f39100d0510 2024-02-21T22:53:56.252 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.260+0000 7f3916347640 1 --2- 172.21.15.116:0/740393971 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f39100cb930 0x7f39100cbda0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f39100cdf20 tx=0x7f390c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb8ddbd84e852a40 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:56.252 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.260+0000 7f3914b44640 1 -- 172.21.15.116:0/740393971 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f390c035020 con 0x7f39100cb930 2024-02-21T22:53:56.252 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.260+0000 7f3914b44640 1 -- 172.21.15.116:0/740393971 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f390c031870 con 0x7f39100cb930 2024-02-21T22:53:56.252 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.260+0000 7f3914b44640 1 -- 172.21.15.116:0/740393971 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f390c031c40 con 0x7f39100cb930 2024-02-21T22:53:56.256 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.260+0000 7f3917daa640 1 -- 172.21.15.116:0/740393971 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f39100cb930 msgr2=0x7f39100cbda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:56.256 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.260+0000 7f3917daa640 1 --2- 172.21.15.116:0/740393971 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f39100cb930 0x7f39100cbda0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f39100cdf20 tx=0x7f390c02b910 comp rx=0 tx=0).stop 2024-02-21T22:53:56.256 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.260+0000 7f3917daa640 1 -- 172.21.15.116:0/740393971 shutdown_connections 2024-02-21T22:53:56.256 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.260+0000 7f3917daa640 1 --2- 172.21.15.116:0/740393971 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f39100cb930 0x7f39100cbda0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:56.256 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.260+0000 7f3917daa640 1 --2- 172.21.15.116:0/740393971 >> v2:172.21.15.142:3300/0 conn(0x7f39100d1c30 0x7f39100d2430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:56.256 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.260+0000 7f3917daa640 1 -- 172.21.15.116:0/740393971 >> 172.21.15.116:0/740393971 conn(0x7f39100d3e50 msgr2=0x7f39100d4260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:56.256 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.260+0000 7f3917daa640 1 -- 172.21.15.116:0/740393971 shutdown_connections 2024-02-21T22:53:56.257 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.260+0000 7f3917daa640 1 -- 172.21.15.116:0/740393971 wait complete. 2024-02-21T22:53:56.257 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.261+0000 7f3917daa640 1 Processor -- start 2024-02-21T22:53:56.257 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.262+0000 7f3917daa640 1 -- start start 2024-02-21T22:53:56.257 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.262+0000 7f3917daa640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f39100cb930 0x7f3910158e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:56.257 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.262+0000 7f3917daa640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f39100d0510 0x7f391009eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:56.257 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.262+0000 7f3917daa640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f39100d1c30 0x7f3910154f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:56.257 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.262+0000 7f3917daa640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39100d2970 con 0x7f39100d1c30 2024-02-21T22:53:56.257 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.262+0000 7f3917daa640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f391015e640 con 0x7f39100d0510 2024-02-21T22:53:56.258 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.262+0000 7f3917daa640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39100d2af0 con 0x7f39100cb930 2024-02-21T22:53:56.258 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.262+0000 7f3916347640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f39100d1c30 0x7f3910154f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:56.258 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.262+0000 7f3916347640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f39100d1c30 0x7f3910154f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:56436/0 (socket says 172.21.15.116:56436) 2024-02-21T22:53:56.258 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.262+0000 7f3916347640 1 -- 172.21.15.116:0/3071418261 learned_addr learned my addr 172.21.15.116:0/3071418261 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:56.258 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.262+0000 7f3915345640 1 --2- 172.21.15.116:0/3071418261 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f39100d0510 0x7f391009eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:56.258 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.262+0000 7f3915b46640 1 --2- 172.21.15.116:0/3071418261 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f39100cb930 0x7f3910158e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:56.258 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.263+0000 7f3916347640 1 -- 172.21.15.116:0/3071418261 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f39100cb930 msgr2=0x7f3910158e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:56.258 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.263+0000 7f3916347640 1 --2- 172.21.15.116:0/3071418261 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f39100cb930 0x7f3910158e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:56.259 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.263+0000 7f3916347640 1 -- 172.21.15.116:0/3071418261 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f39100d0510 msgr2=0x7f391009eea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:56.259 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.263+0000 7f3916347640 1 --2- 172.21.15.116:0/3071418261 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f39100d0510 0x7f391009eea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:56.259 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.263+0000 7f3916347640 1 -- 172.21.15.116:0/3071418261 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39100a1b10 con 0x7f39100d1c30 2024-02-21T22:53:56.259 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.263+0000 7f3915345640 1 --2- 172.21.15.116:0/3071418261 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f39100d0510 0x7f391009eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T22:53:56.259 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.263+0000 7f3916347640 1 --2- 172.21.15.116:0/3071418261 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f39100d1c30 0x7f3910154f20 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f390c0090b0 tx=0x7f390c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:56.259 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.263+0000 7f39067fc640 1 -- 172.21.15.116:0/3071418261 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f390c040070 con 0x7f39100d1c30 2024-02-21T22:53:56.259 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.263+0000 7f39067fc640 1 -- 172.21.15.116:0/3071418261 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f390c030c80 con 0x7f39100d1c30 2024-02-21T22:53:56.259 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.263+0000 7f3917daa640 1 -- 172.21.15.116:0/3071418261 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f391009f610 con 0x7f39100d1c30 2024-02-21T22:53:56.259 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.263+0000 7f39067fc640 1 -- 172.21.15.116:0/3071418261 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f390c035040 con 0x7f39100d1c30 2024-02-21T22:53:56.260 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.263+0000 7f3917daa640 1 -- 172.21.15.116:0/3071418261 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39100a1330 con 0x7f39100d1c30 2024-02-21T22:53:56.260 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.264+0000 7f3917daa640 1 -- 172.21.15.116:0/3071418261 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39100752f0 con 0x7f39100d1c30 2024-02-21T22:53:56.260 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.265+0000 7f39067fc640 1 -- 172.21.15.116:0/3071418261 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f390c038020 con 0x7f39100d1c30 2024-02-21T22:53:56.260 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.265+0000 7f39067fc640 1 --2- 172.21.15.116:0/3071418261 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f38f406b4d0 0x7f38f406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:56.260 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.265+0000 7f39067fc640 1 -- 172.21.15.116:0/3071418261 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f390c0abd60 con 0x7f39100d1c30 2024-02-21T22:53:56.260 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.265+0000 7f3915b46640 1 --2- 172.21.15.116:0/3071418261 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f38f406b4d0 0x7f38f406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:56.260 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.265+0000 7f3915b46640 1 --2- 172.21.15.116:0/3071418261 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f38f406b4d0 0x7f38f406d990 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f39080012e0 tx=0x7f3908001700 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:56.261 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.269+0000 7f39067fc640 1 -- 172.21.15.116:0/3071418261 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f390c07a620 con 0x7f39100d1c30 2024-02-21T22:53:56.432 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.442+0000 7f3917daa640 1 -- 172.21.15.116:0/3071418261 --> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f39100b9ab0 con 0x7f38f406b4d0 2024-02-21T22:53:56.433 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.443+0000 7f39067fc640 1 -- 172.21.15.116:0/3071418261 <== mgr.4103 v2:172.21.15.142:6832/1381484782 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f39100b9ab0 con 0x7f38f406b4d0 2024-02-21T22:53:56.433 INFO:teuthology.orchestra.run.smithi116.stderr:instructed osd(s) 0 to deep-scrub 2024-02-21T22:53:56.435 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.445+0000 7f3917daa640 1 -- 172.21.15.116:0/3071418261 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f38f406b4d0 msgr2=0x7f38f406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:56.436 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.445+0000 7f3917daa640 1 --2- 172.21.15.116:0/3071418261 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f38f406b4d0 0x7f38f406d990 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f39080012e0 tx=0x7f3908001700 comp rx=0 tx=0).stop 2024-02-21T22:53:56.436 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.445+0000 7f3917daa640 1 -- 172.21.15.116:0/3071418261 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f39100d1c30 msgr2=0x7f3910154f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:56.436 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.445+0000 7f3917daa640 1 --2- 172.21.15.116:0/3071418261 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f39100d1c30 0x7f3910154f20 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f390c0090b0 tx=0x7f390c0046c0 comp rx=0 tx=0).stop 2024-02-21T22:53:56.436 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.445+0000 7f3917daa640 1 -- 172.21.15.116:0/3071418261 shutdown_connections 2024-02-21T22:53:56.436 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.445+0000 7f3917daa640 1 --2- 172.21.15.116:0/3071418261 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f39100d1c30 0x7f3910154f20 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:56.436 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.445+0000 7f3917daa640 1 --2- 172.21.15.116:0/3071418261 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f39100d0510 0x7f391009eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:56.436 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.445+0000 7f3917daa640 1 --2- 172.21.15.116:0/3071418261 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f38f406b4d0 0x7f38f406d990 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:56.436 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.445+0000 7f3917daa640 1 --2- 172.21.15.116:0/3071418261 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f39100cb930 0x7f3910158e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:56.437 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.445+0000 7f3917daa640 1 -- 172.21.15.116:0/3071418261 >> 172.21.15.116:0/3071418261 conn(0x7f39100d3e50 msgr2=0x7f39100cd4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:56.437 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.445+0000 7f3917daa640 1 -- 172.21.15.116:0/3071418261 shutdown_connections 2024-02-21T22:53:56.437 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.445+0000 7f3917daa640 1 -- 172.21.15.116:0/3071418261 wait complete. 2024-02-21T22:53:56.446 INFO:tasks.ceph:Scrubbing osd.1 2024-02-21T22:53:56.446 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-02-21T22:53:56.550 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.559+0000 7f191c708640 1 Processor -- start 2024-02-21T22:53:56.550 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.559+0000 7f191c708640 1 -- start start 2024-02-21T22:53:56.553 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.560+0000 7f191c708640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f191415f3b0 0x7f19140cb240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:56.553 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.560+0000 7f191c708640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f19140aee60 0x7f19140b2810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:56.553 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.560+0000 7f191c708640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f191406d230 con 0x7f1914071f00 2024-02-21T22:53:56.553 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.560+0000 7f191c708640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19140cb780 con 0x7f19140aee60 2024-02-21T22:53:56.553 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.560+0000 7f191c708640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19140cb920 con 0x7f191415f3b0 2024-02-21T22:53:56.553 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.560+0000 7f191aca5640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f1914071f00 0x7f1914072370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:40046/0 (socket says 172.21.15.116:40046) 2024-02-21T22:53:56.553 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.560+0000 7f191aca5640 1 -- 172.21.15.116:0/2837053371 learned_addr learned my addr 172.21.15.116:0/2837053371 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-02-21T22:53:56.553 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.560+0000 7f1919ca3640 1 --2- 172.21.15.116:0/2837053371 >> v2:172.21.15.142:3300/0 conn(0x7f19140aee60 0x7f19140b2810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:56.554 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.560+0000 7f191a4a4640 1 --2- 172.21.15.116:0/2837053371 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f191415f3b0 0x7f19140cb240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:56.554 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.560+0000 7f19194a2640 1 -- 172.21.15.116:0/2837053371 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1537330754 0 0) 0x7f191406d230 con 0x7f1914071f00 2024-02-21T22:53:56.554 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.561+0000 7f19194a2640 1 -- 172.21.15.116:0/2837053371 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1900003520 con 0x7f1914071f00 2024-02-21T22:53:56.554 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.561+0000 7f1919ca3640 1 -- 172.21.15.116:0/2837053371 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f191415f3b0 msgr2=0x7f19140cb240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:53:56.554 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.561+0000 7f1919ca3640 1 --2- 172.21.15.116:0/2837053371 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f191415f3b0 0x7f19140cb240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:56.554 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.561+0000 7f1919ca3640 1 -- 172.21.15.116:0/2837053371 >> v1:172.21.15.116:6789/0 conn(0x7f1914071f00 legacy=0x7f1914072370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:56.554 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.561+0000 7f1919ca3640 1 -- 172.21.15.116:0/2837053371 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f191406d510 con 0x7f19140aee60 2024-02-21T22:53:56.554 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.561+0000 7f191a4a4640 1 --2- 172.21.15.116:0/2837053371 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f191415f3b0 0x7f19140cb240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T22:53:56.555 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.561+0000 7f1919ca3640 1 --2- 172.21.15.116:0/2837053371 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f19140aee60 0x7f19140b2810 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f19040097a0 tx=0x7f190402b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6cf337a7f3cd98c server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:56.555 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.562+0000 7f19194a2640 1 -- 172.21.15.116:0/2837053371 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19040315a0 con 0x7f19140aee60 2024-02-21T22:53:56.555 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.562+0000 7f19194a2640 1 -- 172.21.15.116:0/2837053371 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1904037070 con 0x7f19140aee60 2024-02-21T22:53:56.555 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.562+0000 7f19194a2640 1 -- 172.21.15.116:0/2837053371 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1904031940 con 0x7f19140aee60 2024-02-21T22:53:56.555 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.562+0000 7f191c708640 1 -- 172.21.15.116:0/2837053371 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f19140aee60 msgr2=0x7f19140b2810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:56.555 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.562+0000 7f191c708640 1 --2- 172.21.15.116:0/2837053371 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f19140aee60 0x7f19140b2810 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f19040097a0 tx=0x7f190402b840 comp rx=0 tx=0).stop 2024-02-21T22:53:56.555 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.562+0000 7f191c708640 1 -- 172.21.15.116:0/2837053371 shutdown_connections 2024-02-21T22:53:56.555 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.562+0000 7f191c708640 1 --2- 172.21.15.116:0/2837053371 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f19140aee60 0x7f19140b2810 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:56.556 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.562+0000 7f191c708640 1 --2- 172.21.15.116:0/2837053371 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f191415f3b0 0x7f19140cb240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:56.556 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.562+0000 7f191c708640 1 -- 172.21.15.116:0/2837053371 >> 172.21.15.116:0/2837053371 conn(0x7f19140b1510 msgr2=0x7f19140b18f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:56.556 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.562+0000 7f191c708640 1 -- 172.21.15.116:0/2837053371 shutdown_connections 2024-02-21T22:53:56.556 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.562+0000 7f191c708640 1 -- 172.21.15.116:0/2837053371 wait complete. 2024-02-21T22:53:56.559 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.563+0000 7f191c708640 1 Processor -- start 2024-02-21T22:53:56.560 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.563+0000 7f191c708640 1 -- start start 2024-02-21T22:53:56.560 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.564+0000 7f191c708640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1914071f00 0x7f19140c7a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:56.560 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.564+0000 7f191c708640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f19140aee60 0x7f19141f5640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:56.560 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.564+0000 7f191c708640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f191415f3b0 0x7f19141f2790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:56.560 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.564+0000 7f191c708640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19140b2d50 con 0x7f1914071f00 2024-02-21T22:53:56.560 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.564+0000 7f191c708640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19140cbe50 con 0x7f191415f3b0 2024-02-21T22:53:56.561 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.564+0000 7f191c708640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19140b2ed0 con 0x7f19140aee60 2024-02-21T22:53:56.561 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.564+0000 7f191a4a4640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1914071f00 0x7f19140c7a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:56.561 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.564+0000 7f191a4a4640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1914071f00 0x7f19140c7a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:56452/0 (socket says 172.21.15.116:56452) 2024-02-21T22:53:56.561 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.564+0000 7f191a4a4640 1 -- 172.21.15.116:0/2506761083 learned_addr learned my addr 172.21.15.116:0/2506761083 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:56.561 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.564+0000 7f191aca5640 1 --2- 172.21.15.116:0/2506761083 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f191415f3b0 0x7f19141f2790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:56.561 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.564+0000 7f1919ca3640 1 --2- 172.21.15.116:0/2506761083 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f19140aee60 0x7f19141f5640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:56.561 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.564+0000 7f191a4a4640 1 -- 172.21.15.116:0/2506761083 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f19140aee60 msgr2=0x7f19141f5640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:56.561 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.564+0000 7f191a4a4640 1 --2- 172.21.15.116:0/2506761083 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f19140aee60 0x7f19141f5640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:56.562 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.564+0000 7f191a4a4640 1 -- 172.21.15.116:0/2506761083 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f191415f3b0 msgr2=0x7f19141f2790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:56.562 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.564+0000 7f191a4a4640 1 --2- 172.21.15.116:0/2506761083 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f191415f3b0 0x7f19141f2790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:56.562 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.564+0000 7f191a4a4640 1 -- 172.21.15.116:0/2506761083 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19141f2cd0 con 0x7f1914071f00 2024-02-21T22:53:56.562 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.564+0000 7f1919ca3640 1 --2- 172.21.15.116:0/2506761083 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f19140aee60 0x7f19141f5640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T22:53:56.562 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.565+0000 7f191a4a4640 1 --2- 172.21.15.116:0/2506761083 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1914071f00 0x7f19140c7a60 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f191000efc0 tx=0x7f191000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:56.562 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.565+0000 7f190affd640 1 -- 172.21.15.116:0/2506761083 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1910018020 con 0x7f1914071f00 2024-02-21T22:53:56.562 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.565+0000 7f190affd640 1 -- 172.21.15.116:0/2506761083 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1910014680 con 0x7f1914071f00 2024-02-21T22:53:56.562 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.565+0000 7f191c708640 1 -- 172.21.15.116:0/2506761083 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19140c8120 con 0x7f1914071f00 2024-02-21T22:53:56.563 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.565+0000 7f190affd640 1 -- 172.21.15.116:0/2506761083 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1910014a50 con 0x7f1914071f00 2024-02-21T22:53:56.563 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.565+0000 7f191c708640 1 -- 172.21.15.116:0/2506761083 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19140c86e0 con 0x7f1914071f00 2024-02-21T22:53:56.563 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.566+0000 7f191c708640 1 -- 172.21.15.116:0/2506761083 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f19140752f0 con 0x7f1914071f00 2024-02-21T22:53:56.563 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.566+0000 7f190affd640 1 -- 172.21.15.116:0/2506761083 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f1910005d10 con 0x7f1914071f00 2024-02-21T22:53:56.563 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.567+0000 7f190affd640 1 --2- 172.21.15.116:0/2506761083 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f18f806b4d0 0x7f18f806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:56.563 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.567+0000 7f190affd640 1 -- 172.21.15.116:0/2506761083 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f191008af80 con 0x7f1914071f00 2024-02-21T22:53:56.563 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.567+0000 7f190affd640 1 --2- 172.21.15.116:0/2506761083 >> [v2:172.21.15.116:6816/172614746,v1:172.21.15.116:6817/172614746] conn(0x7f18f8073670 0x7f18f8075a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:56.563 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.567+0000 7f190affd640 1 -- 172.21.15.116:0/2506761083 --> [v2:172.21.15.116:6816/172614746,v1:172.21.15.116:6817/172614746] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f18f8076140 con 0x7f18f8073670 2024-02-21T22:53:56.564 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.567+0000 7f190affd640 1 -- 172.21.15.116:0/2506761083 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f191008d620 con 0x7f1914071f00 2024-02-21T22:53:56.564 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.567+0000 7f1919ca3640 1 --2- 172.21.15.116:0/2506761083 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f18f806b4d0 0x7f18f806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:56.564 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.567+0000 7f191aca5640 1 --2- 172.21.15.116:0/2506761083 >> [v2:172.21.15.116:6816/172614746,v1:172.21.15.116:6817/172614746] conn(0x7f18f8073670 0x7f18f8075a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:56.564 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.567+0000 7f191aca5640 1 --2- 172.21.15.116:0/2506761083 >> [v2:172.21.15.116:6816/172614746,v1:172.21.15.116:6817/172614746] conn(0x7f18f8073670 0x7f18f8075a90 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:56.564 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.567+0000 7f1919ca3640 1 --2- 172.21.15.116:0/2506761083 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f18f806b4d0 0x7f18f806d990 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f1904036000 tx=0x7f1904008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:56.564 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.568+0000 7f190affd640 1 -- 172.21.15.116:0/2506761083 <== osd.1 v2:172.21.15.116:6816/172614746 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f18f8076140 con 0x7f18f8073670 2024-02-21T22:53:56.571 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.581+0000 7f191c708640 1 -- 172.21.15.116:0/2506761083 --> [v2:172.21.15.116:6816/172614746,v1:172.21.15.116:6817/172614746] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f19140724f0 con 0x7f18f8073670 2024-02-21T22:53:56.571 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.581+0000 7f190affd640 1 -- 172.21.15.116:0/2506761083 <== osd.1 v2:172.21.15.116:6816/172614746 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f19140724f0 con 0x7f18f8073670 2024-02-21T22:53:56.571 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-02-21T22:53:56.572 INFO:teuthology.orchestra.run.smithi116.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-02-21T22:53:56.572 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-02-21T22:53:56.573 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.581+0000 7f191c708640 1 -- 172.21.15.116:0/2506761083 >> [v2:172.21.15.116:6816/172614746,v1:172.21.15.116:6817/172614746] conn(0x7f18f8073670 msgr2=0x7f18f8075a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:56.573 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.581+0000 7f191c708640 1 --2- 172.21.15.116:0/2506761083 >> [v2:172.21.15.116:6816/172614746,v1:172.21.15.116:6817/172614746] conn(0x7f18f8073670 0x7f18f8075a90 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:56.573 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.581+0000 7f191c708640 1 -- 172.21.15.116:0/2506761083 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f18f806b4d0 msgr2=0x7f18f806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:56.573 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.581+0000 7f191c708640 1 --2- 172.21.15.116:0/2506761083 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f18f806b4d0 0x7f18f806d990 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f1904036000 tx=0x7f1904008030 comp rx=0 tx=0).stop 2024-02-21T22:53:56.574 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.581+0000 7f191c708640 1 -- 172.21.15.116:0/2506761083 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1914071f00 msgr2=0x7f19140c7a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:56.574 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.581+0000 7f191c708640 1 --2- 172.21.15.116:0/2506761083 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1914071f00 0x7f19140c7a60 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f191000efc0 tx=0x7f191000c490 comp rx=0 tx=0).stop 2024-02-21T22:53:56.574 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.581+0000 7f191aca5640 1 -- 172.21.15.116:0/2506761083 reap_dead start 2024-02-21T22:53:56.574 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.581+0000 7f191c708640 1 -- 172.21.15.116:0/2506761083 shutdown_connections 2024-02-21T22:53:56.574 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.581+0000 7f191c708640 1 -- 172.21.15.116:0/2506761083 >> 172.21.15.116:0/2506761083 conn(0x7f19140b1510 msgr2=0x7f19140cc270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:56.574 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.581+0000 7f191c708640 1 -- 172.21.15.116:0/2506761083 shutdown_connections 2024-02-21T22:53:56.574 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.581+0000 7f191c708640 1 -- 172.21.15.116:0/2506761083 wait complete. 2024-02-21T22:53:56.582 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-02-21T22:53:56.684 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.693+0000 7fb7d235d640 1 Processor -- start 2024-02-21T22:53:56.684 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.693+0000 7fb7d235d640 1 -- start start 2024-02-21T22:53:56.686 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.694+0000 7fb7d235d640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fb7cc15afb0 0x7fb7cc0af080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:56.686 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.694+0000 7fb7d235d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb7cc070b70 0x7fb7cc071580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:56.686 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.694+0000 7fb7d235d640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7cc0710e0 con 0x7fb7cc071ac0 2024-02-21T22:53:56.686 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.694+0000 7fb7d235d640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7cc15b390 con 0x7fb7cc15afb0 2024-02-21T22:53:56.686 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.694+0000 7fb7d235d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7cc0713c0 con 0x7fb7cc070b70 2024-02-21T22:53:56.686 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.694+0000 7fb7cbfff640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fb7cc15afb0 0x7fb7cc0af080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:56.686 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.694+0000 7fb7cbfff640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fb7cc15afb0 0x7fb7cc0af080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:56466/0 (socket says 172.21.15.116:56466) 2024-02-21T22:53:56.687 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.694+0000 7fb7cbfff640 1 -- 172.21.15.116:0/3552228606 learned_addr learned my addr 172.21.15.116:0/3552228606 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:56.687 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.694+0000 7fb7cb7fe640 1 --2- 172.21.15.116:0/3552228606 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb7cc070b70 0x7fb7cc071580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:56.687 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.695+0000 7fb7cbfff640 1 -- 172.21.15.116:0/3552228606 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb7cc070b70 msgr2=0x7fb7cc071580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:53:56.687 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.695+0000 7fb7cbfff640 1 --2- 172.21.15.116:0/3552228606 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb7cc070b70 0x7fb7cc071580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:56.687 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.695+0000 7fb7cbfff640 1 -- 172.21.15.116:0/3552228606 >> v1:172.21.15.142:6789/0 conn(0x7fb7cc071ac0 legacy=0x7fb7cc0ad560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:56.687 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.695+0000 7fb7cbfff640 1 -- 172.21.15.116:0/3552228606 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7cc0b2d80 con 0x7fb7cc15afb0 2024-02-21T22:53:56.688 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.695+0000 7fb7cbfff640 1 --2- 172.21.15.116:0/3552228606 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb7cc15afb0 0x7fb7cc0af080 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fb7bc009870 tx=0x7fb7bc02ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=703eb1ec872d2f3e server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:56.688 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.695+0000 7fb7caffd640 1 -- 172.21.15.116:0/3552228606 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7bc02f840 con 0x7fb7cc15afb0 2024-02-21T22:53:56.688 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.695+0000 7fb7caffd640 1 -- 172.21.15.116:0/3552228606 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7bc02f9e0 con 0x7fb7cc15afb0 2024-02-21T22:53:56.688 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.695+0000 7fb7caffd640 1 -- 172.21.15.116:0/3552228606 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7bc02fdb0 con 0x7fb7cc15afb0 2024-02-21T22:53:56.691 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.696+0000 7fb7d235d640 1 -- 172.21.15.116:0/3552228606 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb7cc15afb0 msgr2=0x7fb7cc0af080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:56.691 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.696+0000 7fb7d235d640 1 --2- 172.21.15.116:0/3552228606 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb7cc15afb0 0x7fb7cc0af080 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fb7bc009870 tx=0x7fb7bc02ba20 comp rx=0 tx=0).stop 2024-02-21T22:53:56.691 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.696+0000 7fb7d235d640 1 -- 172.21.15.116:0/3552228606 shutdown_connections 2024-02-21T22:53:56.692 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.696+0000 7fb7d235d640 1 --2- 172.21.15.116:0/3552228606 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb7cc070b70 0x7fb7cc071580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:56.692 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.696+0000 7fb7d235d640 1 --2- 172.21.15.116:0/3552228606 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb7cc15afb0 0x7fb7cc0af080 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:56.692 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.696+0000 7fb7d235d640 1 -- 172.21.15.116:0/3552228606 >> 172.21.15.116:0/3552228606 conn(0x7fb7cc0b18e0 msgr2=0x7fb7cc0b1cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:56.692 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.696+0000 7fb7d235d640 1 -- 172.21.15.116:0/3552228606 shutdown_connections 2024-02-21T22:53:56.692 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.696+0000 7fb7d235d640 1 -- 172.21.15.116:0/3552228606 wait complete. 2024-02-21T22:53:56.692 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.697+0000 7fb7d235d640 1 Processor -- start 2024-02-21T22:53:56.692 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.697+0000 7fb7d235d640 1 -- start start 2024-02-21T22:53:56.693 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.698+0000 7fb7d235d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb7cc070b70 0x7fb7cc156fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:56.693 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.698+0000 7fb7d235d640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb7cc071ac0 0x7fb7cc0adc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:56.693 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.698+0000 7fb7d235d640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb7cc15afb0 0x7fb7cc0ca2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:56.693 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.698+0000 7fb7d235d640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7cc0af5c0 con 0x7fb7cc071ac0 2024-02-21T22:53:56.693 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.698+0000 7fb7d235d640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7cc0b3340 con 0x7fb7cc15afb0 2024-02-21T22:53:56.693 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.698+0000 7fb7d235d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7cc0b4870 con 0x7fb7cc070b70 2024-02-21T22:53:56.693 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.698+0000 7fb7cb7fe640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb7cc071ac0 0x7fb7cc0adc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:56.694 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.698+0000 7fb7cb7fe640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb7cc071ac0 0x7fb7cc0adc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:56482/0 (socket says 172.21.15.116:56482) 2024-02-21T22:53:56.694 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.698+0000 7fb7cb7fe640 1 -- 172.21.15.116:0/600822714 learned_addr learned my addr 172.21.15.116:0/600822714 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:56.694 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.698+0000 7fb7cbfff640 1 --2- 172.21.15.116:0/600822714 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb7cc070b70 0x7fb7cc156fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:56.694 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.698+0000 7fb7d08fa640 1 --2- 172.21.15.116:0/600822714 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb7cc15afb0 0x7fb7cc0ca2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:56.694 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.698+0000 7fb7cb7fe640 1 -- 172.21.15.116:0/600822714 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb7cc070b70 msgr2=0x7fb7cc156fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:56.694 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.698+0000 7fb7cb7fe640 1 --2- 172.21.15.116:0/600822714 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb7cc070b70 0x7fb7cc156fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:56.694 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.698+0000 7fb7cb7fe640 1 -- 172.21.15.116:0/600822714 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb7cc15afb0 msgr2=0x7fb7cc0ca2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:56.694 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.699+0000 7fb7cb7fe640 1 --2- 172.21.15.116:0/600822714 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb7cc15afb0 0x7fb7cc0ca2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:56.695 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.699+0000 7fb7cb7fe640 1 -- 172.21.15.116:0/600822714 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7cc15a310 con 0x7fb7cc071ac0 2024-02-21T22:53:56.695 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.699+0000 7fb7cb7fe640 1 --2- 172.21.15.116:0/600822714 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb7cc071ac0 0x7fb7cc0adc10 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fb7c000e9e0 tx=0x7fb7c000eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:56.695 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.699+0000 7fb7c8ff9640 1 -- 172.21.15.116:0/600822714 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7c0017070 con 0x7fb7cc071ac0 2024-02-21T22:53:56.695 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.699+0000 7fb7c8ff9640 1 -- 172.21.15.116:0/600822714 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7c000c9d0 con 0x7fb7cc071ac0 2024-02-21T22:53:56.695 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.699+0000 7fb7d235d640 1 -- 172.21.15.116:0/600822714 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7cc0c8f60 con 0x7fb7cc071ac0 2024-02-21T22:53:56.695 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.699+0000 7fb7c8ff9640 1 -- 172.21.15.116:0/600822714 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7c000cdc0 con 0x7fb7cc071ac0 2024-02-21T22:53:56.695 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.699+0000 7fb7d235d640 1 -- 172.21.15.116:0/600822714 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7cc0c9520 con 0x7fb7cc071ac0 2024-02-21T22:53:56.695 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.700+0000 7fb7d235d640 1 -- 172.21.15.116:0/600822714 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7cc0c9f20 con 0x7fb7cc071ac0 2024-02-21T22:53:56.695 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.700+0000 7fb7c8ff9640 1 -- 172.21.15.116:0/600822714 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fb7c001a070 con 0x7fb7cc071ac0 2024-02-21T22:53:56.696 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.701+0000 7fb7c8ff9640 1 --2- 172.21.15.116:0/600822714 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fb7b806b4d0 0x7fb7b806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:56.696 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.701+0000 7fb7c8ff9640 1 -- 172.21.15.116:0/600822714 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb7c008a190 con 0x7fb7cc071ac0 2024-02-21T22:53:56.696 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.701+0000 7fb7cbfff640 1 --2- 172.21.15.116:0/600822714 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fb7b806b4d0 0x7fb7b806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:56.696 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.701+0000 7fb7cbfff640 1 --2- 172.21.15.116:0/600822714 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fb7b806b4d0 0x7fb7b806d990 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fb7bc036000 tx=0x7fb7bc008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:56.696 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.705+0000 7fb7c8ff9640 1 -- 172.21.15.116:0/600822714 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7fb7c00589c0 con 0x7fb7cc071ac0 2024-02-21T22:53:56.866 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.875+0000 7fb7d235d640 1 -- 172.21.15.116:0/600822714 --> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7fb7cc0752f0 con 0x7fb7b806b4d0 2024-02-21T22:53:56.867 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.876+0000 7fb7c8ff9640 1 -- 172.21.15.116:0/600822714 <== mgr.4103 v2:172.21.15.142:6832/1381484782 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fb7cc0752f0 con 0x7fb7b806b4d0 2024-02-21T22:53:56.867 INFO:teuthology.orchestra.run.smithi116.stderr:instructed osd(s) 1 to deep-scrub 2024-02-21T22:53:56.869 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.878+0000 7fb7d235d640 1 -- 172.21.15.116:0/600822714 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fb7b806b4d0 msgr2=0x7fb7b806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:56.869 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.878+0000 7fb7d235d640 1 --2- 172.21.15.116:0/600822714 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fb7b806b4d0 0x7fb7b806d990 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fb7bc036000 tx=0x7fb7bc008030 comp rx=0 tx=0).stop 2024-02-21T22:53:56.869 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.878+0000 7fb7d235d640 1 -- 172.21.15.116:0/600822714 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb7cc071ac0 msgr2=0x7fb7cc0adc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:56.869 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.878+0000 7fb7d235d640 1 --2- 172.21.15.116:0/600822714 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb7cc071ac0 0x7fb7cc0adc10 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fb7c000e9e0 tx=0x7fb7c000eea0 comp rx=0 tx=0).stop 2024-02-21T22:53:56.870 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.878+0000 7fb7d235d640 1 -- 172.21.15.116:0/600822714 shutdown_connections 2024-02-21T22:53:56.870 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.878+0000 7fb7d235d640 1 --2- 172.21.15.116:0/600822714 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb7cc15afb0 0x7fb7cc0ca2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:56.870 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.878+0000 7fb7d235d640 1 --2- 172.21.15.116:0/600822714 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb7cc071ac0 0x7fb7cc0adc10 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:56.870 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.878+0000 7fb7d235d640 1 --2- 172.21.15.116:0/600822714 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fb7b806b4d0 0x7fb7b806d990 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:56.870 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.878+0000 7fb7d235d640 1 --2- 172.21.15.116:0/600822714 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb7cc070b70 0x7fb7cc156fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:56.870 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.878+0000 7fb7d235d640 1 -- 172.21.15.116:0/600822714 >> 172.21.15.116:0/600822714 conn(0x7fb7cc0b18e0 msgr2=0x7fb7cc0d0360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:56.870 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.878+0000 7fb7d235d640 1 -- 172.21.15.116:0/600822714 shutdown_connections 2024-02-21T22:53:56.871 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.878+0000 7fb7d235d640 1 -- 172.21.15.116:0/600822714 wait complete. 2024-02-21T22:53:56.879 INFO:tasks.ceph:Scrubbing osd.2 2024-02-21T22:53:56.880 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-02-21T22:53:56.985 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.995+0000 7f9add51e640 1 Processor -- start 2024-02-21T22:53:56.986 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.995+0000 7f9add51e640 1 -- start start 2024-02-21T22:53:56.988 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.995+0000 7f9add51e640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f9ad80d2a60 0x7f9ad80ce980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:56.988 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.995+0000 7f9add51e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9ad80b50d0 0x7f9ad80ceec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:56.989 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.995+0000 7f9add51e640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ad8161ae0 con 0x7f9ad8161700 2024-02-21T22:53:56.989 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.995+0000 7f9add51e640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ad80b3c30 con 0x7f9ad80d2a60 2024-02-21T22:53:56.989 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.995+0000 7f9add51e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ad80d4be0 con 0x7f9ad80b50d0 2024-02-21T22:53:56.989 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.995+0000 7f9ad67fc640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f9ad80d2a60 0x7f9ad80ce980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:56.989 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.996+0000 7f9ad67fc640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f9ad80d2a60 0x7f9ad80ce980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:56498/0 (socket says 172.21.15.116:56498) 2024-02-21T22:53:56.989 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.996+0000 7f9ad67fc640 1 -- 172.21.15.116:0/3203799547 learned_addr learned my addr 172.21.15.116:0/3203799547 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:56.990 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.996+0000 7f9ad6ffd640 1 --1- 172.21.15.116:0/3203799547 >> v1:172.21.15.142:6789/0 conn(0x7f9ad8161700 0x7f9ad80d2350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.116:37808/0 (socket says 172.21.15.116:37808) 2024-02-21T22:53:56.990 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.996+0000 7f9ad77fe640 1 --2- 172.21.15.116:0/3203799547 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9ad80b50d0 0x7f9ad80ceec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:56.990 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.996+0000 7f9ad5ffb640 1 -- 172.21.15.116:0/3203799547 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 788411661 0 0) 0x7f9ac8001110 con 0x7f9ad8161700 2024-02-21T22:53:56.990 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.996+0000 7f9ad67fc640 1 -- 172.21.15.116:0/3203799547 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9ad80b50d0 msgr2=0x7f9ad80ceec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:53:56.990 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.996+0000 7f9ad67fc640 1 --2- 172.21.15.116:0/3203799547 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9ad80b50d0 0x7f9ad80ceec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:56.990 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.996+0000 7f9ad67fc640 1 -- 172.21.15.116:0/3203799547 >> v1:172.21.15.142:6789/0 conn(0x7f9ad8161700 legacy=0x7f9ad80d2350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:56.990 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.996+0000 7f9ad67fc640 1 -- 172.21.15.116:0/3203799547 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ad80b3300 con 0x7f9ad80d2a60 2024-02-21T22:53:56.990 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.997+0000 7f9ad67fc640 1 --2- 172.21.15.116:0/3203799547 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9ad80d2a60 0x7f9ad80ce980 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f9acc009870 tx=0x7f9acc02b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8581ece693cac29e server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:56.991 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.997+0000 7f9ad5ffb640 1 -- 172.21.15.116:0/3203799547 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9acc034070 con 0x7f9ad80d2a60 2024-02-21T22:53:56.991 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.997+0000 7f9ad5ffb640 1 -- 172.21.15.116:0/3203799547 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9acc030840 con 0x7f9ad80d2a60 2024-02-21T22:53:56.991 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.997+0000 7f9ad5ffb640 1 -- 172.21.15.116:0/3203799547 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9acc030c10 con 0x7f9ad80d2a60 2024-02-21T22:53:56.991 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.997+0000 7f9add51e640 1 -- 172.21.15.116:0/3203799547 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9ad80d2a60 msgr2=0x7f9ad80ce980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:56.991 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.997+0000 7f9add51e640 1 --2- 172.21.15.116:0/3203799547 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9ad80d2a60 0x7f9ad80ce980 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f9acc009870 tx=0x7f9acc02b980 comp rx=0 tx=0).stop 2024-02-21T22:53:56.991 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.997+0000 7f9add51e640 1 -- 172.21.15.116:0/3203799547 shutdown_connections 2024-02-21T22:53:56.991 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.997+0000 7f9add51e640 1 --2- 172.21.15.116:0/3203799547 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9ad80b50d0 0x7f9ad80ceec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:56.991 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.997+0000 7f9add51e640 1 --2- 172.21.15.116:0/3203799547 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9ad80d2a60 0x7f9ad80ce980 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:56.992 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.997+0000 7f9add51e640 1 -- 172.21.15.116:0/3203799547 >> 172.21.15.116:0/3203799547 conn(0x7f9ad80d3d70 msgr2=0x7f9ad80d4180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:56.992 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.997+0000 7f9add51e640 1 -- 172.21.15.116:0/3203799547 shutdown_connections 2024-02-21T22:53:56.992 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.997+0000 7f9add51e640 1 -- 172.21.15.116:0/3203799547 wait complete. 2024-02-21T22:53:56.995 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.999+0000 7f9add51e640 1 Processor -- start 2024-02-21T22:53:56.996 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.999+0000 7f9add51e640 1 -- start start 2024-02-21T22:53:56.996 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.999+0000 7f9add51e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9ad80b50d0 0x7f9ad806bec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:56.996 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.999+0000 7f9add51e640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9ad80d2a60 0x7f9ad815d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:56.996 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.999+0000 7f9add51e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9ad8161700 0x7f9ad8152b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:56.996 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.999+0000 7f9add51e640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ad80d4890 con 0x7f9ad80d2a60 2024-02-21T22:53:56.996 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.999+0000 7f9add51e640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ad80b38c0 con 0x7f9ad80b50d0 2024-02-21T22:53:56.997 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.999+0000 7f9add51e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ad80d0e40 con 0x7f9ad8161700 2024-02-21T22:53:56.997 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.999+0000 7f9ad67fc640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9ad80d2a60 0x7f9ad815d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:56.997 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.999+0000 7f9ad67fc640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9ad80d2a60 0x7f9ad815d040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:56504/0 (socket says 172.21.15.116:56504) 2024-02-21T22:53:56.997 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:56.999+0000 7f9ad67fc640 1 -- 172.21.15.116:0/1486961780 learned_addr learned my addr 172.21.15.116:0/1486961780 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:56.997 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.000+0000 7f9ad77fe640 1 --2- 172.21.15.116:0/1486961780 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9ad8161700 0x7f9ad8152b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:56.997 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.000+0000 7f9ad6ffd640 1 --2- 172.21.15.116:0/1486961780 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9ad80b50d0 0x7f9ad806bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:56.997 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.000+0000 7f9ad67fc640 1 -- 172.21.15.116:0/1486961780 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9ad8161700 msgr2=0x7f9ad8152b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:56.997 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.000+0000 7f9ad67fc640 1 --2- 172.21.15.116:0/1486961780 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9ad8161700 0x7f9ad8152b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:56.997 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.000+0000 7f9ad67fc640 1 -- 172.21.15.116:0/1486961780 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9ad80b50d0 msgr2=0x7f9ad806bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:56.998 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.000+0000 7f9ad67fc640 1 --2- 172.21.15.116:0/1486961780 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9ad80b50d0 0x7f9ad806bec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:56.998 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.000+0000 7f9ad67fc640 1 -- 172.21.15.116:0/1486961780 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ad80b7d40 con 0x7f9ad80d2a60 2024-02-21T22:53:56.998 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.000+0000 7f9ad67fc640 1 --2- 172.21.15.116:0/1486961780 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9ad80d2a60 0x7f9ad815d040 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f9acc000c00 tx=0x7f9acc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:56.998 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.000+0000 7f9abf7fe640 1 -- 172.21.15.116:0/1486961780 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9acc048070 con 0x7f9ad80d2a60 2024-02-21T22:53:56.998 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.000+0000 7f9abf7fe640 1 -- 172.21.15.116:0/1486961780 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9acc030640 con 0x7f9ad80d2a60 2024-02-21T22:53:56.998 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.000+0000 7f9add51e640 1 -- 172.21.15.116:0/1486961780 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ad80b8080 con 0x7f9ad80d2a60 2024-02-21T22:53:56.998 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.000+0000 7f9abf7fe640 1 -- 172.21.15.116:0/1486961780 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9acc034040 con 0x7f9ad80d2a60 2024-02-21T22:53:56.999 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.000+0000 7f9add51e640 1 -- 172.21.15.116:0/1486961780 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ad80b88c0 con 0x7f9ad80d2a60 2024-02-21T22:53:56.999 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.001+0000 7f9add51e640 1 -- 172.21.15.116:0/1486961780 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9ad80d0a40 con 0x7f9ad80d2a60 2024-02-21T22:53:56.999 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.001+0000 7f9abf7fe640 1 -- 172.21.15.116:0/1486961780 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f9acc04b070 con 0x7f9ad80d2a60 2024-02-21T22:53:56.999 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.002+0000 7f9abf7fe640 1 --2- 172.21.15.116:0/1486961780 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f9ac406b500 0x7f9ac406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:56.999 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.002+0000 7f9abf7fe640 1 -- 172.21.15.116:0/1486961780 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9acc0abf70 con 0x7f9ad80d2a60 2024-02-21T22:53:57.000 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.002+0000 7f9abf7fe640 1 --2- 172.21.15.116:0/1486961780 >> [v2:172.21.15.116:6824/1029280577,v1:172.21.15.116:6825/1029280577] conn(0x7f9ac40736a0 0x7f9ac4075ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:57.000 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.002+0000 7f9abf7fe640 1 -- 172.21.15.116:0/1486961780 --> [v2:172.21.15.116:6824/1029280577,v1:172.21.15.116:6825/1029280577] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9ac4076170 con 0x7f9ac40736a0 2024-02-21T22:53:57.000 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.002+0000 7f9ad6ffd640 1 --2- 172.21.15.116:0/1486961780 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f9ac406b500 0x7f9ac406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:57.000 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.002+0000 7f9abf7fe640 1 -- 172.21.15.116:0/1486961780 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9acc0ae610 con 0x7f9ad80d2a60 2024-02-21T22:53:57.000 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.002+0000 7f9ad77fe640 1 --2- 172.21.15.116:0/1486961780 >> [v2:172.21.15.116:6824/1029280577,v1:172.21.15.116:6825/1029280577] conn(0x7f9ac40736a0 0x7f9ac4075ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:57.000 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.002+0000 7f9ad6ffd640 1 --2- 172.21.15.116:0/1486961780 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f9ac406b500 0x7f9ac406d9c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f9ac8007fd0 tx=0x7f9ac8007de0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:57.000 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.002+0000 7f9ad77fe640 1 --2- 172.21.15.116:0/1486961780 >> [v2:172.21.15.116:6824/1029280577,v1:172.21.15.116:6825/1029280577] conn(0x7f9ac40736a0 0x7f9ac4075ac0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:57.001 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.003+0000 7f9abf7fe640 1 -- 172.21.15.116:0/1486961780 <== osd.2 v2:172.21.15.116:6824/1029280577 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f9ac4076170 con 0x7f9ac40736a0 2024-02-21T22:53:57.007 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.016+0000 7f9add51e640 1 -- 172.21.15.116:0/1486961780 --> [v2:172.21.15.116:6824/1029280577,v1:172.21.15.116:6825/1029280577] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f9ad80752f0 con 0x7f9ac40736a0 2024-02-21T22:53:57.007 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.016+0000 7f9abf7fe640 1 -- 172.21.15.116:0/1486961780 <== osd.2 v2:172.21.15.116:6824/1029280577 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f9ad80752f0 con 0x7f9ac40736a0 2024-02-21T22:53:57.007 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-02-21T22:53:57.008 INFO:teuthology.orchestra.run.smithi116.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-02-21T22:53:57.009 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-02-21T22:53:57.010 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.016+0000 7f9add51e640 1 -- 172.21.15.116:0/1486961780 >> [v2:172.21.15.116:6824/1029280577,v1:172.21.15.116:6825/1029280577] conn(0x7f9ac40736a0 msgr2=0x7f9ac4075ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:57.011 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.016+0000 7f9add51e640 1 --2- 172.21.15.116:0/1486961780 >> [v2:172.21.15.116:6824/1029280577,v1:172.21.15.116:6825/1029280577] conn(0x7f9ac40736a0 0x7f9ac4075ac0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:57.011 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.016+0000 7f9add51e640 1 -- 172.21.15.116:0/1486961780 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f9ac406b500 msgr2=0x7f9ac406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:57.011 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.016+0000 7f9add51e640 1 --2- 172.21.15.116:0/1486961780 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f9ac406b500 0x7f9ac406d9c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f9ac8007fd0 tx=0x7f9ac8007de0 comp rx=0 tx=0).stop 2024-02-21T22:53:57.011 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.016+0000 7f9add51e640 1 -- 172.21.15.116:0/1486961780 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9ad80d2a60 msgr2=0x7f9ad815d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:57.011 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.016+0000 7f9add51e640 1 --2- 172.21.15.116:0/1486961780 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9ad80d2a60 0x7f9ad815d040 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f9acc000c00 tx=0x7f9acc004730 comp rx=0 tx=0).stop 2024-02-21T22:53:57.011 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.017+0000 7f9ad77fe640 1 -- 172.21.15.116:0/1486961780 reap_dead start 2024-02-21T22:53:57.011 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.017+0000 7f9add51e640 1 -- 172.21.15.116:0/1486961780 shutdown_connections 2024-02-21T22:53:57.011 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.017+0000 7f9add51e640 1 -- 172.21.15.116:0/1486961780 >> 172.21.15.116:0/1486961780 conn(0x7f9ad80d3d70 msgr2=0x7f9ad80b5f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:57.012 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.017+0000 7f9add51e640 1 -- 172.21.15.116:0/1486961780 shutdown_connections 2024-02-21T22:53:57.012 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.017+0000 7f9add51e640 1 -- 172.21.15.116:0/1486961780 wait complete. 2024-02-21T22:53:57.017 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-02-21T22:53:57.118 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.128+0000 7f029ccb0640 1 Processor -- start 2024-02-21T22:53:57.119 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.128+0000 7f029ccb0640 1 -- start start 2024-02-21T22:53:57.120 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.129+0000 7f029ccb0640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f02980b0290 0x7f029806f290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:57.121 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.129+0000 7f029ccb0640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f029806b550 0x7f0298071c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:57.121 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.129+0000 7f029ccb0640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f029815f570 con 0x7f02980b3f90 2024-02-21T22:53:57.121 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.129+0000 7f029ccb0640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f029815f0e0 con 0x7f029806b550 2024-02-21T22:53:57.121 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.129+0000 7f029ccb0640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f029815e7b0 con 0x7f02980b0290 2024-02-21T22:53:57.121 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.129+0000 7f0296d9d640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f029806b550 0x7f0298071c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:57.121 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.129+0000 7f0296d9d640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f029806b550 0x7f0298071c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:56508/0 (socket says 172.21.15.116:56508) 2024-02-21T22:53:57.121 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.129+0000 7f0296d9d640 1 -- 172.21.15.116:0/4245145262 learned_addr learned my addr 172.21.15.116:0/4245145262 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:57.121 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.129+0000 7f029659c640 1 --2- 172.21.15.116:0/4245145262 >> v2:172.21.15.142:3300/0 conn(0x7f02980b0290 0x7f029806f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:57.122 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.129+0000 7f0296d9d640 1 -- 172.21.15.116:0/4245145262 >> v2:172.21.15.142:3300/0 conn(0x7f02980b0290 msgr2=0x7f029806f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:53:57.122 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.129+0000 7f0296d9d640 1 --2- 172.21.15.116:0/4245145262 >> v2:172.21.15.142:3300/0 conn(0x7f02980b0290 0x7f029806f290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:57.122 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.129+0000 7f0296d9d640 1 -- 172.21.15.116:0/4245145262 >> v1:172.21.15.142:6789/0 conn(0x7f02980b3f90 legacy=0x7f029806ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:57.122 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.129+0000 7f0296d9d640 1 -- 172.21.15.116:0/4245145262 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f029815ea90 con 0x7f029806b550 2024-02-21T22:53:57.122 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.130+0000 7f0296d9d640 1 --2- 172.21.15.116:0/4245145262 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f029806b550 0x7f0298071c80 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f029806d780 tx=0x7f029002bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12a64a86fc34f4ce server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:57.122 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.130+0000 7f029559a640 1 -- 172.21.15.116:0/4245145262 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f029002ca80 con 0x7f029806b550 2024-02-21T22:53:57.122 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.130+0000 7f029559a640 1 -- 172.21.15.116:0/4245145262 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f029002cc20 con 0x7f029806b550 2024-02-21T22:53:57.122 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.130+0000 7f029559a640 1 -- 172.21.15.116:0/4245145262 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02900343f0 con 0x7f029806b550 2024-02-21T22:53:57.126 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.131+0000 7f029ccb0640 1 -- 172.21.15.116:0/4245145262 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f029806b550 msgr2=0x7f0298071c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:57.126 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.131+0000 7f029ccb0640 1 --2- 172.21.15.116:0/4245145262 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f029806b550 0x7f0298071c80 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f029806d780 tx=0x7f029002bee0 comp rx=0 tx=0).stop 2024-02-21T22:53:57.126 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.131+0000 7f029ccb0640 1 -- 172.21.15.116:0/4245145262 shutdown_connections 2024-02-21T22:53:57.126 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.131+0000 7f029ccb0640 1 --2- 172.21.15.116:0/4245145262 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f029806b550 0x7f0298071c80 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:57.126 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.131+0000 7f029ccb0640 1 --2- 172.21.15.116:0/4245145262 >> v2:172.21.15.142:3300/0 conn(0x7f02980b0290 0x7f029806f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:57.126 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.131+0000 7f029ccb0640 1 -- 172.21.15.116:0/4245145262 >> 172.21.15.116:0/4245145262 conn(0x7f02980b29f0 msgr2=0x7f02980b2e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:57.126 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.131+0000 7f029ccb0640 1 -- 172.21.15.116:0/4245145262 shutdown_connections 2024-02-21T22:53:57.127 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.131+0000 7f029ccb0640 1 -- 172.21.15.116:0/4245145262 wait complete. 2024-02-21T22:53:57.127 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.132+0000 7f029ccb0640 1 Processor -- start 2024-02-21T22:53:57.127 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.132+0000 7f029ccb0640 1 -- start start 2024-02-21T22:53:57.127 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.133+0000 7f029ccb0640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f029806b550 0x7f029814ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:57.127 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.133+0000 7f029ccb0640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f02980b0290 0x7f02980b1ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:57.127 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.133+0000 7f029ccb0640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f02980b3f90 0x7f0298153540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:57.127 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.133+0000 7f029ccb0640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f029806f7d0 con 0x7f02980b3f90 2024-02-21T22:53:57.127 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.133+0000 7f029ccb0640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02980b0670 con 0x7f02980b0290 2024-02-21T22:53:57.127 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.133+0000 7f029ccb0640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f029806f950 con 0x7f029806b550 2024-02-21T22:53:57.128 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.133+0000 7f0296d9d640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f02980b3f90 0x7f0298153540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:57.128 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.133+0000 7f029659c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f029806b550 0x7f029814ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:57.128 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.133+0000 7f0296d9d640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f02980b3f90 0x7f0298153540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:56510/0 (socket says 172.21.15.116:56510) 2024-02-21T22:53:57.128 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.133+0000 7f0296d9d640 1 -- 172.21.15.116:0/549524872 learned_addr learned my addr 172.21.15.116:0/549524872 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:57.128 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.133+0000 7f0295d9b640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f02980b0290 0x7f02980b1ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:57.128 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.133+0000 7f0296d9d640 1 -- 172.21.15.116:0/549524872 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f029806b550 msgr2=0x7f029814ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:57.128 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.133+0000 7f0296d9d640 1 --2- 172.21.15.116:0/549524872 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f029806b550 0x7f029814ff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:57.128 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.133+0000 7f0296d9d640 1 -- 172.21.15.116:0/549524872 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f02980b0290 msgr2=0x7f02980b1ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:57.129 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.133+0000 7f0296d9d640 1 --2- 172.21.15.116:0/549524872 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f02980b0290 0x7f02980b1ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:57.129 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.133+0000 7f0296d9d640 1 -- 172.21.15.116:0/549524872 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0298154070 con 0x7f02980b3f90 2024-02-21T22:53:57.129 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.133+0000 7f0296d9d640 1 --2- 172.21.15.116:0/549524872 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f02980b3f90 0x7f0298153540 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f0290009e20 tx=0x7f0290004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:57.129 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.134+0000 7f0286ffd640 1 -- 172.21.15.116:0/549524872 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0290043020 con 0x7f02980b3f90 2024-02-21T22:53:57.129 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.134+0000 7f0286ffd640 1 -- 172.21.15.116:0/549524872 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f029003e450 con 0x7f02980b3f90 2024-02-21T22:53:57.129 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.134+0000 7f029ccb0640 1 -- 172.21.15.116:0/549524872 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f029814f180 con 0x7f02980b3f90 2024-02-21T22:53:57.129 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.134+0000 7f0286ffd640 1 -- 172.21.15.116:0/549524872 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0290009510 con 0x7f02980b3f90 2024-02-21T22:53:57.129 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.134+0000 7f029ccb0640 1 -- 172.21.15.116:0/549524872 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f029814f740 con 0x7f02980b3f90 2024-02-21T22:53:57.129 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.135+0000 7f029ccb0640 1 -- 172.21.15.116:0/549524872 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02980752f0 con 0x7f02980b3f90 2024-02-21T22:53:57.130 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.135+0000 7f0286ffd640 1 -- 172.21.15.116:0/549524872 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f0290046020 con 0x7f02980b3f90 2024-02-21T22:53:57.130 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.136+0000 7f0286ffd640 1 --2- 172.21.15.116:0/549524872 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f027806b4d0 0x7f027806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:57.130 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.136+0000 7f0286ffd640 1 -- 172.21.15.116:0/549524872 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f02900ac7e0 con 0x7f02980b3f90 2024-02-21T22:53:57.131 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.136+0000 7f029659c640 1 --2- 172.21.15.116:0/549524872 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f027806b4d0 0x7f027806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:57.131 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.136+0000 7f029659c640 1 --2- 172.21.15.116:0/549524872 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f027806b4d0 0x7f027806d990 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f0288009b40 tx=0x7f0288009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:57.131 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.140+0000 7f0286ffd640 1 -- 172.21.15.116:0/549524872 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f029004d030 con 0x7f02980b3f90 2024-02-21T22:53:57.302 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.311+0000 7f029ccb0640 1 -- 172.21.15.116:0/549524872 --> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f029806d390 con 0x7f027806b4d0 2024-02-21T22:53:57.302 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.312+0000 7f0286ffd640 1 -- 172.21.15.116:0/549524872 <== mgr.4103 v2:172.21.15.142:6832/1381484782 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f029806d390 con 0x7f027806b4d0 2024-02-21T22:53:57.303 INFO:teuthology.orchestra.run.smithi116.stderr:instructed osd(s) 2 to deep-scrub 2024-02-21T22:53:57.305 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.314+0000 7f029ccb0640 1 -- 172.21.15.116:0/549524872 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f027806b4d0 msgr2=0x7f027806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:57.305 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.314+0000 7f029ccb0640 1 --2- 172.21.15.116:0/549524872 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f027806b4d0 0x7f027806d990 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f0288009b40 tx=0x7f0288009190 comp rx=0 tx=0).stop 2024-02-21T22:53:57.305 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.314+0000 7f029ccb0640 1 -- 172.21.15.116:0/549524872 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f02980b3f90 msgr2=0x7f0298153540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:57.305 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.314+0000 7f029ccb0640 1 --2- 172.21.15.116:0/549524872 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f02980b3f90 0x7f0298153540 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f0290009e20 tx=0x7f0290004a40 comp rx=0 tx=0).stop 2024-02-21T22:53:57.305 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.314+0000 7f029ccb0640 1 -- 172.21.15.116:0/549524872 shutdown_connections 2024-02-21T22:53:57.306 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.314+0000 7f029ccb0640 1 --2- 172.21.15.116:0/549524872 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f02980b3f90 0x7f0298153540 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:57.306 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.314+0000 7f029ccb0640 1 --2- 172.21.15.116:0/549524872 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f02980b0290 0x7f02980b1ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:57.306 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.314+0000 7f029ccb0640 1 --2- 172.21.15.116:0/549524872 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f027806b4d0 0x7f027806d990 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:57.306 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.314+0000 7f029ccb0640 1 --2- 172.21.15.116:0/549524872 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f029806b550 0x7f029814ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:57.306 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.314+0000 7f029ccb0640 1 -- 172.21.15.116:0/549524872 >> 172.21.15.116:0/549524872 conn(0x7f02980b29f0 msgr2=0x7f029806da90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:57.306 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.314+0000 7f029ccb0640 1 -- 172.21.15.116:0/549524872 shutdown_connections 2024-02-21T22:53:57.306 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.314+0000 7f029ccb0640 1 -- 172.21.15.116:0/549524872 wait complete. 2024-02-21T22:53:57.315 INFO:tasks.ceph:Scrubbing osd.3 2024-02-21T22:53:57.316 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-02-21T22:53:57.420 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.430+0000 7f1268036640 1 Processor -- start 2024-02-21T22:53:57.420 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.430+0000 7f1268036640 1 -- start start 2024-02-21T22:53:57.422 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.431+0000 7f1268036640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f126015df30 0x7f12600d2740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:57.422 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.431+0000 7f1268036640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12600d1240 con 0x7f12600d0af0 2024-02-21T22:53:57.422 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.431+0000 7f1268036640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12600cc510 con 0x7f1260162310 2024-02-21T22:53:57.422 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.431+0000 7f1268036640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12600cc2c0 con 0x7f126015df30 2024-02-21T22:53:57.422 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.431+0000 7f1265dd2640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f126015df30 0x7f12600d2740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:57.422 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.431+0000 7f12655d1640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f12600d0af0 0x7f1260161c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:40056/0 (socket says 172.21.15.116:40056) 2024-02-21T22:53:57.422 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.431+0000 7f1265dd2640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f126015df30 0x7f12600d2740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:56516/0 (socket says 172.21.15.116:56516) 2024-02-21T22:53:57.422 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.431+0000 7f12655d1640 1 -- 172.21.15.116:0/1536918808 learned_addr learned my addr 172.21.15.116:0/1536918808 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-02-21T22:53:57.423 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.431+0000 7f1265dd2640 1 -- 172.21.15.116:0/1536918808 >> v1:172.21.15.142:6789/0 conn(0x7f1260162310 legacy=0x7f1260167f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:57.423 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.431+0000 7f1265dd2640 1 -- 172.21.15.116:0/1536918808 >> v1:172.21.15.116:6789/0 conn(0x7f12600d0af0 legacy=0x7f1260161c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:57.423 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.431+0000 7f1264dd0640 1 -- 172.21.15.116:0/1536918808 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2219954660 0 0) 0x7f12600cc510 con 0x7f1260162310 2024-02-21T22:53:57.423 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.431+0000 7f1265dd2640 1 -- 172.21.15.116:0/1536918808 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12600cc7f0 con 0x7f126015df30 2024-02-21T22:53:57.428 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.432+0000 7f1265dd2640 1 --2- 172.21.15.116:0/1536918808 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f126015df30 0x7f12600d2740 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f125c0097a0 tx=0x7f125c02b710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1143f7b4c5678caf server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:57.428 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.432+0000 7f1264dd0640 1 -- 172.21.15.116:0/1536918808 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f125c037070 con 0x7f126015df30 2024-02-21T22:53:57.428 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.432+0000 7f1264dd0640 1 -- 172.21.15.116:0/1536918808 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f125c030710 con 0x7f126015df30 2024-02-21T22:53:57.428 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.432+0000 7f1264dd0640 1 -- 172.21.15.116:0/1536918808 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f125c030ae0 con 0x7f126015df30 2024-02-21T22:53:57.428 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.432+0000 7f1268036640 1 -- 172.21.15.116:0/1536918808 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f126015df30 msgr2=0x7f12600d2740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:57.428 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.432+0000 7f1268036640 1 --2- 172.21.15.116:0/1536918808 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f126015df30 0x7f12600d2740 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f125c0097a0 tx=0x7f125c02b710 comp rx=0 tx=0).stop 2024-02-21T22:53:57.428 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.433+0000 7f1268036640 1 -- 172.21.15.116:0/1536918808 shutdown_connections 2024-02-21T22:53:57.429 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.433+0000 7f1268036640 1 --2- 172.21.15.116:0/1536918808 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f126015df30 0x7f12600d2740 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:57.429 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.433+0000 7f1268036640 1 -- 172.21.15.116:0/1536918808 >> 172.21.15.116:0/1536918808 conn(0x7f126009afe0 msgr2=0x7f12600d1c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:57.429 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.433+0000 7f1268036640 1 -- 172.21.15.116:0/1536918808 shutdown_connections 2024-02-21T22:53:57.429 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.433+0000 7f1268036640 1 -- 172.21.15.116:0/1536918808 wait complete. 2024-02-21T22:53:57.429 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.434+0000 7f1268036640 1 Processor -- start 2024-02-21T22:53:57.429 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.434+0000 7f1268036640 1 -- start start 2024-02-21T22:53:57.429 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.434+0000 7f1268036640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f12600d0af0 0x7f12600b4770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:57.429 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.434+0000 7f1268036640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f126015df30 0x7f12601f4630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:57.429 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.434+0000 7f1268036640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1260162310 0x7f1260161690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:57.430 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.434+0000 7f1268036640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f126015e310 con 0x7f12600d0af0 2024-02-21T22:53:57.430 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.434+0000 7f1268036640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12600d0f60 con 0x7f1260162310 2024-02-21T22:53:57.430 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.434+0000 7f1268036640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f126015e490 con 0x7f126015df30 2024-02-21T22:53:57.430 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.435+0000 7f1265dd2640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f12600d0af0 0x7f12600b4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:57.430 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.435+0000 7f1265dd2640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f12600d0af0 0x7f12600b4770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:56520/0 (socket says 172.21.15.116:56520) 2024-02-21T22:53:57.430 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.435+0000 7f1265dd2640 1 -- 172.21.15.116:0/608977454 learned_addr learned my addr 172.21.15.116:0/608977454 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:57.430 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.435+0000 7f12665d3640 1 --2- 172.21.15.116:0/608977454 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1260162310 0x7f1260161690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:57.430 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.435+0000 7f12655d1640 1 --2- 172.21.15.116:0/608977454 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f126015df30 0x7f12601f4630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:57.431 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.435+0000 7f1265dd2640 1 -- 172.21.15.116:0/608977454 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f126015df30 msgr2=0x7f12601f4630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:57.431 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.435+0000 7f1265dd2640 1 --2- 172.21.15.116:0/608977454 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f126015df30 0x7f12601f4630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:57.431 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.435+0000 7f1265dd2640 1 -- 172.21.15.116:0/608977454 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1260162310 msgr2=0x7f1260161690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:57.431 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.435+0000 7f1265dd2640 1 --2- 172.21.15.116:0/608977454 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1260162310 0x7f1260161690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:57.431 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.435+0000 7f1265dd2640 1 -- 172.21.15.116:0/608977454 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12600b4e10 con 0x7f12600d0af0 2024-02-21T22:53:57.431 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.435+0000 7f1265dd2640 1 --2- 172.21.15.116:0/608977454 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f12600d0af0 0x7f12600b4770 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f125c0097a0 tx=0x7f125c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:57.431 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.435+0000 7f12567fc640 1 -- 172.21.15.116:0/608977454 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f125c037040 con 0x7f12600d0af0 2024-02-21T22:53:57.431 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.435+0000 7f12567fc640 1 -- 172.21.15.116:0/608977454 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f125c0329c0 con 0x7f12600d0af0 2024-02-21T22:53:57.431 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.435+0000 7f1268036640 1 -- 172.21.15.116:0/608977454 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12600b50f0 con 0x7f12600d0af0 2024-02-21T22:53:57.431 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.435+0000 7f12567fc640 1 -- 172.21.15.116:0/608977454 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f125c032d90 con 0x7f12600d0af0 2024-02-21T22:53:57.432 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.435+0000 7f1268036640 1 -- 172.21.15.116:0/608977454 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12600b56b0 con 0x7f12600d0af0 2024-02-21T22:53:57.432 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.436+0000 7f1268036640 1 -- 172.21.15.116:0/608977454 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f12600752f0 con 0x7f12600d0af0 2024-02-21T22:53:57.432 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.436+0000 7f12567fc640 1 -- 172.21.15.116:0/608977454 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f125c004030 con 0x7f12600d0af0 2024-02-21T22:53:57.432 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.437+0000 7f12567fc640 1 --2- 172.21.15.116:0/608977454 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f124406b4d0 0x7f124406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:57.432 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.437+0000 7f12567fc640 1 -- 172.21.15.116:0/608977454 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f125c0abf80 con 0x7f12600d0af0 2024-02-21T22:53:57.432 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.437+0000 7f12655d1640 1 --2- 172.21.15.116:0/608977454 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f124406b4d0 0x7f124406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:57.432 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.437+0000 7f12567fc640 1 --2- 172.21.15.116:0/608977454 >> [v2:172.21.15.116:6800/3106627557,v1:172.21.15.116:6801/3106627557] conn(0x7f1244073670 0x7f1244075a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:57.432 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.437+0000 7f12567fc640 1 -- 172.21.15.116:0/608977454 --> [v2:172.21.15.116:6800/3106627557,v1:172.21.15.116:6801/3106627557] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f125c008eb0 con 0x7f1244073670 2024-02-21T22:53:57.433 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.437+0000 7f12567fc640 1 -- 172.21.15.116:0/608977454 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f125c0ae620 con 0x7f12600d0af0 2024-02-21T22:53:57.433 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.437+0000 7f12665d3640 1 --2- 172.21.15.116:0/608977454 >> [v2:172.21.15.116:6800/3106627557,v1:172.21.15.116:6801/3106627557] conn(0x7f1244073670 0x7f1244075a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:57.433 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.437+0000 7f12655d1640 1 --2- 172.21.15.116:0/608977454 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f124406b4d0 0x7f124406d990 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f12600d2970 tx=0x7f1250007e20 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:57.433 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.437+0000 7f12665d3640 1 --2- 172.21.15.116:0/608977454 >> [v2:172.21.15.116:6800/3106627557,v1:172.21.15.116:6801/3106627557] conn(0x7f1244073670 0x7f1244075a90 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:57.433 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.438+0000 7f12567fc640 1 -- 172.21.15.116:0/608977454 <== osd.3 v2:172.21.15.116:6800/3106627557 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f125c008eb0 con 0x7f1244073670 2024-02-21T22:53:57.441 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.451+0000 7f1268036640 1 -- 172.21.15.116:0/608977454 --> [v2:172.21.15.116:6800/3106627557,v1:172.21.15.116:6801/3106627557] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f12600cf3d0 con 0x7f1244073670 2024-02-21T22:53:57.441 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.451+0000 7f12567fc640 1 -- 172.21.15.116:0/608977454 <== osd.3 v2:172.21.15.116:6800/3106627557 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f12600cf3d0 con 0x7f1244073670 2024-02-21T22:53:57.442 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-02-21T22:53:57.442 INFO:teuthology.orchestra.run.smithi116.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-02-21T22:53:57.442 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-02-21T22:53:57.443 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.451+0000 7f1268036640 1 -- 172.21.15.116:0/608977454 >> [v2:172.21.15.116:6800/3106627557,v1:172.21.15.116:6801/3106627557] conn(0x7f1244073670 msgr2=0x7f1244075a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:57.443 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.451+0000 7f1268036640 1 --2- 172.21.15.116:0/608977454 >> [v2:172.21.15.116:6800/3106627557,v1:172.21.15.116:6801/3106627557] conn(0x7f1244073670 0x7f1244075a90 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:57.443 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.451+0000 7f1268036640 1 -- 172.21.15.116:0/608977454 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f124406b4d0 msgr2=0x7f124406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:57.444 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.452+0000 7f1268036640 1 --2- 172.21.15.116:0/608977454 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f124406b4d0 0x7f124406d990 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f12600d2970 tx=0x7f1250007e20 comp rx=0 tx=0).stop 2024-02-21T22:53:57.444 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.452+0000 7f1268036640 1 -- 172.21.15.116:0/608977454 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f12600d0af0 msgr2=0x7f12600b4770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:57.444 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.452+0000 7f1268036640 1 --2- 172.21.15.116:0/608977454 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f12600d0af0 0x7f12600b4770 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f125c0097a0 tx=0x7f125c0046c0 comp rx=0 tx=0).stop 2024-02-21T22:53:57.444 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.452+0000 7f12665d3640 1 -- 172.21.15.116:0/608977454 reap_dead start 2024-02-21T22:53:57.444 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.452+0000 7f1268036640 1 -- 172.21.15.116:0/608977454 shutdown_connections 2024-02-21T22:53:57.444 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.452+0000 7f1268036640 1 -- 172.21.15.116:0/608977454 >> 172.21.15.116:0/608977454 conn(0x7f126009afe0 msgr2=0x7f126015c800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:57.444 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.452+0000 7f1268036640 1 -- 172.21.15.116:0/608977454 shutdown_connections 2024-02-21T22:53:57.444 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.452+0000 7f1268036640 1 -- 172.21.15.116:0/608977454 wait complete. 2024-02-21T22:53:57.452 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-02-21T22:53:57.555 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.565+0000 7ff0a531e640 1 Processor -- start 2024-02-21T22:53:57.556 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.565+0000 7ff0a531e640 1 -- start start 2024-02-21T22:53:57.558 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.566+0000 7ff0a531e640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7ff0a00d0510 0x7ff0a00d08f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:57.558 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.566+0000 7ff0a531e640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff0a00cb930 0x7ff0a00cbd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:57.558 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.566+0000 7ff0a531e640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0a00cfa50 con 0x7ff0a00d1c30 2024-02-21T22:53:57.558 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.566+0000 7ff0a531e640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0a00d1450 con 0x7ff0a00d0510 2024-02-21T22:53:57.559 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.566+0000 7ff0a531e640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0a00d0e30 con 0x7ff0a00cb930 2024-02-21T22:53:57.559 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.566+0000 7ff09effd640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7ff0a00d0510 0x7ff0a00d08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:57.559 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.566+0000 7ff097fff640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7ff0a00d1c30 0x7ff0a00d2430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:40072/0 (socket says 172.21.15.116:40072) 2024-02-21T22:53:57.559 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.566+0000 7ff097fff640 1 -- 172.21.15.116:0/2913745586 learned_addr learned my addr 172.21.15.116:0/2913745586 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-02-21T22:53:57.559 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.566+0000 7ff09f7fe640 1 --2- 172.21.15.116:0/2913745586 >> v2:172.21.15.142:3300/0 conn(0x7ff0a00cb930 0x7ff0a00cbd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:57.559 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.566+0000 7ff09effd640 1 -- 172.21.15.116:0/2913745586 >> v2:172.21.15.142:3300/0 conn(0x7ff0a00cb930 msgr2=0x7ff0a00cbd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:53:57.559 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.566+0000 7ff09effd640 1 --2- 172.21.15.116:0/2913745586 >> v2:172.21.15.142:3300/0 conn(0x7ff0a00cb930 0x7ff0a00cbd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:57.559 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.566+0000 7ff09effd640 1 -- 172.21.15.116:0/2913745586 >> v1:172.21.15.116:6789/0 conn(0x7ff0a00d1c30 legacy=0x7ff0a00d2430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:57.559 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.566+0000 7ff09effd640 1 -- 172.21.15.116:0/2913745586 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0a00cfcc0 con 0x7ff0a00d0510 2024-02-21T22:53:57.560 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.567+0000 7ff09effd640 1 --2- 172.21.15.116:0/2913745586 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff0a00d0510 0x7ff0a00d08f0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7ff0a00d15d0 tx=0x7ff09002b680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=519aa7143a3523bb server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:57.560 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.567+0000 7ff09e7fc640 1 -- 172.21.15.116:0/2913745586 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff090037070 con 0x7ff0a00d0510 2024-02-21T22:53:57.560 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.567+0000 7ff09e7fc640 1 -- 172.21.15.116:0/2913745586 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff090030710 con 0x7ff0a00d0510 2024-02-21T22:53:57.560 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.567+0000 7ff09e7fc640 1 -- 172.21.15.116:0/2913745586 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff090030ae0 con 0x7ff0a00d0510 2024-02-21T22:53:57.560 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.568+0000 7ff0a531e640 1 -- 172.21.15.116:0/2913745586 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff0a00d0510 msgr2=0x7ff0a00d08f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:57.560 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.568+0000 7ff0a531e640 1 --2- 172.21.15.116:0/2913745586 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff0a00d0510 0x7ff0a00d08f0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7ff0a00d15d0 tx=0x7ff09002b680 comp rx=0 tx=0).stop 2024-02-21T22:53:57.560 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.568+0000 7ff0a531e640 1 -- 172.21.15.116:0/2913745586 shutdown_connections 2024-02-21T22:53:57.560 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.568+0000 7ff0a531e640 1 --2- 172.21.15.116:0/2913745586 >> v2:172.21.15.142:3300/0 conn(0x7ff0a00cb930 0x7ff0a00cbd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:57.561 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.568+0000 7ff0a531e640 1 --2- 172.21.15.116:0/2913745586 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff0a00d0510 0x7ff0a00d08f0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:57.561 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.568+0000 7ff0a531e640 1 -- 172.21.15.116:0/2913745586 >> 172.21.15.116:0/2913745586 conn(0x7ff0a00d3e50 msgr2=0x7ff0a00d4260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:57.561 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.568+0000 7ff0a531e640 1 -- 172.21.15.116:0/2913745586 shutdown_connections 2024-02-21T22:53:57.561 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.568+0000 7ff0a531e640 1 -- 172.21.15.116:0/2913745586 wait complete. 2024-02-21T22:53:57.565 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.569+0000 7ff0a531e640 1 Processor -- start 2024-02-21T22:53:57.565 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.569+0000 7ff0a531e640 1 -- start start 2024-02-21T22:53:57.565 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.569+0000 7ff0a531e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff0a00cb930 0x7ff0a01e7370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:57.566 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.569+0000 7ff0a531e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff0a00d0510 0x7ff0a009e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:57.566 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.569+0000 7ff0a531e640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff0a00d1c30 0x7ff0a014bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:57.566 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.569+0000 7ff0a531e640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0a015e640 con 0x7ff0a00d1c30 2024-02-21T22:53:57.566 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.569+0000 7ff0a531e640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0a00d10e0 con 0x7ff0a00cb930 2024-02-21T22:53:57.566 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.569+0000 7ff0a531e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0a00cc2c0 con 0x7ff0a00d0510 2024-02-21T22:53:57.566 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.570+0000 7ff09f7fe640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff0a00d1c30 0x7ff0a014bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:57.566 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.570+0000 7ff09f7fe640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff0a00d1c30 0x7ff0a014bcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:56536/0 (socket says 172.21.15.116:56536) 2024-02-21T22:53:57.566 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.570+0000 7ff09f7fe640 1 -- 172.21.15.116:0/3801591442 learned_addr learned my addr 172.21.15.116:0/3801591442 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:57.566 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.570+0000 7ff097fff640 1 --2- 172.21.15.116:0/3801591442 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff0a00d0510 0x7ff0a009e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:57.567 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.570+0000 7ff09effd640 1 --2- 172.21.15.116:0/3801591442 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff0a00cb930 0x7ff0a01e7370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:57.567 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.570+0000 7ff09f7fe640 1 -- 172.21.15.116:0/3801591442 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff0a00d0510 msgr2=0x7ff0a009e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:57.567 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.570+0000 7ff09f7fe640 1 --2- 172.21.15.116:0/3801591442 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff0a00d0510 0x7ff0a009e5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:57.567 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.570+0000 7ff09f7fe640 1 -- 172.21.15.116:0/3801591442 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff0a00cb930 msgr2=0x7ff0a01e7370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:57.567 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.570+0000 7ff09f7fe640 1 --2- 172.21.15.116:0/3801591442 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff0a00cb930 0x7ff0a01e7370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:57.567 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.570+0000 7ff09f7fe640 1 -- 172.21.15.116:0/3801591442 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0a009f030 con 0x7ff0a00d1c30 2024-02-21T22:53:57.567 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.570+0000 7ff09f7fe640 1 --2- 172.21.15.116:0/3801591442 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff0a00d1c30 0x7ff0a014bcd0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7ff098009dd0 tx=0x7ff09800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:57.567 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.570+0000 7ff0977fe640 1 -- 172.21.15.116:0/3801591442 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff098018020 con 0x7ff0a00d1c30 2024-02-21T22:53:57.568 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.570+0000 7ff0977fe640 1 -- 172.21.15.116:0/3801591442 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff098014480 con 0x7ff0a00d1c30 2024-02-21T22:53:57.568 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.570+0000 7ff0a531e640 1 -- 172.21.15.116:0/3801591442 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0a009f310 con 0x7ff0a00d1c30 2024-02-21T22:53:57.568 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.570+0000 7ff0977fe640 1 -- 172.21.15.116:0/3801591442 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff098014870 con 0x7ff0a00d1c30 2024-02-21T22:53:57.568 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.570+0000 7ff0a531e640 1 -- 172.21.15.116:0/3801591442 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0a00a0330 con 0x7ff0a00d1c30 2024-02-21T22:53:57.568 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.571+0000 7ff0a531e640 1 -- 172.21.15.116:0/3801591442 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0a00752f0 con 0x7ff0a00d1c30 2024-02-21T22:53:57.568 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.572+0000 7ff0977fe640 1 -- 172.21.15.116:0/3801591442 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ff09801b020 con 0x7ff0a00d1c30 2024-02-21T22:53:57.568 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.572+0000 7ff0977fe640 1 --2- 172.21.15.116:0/3801591442 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7ff08006b4d0 0x7ff08006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:57.568 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.572+0000 7ff0977fe640 1 -- 172.21.15.116:0/3801591442 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff09808ac50 con 0x7ff0a00d1c30 2024-02-21T22:53:57.568 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.572+0000 7ff09effd640 1 --2- 172.21.15.116:0/3801591442 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7ff08006b4d0 0x7ff08006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:57.569 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.573+0000 7ff09effd640 1 --2- 172.21.15.116:0/3801591442 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7ff08006b4d0 0x7ff08006d990 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7ff090034000 tx=0x7ff090008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:57.569 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.576+0000 7ff0977fe640 1 -- 172.21.15.116:0/3801591442 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7ff098090020 con 0x7ff0a00d1c30 2024-02-21T22:53:57.739 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.748+0000 7ff0a531e640 1 -- 172.21.15.116:0/3801591442 --> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7ff0a00a0500 con 0x7ff08006b4d0 2024-02-21T22:53:57.740 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.749+0000 7ff0977fe640 1 -- 172.21.15.116:0/3801591442 <== mgr.4103 v2:172.21.15.142:6832/1381484782 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7ff0a00a0500 con 0x7ff08006b4d0 2024-02-21T22:53:57.740 INFO:teuthology.orchestra.run.smithi116.stderr:instructed osd(s) 3 to deep-scrub 2024-02-21T22:53:57.742 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.751+0000 7ff0a531e640 1 -- 172.21.15.116:0/3801591442 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7ff08006b4d0 msgr2=0x7ff08006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:57.742 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.751+0000 7ff0a531e640 1 --2- 172.21.15.116:0/3801591442 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7ff08006b4d0 0x7ff08006d990 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7ff090034000 tx=0x7ff090008030 comp rx=0 tx=0).stop 2024-02-21T22:53:57.742 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.751+0000 7ff0a531e640 1 -- 172.21.15.116:0/3801591442 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff0a00d1c30 msgr2=0x7ff0a014bcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:57.742 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.751+0000 7ff0a531e640 1 --2- 172.21.15.116:0/3801591442 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff0a00d1c30 0x7ff0a014bcd0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7ff098009dd0 tx=0x7ff09800c490 comp rx=0 tx=0).stop 2024-02-21T22:53:57.742 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.751+0000 7ff0a531e640 1 -- 172.21.15.116:0/3801591442 shutdown_connections 2024-02-21T22:53:57.743 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.751+0000 7ff0a531e640 1 --2- 172.21.15.116:0/3801591442 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff0a00d1c30 0x7ff0a014bcd0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:57.743 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.751+0000 7ff0a531e640 1 --2- 172.21.15.116:0/3801591442 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7ff08006b4d0 0x7ff08006d990 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:57.743 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.751+0000 7ff0a531e640 1 --2- 172.21.15.116:0/3801591442 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff0a00d0510 0x7ff0a009e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:57.743 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.751+0000 7ff0a531e640 1 --2- 172.21.15.116:0/3801591442 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff0a00cb930 0x7ff0a01e7370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:57.743 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.751+0000 7ff0a531e640 1 -- 172.21.15.116:0/3801591442 >> 172.21.15.116:0/3801591442 conn(0x7ff0a00d3e50 msgr2=0x7ff0a006b760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:57.743 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.751+0000 7ff0a531e640 1 -- 172.21.15.116:0/3801591442 shutdown_connections 2024-02-21T22:53:57.743 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.751+0000 7ff0a531e640 1 -- 172.21.15.116:0/3801591442 wait complete. 2024-02-21T22:53:57.753 INFO:tasks.ceph:Scrubbing osd.4 2024-02-21T22:53:57.753 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-02-21T22:53:57.857 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.866+0000 7fc25379c640 1 Processor -- start 2024-02-21T22:53:57.857 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.867+0000 7fc25379c640 1 -- start start 2024-02-21T22:53:57.860 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.867+0000 7fc25379c640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc24c0d2a60 0x7fc24c0ce980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:57.860 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.867+0000 7fc25379c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc24c0b50d0 0x7fc24c0ceec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:57.861 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.867+0000 7fc25379c640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc24c161ae0 con 0x7fc24c161700 2024-02-21T22:53:57.861 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.867+0000 7fc25379c640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc24c0b3c30 con 0x7fc24c0d2a60 2024-02-21T22:53:57.861 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.867+0000 7fc25379c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc24c0d4be0 con 0x7fc24c0b50d0 2024-02-21T22:53:57.861 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.867+0000 7fc251538640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7fc24c161700 0x7fc24c0d2350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:40074/0 (socket says 172.21.15.116:40074) 2024-02-21T22:53:57.861 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.867+0000 7fc251538640 1 -- 172.21.15.116:0/651322642 learned_addr learned my addr 172.21.15.116:0/651322642 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-02-21T22:53:57.862 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.867+0000 7fc251d39640 1 --2- 172.21.15.116:0/651322642 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc24c0b50d0 0x7fc24c0ceec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:57.862 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.868+0000 7fc250d37640 1 --2- 172.21.15.116:0/651322642 >> v2:172.21.15.142:3300/0 conn(0x7fc24c0d2a60 0x7fc24c0ce980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:57.862 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.868+0000 7fc243fff640 1 -- 172.21.15.116:0/651322642 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 99404353 0 0) 0x7fc248001110 con 0x7fc24c161700 2024-02-21T22:53:57.862 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.868+0000 7fc243fff640 1 -- 172.21.15.116:0/651322642 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc238003520 con 0x7fc24c161700 2024-02-21T22:53:57.862 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.868+0000 7fc250d37640 1 -- 172.21.15.116:0/651322642 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc24c0b50d0 msgr2=0x7fc24c0ceec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:53:57.862 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.868+0000 7fc250d37640 1 --2- 172.21.15.116:0/651322642 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc24c0b50d0 0x7fc24c0ceec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:57.862 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.868+0000 7fc250d37640 1 -- 172.21.15.116:0/651322642 >> v1:172.21.15.116:6789/0 conn(0x7fc24c161700 legacy=0x7fc24c0d2350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:57.863 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.868+0000 7fc250d37640 1 -- 172.21.15.116:0/651322642 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc24c0b3300 con 0x7fc24c0d2a60 2024-02-21T22:53:57.863 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.868+0000 7fc251d39640 1 --2- 172.21.15.116:0/651322642 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc24c0b50d0 0x7fc24c0ceec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T22:53:57.863 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.869+0000 7fc250d37640 1 --2- 172.21.15.116:0/651322642 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc24c0d2a60 0x7fc24c0ce980 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fc23c0097a0 tx=0x7fc23c02b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6496c76bbba356ff server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:57.863 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.869+0000 7fc243fff640 1 -- 172.21.15.116:0/651322642 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc23c035020 con 0x7fc24c0d2a60 2024-02-21T22:53:57.863 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.869+0000 7fc243fff640 1 -- 172.21.15.116:0/651322642 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc23c031830 con 0x7fc24c0d2a60 2024-02-21T22:53:57.863 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.869+0000 7fc243fff640 1 -- 172.21.15.116:0/651322642 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc23c031be0 con 0x7fc24c0d2a60 2024-02-21T22:53:57.864 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.869+0000 7fc25379c640 1 -- 172.21.15.116:0/651322642 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc24c0d2a60 msgr2=0x7fc24c0ce980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:57.865 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.869+0000 7fc25379c640 1 --2- 172.21.15.116:0/651322642 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc24c0d2a60 0x7fc24c0ce980 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fc23c0097a0 tx=0x7fc23c02b8d0 comp rx=0 tx=0).stop 2024-02-21T22:53:57.865 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.869+0000 7fc25379c640 1 -- 172.21.15.116:0/651322642 shutdown_connections 2024-02-21T22:53:57.865 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.869+0000 7fc25379c640 1 --2- 172.21.15.116:0/651322642 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc24c0b50d0 0x7fc24c0ceec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:57.865 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.869+0000 7fc25379c640 1 --2- 172.21.15.116:0/651322642 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc24c0d2a60 0x7fc24c0ce980 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:57.865 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.869+0000 7fc25379c640 1 -- 172.21.15.116:0/651322642 >> 172.21.15.116:0/651322642 conn(0x7fc24c0d3d70 msgr2=0x7fc24c0d4180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:57.865 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.869+0000 7fc25379c640 1 -- 172.21.15.116:0/651322642 shutdown_connections 2024-02-21T22:53:57.865 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.869+0000 7fc25379c640 1 -- 172.21.15.116:0/651322642 wait complete. 2024-02-21T22:53:57.870 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.870+0000 7fc25379c640 1 Processor -- start 2024-02-21T22:53:57.870 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.871+0000 7fc25379c640 1 -- start start 2024-02-21T22:53:57.870 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.871+0000 7fc25379c640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc24c0b50d0 0x7fc24c0ca290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:57.870 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.871+0000 7fc25379c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc24c0d2a60 0x7fc24c152050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:57.870 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.871+0000 7fc25379c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc24c161700 0x7fc24c0b6990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:57.871 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.871+0000 7fc25379c640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc24c0d4890 con 0x7fc24c0b50d0 2024-02-21T22:53:57.872 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.871+0000 7fc25379c640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc24c0b38c0 con 0x7fc24c0d2a60 2024-02-21T22:53:57.872 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.871+0000 7fc25379c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc24c0d0e40 con 0x7fc24c161700 2024-02-21T22:53:57.872 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.871+0000 7fc251538640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc24c0b50d0 0x7fc24c0ca290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:57.872 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.871+0000 7fc251538640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc24c0b50d0 0x7fc24c0ca290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:56552/0 (socket says 172.21.15.116:56552) 2024-02-21T22:53:57.872 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.871+0000 7fc251538640 1 -- 172.21.15.116:0/1455243426 learned_addr learned my addr 172.21.15.116:0/1455243426 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:57.872 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.871+0000 7fc250d37640 1 --2- 172.21.15.116:0/1455243426 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc24c0d2a60 0x7fc24c152050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:57.873 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.871+0000 7fc251d39640 1 --2- 172.21.15.116:0/1455243426 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc24c161700 0x7fc24c0b6990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:57.873 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.872+0000 7fc251538640 1 -- 172.21.15.116:0/1455243426 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc24c161700 msgr2=0x7fc24c0b6990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:57.873 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.872+0000 7fc251538640 1 --2- 172.21.15.116:0/1455243426 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc24c161700 0x7fc24c0b6990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:57.873 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.872+0000 7fc251538640 1 -- 172.21.15.116:0/1455243426 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc24c0d2a60 msgr2=0x7fc24c152050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:57.873 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.872+0000 7fc251538640 1 --2- 172.21.15.116:0/1455243426 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc24c0d2a60 0x7fc24c152050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:57.873 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.872+0000 7fc251538640 1 -- 172.21.15.116:0/1455243426 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc24c0cc470 con 0x7fc24c0b50d0 2024-02-21T22:53:57.873 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.872+0000 7fc251538640 1 --2- 172.21.15.116:0/1455243426 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc24c0b50d0 0x7fc24c0ca290 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fc24800c3a0 tx=0x7fc24800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:57.873 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.872+0000 7fc241ffb640 1 -- 172.21.15.116:0/1455243426 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc248017070 con 0x7fc24c0b50d0 2024-02-21T22:53:57.874 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.872+0000 7fc241ffb640 1 -- 172.21.15.116:0/1455243426 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc248005ce0 con 0x7fc24c0b50d0 2024-02-21T22:53:57.874 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.872+0000 7fc25379c640 1 -- 172.21.15.116:0/1455243426 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc24c0cc750 con 0x7fc24c0b50d0 2024-02-21T22:53:57.874 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.872+0000 7fc241ffb640 1 -- 172.21.15.116:0/1455243426 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc248007310 con 0x7fc24c0b50d0 2024-02-21T22:53:57.874 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.872+0000 7fc25379c640 1 -- 172.21.15.116:0/1455243426 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc24c0ccd10 con 0x7fc24c0b50d0 2024-02-21T22:53:57.874 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.873+0000 7fc25379c640 1 -- 172.21.15.116:0/1455243426 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc24c0752f0 con 0x7fc24c0b50d0 2024-02-21T22:53:57.874 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.873+0000 7fc241ffb640 1 -- 172.21.15.116:0/1455243426 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fc24801a070 con 0x7fc24c0b50d0 2024-02-21T22:53:57.874 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.874+0000 7fc241ffb640 1 --2- 172.21.15.116:0/1455243426 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fc23006b4d0 0x7fc23006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:57.874 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.874+0000 7fc241ffb640 1 -- 172.21.15.116:0/1455243426 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc248089520 con 0x7fc24c0b50d0 2024-02-21T22:53:57.875 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.874+0000 7fc250d37640 1 --2- 172.21.15.116:0/1455243426 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fc23006b4d0 0x7fc23006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:57.875 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.874+0000 7fc241ffb640 1 --2- 172.21.15.116:0/1455243426 >> [v2:172.21.15.142:6824/3231407772,v1:172.21.15.142:6825/3231407772] conn(0x7fc230073670 0x7fc230075a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:57.875 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.874+0000 7fc241ffb640 1 -- 172.21.15.116:0/1455243426 --> [v2:172.21.15.142:6824/3231407772,v1:172.21.15.142:6825/3231407772] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc248014ec0 con 0x7fc230073670 2024-02-21T22:53:57.875 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.874+0000 7fc241ffb640 1 -- 172.21.15.116:0/1455243426 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc248090050 con 0x7fc24c0b50d0 2024-02-21T22:53:57.875 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.874+0000 7fc251d39640 1 --2- 172.21.15.116:0/1455243426 >> [v2:172.21.15.142:6824/3231407772,v1:172.21.15.142:6825/3231407772] conn(0x7fc230073670 0x7fc230075a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:57.875 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.874+0000 7fc250d37640 1 --2- 172.21.15.116:0/1455243426 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fc23006b4d0 0x7fc23006d990 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fc23c036000 tx=0x7fc23c008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:57.875 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.875+0000 7fc251d39640 1 --2- 172.21.15.116:0/1455243426 >> [v2:172.21.15.142:6824/3231407772,v1:172.21.15.142:6825/3231407772] conn(0x7fc230073670 0x7fc230075a90 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:57.875 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.875+0000 7fc241ffb640 1 -- 172.21.15.116:0/1455243426 <== osd.4 v2:172.21.15.142:6824/3231407772 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fc248014ec0 con 0x7fc230073670 2024-02-21T22:53:57.879 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.889+0000 7fc25379c640 1 -- 172.21.15.116:0/1455243426 --> [v2:172.21.15.142:6824/3231407772,v1:172.21.15.142:6825/3231407772] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fc24c0c74b0 con 0x7fc230073670 2024-02-21T22:53:57.879 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.889+0000 7fc241ffb640 1 -- 172.21.15.116:0/1455243426 <== osd.4 v2:172.21.15.142:6824/3231407772 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fc24c0c74b0 con 0x7fc230073670 2024-02-21T22:53:57.880 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-02-21T22:53:57.880 INFO:teuthology.orchestra.run.smithi116.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-02-21T22:53:57.880 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-02-21T22:53:57.881 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.889+0000 7fc25379c640 1 -- 172.21.15.116:0/1455243426 >> [v2:172.21.15.142:6824/3231407772,v1:172.21.15.142:6825/3231407772] conn(0x7fc230073670 msgr2=0x7fc230075a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:57.881 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.889+0000 7fc25379c640 1 --2- 172.21.15.116:0/1455243426 >> [v2:172.21.15.142:6824/3231407772,v1:172.21.15.142:6825/3231407772] conn(0x7fc230073670 0x7fc230075a90 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:57.882 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.889+0000 7fc25379c640 1 -- 172.21.15.116:0/1455243426 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fc23006b4d0 msgr2=0x7fc23006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:57.882 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.889+0000 7fc25379c640 1 --2- 172.21.15.116:0/1455243426 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fc23006b4d0 0x7fc23006d990 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fc23c036000 tx=0x7fc23c008030 comp rx=0 tx=0).stop 2024-02-21T22:53:57.882 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.889+0000 7fc25379c640 1 -- 172.21.15.116:0/1455243426 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc24c0b50d0 msgr2=0x7fc24c0ca290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:57.882 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.889+0000 7fc25379c640 1 --2- 172.21.15.116:0/1455243426 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc24c0b50d0 0x7fc24c0ca290 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fc24800c3a0 tx=0x7fc24800c860 comp rx=0 tx=0).stop 2024-02-21T22:53:57.882 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.889+0000 7fc251d39640 1 -- 172.21.15.116:0/1455243426 reap_dead start 2024-02-21T22:53:57.882 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.889+0000 7fc25379c640 1 -- 172.21.15.116:0/1455243426 shutdown_connections 2024-02-21T22:53:57.882 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.889+0000 7fc25379c640 1 -- 172.21.15.116:0/1455243426 >> 172.21.15.116:0/1455243426 conn(0x7fc24c0d3d70 msgr2=0x7fc24c0cfb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:57.883 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.889+0000 7fc25379c640 1 -- 172.21.15.116:0/1455243426 shutdown_connections 2024-02-21T22:53:57.883 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:57.889+0000 7fc25379c640 1 -- 172.21.15.116:0/1455243426 wait complete. 2024-02-21T22:53:57.890 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-02-21T22:53:57.993 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.002+0000 7f44b6d1e640 1 Processor -- start 2024-02-21T22:53:57.993 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.002+0000 7f44b6d1e640 1 -- start start 2024-02-21T22:53:57.995 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.003+0000 7f44b6d1e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f44b00d1c30 0x7f44b00d2430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:57.996 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.003+0000 7f44b6d1e640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f44b00cb930 0x7f44b00cbdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:57.996 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.003+0000 7f44b6d1e640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44b00cfa50 con 0x7f44b00d0510 2024-02-21T22:53:57.996 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.003+0000 7f44b6d1e640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44b00d1450 con 0x7f44b00cb930 2024-02-21T22:53:57.996 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.003+0000 7f44b6d1e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44b00cfcc0 con 0x7f44b00d1c30 2024-02-21T22:53:57.996 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.003+0000 7f44b4aba640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f44b00d0510 0x7f44b00d08f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:40082/0 (socket says 172.21.15.116:40082) 2024-02-21T22:53:57.997 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.003+0000 7f44b4aba640 1 -- 172.21.15.116:0/3085264168 learned_addr learned my addr 172.21.15.116:0/3085264168 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-02-21T22:53:57.997 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.003+0000 7f44affff640 1 --2- 172.21.15.116:0/3085264168 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f44b00d1c30 0x7f44b00d2430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:57.997 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.003+0000 7f44b52bb640 1 --2- 172.21.15.116:0/3085264168 >> v2:172.21.15.142:3300/0 conn(0x7f44b00cb930 0x7f44b00cbdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:57.997 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.003+0000 7f44af7fe640 1 -- 172.21.15.116:0/3085264168 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2577836904 0 0) 0x7f44b00cfa50 con 0x7f44b00d0510 2024-02-21T22:53:57.997 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.003+0000 7f44af7fe640 1 -- 172.21.15.116:0/3085264168 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4498003520 con 0x7f44b00d0510 2024-02-21T22:53:57.997 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.003+0000 7f44affff640 1 -- 172.21.15.116:0/3085264168 >> v2:172.21.15.142:3300/0 conn(0x7f44b00cb930 msgr2=0x7f44b00cbdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:53:57.997 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.003+0000 7f44affff640 1 --2- 172.21.15.116:0/3085264168 >> v2:172.21.15.142:3300/0 conn(0x7f44b00cb930 0x7f44b00cbdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:57.997 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.003+0000 7f44affff640 1 -- 172.21.15.116:0/3085264168 >> v1:172.21.15.116:6789/0 conn(0x7f44b00d0510 legacy=0x7f44b00d08f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:57.997 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.003+0000 7f44affff640 1 -- 172.21.15.116:0/3085264168 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44b00cffa0 con 0x7f44b00d1c30 2024-02-21T22:53:57.998 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.003+0000 7f44b52bb640 1 --2- 172.21.15.116:0/3085264168 >> v2:172.21.15.142:3300/0 conn(0x7f44b00cb930 0x7f44b00cbdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T22:53:57.998 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.004+0000 7f44affff640 1 --2- 172.21.15.116:0/3085264168 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f44b00d1c30 0x7f44b00d2430 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f44a40097a0 tx=0x7f44a402b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=30e380788c8181c7 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:57.998 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.004+0000 7f44af7fe640 1 -- 172.21.15.116:0/3085264168 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44a40315a0 con 0x7f44b00d1c30 2024-02-21T22:53:57.998 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.004+0000 7f44af7fe640 1 -- 172.21.15.116:0/3085264168 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44a4037070 con 0x7f44b00d1c30 2024-02-21T22:53:57.998 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.004+0000 7f44af7fe640 1 -- 172.21.15.116:0/3085264168 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44a4031940 con 0x7f44b00d1c30 2024-02-21T22:53:58.001 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.005+0000 7f44b6d1e640 1 -- 172.21.15.116:0/3085264168 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f44b00d1c30 msgr2=0x7f44b00d2430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:58.002 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.005+0000 7f44b6d1e640 1 --2- 172.21.15.116:0/3085264168 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f44b00d1c30 0x7f44b00d2430 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f44a40097a0 tx=0x7f44a402b840 comp rx=0 tx=0).stop 2024-02-21T22:53:58.002 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.005+0000 7f44b6d1e640 1 -- 172.21.15.116:0/3085264168 shutdown_connections 2024-02-21T22:53:58.002 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.005+0000 7f44b6d1e640 1 --2- 172.21.15.116:0/3085264168 >> v2:172.21.15.142:3300/0 conn(0x7f44b00cb930 0x7f44b00cbdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:58.002 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.005+0000 7f44b6d1e640 1 --2- 172.21.15.116:0/3085264168 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f44b00d1c30 0x7f44b00d2430 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:58.002 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.005+0000 7f44b6d1e640 1 -- 172.21.15.116:0/3085264168 >> 172.21.15.116:0/3085264168 conn(0x7f44b00d3e50 msgr2=0x7f44b00d4260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:58.002 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.005+0000 7f44b6d1e640 1 -- 172.21.15.116:0/3085264168 shutdown_connections 2024-02-21T22:53:58.002 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.005+0000 7f44b6d1e640 1 -- 172.21.15.116:0/3085264168 wait complete. 2024-02-21T22:53:58.002 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.006+0000 7f44b6d1e640 1 Processor -- start 2024-02-21T22:53:58.003 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.006+0000 7f44b6d1e640 1 -- start start 2024-02-21T22:53:58.003 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.007+0000 7f44b6d1e640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f44b00cb930 0x7f44b0151430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:58.003 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.007+0000 7f44b6d1e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f44b00d0510 0x7f44b0156290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:58.003 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.007+0000 7f44b6d1e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f44b00d1c30 0x7f44b0160290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:58.003 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.007+0000 7f44b6d1e640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44b00d2970 con 0x7f44b00cb930 2024-02-21T22:53:58.003 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.007+0000 7f44b6d1e640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44b015e640 con 0x7f44b00d0510 2024-02-21T22:53:58.003 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.007+0000 7f44b6d1e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44b00d2af0 con 0x7f44b00d1c30 2024-02-21T22:53:58.003 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.007+0000 7f44b4aba640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f44b00cb930 0x7f44b0151430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:58.003 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.007+0000 7f44b4aba640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f44b00cb930 0x7f44b0151430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:56556/0 (socket says 172.21.15.116:56556) 2024-02-21T22:53:58.004 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.007+0000 7f44b4aba640 1 -- 172.21.15.116:0/3355941418 learned_addr learned my addr 172.21.15.116:0/3355941418 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:58.004 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.007+0000 7f44b52bb640 1 --2- 172.21.15.116:0/3355941418 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f44b00d1c30 0x7f44b0160290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:58.004 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.007+0000 7f44affff640 1 --2- 172.21.15.116:0/3355941418 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f44b00d0510 0x7f44b0156290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:58.004 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.007+0000 7f44b4aba640 1 -- 172.21.15.116:0/3355941418 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f44b00d1c30 msgr2=0x7f44b0160290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:58.004 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.007+0000 7f44b4aba640 1 --2- 172.21.15.116:0/3355941418 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f44b00d1c30 0x7f44b0160290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:58.004 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.007+0000 7f44b4aba640 1 -- 172.21.15.116:0/3355941418 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f44b00d0510 msgr2=0x7f44b0156290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:58.004 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.007+0000 7f44b4aba640 1 --2- 172.21.15.116:0/3355941418 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f44b00d0510 0x7f44b0156290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:58.004 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.007+0000 7f44b4aba640 1 -- 172.21.15.116:0/3355941418 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44b0156ec0 con 0x7f44b00cb930 2024-02-21T22:53:58.005 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.008+0000 7f44b4aba640 1 --2- 172.21.15.116:0/3355941418 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f44b00cb930 0x7f44b0151430 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f44a000c430 tx=0x7f44a000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:58.005 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.008+0000 7f44ad7fa640 1 -- 172.21.15.116:0/3355941418 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44a0017070 con 0x7f44b00cb930 2024-02-21T22:53:58.005 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.008+0000 7f44ad7fa640 1 -- 172.21.15.116:0/3355941418 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44a0005ce0 con 0x7f44b00cb930 2024-02-21T22:53:58.005 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.008+0000 7f44b6d1e640 1 -- 172.21.15.116:0/3355941418 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44b0156be0 con 0x7f44b00cb930 2024-02-21T22:53:58.005 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.008+0000 7f44ad7fa640 1 -- 172.21.15.116:0/3355941418 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44a00072f0 con 0x7f44b00cb930 2024-02-21T22:53:58.005 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.008+0000 7f44b6d1e640 1 -- 172.21.15.116:0/3355941418 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44b0153db0 con 0x7f44b00cb930 2024-02-21T22:53:58.005 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.009+0000 7f44b6d1e640 1 -- 172.21.15.116:0/3355941418 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44b00752f0 con 0x7f44b00cb930 2024-02-21T22:53:58.005 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.009+0000 7f44ad7fa640 1 -- 172.21.15.116:0/3355941418 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f44a001a070 con 0x7f44b00cb930 2024-02-21T22:53:58.005 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.009+0000 7f44ad7fa640 1 --2- 172.21.15.116:0/3355941418 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f449c06b4d0 0x7f449c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:58.006 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.010+0000 7f44ad7fa640 1 -- 172.21.15.116:0/3355941418 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f44a0089540 con 0x7f44b00cb930 2024-02-21T22:53:58.006 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.010+0000 7f44affff640 1 --2- 172.21.15.116:0/3355941418 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f449c06b4d0 0x7f449c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:58.006 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.010+0000 7f44affff640 1 --2- 172.21.15.116:0/3355941418 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f449c06b4d0 0x7f449c06d990 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f44a4036000 tx=0x7f44a403d040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:58.006 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.014+0000 7f44ad7fa640 1 -- 172.21.15.116:0/3355941418 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f44a0057d70 con 0x7f44b00cb930 2024-02-21T22:53:58.175 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.185+0000 7f44b6d1e640 1 -- 172.21.15.116:0/3355941418 --> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f44b015b8d0 con 0x7f449c06b4d0 2024-02-21T22:53:58.176 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.185+0000 7f44ad7fa640 1 -- 172.21.15.116:0/3355941418 <== mgr.4103 v2:172.21.15.142:6832/1381484782 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f44b015b8d0 con 0x7f449c06b4d0 2024-02-21T22:53:58.176 INFO:teuthology.orchestra.run.smithi116.stderr:instructed osd(s) 4 to deep-scrub 2024-02-21T22:53:58.180 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.187+0000 7f44b6d1e640 1 -- 172.21.15.116:0/3355941418 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f449c06b4d0 msgr2=0x7f449c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:58.180 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.187+0000 7f44b6d1e640 1 --2- 172.21.15.116:0/3355941418 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f449c06b4d0 0x7f449c06d990 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f44a4036000 tx=0x7f44a403d040 comp rx=0 tx=0).stop 2024-02-21T22:53:58.180 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.187+0000 7f44b6d1e640 1 -- 172.21.15.116:0/3355941418 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f44b00cb930 msgr2=0x7f44b0151430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:58.180 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.187+0000 7f44b6d1e640 1 --2- 172.21.15.116:0/3355941418 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f44b00cb930 0x7f44b0151430 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f44a000c430 tx=0x7f44a000c830 comp rx=0 tx=0).stop 2024-02-21T22:53:58.180 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.187+0000 7f44b6d1e640 1 -- 172.21.15.116:0/3355941418 shutdown_connections 2024-02-21T22:53:58.181 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.187+0000 7f44b6d1e640 1 --2- 172.21.15.116:0/3355941418 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f449c06b4d0 0x7f449c06d990 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:58.181 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.187+0000 7f44b6d1e640 1 --2- 172.21.15.116:0/3355941418 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f44b00d1c30 0x7f44b0160290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:58.181 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.187+0000 7f44b6d1e640 1 --2- 172.21.15.116:0/3355941418 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f44b00d0510 0x7f44b0156290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:58.181 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.187+0000 7f44b6d1e640 1 --2- 172.21.15.116:0/3355941418 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f44b00cb930 0x7f44b0151430 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:58.181 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.187+0000 7f44b6d1e640 1 -- 172.21.15.116:0/3355941418 >> 172.21.15.116:0/3355941418 conn(0x7f44b00d3e50 msgr2=0x7f44b015baf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:58.181 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.188+0000 7f44b6d1e640 1 -- 172.21.15.116:0/3355941418 shutdown_connections 2024-02-21T22:53:58.181 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.188+0000 7f44b6d1e640 1 -- 172.21.15.116:0/3355941418 wait complete. 2024-02-21T22:53:58.189 INFO:tasks.ceph:Scrubbing osd.5 2024-02-21T22:53:58.189 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-02-21T22:53:58.295 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.305+0000 7fcd85005640 1 Processor -- start 2024-02-21T22:53:58.295 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.305+0000 7fcd85005640 1 -- start start 2024-02-21T22:53:58.297 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.306+0000 7fcd85005640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fcd8015e190 0x7fcd800cf430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:58.297 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.306+0000 7fcd85005640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fcd800d1d40 0x7fcd800d23f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:58.297 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.306+0000 7fcd85005640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd800d2d40 con 0x7fcd800d2930 2024-02-21T22:53:58.297 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.306+0000 7fcd85005640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd800cfc80 con 0x7fcd8015e190 2024-02-21T22:53:58.298 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.306+0000 7fcd85005640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd800cff60 con 0x7fcd800d1d40 2024-02-21T22:53:58.298 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.306+0000 7fcd7ed9d640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fcd8015e190 0x7fcd800cf430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:58.298 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.306+0000 7fcd7ed9d640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fcd8015e190 0x7fcd800cf430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:56564/0 (socket says 172.21.15.116:56564) 2024-02-21T22:53:58.298 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.306+0000 7fcd7ed9d640 1 -- 172.21.15.116:0/1163732063 learned_addr learned my addr 172.21.15.116:0/1163732063 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:58.298 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.306+0000 7fcd7e59c640 1 --2- 172.21.15.116:0/1163732063 >> v2:172.21.15.142:3300/0 conn(0x7fcd800d1d40 0x7fcd800d23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:58.298 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.307+0000 7fcd7ed9d640 1 -- 172.21.15.116:0/1163732063 >> v2:172.21.15.142:3300/0 conn(0x7fcd800d1d40 msgr2=0x7fcd800d23f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:53:58.298 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.307+0000 7fcd7ed9d640 1 --2- 172.21.15.116:0/1163732063 >> v2:172.21.15.142:3300/0 conn(0x7fcd800d1d40 0x7fcd800d23f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:58.298 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.307+0000 7fcd7ed9d640 1 -- 172.21.15.116:0/1163732063 >> v1:172.21.15.142:6789/0 conn(0x7fcd800d2930 legacy=0x7fcd800d0570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:58.299 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.307+0000 7fcd7ed9d640 1 -- 172.21.15.116:0/1163732063 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd800b3770 con 0x7fcd8015e190 2024-02-21T22:53:58.300 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.307+0000 7fcd7ed9d640 1 --2- 172.21.15.116:0/1163732063 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcd8015e190 0x7fcd800cf430 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fcd8008e570 tx=0x7fcd7402ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=893d0760e66d1d5b server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:58.300 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.308+0000 7fcd7dd9b640 1 -- 172.21.15.116:0/1163732063 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd7402f850 con 0x7fcd8015e190 2024-02-21T22:53:58.300 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.308+0000 7fcd7dd9b640 1 -- 172.21.15.116:0/1163732063 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd7402f9f0 con 0x7fcd8015e190 2024-02-21T22:53:58.300 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.308+0000 7fcd7dd9b640 1 -- 172.21.15.116:0/1163732063 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd7402fdc0 con 0x7fcd8015e190 2024-02-21T22:53:58.300 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.308+0000 7fcd85005640 1 -- 172.21.15.116:0/1163732063 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcd8015e190 msgr2=0x7fcd800cf430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:58.300 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.308+0000 7fcd85005640 1 --2- 172.21.15.116:0/1163732063 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcd8015e190 0x7fcd800cf430 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fcd8008e570 tx=0x7fcd7402ba30 comp rx=0 tx=0).stop 2024-02-21T22:53:58.301 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.308+0000 7fcd85005640 1 -- 172.21.15.116:0/1163732063 shutdown_connections 2024-02-21T22:53:58.301 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.308+0000 7fcd85005640 1 --2- 172.21.15.116:0/1163732063 >> v2:172.21.15.142:3300/0 conn(0x7fcd800d1d40 0x7fcd800d23f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:58.301 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.308+0000 7fcd85005640 1 --2- 172.21.15.116:0/1163732063 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcd8015e190 0x7fcd800cf430 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:58.301 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.308+0000 7fcd85005640 1 -- 172.21.15.116:0/1163732063 >> 172.21.15.116:0/1163732063 conn(0x7fcd800d3e10 msgr2=0x7fcd800d4220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:58.301 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.308+0000 7fcd85005640 1 -- 172.21.15.116:0/1163732063 shutdown_connections 2024-02-21T22:53:58.301 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.308+0000 7fcd85005640 1 -- 172.21.15.116:0/1163732063 wait complete. 2024-02-21T22:53:58.304 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.311+0000 7fcd85005640 1 Processor -- start 2024-02-21T22:53:58.304 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.311+0000 7fcd85005640 1 -- start start 2024-02-21T22:53:58.304 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.312+0000 7fcd85005640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcd800d1d40 0x7fcd80149920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:58.304 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.312+0000 7fcd85005640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcd800d2930 0x7fcd80149e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:58.304 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.312+0000 7fcd85005640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcd8015e190 0x7fcd8015f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:58.304 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.312+0000 7fcd85005640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd800cf970 con 0x7fcd800d1d40 2024-02-21T22:53:58.304 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.312+0000 7fcd85005640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd800b3d30 con 0x7fcd800d2930 2024-02-21T22:53:58.305 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.312+0000 7fcd85005640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd8015e570 con 0x7fcd8015e190 2024-02-21T22:53:58.305 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.312+0000 7fcd7ed9d640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcd800d1d40 0x7fcd80149920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:58.305 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.312+0000 7fcd7e59c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcd800d2930 0x7fcd80149e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:58.305 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.312+0000 7fcd7ed9d640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcd800d1d40 0x7fcd80149920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:56580/0 (socket says 172.21.15.116:56580) 2024-02-21T22:53:58.305 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.312+0000 7fcd7ed9d640 1 -- 172.21.15.116:0/2458846751 learned_addr learned my addr 172.21.15.116:0/2458846751 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:58.305 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.312+0000 7fcd7f59e640 1 --2- 172.21.15.116:0/2458846751 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcd8015e190 0x7fcd8015f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:58.305 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.312+0000 7fcd7ed9d640 1 -- 172.21.15.116:0/2458846751 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcd8015e190 msgr2=0x7fcd8015f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:58.305 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.312+0000 7fcd7ed9d640 1 --2- 172.21.15.116:0/2458846751 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcd8015e190 0x7fcd8015f8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:58.306 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.312+0000 7fcd7ed9d640 1 -- 172.21.15.116:0/2458846751 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcd800d2930 msgr2=0x7fcd80149e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:58.306 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.312+0000 7fcd7ed9d640 1 --2- 172.21.15.116:0/2458846751 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcd800d2930 0x7fcd80149e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:58.306 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.312+0000 7fcd7ed9d640 1 -- 172.21.15.116:0/2458846751 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd801609a0 con 0x7fcd800d1d40 2024-02-21T22:53:58.306 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.312+0000 7fcd7ed9d640 1 --2- 172.21.15.116:0/2458846751 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcd800d1d40 0x7fcd80149920 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fcd7402ba70 tx=0x7fcd74004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:58.306 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.313+0000 7fcd677fe640 1 -- 172.21.15.116:0/2458846751 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd74037d10 con 0x7fcd800d1d40 2024-02-21T22:53:58.306 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.313+0000 7fcd677fe640 1 -- 172.21.15.116:0/2458846751 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd74046070 con 0x7fcd800d1d40 2024-02-21T22:53:58.306 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.313+0000 7fcd85005640 1 -- 172.21.15.116:0/2458846751 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd80160c80 con 0x7fcd800d1d40 2024-02-21T22:53:58.306 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.313+0000 7fcd677fe640 1 -- 172.21.15.116:0/2458846751 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd74041640 con 0x7fcd800d1d40 2024-02-21T22:53:58.306 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.313+0000 7fcd85005640 1 -- 172.21.15.116:0/2458846751 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd80161240 con 0x7fcd800d1d40 2024-02-21T22:53:58.307 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.314+0000 7fcd85005640 1 -- 172.21.15.116:0/2458846751 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fcd80161480 con 0x7fcd800d1d40 2024-02-21T22:53:58.308 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.314+0000 7fcd677fe640 1 -- 172.21.15.116:0/2458846751 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fcd74040070 con 0x7fcd800d1d40 2024-02-21T22:53:58.308 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.315+0000 7fcd677fe640 1 --2- 172.21.15.116:0/2458846751 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fcd6c06b4d0 0x7fcd6c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:58.308 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.315+0000 7fcd677fe640 1 -- 172.21.15.116:0/2458846751 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcd740ac7d0 con 0x7fcd800d1d40 2024-02-21T22:53:58.308 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.315+0000 7fcd7e59c640 1 --2- 172.21.15.116:0/2458846751 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fcd6c06b4d0 0x7fcd6c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:58.309 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.315+0000 7fcd677fe640 1 --2- 172.21.15.116:0/2458846751 >> [v2:172.21.15.142:6816/1184158716,v1:172.21.15.142:6817/1184158716] conn(0x7fcd6c073670 0x7fcd6c075a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:58.309 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.315+0000 7fcd677fe640 1 -- 172.21.15.116:0/2458846751 --> [v2:172.21.15.142:6816/1184158716,v1:172.21.15.142:6817/1184158716] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fcd6c076140 con 0x7fcd6c073670 2024-02-21T22:53:58.309 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.315+0000 7fcd677fe640 1 -- 172.21.15.116:0/2458846751 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcd740b3050 con 0x7fcd800d1d40 2024-02-21T22:53:58.309 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.315+0000 7fcd7f59e640 1 --2- 172.21.15.116:0/2458846751 >> [v2:172.21.15.142:6816/1184158716,v1:172.21.15.142:6817/1184158716] conn(0x7fcd6c073670 0x7fcd6c075a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:58.309 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.315+0000 7fcd7e59c640 1 --2- 172.21.15.116:0/2458846751 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fcd6c06b4d0 0x7fcd6c06d990 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fcd80153a00 tx=0x7fcd70009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:58.309 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.316+0000 7fcd7f59e640 1 --2- 172.21.15.116:0/2458846751 >> [v2:172.21.15.142:6816/1184158716,v1:172.21.15.142:6817/1184158716] conn(0x7fcd6c073670 0x7fcd6c075a90 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:58.309 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.316+0000 7fcd677fe640 1 -- 172.21.15.116:0/2458846751 <== osd.5 v2:172.21.15.142:6816/1184158716 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fcd6c076140 con 0x7fcd6c073670 2024-02-21T22:53:58.319 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.329+0000 7fcd85005640 1 -- 172.21.15.116:0/2458846751 --> [v2:172.21.15.142:6816/1184158716,v1:172.21.15.142:6817/1184158716] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fcd800752f0 con 0x7fcd6c073670 2024-02-21T22:53:58.320 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.329+0000 7fcd677fe640 1 -- 172.21.15.116:0/2458846751 <== osd.5 v2:172.21.15.142:6816/1184158716 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fcd800752f0 con 0x7fcd6c073670 2024-02-21T22:53:58.320 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-02-21T22:53:58.320 INFO:teuthology.orchestra.run.smithi116.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-02-21T22:53:58.320 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-02-21T22:53:58.321 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.330+0000 7fcd85005640 1 -- 172.21.15.116:0/2458846751 >> [v2:172.21.15.142:6816/1184158716,v1:172.21.15.142:6817/1184158716] conn(0x7fcd6c073670 msgr2=0x7fcd6c075a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:58.322 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.330+0000 7fcd85005640 1 --2- 172.21.15.116:0/2458846751 >> [v2:172.21.15.142:6816/1184158716,v1:172.21.15.142:6817/1184158716] conn(0x7fcd6c073670 0x7fcd6c075a90 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:58.322 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.330+0000 7fcd85005640 1 -- 172.21.15.116:0/2458846751 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fcd6c06b4d0 msgr2=0x7fcd6c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:58.322 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.330+0000 7fcd85005640 1 --2- 172.21.15.116:0/2458846751 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fcd6c06b4d0 0x7fcd6c06d990 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fcd80153a00 tx=0x7fcd70009190 comp rx=0 tx=0).stop 2024-02-21T22:53:58.322 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.330+0000 7fcd85005640 1 -- 172.21.15.116:0/2458846751 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcd800d1d40 msgr2=0x7fcd80149920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:58.322 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.330+0000 7fcd85005640 1 --2- 172.21.15.116:0/2458846751 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcd800d1d40 0x7fcd80149920 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fcd7402ba70 tx=0x7fcd74004730 comp rx=0 tx=0).stop 2024-02-21T22:53:58.322 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.330+0000 7fcd7f59e640 1 -- 172.21.15.116:0/2458846751 reap_dead start 2024-02-21T22:53:58.322 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.330+0000 7fcd85005640 1 -- 172.21.15.116:0/2458846751 shutdown_connections 2024-02-21T22:53:58.322 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.330+0000 7fcd85005640 1 -- 172.21.15.116:0/2458846751 >> 172.21.15.116:0/2458846751 conn(0x7fcd800d3e10 msgr2=0x7fcd800b5a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:58.323 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.330+0000 7fcd85005640 1 -- 172.21.15.116:0/2458846751 shutdown_connections 2024-02-21T22:53:58.323 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.330+0000 7fcd85005640 1 -- 172.21.15.116:0/2458846751 wait complete. 2024-02-21T22:53:58.331 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-02-21T22:53:58.434 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.444+0000 7fe418eb0640 1 Processor -- start 2024-02-21T22:53:58.434 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.444+0000 7fe418eb0640 1 -- start start 2024-02-21T22:53:58.436 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.445+0000 7fe418eb0640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fe414071990 0x7fe414071e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:58.436 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.445+0000 7fe418eb0640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fe4140b3d30 0x7fe4140b4160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:58.436 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.445+0000 7fe418eb0640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe41415fd00 con 0x7fe4141456c0 2024-02-21T22:53:58.437 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.445+0000 7fe418eb0640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe414145aa0 con 0x7fe4140b3d30 2024-02-21T22:53:58.437 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.445+0000 7fe418eb0640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe414160910 con 0x7fe414071990 2024-02-21T22:53:58.438 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.445+0000 7fe412d9d640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fe4140b3d30 0x7fe4140b4160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:58.438 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.445+0000 7fe412d9d640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fe4140b3d30 0x7fe4140b4160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:56590/0 (socket says 172.21.15.116:56590) 2024-02-21T22:53:58.438 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.445+0000 7fe41259c640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7fe4141456c0 0x7fe41415ce10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:40092/0 (socket says 172.21.15.116:40092) 2024-02-21T22:53:58.438 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.445+0000 7fe412d9d640 1 -- 172.21.15.116:0/1798988205 learned_addr learned my addr 172.21.15.116:0/1798988205 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:58.438 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.445+0000 7fe411d9b640 1 --2- 172.21.15.116:0/1798988205 >> v2:172.21.15.142:3300/0 conn(0x7fe414071990 0x7fe414071e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:58.438 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.445+0000 7fe412d9d640 1 -- 172.21.15.116:0/1798988205 >> v2:172.21.15.142:3300/0 conn(0x7fe414071990 msgr2=0x7fe414071e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:53:58.438 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.445+0000 7fe412d9d640 1 --2- 172.21.15.116:0/1798988205 >> v2:172.21.15.142:3300/0 conn(0x7fe414071990 0x7fe414071e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:58.439 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.445+0000 7fe412d9d640 1 -- 172.21.15.116:0/1798988205 >> v1:172.21.15.116:6789/0 conn(0x7fe4141456c0 legacy=0x7fe41415ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:58.439 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.445+0000 7fe412d9d640 1 -- 172.21.15.116:0/1798988205 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe41415ffe0 con 0x7fe4140b3d30 2024-02-21T22:53:58.439 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.445+0000 7fe41159a640 1 -- 172.21.15.116:0/1798988205 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4116013792 0 0) 0x7fe41415fd00 con 0x7fe4141456c0 2024-02-21T22:53:58.439 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.446+0000 7fe412d9d640 1 --2- 172.21.15.116:0/1798988205 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe4140b3d30 0x7fe4140b4160 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fe4140d1b90 tx=0x7fe40c02bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=424738ac1a97b04d server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:58.439 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.446+0000 7fe41159a640 1 -- 172.21.15.116:0/1798988205 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe40c02ca80 con 0x7fe4140b3d30 2024-02-21T22:53:58.439 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.446+0000 7fe41159a640 1 -- 172.21.15.116:0/1798988205 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe40c02cc20 con 0x7fe4140b3d30 2024-02-21T22:53:58.439 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.446+0000 7fe41159a640 1 -- 172.21.15.116:0/1798988205 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe40c0343f0 con 0x7fe4140b3d30 2024-02-21T22:53:58.443 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.447+0000 7fe418eb0640 1 -- 172.21.15.116:0/1798988205 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe4140b3d30 msgr2=0x7fe4140b4160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:58.443 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.447+0000 7fe418eb0640 1 --2- 172.21.15.116:0/1798988205 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe4140b3d30 0x7fe4140b4160 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fe4140d1b90 tx=0x7fe40c02bee0 comp rx=0 tx=0).stop 2024-02-21T22:53:58.443 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.447+0000 7fe418eb0640 1 -- 172.21.15.116:0/1798988205 shutdown_connections 2024-02-21T22:53:58.443 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.447+0000 7fe418eb0640 1 --2- 172.21.15.116:0/1798988205 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe4140b3d30 0x7fe4140b4160 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:58.443 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.447+0000 7fe418eb0640 1 --2- 172.21.15.116:0/1798988205 >> v2:172.21.15.142:3300/0 conn(0x7fe414071990 0x7fe414071e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:58.443 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.447+0000 7fe418eb0640 1 -- 172.21.15.116:0/1798988205 >> 172.21.15.116:0/1798988205 conn(0x7fe4140b2750 msgr2=0x7fe4140b2b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:58.444 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.447+0000 7fe418eb0640 1 -- 172.21.15.116:0/1798988205 shutdown_connections 2024-02-21T22:53:58.444 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.447+0000 7fe418eb0640 1 -- 172.21.15.116:0/1798988205 wait complete. 2024-02-21T22:53:58.444 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.448+0000 7fe418eb0640 1 Processor -- start 2024-02-21T22:53:58.444 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.448+0000 7fe418eb0640 1 -- start start 2024-02-21T22:53:58.444 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.449+0000 7fe418eb0640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe414071990 0x7fe4141391a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:58.444 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.449+0000 7fe418eb0640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe4140b3d30 0x7fe414155c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:58.444 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.449+0000 7fe418eb0640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe4141456c0 0x7fe41415d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:58.444 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.449+0000 7fe418eb0640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4140b5bd0 con 0x7fe4141456c0 2024-02-21T22:53:58.445 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.449+0000 7fe418eb0640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4141605a0 con 0x7fe4140b3d30 2024-02-21T22:53:58.445 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.449+0000 7fe418eb0640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe41415f980 con 0x7fe414071990 2024-02-21T22:53:58.445 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.449+0000 7fe412d9d640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe4141456c0 0x7fe41415d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:58.445 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.449+0000 7fe412d9d640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe4141456c0 0x7fe41415d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:56596/0 (socket says 172.21.15.116:56596) 2024-02-21T22:53:58.445 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.449+0000 7fe412d9d640 1 -- 172.21.15.116:0/2253553623 learned_addr learned my addr 172.21.15.116:0/2253553623 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:58.445 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.449+0000 7fe41259c640 1 --2- 172.21.15.116:0/2253553623 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe414071990 0x7fe4141391a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:58.445 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.449+0000 7fe411d9b640 1 --2- 172.21.15.116:0/2253553623 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe4140b3d30 0x7fe414155c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:58.446 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.449+0000 7fe412d9d640 1 -- 172.21.15.116:0/2253553623 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe414071990 msgr2=0x7fe4141391a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:58.446 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.449+0000 7fe412d9d640 1 --2- 172.21.15.116:0/2253553623 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe414071990 0x7fe4141391a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:58.446 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.449+0000 7fe412d9d640 1 -- 172.21.15.116:0/2253553623 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe4140b3d30 msgr2=0x7fe414155c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:58.446 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.449+0000 7fe412d9d640 1 --2- 172.21.15.116:0/2253553623 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe4140b3d30 0x7fe414155c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:58.446 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.449+0000 7fe412d9d640 1 -- 172.21.15.116:0/2253553623 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe41415c530 con 0x7fe4141456c0 2024-02-21T22:53:58.446 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.449+0000 7fe412d9d640 1 --2- 172.21.15.116:0/2253553623 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe4141456c0 0x7fe41415d5d0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fe40c036040 tx=0x7fe40c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:58.446 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.450+0000 7fe402ffd640 1 -- 172.21.15.116:0/2253553623 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe40c043020 con 0x7fe4141456c0 2024-02-21T22:53:58.446 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.450+0000 7fe402ffd640 1 -- 172.21.15.116:0/2253553623 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe40c03e450 con 0x7fe4141456c0 2024-02-21T22:53:58.446 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.450+0000 7fe418eb0640 1 -- 172.21.15.116:0/2253553623 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe41415c810 con 0x7fe4141456c0 2024-02-21T22:53:58.447 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.450+0000 7fe402ffd640 1 -- 172.21.15.116:0/2253553623 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe40c009510 con 0x7fe4141456c0 2024-02-21T22:53:58.447 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.450+0000 7fe418eb0640 1 -- 172.21.15.116:0/2253553623 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe41415cdd0 con 0x7fe4141456c0 2024-02-21T22:53:58.447 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.451+0000 7fe418eb0640 1 -- 172.21.15.116:0/2253553623 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4140752f0 con 0x7fe4141456c0 2024-02-21T22:53:58.447 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.451+0000 7fe402ffd640 1 -- 172.21.15.116:0/2253553623 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fe40c046020 con 0x7fe4141456c0 2024-02-21T22:53:58.447 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.452+0000 7fe402ffd640 1 --2- 172.21.15.116:0/2253553623 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fe3f406b4d0 0x7fe3f406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:58.447 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.452+0000 7fe402ffd640 1 -- 172.21.15.116:0/2253553623 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe40c0ac890 con 0x7fe4141456c0 2024-02-21T22:53:58.447 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.452+0000 7fe41259c640 1 --2- 172.21.15.116:0/2253553623 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fe3f406b4d0 0x7fe3f406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:58.447 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.452+0000 7fe41259c640 1 --2- 172.21.15.116:0/2253553623 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fe3f406b4d0 0x7fe3f406d990 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fe404000f60 tx=0x7fe404007d50 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:58.448 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.456+0000 7fe402ffd640 1 -- 172.21.15.116:0/2253553623 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7fe40c04d030 con 0x7fe4141456c0 2024-02-21T22:53:58.624 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.634+0000 7fe418eb0640 1 -- 172.21.15.116:0/2253553623 --> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7fe4140b3490 con 0x7fe3f406b4d0 2024-02-21T22:53:58.625 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.634+0000 7fe402ffd640 1 -- 172.21.15.116:0/2253553623 <== mgr.4103 v2:172.21.15.142:6832/1381484782 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fe4140b3490 con 0x7fe3f406b4d0 2024-02-21T22:53:58.625 INFO:teuthology.orchestra.run.smithi116.stderr:instructed osd(s) 5 to deep-scrub 2024-02-21T22:53:58.627 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.636+0000 7fe418eb0640 1 -- 172.21.15.116:0/2253553623 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fe3f406b4d0 msgr2=0x7fe3f406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:58.627 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.636+0000 7fe418eb0640 1 --2- 172.21.15.116:0/2253553623 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fe3f406b4d0 0x7fe3f406d990 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fe404000f60 tx=0x7fe404007d50 comp rx=0 tx=0).stop 2024-02-21T22:53:58.627 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.636+0000 7fe418eb0640 1 -- 172.21.15.116:0/2253553623 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe4141456c0 msgr2=0x7fe41415d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:58.627 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.636+0000 7fe418eb0640 1 --2- 172.21.15.116:0/2253553623 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe4141456c0 0x7fe41415d5d0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fe40c036040 tx=0x7fe40c004a40 comp rx=0 tx=0).stop 2024-02-21T22:53:58.628 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.636+0000 7fe418eb0640 1 -- 172.21.15.116:0/2253553623 shutdown_connections 2024-02-21T22:53:58.628 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.636+0000 7fe418eb0640 1 --2- 172.21.15.116:0/2253553623 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe4141456c0 0x7fe41415d5d0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:58.628 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.636+0000 7fe418eb0640 1 --2- 172.21.15.116:0/2253553623 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe4140b3d30 0x7fe414155c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:58.628 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.636+0000 7fe418eb0640 1 --2- 172.21.15.116:0/2253553623 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fe3f406b4d0 0x7fe3f406d990 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:58.628 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.636+0000 7fe418eb0640 1 --2- 172.21.15.116:0/2253553623 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe414071990 0x7fe4141391a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:58.628 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.636+0000 7fe418eb0640 1 -- 172.21.15.116:0/2253553623 >> 172.21.15.116:0/2253553623 conn(0x7fe4140b2750 msgr2=0x7fe41406ae40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:58.628 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.636+0000 7fe418eb0640 1 -- 172.21.15.116:0/2253553623 shutdown_connections 2024-02-21T22:53:58.628 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.636+0000 7fe418eb0640 1 -- 172.21.15.116:0/2253553623 wait complete. 2024-02-21T22:53:58.638 INFO:tasks.ceph:Scrubbing osd.6 2024-02-21T22:53:58.638 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-02-21T22:53:58.743 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.753+0000 7fd7eb2d1640 1 Processor -- start 2024-02-21T22:53:58.744 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.753+0000 7fd7eb2d1640 1 -- start start 2024-02-21T22:53:58.745 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.754+0000 7fd7eb2d1640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fd7e4161700 0x7fd7e40d2350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:58.745 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.754+0000 7fd7eb2d1640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd7e40d2890 0x7fd7e40cf990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:58.745 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.754+0000 7fd7eb2d1640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7e4161ae0 con 0x7fd7e40d0e40 2024-02-21T22:53:58.745 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.754+0000 7fd7eb2d1640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7e40b3c30 con 0x7fd7e4161700 2024-02-21T22:53:58.745 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.754+0000 7fd7eb2d1640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7e40d4be0 con 0x7fd7e40d2890 2024-02-21T22:53:58.745 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.754+0000 7fd7e906d640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fd7e4161700 0x7fd7e40d2350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:58.745 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.754+0000 7fd7e886c640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7fd7e40d0e40 0x7fd7e40b40c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:40102/0 (socket says 172.21.15.116:40102) 2024-02-21T22:53:58.746 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.754+0000 7fd7e886c640 1 -- 172.21.15.116:0/1966288674 learned_addr learned my addr 172.21.15.116:0/1966288674 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-02-21T22:53:58.746 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.754+0000 7fd7e986e640 1 --2- 172.21.15.116:0/1966288674 >> v2:172.21.15.142:3300/0 conn(0x7fd7e40d2890 0x7fd7e40cf990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:58.746 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.754+0000 7fd7e906d640 1 -- 172.21.15.116:0/1966288674 >> v2:172.21.15.142:3300/0 conn(0x7fd7e40d2890 msgr2=0x7fd7e40cf990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:53:58.746 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.754+0000 7fd7e906d640 1 --2- 172.21.15.116:0/1966288674 >> v2:172.21.15.142:3300/0 conn(0x7fd7e40d2890 0x7fd7e40cf990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:58.746 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.754+0000 7fd7e906d640 1 -- 172.21.15.116:0/1966288674 >> v1:172.21.15.116:6789/0 conn(0x7fd7e40d0e40 legacy=0x7fd7e40b40c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:58.746 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.754+0000 7fd7dbfff640 1 -- 172.21.15.116:0/1966288674 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2495033780 0 0) 0x7fd7d4001110 con 0x7fd7e40d0e40 2024-02-21T22:53:58.746 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.754+0000 7fd7e906d640 1 -- 172.21.15.116:0/1966288674 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7e40b3300 con 0x7fd7e4161700 2024-02-21T22:53:58.750 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.755+0000 7fd7e906d640 1 --2- 172.21.15.116:0/1966288674 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd7e4161700 0x7fd7e40d2350 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fd7e408e320 tx=0x7fd7dc02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ba388502c07fd5e server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:58.750 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.755+0000 7fd7dbfff640 1 -- 172.21.15.116:0/1966288674 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7dc039070 con 0x7fd7e4161700 2024-02-21T22:53:58.750 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.755+0000 7fd7dbfff640 1 -- 172.21.15.116:0/1966288674 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7dc02cc80 con 0x7fd7e4161700 2024-02-21T22:53:58.750 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.755+0000 7fd7dbfff640 1 -- 172.21.15.116:0/1966288674 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7dc034660 con 0x7fd7e4161700 2024-02-21T22:53:58.751 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.756+0000 7fd7eb2d1640 1 -- 172.21.15.116:0/1966288674 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd7e4161700 msgr2=0x7fd7e40d2350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:58.751 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.756+0000 7fd7eb2d1640 1 --2- 172.21.15.116:0/1966288674 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd7e4161700 0x7fd7e40d2350 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fd7e408e320 tx=0x7fd7dc02bed0 comp rx=0 tx=0).stop 2024-02-21T22:53:58.751 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.756+0000 7fd7eb2d1640 1 -- 172.21.15.116:0/1966288674 shutdown_connections 2024-02-21T22:53:58.751 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.756+0000 7fd7eb2d1640 1 --2- 172.21.15.116:0/1966288674 >> v2:172.21.15.142:3300/0 conn(0x7fd7e40d2890 0x7fd7e40cf990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:58.751 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.756+0000 7fd7eb2d1640 1 --2- 172.21.15.116:0/1966288674 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd7e4161700 0x7fd7e40d2350 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:58.751 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.756+0000 7fd7eb2d1640 1 -- 172.21.15.116:0/1966288674 >> 172.21.15.116:0/1966288674 conn(0x7fd7e40d3d70 msgr2=0x7fd7e40d4180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:58.751 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.756+0000 7fd7eb2d1640 1 -- 172.21.15.116:0/1966288674 shutdown_connections 2024-02-21T22:53:58.751 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.756+0000 7fd7eb2d1640 1 -- 172.21.15.116:0/1966288674 wait complete. 2024-02-21T22:53:58.751 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.757+0000 7fd7eb2d1640 1 Processor -- start 2024-02-21T22:53:58.752 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.757+0000 7fd7eb2d1640 1 -- start start 2024-02-21T22:53:58.752 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.758+0000 7fd7eb2d1640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd7e40d0e40 0x7fd7e40cbc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:58.752 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.758+0000 7fd7eb2d1640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd7e40d2890 0x7fd7e41f31c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:58.752 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.758+0000 7fd7eb2d1640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd7e4161700 0x7fd7e40c80e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:58.752 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.758+0000 7fd7eb2d1640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7e40d4890 con 0x7fd7e40d0e40 2024-02-21T22:53:58.752 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.758+0000 7fd7eb2d1640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7e40b38c0 con 0x7fd7e4161700 2024-02-21T22:53:58.752 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.758+0000 7fd7eb2d1640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7e40b47d0 con 0x7fd7e40d2890 2024-02-21T22:53:58.752 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.758+0000 7fd7e906d640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd7e40d0e40 0x7fd7e40cbc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:58.753 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.758+0000 7fd7e906d640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd7e40d0e40 0x7fd7e40cbc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:56612/0 (socket says 172.21.15.116:56612) 2024-02-21T22:53:58.753 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.758+0000 7fd7e906d640 1 -- 172.21.15.116:0/1148912375 learned_addr learned my addr 172.21.15.116:0/1148912375 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:58.753 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.758+0000 7fd7e986e640 1 --2- 172.21.15.116:0/1148912375 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd7e4161700 0x7fd7e40c80e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:58.753 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.758+0000 7fd7e886c640 1 --2- 172.21.15.116:0/1148912375 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd7e40d2890 0x7fd7e41f31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:58.753 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.759+0000 7fd7e906d640 1 -- 172.21.15.116:0/1148912375 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd7e40d2890 msgr2=0x7fd7e41f31c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:58.753 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.759+0000 7fd7e906d640 1 --2- 172.21.15.116:0/1148912375 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd7e40d2890 0x7fd7e41f31c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:58.753 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.759+0000 7fd7e906d640 1 -- 172.21.15.116:0/1148912375 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd7e4161700 msgr2=0x7fd7e40c80e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:58.753 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.759+0000 7fd7e906d640 1 --2- 172.21.15.116:0/1148912375 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd7e4161700 0x7fd7e40c80e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:58.753 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.759+0000 7fd7e906d640 1 -- 172.21.15.116:0/1148912375 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7e40b0ae0 con 0x7fd7e40d0e40 2024-02-21T22:53:58.754 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.759+0000 7fd7e906d640 1 --2- 172.21.15.116:0/1148912375 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd7e40d0e40 0x7fd7e40cbc30 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fd7dc009e80 tx=0x7fd7dc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:58.754 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.759+0000 7fd7d9ffb640 1 -- 172.21.15.116:0/1148912375 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7dc039050 con 0x7fd7e40d0e40 2024-02-21T22:53:58.754 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.759+0000 7fd7d9ffb640 1 -- 172.21.15.116:0/1148912375 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7dc045070 con 0x7fd7e40d0e40 2024-02-21T22:53:58.754 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.759+0000 7fd7eb2d1640 1 -- 172.21.15.116:0/1148912375 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7e40b0d80 con 0x7fd7e40d0e40 2024-02-21T22:53:58.754 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.759+0000 7fd7d9ffb640 1 -- 172.21.15.116:0/1148912375 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7dc03e850 con 0x7fd7e40d0e40 2024-02-21T22:53:58.754 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.759+0000 7fd7eb2d1640 1 -- 172.21.15.116:0/1148912375 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7e40b1340 con 0x7fd7e40d0e40 2024-02-21T22:53:58.754 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.760+0000 7fd7eb2d1640 1 -- 172.21.15.116:0/1148912375 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd7e40b6710 con 0x7fd7e40d0e40 2024-02-21T22:53:58.756 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.761+0000 7fd7d9ffb640 1 -- 172.21.15.116:0/1148912375 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fd7dc03e9f0 con 0x7fd7e40d0e40 2024-02-21T22:53:58.756 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.761+0000 7fd7d9ffb640 1 --2- 172.21.15.116:0/1148912375 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fd7c806b4d0 0x7fd7c806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:58.756 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.761+0000 7fd7d9ffb640 1 -- 172.21.15.116:0/1148912375 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd7dc0ad9c0 con 0x7fd7e40d0e40 2024-02-21T22:53:58.756 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.761+0000 7fd7d9ffb640 1 --2- 172.21.15.116:0/1148912375 >> [v2:172.21.15.142:6800/1987868911,v1:172.21.15.142:6801/1987868911] conn(0x7fd7c8073670 0x7fd7c8075a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:58.757 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.761+0000 7fd7d9ffb640 1 -- 172.21.15.116:0/1148912375 --> [v2:172.21.15.142:6800/1987868911,v1:172.21.15.142:6801/1987868911] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd7dc0091a0 con 0x7fd7c8073670 2024-02-21T22:53:58.757 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.761+0000 7fd7d9ffb640 1 -- 172.21.15.116:0/1148912375 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd7dc0ade50 con 0x7fd7e40d0e40 2024-02-21T22:53:58.757 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.761+0000 7fd7e886c640 1 --2- 172.21.15.116:0/1148912375 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fd7c806b4d0 0x7fd7c806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:58.757 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.761+0000 7fd7e986e640 1 --2- 172.21.15.116:0/1148912375 >> [v2:172.21.15.142:6800/1987868911,v1:172.21.15.142:6801/1987868911] conn(0x7fd7c8073670 0x7fd7c8075a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:58.757 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.762+0000 7fd7e986e640 1 --2- 172.21.15.116:0/1148912375 >> [v2:172.21.15.142:6800/1987868911,v1:172.21.15.142:6801/1987868911] conn(0x7fd7c8073670 0x7fd7c8075a90 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:58.757 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.762+0000 7fd7e886c640 1 --2- 172.21.15.116:0/1148912375 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fd7c806b4d0 0x7fd7c806d990 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fd7e41f6f70 tx=0x7fd7d4007b50 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:58.757 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.762+0000 7fd7d9ffb640 1 -- 172.21.15.116:0/1148912375 <== osd.6 v2:172.21.15.142:6800/1987868911 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fd7dc0091a0 con 0x7fd7c8073670 2024-02-21T22:53:58.765 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.775+0000 7fd7eb2d1640 1 -- 172.21.15.116:0/1148912375 --> [v2:172.21.15.142:6800/1987868911,v1:172.21.15.142:6801/1987868911] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fd7e40752f0 con 0x7fd7c8073670 2024-02-21T22:53:58.766 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.776+0000 7fd7d9ffb640 1 -- 172.21.15.116:0/1148912375 <== osd.6 v2:172.21.15.142:6800/1987868911 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fd7e40752f0 con 0x7fd7c8073670 2024-02-21T22:53:58.766 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-02-21T22:53:58.767 INFO:teuthology.orchestra.run.smithi116.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-02-21T22:53:58.767 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-02-21T22:53:58.768 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.776+0000 7fd7eb2d1640 1 -- 172.21.15.116:0/1148912375 >> [v2:172.21.15.142:6800/1987868911,v1:172.21.15.142:6801/1987868911] conn(0x7fd7c8073670 msgr2=0x7fd7c8075a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:58.768 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.776+0000 7fd7eb2d1640 1 --2- 172.21.15.116:0/1148912375 >> [v2:172.21.15.142:6800/1987868911,v1:172.21.15.142:6801/1987868911] conn(0x7fd7c8073670 0x7fd7c8075a90 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:58.768 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.776+0000 7fd7eb2d1640 1 -- 172.21.15.116:0/1148912375 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fd7c806b4d0 msgr2=0x7fd7c806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:58.768 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.776+0000 7fd7eb2d1640 1 --2- 172.21.15.116:0/1148912375 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fd7c806b4d0 0x7fd7c806d990 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fd7e41f6f70 tx=0x7fd7d4007b50 comp rx=0 tx=0).stop 2024-02-21T22:53:58.768 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.776+0000 7fd7eb2d1640 1 -- 172.21.15.116:0/1148912375 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd7e40d0e40 msgr2=0x7fd7e40cbc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:58.768 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.776+0000 7fd7eb2d1640 1 --2- 172.21.15.116:0/1148912375 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd7e40d0e40 0x7fd7e40cbc30 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fd7dc009e80 tx=0x7fd7dc004a40 comp rx=0 tx=0).stop 2024-02-21T22:53:58.769 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.776+0000 7fd7e986e640 1 -- 172.21.15.116:0/1148912375 reap_dead start 2024-02-21T22:53:58.769 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.776+0000 7fd7eb2d1640 1 -- 172.21.15.116:0/1148912375 shutdown_connections 2024-02-21T22:53:58.769 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.776+0000 7fd7eb2d1640 1 -- 172.21.15.116:0/1148912375 >> 172.21.15.116:0/1148912375 conn(0x7fd7e40d3d70 msgr2=0x7fd7e40b40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:58.769 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.776+0000 7fd7eb2d1640 1 -- 172.21.15.116:0/1148912375 shutdown_connections 2024-02-21T22:53:58.769 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.776+0000 7fd7eb2d1640 1 -- 172.21.15.116:0/1148912375 wait complete. 2024-02-21T22:53:58.777 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-02-21T22:53:58.880 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.889+0000 7f5f3898c640 1 Processor -- start 2024-02-21T22:53:58.880 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.889+0000 7f5f3898c640 1 -- start start 2024-02-21T22:53:58.882 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.890+0000 7f5f3898c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5f3406b550 0x7f5f3406d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:58.883 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.890+0000 7f5f3898c640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f5f341628a0 0x7f5f3406dc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:58.883 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.890+0000 7f5f3898c640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f340b5830 con 0x7f5f3415dfb0 2024-02-21T22:53:58.883 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.890+0000 7f5f3898c640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f34161b70 con 0x7f5f341628a0 2024-02-21T22:53:58.883 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.890+0000 7f5f3898c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f34162410 con 0x7f5f3406b550 2024-02-21T22:53:58.883 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.890+0000 7f5f32d9d640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f5f341628a0 0x7f5f3406dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:58.883 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.890+0000 7f5f32d9d640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f5f341628a0 0x7f5f3406dc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:56624/0 (socket says 172.21.15.116:56624) 2024-02-21T22:53:58.883 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.890+0000 7f5f32d9d640 1 -- 172.21.15.116:0/1042392035 learned_addr learned my addr 172.21.15.116:0/1042392035 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:58.883 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.890+0000 7f5f31d9b640 1 --2- 172.21.15.116:0/1042392035 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5f3406b550 0x7f5f3406d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:58.884 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.890+0000 7f5f3159a640 1 -- 172.21.15.116:0/1042392035 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1751330501 0 0) 0x7f5f340b5830 con 0x7f5f3415dfb0 2024-02-21T22:53:58.884 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.890+0000 7f5f3159a640 1 -- 172.21.15.116:0/1042392035 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f1c003520 con 0x7f5f3415dfb0 2024-02-21T22:53:58.884 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.890+0000 7f5f31d9b640 1 -- 172.21.15.116:0/1042392035 >> v2:172.21.15.116:3300/0 conn(0x7f5f341628a0 msgr2=0x7f5f3406dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:53:58.884 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.891+0000 7f5f31d9b640 1 --2- 172.21.15.116:0/1042392035 >> v2:172.21.15.116:3300/0 conn(0x7f5f341628a0 0x7f5f3406dc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:58.884 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.891+0000 7f5f31d9b640 1 -- 172.21.15.116:0/1042392035 >> v1:172.21.15.142:6789/0 conn(0x7f5f3415dfb0 legacy=0x7f5f3406ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:58.884 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.891+0000 7f5f31d9b640 1 -- 172.21.15.116:0/1042392035 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f340b5ad0 con 0x7f5f3406b550 2024-02-21T22:53:58.885 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.891+0000 7f5f32d9d640 1 --2- 172.21.15.116:0/1042392035 >> v2:172.21.15.116:3300/0 conn(0x7f5f341628a0 0x7f5f3406dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T22:53:58.885 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.891+0000 7f5f31d9b640 1 --2- 172.21.15.116:0/1042392035 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5f3406b550 0x7f5f3406d710 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f5f28009d90 tx=0x7f5f2802bd80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=314dab30ff0e4509 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:58.885 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.891+0000 7f5f3159a640 1 -- 172.21.15.116:0/1042392035 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f28039070 con 0x7f5f3406b550 2024-02-21T22:53:58.885 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.891+0000 7f5f3159a640 1 -- 172.21.15.116:0/1042392035 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f2802cb30 con 0x7f5f3406b550 2024-02-21T22:53:58.885 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.891+0000 7f5f3159a640 1 -- 172.21.15.116:0/1042392035 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f28034440 con 0x7f5f3406b550 2024-02-21T22:53:58.885 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.892+0000 7f5f3898c640 1 -- 172.21.15.116:0/1042392035 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5f3406b550 msgr2=0x7f5f3406d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:58.885 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.892+0000 7f5f3898c640 1 --2- 172.21.15.116:0/1042392035 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5f3406b550 0x7f5f3406d710 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f5f28009d90 tx=0x7f5f2802bd80 comp rx=0 tx=0).stop 2024-02-21T22:53:58.885 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.892+0000 7f5f3898c640 1 -- 172.21.15.116:0/1042392035 shutdown_connections 2024-02-21T22:53:58.886 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.892+0000 7f5f3898c640 1 --2- 172.21.15.116:0/1042392035 >> v2:172.21.15.116:3300/0 conn(0x7f5f341628a0 0x7f5f3406dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:58.886 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.892+0000 7f5f3898c640 1 --2- 172.21.15.116:0/1042392035 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5f3406b550 0x7f5f3406d710 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:58.886 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.892+0000 7f5f3898c640 1 -- 172.21.15.116:0/1042392035 >> 172.21.15.116:0/1042392035 conn(0x7f5f340b2750 msgr2=0x7f5f340b2b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:58.886 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.892+0000 7f5f3898c640 1 -- 172.21.15.116:0/1042392035 shutdown_connections 2024-02-21T22:53:58.886 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.892+0000 7f5f3898c640 1 -- 172.21.15.116:0/1042392035 wait complete. 2024-02-21T22:53:58.889 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.893+0000 7f5f3898c640 1 Processor -- start 2024-02-21T22:53:58.889 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.894+0000 7f5f3898c640 1 -- start start 2024-02-21T22:53:58.889 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.894+0000 7f5f3898c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5f3406b550 0x7f5f3414e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:58.889 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.894+0000 7f5f3898c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5f3415dfb0 0x7f5f340b1840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:58.889 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.894+0000 7f5f3898c640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5f341628a0 0x7f5f340b1d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:58.890 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.894+0000 7f5f3898c640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f3415e390 con 0x7f5f341628a0 2024-02-21T22:53:58.890 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.894+0000 7f5f3898c640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f341620a0 con 0x7f5f3415dfb0 2024-02-21T22:53:58.890 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.894+0000 7f5f3898c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f3406f760 con 0x7f5f3406b550 2024-02-21T22:53:58.890 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.894+0000 7f5f32d9d640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5f341628a0 0x7f5f340b1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:58.890 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.894+0000 7f5f32d9d640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5f341628a0 0x7f5f340b1d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:56634/0 (socket says 172.21.15.116:56634) 2024-02-21T22:53:58.890 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.894+0000 7f5f32d9d640 1 -- 172.21.15.116:0/1230481431 learned_addr learned my addr 172.21.15.116:0/1230481431 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:58.890 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.894+0000 7f5f31d9b640 1 --2- 172.21.15.116:0/1230481431 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5f3415dfb0 0x7f5f340b1840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:58.890 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.894+0000 7f5f3259c640 1 --2- 172.21.15.116:0/1230481431 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5f3406b550 0x7f5f3414e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:58.891 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.895+0000 7f5f32d9d640 1 -- 172.21.15.116:0/1230481431 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5f3406b550 msgr2=0x7f5f3414e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:58.891 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.895+0000 7f5f32d9d640 1 --2- 172.21.15.116:0/1230481431 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5f3406b550 0x7f5f3414e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:58.891 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.895+0000 7f5f32d9d640 1 -- 172.21.15.116:0/1230481431 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5f3415dfb0 msgr2=0x7f5f340b1840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:58.891 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.895+0000 7f5f32d9d640 1 --2- 172.21.15.116:0/1230481431 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5f3415dfb0 0x7f5f340b1840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:58.891 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.895+0000 7f5f32d9d640 1 -- 172.21.15.116:0/1230481431 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f3415f0f0 con 0x7f5f341628a0 2024-02-21T22:53:58.891 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.895+0000 7f5f31d9b640 1 --2- 172.21.15.116:0/1230481431 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5f3415dfb0 0x7f5f340b1840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T22:53:58.891 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.895+0000 7f5f32d9d640 1 --2- 172.21.15.116:0/1230481431 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5f341628a0 0x7f5f340b1d80 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f5f2400e820 tx=0x7f5f2400ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:58.891 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.895+0000 7f5f22ffd640 1 -- 172.21.15.116:0/1230481431 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f24017070 con 0x7f5f341628a0 2024-02-21T22:53:58.891 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.895+0000 7f5f22ffd640 1 -- 172.21.15.116:0/1230481431 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f24004020 con 0x7f5f341628a0 2024-02-21T22:53:58.892 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.895+0000 7f5f3898c640 1 -- 172.21.15.116:0/1230481431 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f3415f3d0 con 0x7f5f341628a0 2024-02-21T22:53:58.892 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.895+0000 7f5f22ffd640 1 -- 172.21.15.116:0/1230481431 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f240043f0 con 0x7f5f341628a0 2024-02-21T22:53:58.892 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.895+0000 7f5f3898c640 1 -- 172.21.15.116:0/1230481431 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f3415f990 con 0x7f5f341628a0 2024-02-21T22:53:58.892 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.896+0000 7f5f3898c640 1 -- 172.21.15.116:0/1230481431 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f340752f0 con 0x7f5f341628a0 2024-02-21T22:53:58.892 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.896+0000 7f5f22ffd640 1 -- 172.21.15.116:0/1230481431 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f5f2400c940 con 0x7f5f341628a0 2024-02-21T22:53:58.892 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.897+0000 7f5f22ffd640 1 --2- 172.21.15.116:0/1230481431 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f5f1406b4d0 0x7f5f1406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:58.892 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.897+0000 7f5f22ffd640 1 -- 172.21.15.116:0/1230481431 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5f2408a240 con 0x7f5f341628a0 2024-02-21T22:53:58.892 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.897+0000 7f5f3259c640 1 --2- 172.21.15.116:0/1230481431 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f5f1406b4d0 0x7f5f1406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:58.893 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.897+0000 7f5f3259c640 1 --2- 172.21.15.116:0/1230481431 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f5f1406b4d0 0x7f5f1406d990 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f5f2c007fd0 tx=0x7f5f2c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:58.895 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:58.905+0000 7f5f22ffd640 1 -- 172.21.15.116:0/1230481431 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f5f24058a70 con 0x7f5f341628a0 2024-02-21T22:53:59.074 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.083+0000 7f5f3898c640 1 -- 172.21.15.116:0/1230481431 --> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f5f340b34b0 con 0x7f5f1406b4d0 2024-02-21T22:53:59.074 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.083+0000 7f5f22ffd640 1 -- 172.21.15.116:0/1230481431 <== mgr.4103 v2:172.21.15.142:6832/1381484782 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f5f340b34b0 con 0x7f5f1406b4d0 2024-02-21T22:53:59.074 INFO:teuthology.orchestra.run.smithi116.stderr:instructed osd(s) 6 to deep-scrub 2024-02-21T22:53:59.076 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.085+0000 7f5f3898c640 1 -- 172.21.15.116:0/1230481431 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f5f1406b4d0 msgr2=0x7f5f1406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:59.076 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.085+0000 7f5f3898c640 1 --2- 172.21.15.116:0/1230481431 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f5f1406b4d0 0x7f5f1406d990 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f5f2c007fd0 tx=0x7f5f2c009040 comp rx=0 tx=0).stop 2024-02-21T22:53:59.076 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.085+0000 7f5f3898c640 1 -- 172.21.15.116:0/1230481431 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5f341628a0 msgr2=0x7f5f340b1d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:59.076 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.085+0000 7f5f3898c640 1 --2- 172.21.15.116:0/1230481431 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5f341628a0 0x7f5f340b1d80 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f5f2400e820 tx=0x7f5f2400ece0 comp rx=0 tx=0).stop 2024-02-21T22:53:59.077 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.085+0000 7f5f3898c640 1 -- 172.21.15.116:0/1230481431 shutdown_connections 2024-02-21T22:53:59.077 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.085+0000 7f5f3898c640 1 --2- 172.21.15.116:0/1230481431 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5f341628a0 0x7f5f340b1d80 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:59.077 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.085+0000 7f5f3898c640 1 --2- 172.21.15.116:0/1230481431 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5f3415dfb0 0x7f5f340b1840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:59.077 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.085+0000 7f5f3898c640 1 --2- 172.21.15.116:0/1230481431 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f5f1406b4d0 0x7f5f1406d990 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:59.077 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.085+0000 7f5f3898c640 1 --2- 172.21.15.116:0/1230481431 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5f3406b550 0x7f5f3414e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:59.077 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.085+0000 7f5f3898c640 1 -- 172.21.15.116:0/1230481431 >> 172.21.15.116:0/1230481431 conn(0x7f5f340b2750 msgr2=0x7f5f34158760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:59.077 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.085+0000 7f5f3898c640 1 -- 172.21.15.116:0/1230481431 shutdown_connections 2024-02-21T22:53:59.077 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.085+0000 7f5f3898c640 1 -- 172.21.15.116:0/1230481431 wait complete. 2024-02-21T22:53:59.086 INFO:tasks.ceph:Scrubbing osd.7 2024-02-21T22:53:59.086 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-02-21T22:53:59.191 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.201+0000 7f24cc608640 1 Processor -- start 2024-02-21T22:53:59.191 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.201+0000 7f24cc608640 1 -- start start 2024-02-21T22:53:59.194 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.202+0000 7f24cc608640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f24c415f370 0x7f24c40cd470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:59.194 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.202+0000 7f24cc608640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f24c40ced10 0x7f24c40b4ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:59.194 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.202+0000 7f24cc608640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24c40d0c10 con 0x7f24c40cd9b0 2024-02-21T22:53:59.194 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.202+0000 7f24cc608640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24c40cfb70 con 0x7f24c415f370 2024-02-21T22:53:59.195 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.202+0000 7f24cc608640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24c40cfe50 con 0x7f24c40ced10 2024-02-21T22:53:59.195 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.202+0000 7f24ca3a4640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f24c415f370 0x7f24c40cd470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:59.195 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.202+0000 7f24ca3a4640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f24c415f370 0x7f24c40cd470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:56636/0 (socket says 172.21.15.116:56636) 2024-02-21T22:53:59.195 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.202+0000 7f24ca3a4640 1 -- 172.21.15.116:0/606319459 learned_addr learned my addr 172.21.15.116:0/606319459 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:59.195 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.202+0000 7f24caba5640 1 --2- 172.21.15.116:0/606319459 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f24c40ced10 0x7f24c40b4ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:59.195 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.202+0000 7f24ca3a4640 1 -- 172.21.15.116:0/606319459 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f24c40ced10 msgr2=0x7f24c40b4ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:53:59.195 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.202+0000 7f24ca3a4640 1 --2- 172.21.15.116:0/606319459 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f24c40ced10 0x7f24c40b4ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:59.195 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.202+0000 7f24ca3a4640 1 -- 172.21.15.116:0/606319459 >> v1:172.21.15.142:6789/0 conn(0x7f24c40cd9b0 legacy=0x7f24c40ce600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:59.196 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.202+0000 7f24c93a2640 1 -- 172.21.15.116:0/606319459 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3172759005 0 0) 0x7f24c40d0c10 con 0x7f24c40cd9b0 2024-02-21T22:53:59.196 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.202+0000 7f24ca3a4640 1 -- 172.21.15.116:0/606319459 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24c40d0130 con 0x7f24c415f370 2024-02-21T22:53:59.196 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.203+0000 7f24ca3a4640 1 --2- 172.21.15.116:0/606319459 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f24c415f370 0x7f24c40cd470 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f24c0009870 tx=0x7f24c002b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1a2328cb8c2f38 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:59.196 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.203+0000 7f24c93a2640 1 -- 172.21.15.116:0/606319459 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24c0034070 con 0x7f24c415f370 2024-02-21T22:53:59.196 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.203+0000 7f24c93a2640 1 -- 172.21.15.116:0/606319459 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24c0030840 con 0x7f24c415f370 2024-02-21T22:53:59.196 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.203+0000 7f24c93a2640 1 -- 172.21.15.116:0/606319459 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24c0030c10 con 0x7f24c415f370 2024-02-21T22:53:59.196 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.204+0000 7f24cc608640 1 -- 172.21.15.116:0/606319459 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f24c415f370 msgr2=0x7f24c40cd470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:59.196 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.204+0000 7f24cc608640 1 --2- 172.21.15.116:0/606319459 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f24c415f370 0x7f24c40cd470 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f24c0009870 tx=0x7f24c002b980 comp rx=0 tx=0).stop 2024-02-21T22:53:59.196 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.204+0000 7f24cc608640 1 -- 172.21.15.116:0/606319459 shutdown_connections 2024-02-21T22:53:59.197 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.204+0000 7f24cc608640 1 --2- 172.21.15.116:0/606319459 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f24c40ced10 0x7f24c40b4ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:59.197 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.204+0000 7f24cc608640 1 --2- 172.21.15.116:0/606319459 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f24c415f370 0x7f24c40cd470 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:59.197 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.204+0000 7f24cc608640 1 -- 172.21.15.116:0/606319459 >> 172.21.15.116:0/606319459 conn(0x7f24c409afe0 msgr2=0x7f24c40d1c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:59.197 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.204+0000 7f24cc608640 1 -- 172.21.15.116:0/606319459 shutdown_connections 2024-02-21T22:53:59.197 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.204+0000 7f24cc608640 1 -- 172.21.15.116:0/606319459 wait complete. 2024-02-21T22:53:59.200 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.205+0000 7f24cc608640 1 Processor -- start 2024-02-21T22:53:59.200 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.205+0000 7f24cc608640 1 -- start start 2024-02-21T22:53:59.200 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.206+0000 7f24cc608640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f24c40cd9b0 0x7f24c4153570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:59.200 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.206+0000 7f24cc608640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f24c40ced10 0x7f24c40c5f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:59.201 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.206+0000 7f24cc608640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f24c415f370 0x7f24c41e6ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:59.201 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.206+0000 7f24cc608640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24c40cf840 con 0x7f24c40cd9b0 2024-02-21T22:53:59.201 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.206+0000 7f24cc608640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24c40d06f0 con 0x7f24c40ced10 2024-02-21T22:53:59.201 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.206+0000 7f24cc608640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24c415f750 con 0x7f24c415f370 2024-02-21T22:53:59.201 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.206+0000 7f24ca3a4640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f24c40cd9b0 0x7f24c4153570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:59.201 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.206+0000 7f24ca3a4640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f24c40cd9b0 0x7f24c4153570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:56650/0 (socket says 172.21.15.116:56650) 2024-02-21T22:53:59.201 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.206+0000 7f24ca3a4640 1 -- 172.21.15.116:0/3419521391 learned_addr learned my addr 172.21.15.116:0/3419521391 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:59.201 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.206+0000 7f24c9ba3640 1 --2- 172.21.15.116:0/3419521391 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f24c40ced10 0x7f24c40c5f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:59.201 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.206+0000 7f24caba5640 1 --2- 172.21.15.116:0/3419521391 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f24c415f370 0x7f24c41e6ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:59.202 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.206+0000 7f24ca3a4640 1 -- 172.21.15.116:0/3419521391 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f24c415f370 msgr2=0x7f24c41e6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:59.202 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.206+0000 7f24ca3a4640 1 --2- 172.21.15.116:0/3419521391 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f24c415f370 0x7f24c41e6ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:59.202 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.206+0000 7f24ca3a4640 1 -- 172.21.15.116:0/3419521391 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f24c40ced10 msgr2=0x7f24c40c5f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:59.202 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.206+0000 7f24ca3a4640 1 --2- 172.21.15.116:0/3419521391 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f24c40ced10 0x7f24c40c5f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:59.202 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.206+0000 7f24ca3a4640 1 -- 172.21.15.116:0/3419521391 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24c40c6850 con 0x7f24c40cd9b0 2024-02-21T22:53:59.202 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.206+0000 7f24ca3a4640 1 --2- 172.21.15.116:0/3419521391 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f24c40cd9b0 0x7f24c4153570 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f24c0009870 tx=0x7f24c00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:59.202 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.206+0000 7f24baffd640 1 -- 172.21.15.116:0/3419521391 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24c0034040 con 0x7f24c40cd9b0 2024-02-21T22:53:59.202 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.206+0000 7f24baffd640 1 -- 172.21.15.116:0/3419521391 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24c003ab90 con 0x7f24c40cd9b0 2024-02-21T22:53:59.203 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.206+0000 7f24baffd640 1 -- 172.21.15.116:0/3419521391 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24c0004030 con 0x7f24c40cd9b0 2024-02-21T22:53:59.203 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.206+0000 7f24cc608640 1 -- 172.21.15.116:0/3419521391 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24c40c6b30 con 0x7f24c40cd9b0 2024-02-21T22:53:59.203 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.206+0000 7f24cc608640 1 -- 172.21.15.116:0/3419521391 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24c4153ab0 con 0x7f24c40cd9b0 2024-02-21T22:53:59.203 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.207+0000 7f24cc608640 1 -- 172.21.15.116:0/3419521391 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f24c4154b00 con 0x7f24c40cd9b0 2024-02-21T22:53:59.203 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.208+0000 7f24baffd640 1 -- 172.21.15.116:0/3419521391 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f24c0037070 con 0x7f24c40cd9b0 2024-02-21T22:53:59.203 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.208+0000 7f24baffd640 1 --2- 172.21.15.116:0/3419521391 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f24a806b500 0x7f24a806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:59.203 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.208+0000 7f24baffd640 1 -- 172.21.15.116:0/3419521391 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f24c00abf20 con 0x7f24c40cd9b0 2024-02-21T22:53:59.203 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.208+0000 7f24c9ba3640 1 --2- 172.21.15.116:0/3419521391 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f24a806b500 0x7f24a806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:59.203 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.208+0000 7f24baffd640 1 --2- 172.21.15.116:0/3419521391 >> [v2:172.21.15.142:6808/1272081937,v1:172.21.15.142:6809/1272081937] conn(0x7f24a8073700 0x7f24a8075b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:59.204 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.208+0000 7f24baffd640 1 -- 172.21.15.116:0/3419521391 --> [v2:172.21.15.142:6808/1272081937,v1:172.21.15.142:6809/1272081937] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f24c00094b0 con 0x7f24a8073700 2024-02-21T22:53:59.204 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.208+0000 7f24baffd640 1 -- 172.21.15.116:0/3419521391 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f24c00ae620 con 0x7f24c40cd9b0 2024-02-21T22:53:59.204 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.209+0000 7f24caba5640 1 --2- 172.21.15.116:0/3419521391 >> [v2:172.21.15.142:6808/1272081937,v1:172.21.15.142:6809/1272081937] conn(0x7f24a8073700 0x7f24a8075b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:59.204 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.209+0000 7f24c9ba3640 1 --2- 172.21.15.116:0/3419521391 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f24a806b500 0x7f24a806d9c0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f24c40c7e30 tx=0x7f24b4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:59.204 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.209+0000 7f24caba5640 1 --2- 172.21.15.116:0/3419521391 >> [v2:172.21.15.142:6808/1272081937,v1:172.21.15.142:6809/1272081937] conn(0x7f24a8073700 0x7f24a8075b20 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:59.204 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.210+0000 7f24baffd640 1 -- 172.21.15.116:0/3419521391 <== osd.7 v2:172.21.15.142:6808/1272081937 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f24c00094b0 con 0x7f24a8073700 2024-02-21T22:53:59.213 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.222+0000 7f24cc608640 1 -- 172.21.15.116:0/3419521391 --> [v2:172.21.15.142:6808/1272081937,v1:172.21.15.142:6809/1272081937] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f24c40752f0 con 0x7f24a8073700 2024-02-21T22:53:59.213 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.223+0000 7f24baffd640 1 -- 172.21.15.116:0/3419521391 <== osd.7 v2:172.21.15.142:6808/1272081937 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f24c40752f0 con 0x7f24a8073700 2024-02-21T22:53:59.213 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-02-21T22:53:59.214 INFO:teuthology.orchestra.run.smithi116.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-02-21T22:53:59.214 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-02-21T22:53:59.215 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.223+0000 7f24cc608640 1 -- 172.21.15.116:0/3419521391 >> [v2:172.21.15.142:6808/1272081937,v1:172.21.15.142:6809/1272081937] conn(0x7f24a8073700 msgr2=0x7f24a8075b20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:59.215 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.223+0000 7f24cc608640 1 --2- 172.21.15.116:0/3419521391 >> [v2:172.21.15.142:6808/1272081937,v1:172.21.15.142:6809/1272081937] conn(0x7f24a8073700 0x7f24a8075b20 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:59.215 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.223+0000 7f24cc608640 1 -- 172.21.15.116:0/3419521391 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f24a806b500 msgr2=0x7f24a806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:59.215 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.223+0000 7f24cc608640 1 --2- 172.21.15.116:0/3419521391 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f24a806b500 0x7f24a806d9c0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f24c40c7e30 tx=0x7f24b4009040 comp rx=0 tx=0).stop 2024-02-21T22:53:59.215 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.223+0000 7f24cc608640 1 -- 172.21.15.116:0/3419521391 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f24c40cd9b0 msgr2=0x7f24c4153570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:59.215 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.223+0000 7f24cc608640 1 --2- 172.21.15.116:0/3419521391 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f24c40cd9b0 0x7f24c4153570 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f24c0009870 tx=0x7f24c00046c0 comp rx=0 tx=0).stop 2024-02-21T22:53:59.215 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.223+0000 7f24caba5640 1 -- 172.21.15.116:0/3419521391 reap_dead start 2024-02-21T22:53:59.216 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.223+0000 7f24cc608640 1 -- 172.21.15.116:0/3419521391 shutdown_connections 2024-02-21T22:53:59.216 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.223+0000 7f24cc608640 1 -- 172.21.15.116:0/3419521391 >> 172.21.15.116:0/3419521391 conn(0x7f24c409afe0 msgr2=0x7f24c406ea80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:59.216 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.223+0000 7f24cc608640 1 -- 172.21.15.116:0/3419521391 shutdown_connections 2024-02-21T22:53:59.216 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.223+0000 7f24cc608640 1 -- 172.21.15.116:0/3419521391 wait complete. 2024-02-21T22:53:59.224 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-02-21T22:53:59.326 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.335+0000 7ff9d6d55640 1 Processor -- start 2024-02-21T22:53:59.326 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.335+0000 7ff9d6d55640 1 -- start start 2024-02-21T22:53:59.328 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.336+0000 7ff9d6d55640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff9d006b550 0x7ff9d00cd4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:59.329 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.336+0000 7ff9d6d55640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9d015e7e0 con 0x7ff9d015e400 2024-02-21T22:53:59.329 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.336+0000 7ff9d6d55640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9d00b5020 con 0x7ff9d0066e70 2024-02-21T22:53:59.329 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.336+0000 7ff9d6d55640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9d00b5300 con 0x7ff9d006b550 2024-02-21T22:53:59.329 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.336+0000 7ff9d4af1640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7ff9d015e400 0x7ff9d006ae40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:40110/0 (socket says 172.21.15.116:40110) 2024-02-21T22:53:59.329 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.336+0000 7ff9d4af1640 1 -- 172.21.15.116:0/1338697602 learned_addr learned my addr 172.21.15.116:0/1338697602 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-02-21T22:53:59.329 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.336+0000 7ff9cffff640 1 --2- 172.21.15.116:0/1338697602 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff9d006b550 0x7ff9d00cd4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:59.329 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.336+0000 7ff9cf7fe640 1 -- 172.21.15.116:0/1338697602 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1505214147 0 0) 0x7ff9c4001110 con 0x7ff9d015e400 2024-02-21T22:53:59.329 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.336+0000 7ff9cf7fe640 1 -- 172.21.15.116:0/1338697602 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff9c0003520 con 0x7ff9d015e400 2024-02-21T22:53:59.329 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.336+0000 7ff9cf7fe640 1 -- 172.21.15.116:0/1338697602 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3334177886 0 0) 0x7ff9d00b5020 con 0x7ff9d0066e70 2024-02-21T22:53:59.330 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.336+0000 7ff9cffff640 1 -- 172.21.15.116:0/1338697602 >> v1:172.21.15.142:6789/0 conn(0x7ff9d0066e70 legacy=0x7ff9d00b0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:59.330 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.336+0000 7ff9cffff640 1 -- 172.21.15.116:0/1338697602 >> v1:172.21.15.116:6789/0 conn(0x7ff9d015e400 legacy=0x7ff9d006ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:59.330 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.336+0000 7ff9cffff640 1 -- 172.21.15.116:0/1338697602 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9d00b55e0 con 0x7ff9d006b550 2024-02-21T22:53:59.330 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.337+0000 7ff9cffff640 1 --2- 172.21.15.116:0/1338697602 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff9d006b550 0x7ff9d00cd4e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff9bc0097d0 tx=0x7ff9bc02b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ec5d714623fd54d2 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:59.330 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.337+0000 7ff9cf7fe640 1 -- 172.21.15.116:0/1338697602 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9bc035020 con 0x7ff9d006b550 2024-02-21T22:53:59.330 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.337+0000 7ff9cf7fe640 1 -- 172.21.15.116:0/1338697602 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9bc031800 con 0x7ff9d006b550 2024-02-21T22:53:59.330 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.337+0000 7ff9cf7fe640 1 -- 172.21.15.116:0/1338697602 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9bc031bb0 con 0x7ff9d006b550 2024-02-21T22:53:59.330 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.338+0000 7ff9d6d55640 1 -- 172.21.15.116:0/1338697602 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff9d006b550 msgr2=0x7ff9d00cd4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:59.331 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.338+0000 7ff9d6d55640 1 --2- 172.21.15.116:0/1338697602 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff9d006b550 0x7ff9d00cd4e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff9bc0097d0 tx=0x7ff9bc02b8a0 comp rx=0 tx=0).stop 2024-02-21T22:53:59.331 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.338+0000 7ff9d6d55640 1 -- 172.21.15.116:0/1338697602 shutdown_connections 2024-02-21T22:53:59.331 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.338+0000 7ff9d6d55640 1 --2- 172.21.15.116:0/1338697602 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff9d006b550 0x7ff9d00cd4e0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:59.331 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.338+0000 7ff9d6d55640 1 -- 172.21.15.116:0/1338697602 >> 172.21.15.116:0/1338697602 conn(0x7ff9d00b1e20 msgr2=0x7ff9d00b2230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:59.331 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.338+0000 7ff9d6d55640 1 -- 172.21.15.116:0/1338697602 shutdown_connections 2024-02-21T22:53:59.331 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.338+0000 7ff9d6d55640 1 -- 172.21.15.116:0/1338697602 wait complete. 2024-02-21T22:53:59.334 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.339+0000 7ff9d6d55640 1 Processor -- start 2024-02-21T22:53:59.334 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.339+0000 7ff9d6d55640 1 -- start start 2024-02-21T22:53:59.334 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.340+0000 7ff9d6d55640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff9d0066e70 0x7ff9d00998e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:59.334 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.340+0000 7ff9d6d55640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff9d006b550 0x7ff9d0156fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:59.334 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.340+0000 7ff9d6d55640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff9d015e400 0x7ff9d01596d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:59.334 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.340+0000 7ff9d6d55640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9d00cdac0 con 0x7ff9d0066e70 2024-02-21T22:53:59.335 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.340+0000 7ff9d6d55640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9d00af890 con 0x7ff9d006b550 2024-02-21T22:53:59.335 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.340+0000 7ff9d6d55640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9d00b5de0 con 0x7ff9d015e400 2024-02-21T22:53:59.335 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.340+0000 7ff9d4af1640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff9d0066e70 0x7ff9d00998e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:59.335 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.340+0000 7ff9d4af1640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff9d0066e70 0x7ff9d00998e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:56662/0 (socket says 172.21.15.116:56662) 2024-02-21T22:53:59.335 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.340+0000 7ff9d4af1640 1 -- 172.21.15.116:0/3502707321 learned_addr learned my addr 172.21.15.116:0/3502707321 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:59.335 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.340+0000 7ff9cffff640 1 --2- 172.21.15.116:0/3502707321 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff9d006b550 0x7ff9d0156fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:59.335 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.340+0000 7ff9d52f2640 1 --2- 172.21.15.116:0/3502707321 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff9d015e400 0x7ff9d01596d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:59.335 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.340+0000 7ff9d4af1640 1 -- 172.21.15.116:0/3502707321 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff9d015e400 msgr2=0x7ff9d01596d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:59.335 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.340+0000 7ff9d4af1640 1 --2- 172.21.15.116:0/3502707321 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff9d015e400 0x7ff9d01596d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:59.336 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.340+0000 7ff9d4af1640 1 -- 172.21.15.116:0/3502707321 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff9d006b550 msgr2=0x7ff9d0156fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:59.336 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.340+0000 7ff9d4af1640 1 --2- 172.21.15.116:0/3502707321 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff9d006b550 0x7ff9d0156fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:59.336 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.340+0000 7ff9d4af1640 1 -- 172.21.15.116:0/3502707321 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9d01574f0 con 0x7ff9d0066e70 2024-02-21T22:53:59.336 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.341+0000 7ff9d4af1640 1 --2- 172.21.15.116:0/3502707321 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff9d0066e70 0x7ff9d00998e0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7ff9c400c3a0 tx=0x7ff9c400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:59.336 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.341+0000 7ff9cd7fa640 1 -- 172.21.15.116:0/3502707321 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9c4017070 con 0x7ff9d0066e70 2024-02-21T22:53:59.336 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.341+0000 7ff9cd7fa640 1 -- 172.21.15.116:0/3502707321 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9c4005ce0 con 0x7ff9d0066e70 2024-02-21T22:53:59.336 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.341+0000 7ff9d6d55640 1 -- 172.21.15.116:0/3502707321 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9d0157790 con 0x7ff9d0066e70 2024-02-21T22:53:59.336 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.341+0000 7ff9cd7fa640 1 -- 172.21.15.116:0/3502707321 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9c4007310 con 0x7ff9d0066e70 2024-02-21T22:53:59.336 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.341+0000 7ff9d6d55640 1 -- 172.21.15.116:0/3502707321 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9d0157d50 con 0x7ff9d0066e70 2024-02-21T22:53:59.337 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.342+0000 7ff9d6d55640 1 -- 172.21.15.116:0/3502707321 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9d00752f0 con 0x7ff9d0066e70 2024-02-21T22:53:59.337 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.342+0000 7ff9cd7fa640 1 -- 172.21.15.116:0/3502707321 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ff9c401a070 con 0x7ff9d0066e70 2024-02-21T22:53:59.337 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.343+0000 7ff9cd7fa640 1 --2- 172.21.15.116:0/3502707321 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7ff9b406b4d0 0x7ff9b406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:59.337 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.343+0000 7ff9cd7fa640 1 -- 172.21.15.116:0/3502707321 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff9c4089570 con 0x7ff9d0066e70 2024-02-21T22:53:59.337 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.343+0000 7ff9cffff640 1 --2- 172.21.15.116:0/3502707321 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7ff9b406b4d0 0x7ff9b406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:59.337 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.343+0000 7ff9cffff640 1 --2- 172.21.15.116:0/3502707321 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7ff9b406b4d0 0x7ff9b406d990 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7ff9bc036000 tx=0x7ff9bc008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:59.338 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.347+0000 7ff9cd7fa640 1 -- 172.21.15.116:0/3502707321 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7ff9d015e7e0 con 0x7ff9d0066e70 2024-02-21T22:53:59.514 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.523+0000 7ff9d6d55640 1 -- 172.21.15.116:0/3502707321 --> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7ff9d00cc0e0 con 0x7ff9b406b4d0 2024-02-21T22:53:59.514 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.524+0000 7ff9cd7fa640 1 -- 172.21.15.116:0/3502707321 <== mgr.4103 v2:172.21.15.142:6832/1381484782 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7ff9d00cc0e0 con 0x7ff9b406b4d0 2024-02-21T22:53:59.515 INFO:teuthology.orchestra.run.smithi116.stderr:instructed osd(s) 7 to deep-scrub 2024-02-21T22:53:59.517 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.526+0000 7ff9d6d55640 1 -- 172.21.15.116:0/3502707321 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7ff9b406b4d0 msgr2=0x7ff9b406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:59.517 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.526+0000 7ff9d6d55640 1 --2- 172.21.15.116:0/3502707321 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7ff9b406b4d0 0x7ff9b406d990 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7ff9bc036000 tx=0x7ff9bc008030 comp rx=0 tx=0).stop 2024-02-21T22:53:59.517 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.526+0000 7ff9d6d55640 1 -- 172.21.15.116:0/3502707321 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff9d0066e70 msgr2=0x7ff9d00998e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:59.517 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.526+0000 7ff9d6d55640 1 --2- 172.21.15.116:0/3502707321 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff9d0066e70 0x7ff9d00998e0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7ff9c400c3a0 tx=0x7ff9c400c860 comp rx=0 tx=0).stop 2024-02-21T22:53:59.517 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.526+0000 7ff9d6d55640 1 -- 172.21.15.116:0/3502707321 shutdown_connections 2024-02-21T22:53:59.517 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.526+0000 7ff9d6d55640 1 --2- 172.21.15.116:0/3502707321 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7ff9b406b4d0 0x7ff9b406d990 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:59.517 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.526+0000 7ff9d6d55640 1 --2- 172.21.15.116:0/3502707321 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff9d015e400 0x7ff9d01596d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:59.517 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.526+0000 7ff9d6d55640 1 --2- 172.21.15.116:0/3502707321 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff9d006b550 0x7ff9d0156fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:59.518 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.526+0000 7ff9d6d55640 1 --2- 172.21.15.116:0/3502707321 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff9d0066e70 0x7ff9d00998e0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:59.518 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.526+0000 7ff9d6d55640 1 -- 172.21.15.116:0/3502707321 >> 172.21.15.116:0/3502707321 conn(0x7ff9d00b1e20 msgr2=0x7ff9d006b930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:59.518 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.526+0000 7ff9d6d55640 1 -- 172.21.15.116:0/3502707321 shutdown_connections 2024-02-21T22:53:59.518 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.526+0000 7ff9d6d55640 1 -- 172.21.15.116:0/3502707321 wait complete. 2024-02-21T22:53:59.527 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-21T22:53:59.628 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.638+0000 7fe756b9c640 1 Processor -- start 2024-02-21T22:53:59.628 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.638+0000 7fe756b9c640 1 -- start start 2024-02-21T22:53:59.631 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.638+0000 7fe756b9c640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fe75015f5a0 0x7fe7500cec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:59.631 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.638+0000 7fe756b9c640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fe7500b26d0 0x7fe7500d01f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:59.631 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.638+0000 7fe756b9c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe7500d0730 0x7fe7500b1570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:59.631 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.638+0000 7fe756b9c640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7500cf9f0 con 0x7fe75015f5a0 2024-02-21T22:53:59.631 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.638+0000 7fe756b9c640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7500ae8a0 con 0x7fe7500b26d0 2024-02-21T22:53:59.632 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.638+0000 7fe756b9c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7500d2730 con 0x7fe7500d0730 2024-02-21T22:53:59.632 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.639+0000 7fe754938640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fe75015f5a0 0x7fe7500cec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:59.632 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.639+0000 7fe754938640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fe75015f5a0 0x7fe7500cec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:56678/0 (socket says 172.21.15.116:56678) 2024-02-21T22:53:59.632 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.639+0000 7fe754938640 1 -- 172.21.15.116:0/3099689868 learned_addr learned my addr 172.21.15.116:0/3099689868 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:59.632 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.639+0000 7fe755139640 1 --2- 172.21.15.116:0/3099689868 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe7500d0730 0x7fe7500b1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:59.632 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.639+0000 7fe74ffff640 1 --2- 172.21.15.116:0/3099689868 >> v2:172.21.15.142:3300/0 conn(0x7fe7500b26d0 0x7fe7500d01f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:59.632 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.639+0000 7fe754938640 1 -- 172.21.15.116:0/3099689868 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe7500d0730 msgr2=0x7fe7500b1570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:53:59.634 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.639+0000 7fe754938640 1 --2- 172.21.15.116:0/3099689868 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe7500d0730 0x7fe7500b1570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:59.634 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.639+0000 7fe754938640 1 -- 172.21.15.116:0/3099689868 >> v2:172.21.15.142:3300/0 conn(0x7fe7500b26d0 msgr2=0x7fe7500d01f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:53:59.634 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.639+0000 7fe754938640 1 --2- 172.21.15.116:0/3099689868 >> v2:172.21.15.142:3300/0 conn(0x7fe7500b26d0 0x7fe7500d01f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:59.634 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.639+0000 7fe754938640 1 -- 172.21.15.116:0/3099689868 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7500cff20 con 0x7fe75015f5a0 2024-02-21T22:53:59.634 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.640+0000 7fe754938640 1 --2- 172.21.15.116:0/3099689868 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe75015f5a0 0x7fe7500cec50 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fe750068460 tx=0x7fe74802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9261d4025fc6f1eb server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:59.634 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.640+0000 7fe74f7fe640 1 -- 172.21.15.116:0/3099689868 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe74802ca70 con 0x7fe75015f5a0 2024-02-21T22:53:59.634 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.640+0000 7fe74f7fe640 1 -- 172.21.15.116:0/3099689868 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe74802cc10 con 0x7fe75015f5a0 2024-02-21T22:53:59.635 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.640+0000 7fe74f7fe640 1 -- 172.21.15.116:0/3099689868 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7480343f0 con 0x7fe75015f5a0 2024-02-21T22:53:59.635 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.640+0000 7fe756b9c640 1 -- 172.21.15.116:0/3099689868 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe75015f5a0 msgr2=0x7fe7500cec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:59.635 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.640+0000 7fe756b9c640 1 --2- 172.21.15.116:0/3099689868 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe75015f5a0 0x7fe7500cec50 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fe750068460 tx=0x7fe74802bed0 comp rx=0 tx=0).stop 2024-02-21T22:53:59.635 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.640+0000 7fe756b9c640 1 -- 172.21.15.116:0/3099689868 shutdown_connections 2024-02-21T22:53:59.635 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.640+0000 7fe756b9c640 1 --2- 172.21.15.116:0/3099689868 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe7500d0730 0x7fe7500b1570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:59.635 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.640+0000 7fe756b9c640 1 --2- 172.21.15.116:0/3099689868 >> v2:172.21.15.142:3300/0 conn(0x7fe7500b26d0 0x7fe7500d01f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:59.636 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.640+0000 7fe756b9c640 1 --2- 172.21.15.116:0/3099689868 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe75015f5a0 0x7fe7500cec50 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:59.636 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.640+0000 7fe756b9c640 1 -- 172.21.15.116:0/3099689868 >> 172.21.15.116:0/3099689868 conn(0x7fe7500d1c10 msgr2=0x7fe7500d2020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:59.636 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.640+0000 7fe756b9c640 1 -- 172.21.15.116:0/3099689868 shutdown_connections 2024-02-21T22:53:59.636 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.640+0000 7fe756b9c640 1 -- 172.21.15.116:0/3099689868 wait complete. 2024-02-21T22:53:59.639 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.642+0000 7fe756b9c640 1 Processor -- start 2024-02-21T22:53:59.639 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.642+0000 7fe756b9c640 1 -- start start 2024-02-21T22:53:59.639 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.642+0000 7fe756b9c640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe7500b26d0 0x7fe7501f1f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:59.639 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.642+0000 7fe756b9c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe7500d0730 0x7fe75015bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:59.639 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.642+0000 7fe756b9c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe75015f5a0 0x7fe7500b69a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:59.639 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.642+0000 7fe756b9c640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7500b2e90 con 0x7fe7500b26d0 2024-02-21T22:53:59.640 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.642+0000 7fe756b9c640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7500cfc40 con 0x7fe75015f5a0 2024-02-21T22:53:59.640 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.642+0000 7fe756b9c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7500b3010 con 0x7fe7500d0730 2024-02-21T22:53:59.640 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.642+0000 7fe754938640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe7500b26d0 0x7fe7501f1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:59.640 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.642+0000 7fe754938640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe7500b26d0 0x7fe7501f1f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:56680/0 (socket says 172.21.15.116:56680) 2024-02-21T22:53:59.640 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.643+0000 7fe754938640 1 -- 172.21.15.116:0/2465319921 learned_addr learned my addr 172.21.15.116:0/2465319921 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:53:59.640 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.643+0000 7fe74ffff640 1 --2- 172.21.15.116:0/2465319921 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe7500d0730 0x7fe75015bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:59.640 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.643+0000 7fe755139640 1 --2- 172.21.15.116:0/2465319921 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe75015f5a0 0x7fe7500b69a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:59.641 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.643+0000 7fe754938640 1 -- 172.21.15.116:0/2465319921 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe7500d0730 msgr2=0x7fe75015bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:59.641 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.643+0000 7fe754938640 1 --2- 172.21.15.116:0/2465319921 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe7500d0730 0x7fe75015bab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:59.641 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.643+0000 7fe754938640 1 -- 172.21.15.116:0/2465319921 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe75015f5a0 msgr2=0x7fe7500b69a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:59.641 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.643+0000 7fe754938640 1 --2- 172.21.15.116:0/2465319921 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe75015f5a0 0x7fe7500b69a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:59.641 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.643+0000 7fe754938640 1 -- 172.21.15.116:0/2465319921 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7500c5a80 con 0x7fe7500b26d0 2024-02-21T22:53:59.641 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.643+0000 7fe754938640 1 --2- 172.21.15.116:0/2465319921 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe7500b26d0 0x7fe7501f1f10 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fe748000f80 tx=0x7fe748004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:59.641 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.643+0000 7fe74d7fa640 1 -- 172.21.15.116:0/2465319921 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe748043020 con 0x7fe7500b26d0 2024-02-21T22:53:59.642 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.643+0000 7fe74d7fa640 1 -- 172.21.15.116:0/2465319921 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe74803e450 con 0x7fe7500b26d0 2024-02-21T22:53:59.642 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.643+0000 7fe74d7fa640 1 -- 172.21.15.116:0/2465319921 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe748009510 con 0x7fe7500b26d0 2024-02-21T22:53:59.642 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.643+0000 7fe756b9c640 1 -- 172.21.15.116:0/2465319921 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7500b7340 con 0x7fe7500b26d0 2024-02-21T22:53:59.642 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.643+0000 7fe756b9c640 1 -- 172.21.15.116:0/2465319921 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7500c6020 con 0x7fe7500b26d0 2024-02-21T22:53:59.642 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.644+0000 7fe756b9c640 1 -- 172.21.15.116:0/2465319921 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7500752f0 con 0x7fe7500b26d0 2024-02-21T22:53:59.642 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.645+0000 7fe74d7fa640 1 -- 172.21.15.116:0/2465319921 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fe748046020 con 0x7fe7500b26d0 2024-02-21T22:53:59.642 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.645+0000 7fe74d7fa640 1 --2- 172.21.15.116:0/2465319921 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fe73006b4d0 0x7fe73006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:53:59.642 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.645+0000 7fe74d7fa640 1 -- 172.21.15.116:0/2465319921 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe7480ac7f0 con 0x7fe7500b26d0 2024-02-21T22:53:59.643 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.645+0000 7fe74ffff640 1 --2- 172.21.15.116:0/2465319921 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fe73006b4d0 0x7fe73006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:53:59.643 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.646+0000 7fe74ffff640 1 --2- 172.21.15.116:0/2465319921 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fe73006b4d0 0x7fe73006d990 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fe75015cc00 tx=0x7fe738009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:53:59.643 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.649+0000 7fe74d7fa640 1 -- 172.21.15.116:0/2465319921 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7fe74804d030 con 0x7fe7500b26d0 2024-02-21T22:53:59.808 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.817+0000 7fe756b9c640 1 -- 172.21.15.116:0/2465319921 --> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe7501f2450 con 0x7fe73006b4d0 2024-02-21T22:53:59.819 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.829+0000 7fe74d7fa640 1 -- 172.21.15.116:0/2465319921 <== mgr.4103 v2:172.21.15.142:6832/1381484782 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251840 (secure 0 0 0) 0x7fe738011910 con 0x7fe73006b4d0 2024-02-21T22:53:59.822 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-02-21T22:53:59.823 INFO:teuthology.orchestra.run.smithi116.stderr:dumped all 2024-02-21T22:53:59.825 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.832+0000 7fe756b9c640 1 -- 172.21.15.116:0/2465319921 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fe73006b4d0 msgr2=0x7fe73006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:59.825 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.832+0000 7fe756b9c640 1 --2- 172.21.15.116:0/2465319921 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fe73006b4d0 0x7fe73006d990 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fe75015cc00 tx=0x7fe738009190 comp rx=0 tx=0).stop 2024-02-21T22:53:59.825 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.832+0000 7fe756b9c640 1 -- 172.21.15.116:0/2465319921 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe7500b26d0 msgr2=0x7fe7501f1f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:53:59.826 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.832+0000 7fe756b9c640 1 --2- 172.21.15.116:0/2465319921 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe7500b26d0 0x7fe7501f1f10 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fe748000f80 tx=0x7fe748004a40 comp rx=0 tx=0).stop 2024-02-21T22:53:59.826 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.832+0000 7fe756b9c640 1 -- 172.21.15.116:0/2465319921 shutdown_connections 2024-02-21T22:53:59.826 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.832+0000 7fe756b9c640 1 --2- 172.21.15.116:0/2465319921 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe75015f5a0 0x7fe7500b69a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:59.826 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.832+0000 7fe756b9c640 1 --2- 172.21.15.116:0/2465319921 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fe73006b4d0 0x7fe73006d990 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:59.826 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.832+0000 7fe756b9c640 1 --2- 172.21.15.116:0/2465319921 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe7500d0730 0x7fe75015bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:59.826 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.832+0000 7fe756b9c640 1 --2- 172.21.15.116:0/2465319921 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe7500b26d0 0x7fe7501f1f10 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:53:59.826 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.832+0000 7fe756b9c640 1 -- 172.21.15.116:0/2465319921 >> 172.21.15.116:0/2465319921 conn(0x7fe7500d1c10 msgr2=0x7fe7500b0ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:53:59.826 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.832+0000 7fe756b9c640 1 -- 172.21.15.116:0/2465319921 shutdown_connections 2024-02-21T22:53:59.827 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:53:59.832+0000 7fe756b9c640 1 -- 172.21.15.116:0/2465319921 wait complete. 2024-02-21T22:53:59.833 INFO:teuthology.orchestra.run.smithi116.stdout:{"pg_ready":true,"pg_map":{"version":66,"stamp":"2024-02-21T22:53:58.299458+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":598311,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":212,"num_write_kb":2439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":162,"ondisk_log_size":162,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220332,"kb_used_data":4144,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754388,"statfs":{"total":773094113280,"available":772868493312,"internally_reserved":0,"allocated":4243456,"data_stored":2369393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5533,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001955"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.323002+0000","last_change":"2024-02-21T22:53:43.002525+0000","last_active":"2024-02-21T22:53:44.323002+0000","last_peered":"2024-02-21T22:53:44.323002+0000","last_clean":"2024-02-21T22:53:44.323002+0000","last_became_active":"2024-02-21T22:53:43.002238+0000","last_became_peered":"2024-02-21T22:53:43.002238+0000","last_unstale":"2024-02-21T22:53:44.323002+0000","last_undegraded":"2024-02-21T22:53:44.323002+0000","last_fullsized":"2024-02-21T22:53:44.323002+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:26:25.990337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.340424+0000","last_change":"2024-02-21T22:53:43.000671+0000","last_active":"2024-02-21T22:53:44.340424+0000","last_peered":"2024-02-21T22:53:44.340424+0000","last_clean":"2024-02-21T22:53:44.340424+0000","last_became_active":"2024-02-21T22:53:43.000396+0000","last_became_peered":"2024-02-21T22:53:43.000396+0000","last_unstale":"2024-02-21T22:53:44.340424+0000","last_undegraded":"2024-02-21T22:53:44.340424+0000","last_fullsized":"2024-02-21T22:53:44.340424+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:54:49.339689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.340666+0000","last_change":"2024-02-21T22:53:43.004625+0000","last_active":"2024-02-21T22:53:44.340666+0000","last_peered":"2024-02-21T22:53:44.340666+0000","last_clean":"2024-02-21T22:53:44.340666+0000","last_became_active":"2024-02-21T22:53:43.004321+0000","last_became_peered":"2024-02-21T22:53:43.004321+0000","last_unstale":"2024-02-21T22:53:44.340666+0000","last_undegraded":"2024-02-21T22:53:44.340666+0000","last_fullsized":"2024-02-21T22:53:44.340666+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:34:47.098047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.989775+0000","last_change":"2024-02-21T22:53:43.010931+0000","last_active":"2024-02-21T22:53:43.989775+0000","last_peered":"2024-02-21T22:53:43.989775+0000","last_clean":"2024-02-21T22:53:43.989775+0000","last_became_active":"2024-02-21T22:53:43.010683+0000","last_became_peered":"2024-02-21T22:53:43.010683+0000","last_unstale":"2024-02-21T22:53:43.989775+0000","last_undegraded":"2024-02-21T22:53:43.989775+0000","last_fullsized":"2024-02-21T22:53:43.989775+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:38:31.580364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.236363+0000","last_change":"2024-02-21T22:53:43.006662+0000","last_active":"2024-02-21T22:53:44.236363+0000","last_peered":"2024-02-21T22:53:44.236363+0000","last_clean":"2024-02-21T22:53:44.236363+0000","last_became_active":"2024-02-21T22:53:43.006405+0000","last_became_peered":"2024-02-21T22:53:43.006405+0000","last_unstale":"2024-02-21T22:53:44.236363+0000","last_undegraded":"2024-02-21T22:53:44.236363+0000","last_fullsized":"2024-02-21T22:53:44.236363+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:38:23.681255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.340162+0000","last_change":"2024-02-21T22:53:42.997969+0000","last_active":"2024-02-21T22:53:44.340162+0000","last_peered":"2024-02-21T22:53:44.340162+0000","last_clean":"2024-02-21T22:53:44.340162+0000","last_became_active":"2024-02-21T22:53:42.997719+0000","last_became_peered":"2024-02-21T22:53:42.997719+0000","last_unstale":"2024-02-21T22:53:44.340162+0000","last_undegraded":"2024-02-21T22:53:44.340162+0000","last_fullsized":"2024-02-21T22:53:44.340162+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:09:41.280308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.340372+0000","last_change":"2024-02-21T22:53:43.007930+0000","last_active":"2024-02-21T22:53:44.340372+0000","last_peered":"2024-02-21T22:53:44.340372+0000","last_clean":"2024-02-21T22:53:44.340372+0000","last_became_active":"2024-02-21T22:53:43.007675+0000","last_became_peered":"2024-02-21T22:53:43.007675+0000","last_unstale":"2024-02-21T22:53:44.340372+0000","last_undegraded":"2024-02-21T22:53:44.340372+0000","last_fullsized":"2024-02-21T22:53:44.340372+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:09:41.280308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.340102+0000","last_change":"2024-02-21T22:53:43.001108+0000","last_active":"2024-02-21T22:53:44.340102+0000","last_peered":"2024-02-21T22:53:44.340102+0000","last_clean":"2024-02-21T22:53:44.340102+0000","last_became_active":"2024-02-21T22:53:43.000729+0000","last_became_peered":"2024-02-21T22:53:43.000729+0000","last_unstale":"2024-02-21T22:53:44.340102+0000","last_undegraded":"2024-02-21T22:53:44.340102+0000","last_fullsized":"2024-02-21T22:53:44.340102+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:53:37.531108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.991662+0000","last_change":"2024-02-21T22:53:43.016364+0000","last_active":"2024-02-21T22:53:43.991662+0000","last_peered":"2024-02-21T22:53:43.991662+0000","last_clean":"2024-02-21T22:53:43.991662+0000","last_became_active":"2024-02-21T22:53:43.015907+0000","last_became_peered":"2024-02-21T22:53:43.015907+0000","last_unstale":"2024-02-21T22:53:43.991662+0000","last_undegraded":"2024-02-21T22:53:43.991662+0000","last_fullsized":"2024-02-21T22:53:43.991662+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:53:37.531108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.990165+0000","last_change":"2024-02-21T22:53:43.005373+0000","last_active":"2024-02-21T22:53:43.990165+0000","last_peered":"2024-02-21T22:53:43.990165+0000","last_clean":"2024-02-21T22:53:43.990165+0000","last_became_active":"2024-02-21T22:53:43.005035+0000","last_became_peered":"2024-02-21T22:53:43.005035+0000","last_unstale":"2024-02-21T22:53:43.990165+0000","last_undegraded":"2024-02-21T22:53:43.990165+0000","last_fullsized":"2024-02-21T22:53:43.990165+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:03:52.457060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.341174+0000","last_change":"2024-02-21T22:53:43.011309+0000","last_active":"2024-02-21T22:53:44.341174+0000","last_peered":"2024-02-21T22:53:44.341174+0000","last_clean":"2024-02-21T22:53:44.341174+0000","last_became_active":"2024-02-21T22:53:43.010956+0000","last_became_peered":"2024-02-21T22:53:43.010956+0000","last_unstale":"2024-02-21T22:53:44.341174+0000","last_undegraded":"2024-02-21T22:53:44.341174+0000","last_fullsized":"2024-02-21T22:53:44.341174+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:24:37.189670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.340545+0000","last_change":"2024-02-21T22:53:43.007326+0000","last_active":"2024-02-21T22:53:44.340545+0000","last_peered":"2024-02-21T22:53:44.340545+0000","last_clean":"2024-02-21T22:53:44.340545+0000","last_became_active":"2024-02-21T22:53:43.007022+0000","last_became_peered":"2024-02-21T22:53:43.007022+0000","last_unstale":"2024-02-21T22:53:44.340545+0000","last_undegraded":"2024-02-21T22:53:44.340545+0000","last_fullsized":"2024-02-21T22:53:44.340545+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:09:41.280308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.236376+0000","last_change":"2024-02-21T22:53:42.999643+0000","last_active":"2024-02-21T22:53:44.236376+0000","last_peered":"2024-02-21T22:53:44.236376+0000","last_clean":"2024-02-21T22:53:44.236376+0000","last_became_active":"2024-02-21T22:53:42.999406+0000","last_became_peered":"2024-02-21T22:53:42.999406+0000","last_unstale":"2024-02-21T22:53:44.236376+0000","last_undegraded":"2024-02-21T22:53:44.236376+0000","last_fullsized":"2024-02-21T22:53:44.236376+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:44:43.049562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.340324+0000","last_change":"2024-02-21T22:53:43.005346+0000","last_active":"2024-02-21T22:53:44.340324+0000","last_peered":"2024-02-21T22:53:44.340324+0000","last_clean":"2024-02-21T22:53:44.340324+0000","last_became_active":"2024-02-21T22:53:43.004383+0000","last_became_peered":"2024-02-21T22:53:43.004383+0000","last_unstale":"2024-02-21T22:53:44.340324+0000","last_undegraded":"2024-02-21T22:53:44.340324+0000","last_fullsized":"2024-02-21T22:53:44.340324+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:24:37.189670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.340241+0000","last_change":"2024-02-21T22:53:42.995690+0000","last_active":"2024-02-21T22:53:44.340241+0000","last_peered":"2024-02-21T22:53:44.340241+0000","last_clean":"2024-02-21T22:53:44.340241+0000","last_became_active":"2024-02-21T22:53:42.995407+0000","last_became_peered":"2024-02-21T22:53:42.995407+0000","last_unstale":"2024-02-21T22:53:44.340241+0000","last_undegraded":"2024-02-21T22:53:44.340241+0000","last_fullsized":"2024-02-21T22:53:44.340241+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:41:56.581902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.340256+0000","last_change":"2024-02-21T22:53:43.009355+0000","last_active":"2024-02-21T22:53:44.340256+0000","last_peered":"2024-02-21T22:53:44.340256+0000","last_clean":"2024-02-21T22:53:44.340256+0000","last_became_active":"2024-02-21T22:53:43.009073+0000","last_became_peered":"2024-02-21T22:53:43.009073+0000","last_unstale":"2024-02-21T22:53:44.340256+0000","last_undegraded":"2024-02-21T22:53:44.340256+0000","last_fullsized":"2024-02-21T22:53:44.340256+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:03:52.457060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.341204+0000","last_change":"2024-02-21T22:53:43.008675+0000","last_active":"2024-02-21T22:53:44.341204+0000","last_peered":"2024-02-21T22:53:44.341204+0000","last_clean":"2024-02-21T22:53:44.341204+0000","last_became_active":"2024-02-21T22:53:43.008404+0000","last_became_peered":"2024-02-21T22:53:43.008404+0000","last_unstale":"2024-02-21T22:53:44.341204+0000","last_undegraded":"2024-02-21T22:53:44.341204+0000","last_fullsized":"2024-02-21T22:53:44.341204+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:00:32.372505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.340466+0000","last_change":"2024-02-21T22:53:42.999615+0000","last_active":"2024-02-21T22:53:44.340466+0000","last_peered":"2024-02-21T22:53:44.340466+0000","last_clean":"2024-02-21T22:53:44.340466+0000","last_became_active":"2024-02-21T22:53:42.999362+0000","last_became_peered":"2024-02-21T22:53:42.999362+0000","last_unstale":"2024-02-21T22:53:44.340466+0000","last_undegraded":"2024-02-21T22:53:44.340466+0000","last_fullsized":"2024-02-21T22:53:44.340466+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:36:43.932976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.340333+0000","last_change":"2024-02-21T22:53:43.010970+0000","last_active":"2024-02-21T22:53:44.340333+0000","last_peered":"2024-02-21T22:53:44.340333+0000","last_clean":"2024-02-21T22:53:44.340333+0000","last_became_active":"2024-02-21T22:53:43.010702+0000","last_became_peered":"2024-02-21T22:53:43.010702+0000","last_unstale":"2024-02-21T22:53:44.340333+0000","last_undegraded":"2024-02-21T22:53:44.340333+0000","last_fullsized":"2024-02-21T22:53:44.340333+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:00:32.372505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.236456+0000","last_change":"2024-02-21T22:53:43.006258+0000","last_active":"2024-02-21T22:53:44.236456+0000","last_peered":"2024-02-21T22:53:44.236456+0000","last_clean":"2024-02-21T22:53:44.236456+0000","last_became_active":"2024-02-21T22:53:43.005993+0000","last_became_peered":"2024-02-21T22:53:43.005993+0000","last_unstale":"2024-02-21T22:53:44.236456+0000","last_undegraded":"2024-02-21T22:53:44.236456+0000","last_fullsized":"2024-02-21T22:53:44.236456+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:27:19.189008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.991192+0000","last_change":"2024-02-21T22:53:43.015003+0000","last_active":"2024-02-21T22:53:43.991192+0000","last_peered":"2024-02-21T22:53:43.991192+0000","last_clean":"2024-02-21T22:53:43.991192+0000","last_became_active":"2024-02-21T22:53:43.014712+0000","last_became_peered":"2024-02-21T22:53:43.014712+0000","last_unstale":"2024-02-21T22:53:43.991192+0000","last_undegraded":"2024-02-21T22:53:43.991192+0000","last_fullsized":"2024-02-21T22:53:43.991192+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:15:36.152598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.991098+0000","last_change":"2024-02-21T22:53:43.014845+0000","last_active":"2024-02-21T22:53:43.991098+0000","last_peered":"2024-02-21T22:53:43.991098+0000","last_clean":"2024-02-21T22:53:43.991098+0000","last_became_active":"2024-02-21T22:53:43.014570+0000","last_became_peered":"2024-02-21T22:53:43.014570+0000","last_unstale":"2024-02-21T22:53:43.991098+0000","last_undegraded":"2024-02-21T22:53:43.991098+0000","last_fullsized":"2024-02-21T22:53:43.991098+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:26:25.990337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.990453+0000","last_change":"2024-02-21T22:53:43.002518+0000","last_active":"2024-02-21T22:53:43.990453+0000","last_peered":"2024-02-21T22:53:43.990453+0000","last_clean":"2024-02-21T22:53:43.990453+0000","last_became_active":"2024-02-21T22:53:43.002254+0000","last_became_peered":"2024-02-21T22:53:43.002254+0000","last_unstale":"2024-02-21T22:53:43.990453+0000","last_undegraded":"2024-02-21T22:53:43.990453+0000","last_fullsized":"2024-02-21T22:53:43.990453+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:06:03.706623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.340072+0000","last_change":"2024-02-21T22:53:42.996552+0000","last_active":"2024-02-21T22:53:44.340072+0000","last_peered":"2024-02-21T22:53:44.340072+0000","last_clean":"2024-02-21T22:53:44.340072+0000","last_became_active":"2024-02-21T22:53:42.996208+0000","last_became_peered":"2024-02-21T22:53:42.996208+0000","last_unstale":"2024-02-21T22:53:44.340072+0000","last_undegraded":"2024-02-21T22:53:44.340072+0000","last_fullsized":"2024-02-21T22:53:44.340072+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:31:54.235302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.990349+0000","last_change":"2024-02-21T22:53:43.003996+0000","last_active":"2024-02-21T22:53:43.990349+0000","last_peered":"2024-02-21T22:53:43.990349+0000","last_clean":"2024-02-21T22:53:43.990349+0000","last_became_active":"2024-02-21T22:53:43.003710+0000","last_became_peered":"2024-02-21T22:53:43.003710+0000","last_unstale":"2024-02-21T22:53:43.990349+0000","last_undegraded":"2024-02-21T22:53:43.990349+0000","last_fullsized":"2024-02-21T22:53:43.990349+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T02:25:22.385393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.340570+0000","last_change":"2024-02-21T22:53:43.000854+0000","last_active":"2024-02-21T22:53:44.340570+0000","last_peered":"2024-02-21T22:53:44.340570+0000","last_clean":"2024-02-21T22:53:44.340570+0000","last_became_active":"2024-02-21T22:53:43.000575+0000","last_became_peered":"2024-02-21T22:53:43.000575+0000","last_unstale":"2024-02-21T22:53:44.340570+0000","last_undegraded":"2024-02-21T22:53:44.340570+0000","last_fullsized":"2024-02-21T22:53:44.340570+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:03:16.607197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.990344+0000","last_change":"2024-02-21T22:53:43.011416+0000","last_active":"2024-02-21T22:53:43.990344+0000","last_peered":"2024-02-21T22:53:43.990344+0000","last_clean":"2024-02-21T22:53:43.990344+0000","last_became_active":"2024-02-21T22:53:43.010808+0000","last_became_peered":"2024-02-21T22:53:43.010808+0000","last_unstale":"2024-02-21T22:53:43.990344+0000","last_undegraded":"2024-02-21T22:53:43.990344+0000","last_fullsized":"2024-02-21T22:53:43.990344+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:09:41.280308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.340672+0000","last_change":"2024-02-21T22:53:42.999624+0000","last_active":"2024-02-21T22:53:44.340672+0000","last_peered":"2024-02-21T22:53:44.340672+0000","last_clean":"2024-02-21T22:53:44.340672+0000","last_became_active":"2024-02-21T22:53:42.999295+0000","last_became_peered":"2024-02-21T22:53:42.999295+0000","last_unstale":"2024-02-21T22:53:44.340672+0000","last_undegraded":"2024-02-21T22:53:44.340672+0000","last_fullsized":"2024-02-21T22:53:44.340672+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:24:37.189670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.991295+0000","last_change":"2024-02-21T22:53:43.016081+0000","last_active":"2024-02-21T22:53:43.991295+0000","last_peered":"2024-02-21T22:53:43.991295+0000","last_clean":"2024-02-21T22:53:43.991295+0000","last_became_active":"2024-02-21T22:53:43.015533+0000","last_became_peered":"2024-02-21T22:53:43.015533+0000","last_unstale":"2024-02-21T22:53:43.991295+0000","last_undegraded":"2024-02-21T22:53:43.991295+0000","last_fullsized":"2024-02-21T22:53:43.991295+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:13:51.231189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.340327+0000","last_change":"2024-02-21T22:53:43.007179+0000","last_active":"2024-02-21T22:53:44.340327+0000","last_peered":"2024-02-21T22:53:44.340327+0000","last_clean":"2024-02-21T22:53:44.340327+0000","last_became_active":"2024-02-21T22:53:43.006982+0000","last_became_peered":"2024-02-21T22:53:43.006982+0000","last_unstale":"2024-02-21T22:53:44.340327+0000","last_undegraded":"2024-02-21T22:53:44.340327+0000","last_fullsized":"2024-02-21T22:53:44.340327+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:41:56.581902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.322838+0000","last_change":"2024-02-21T22:53:43.000423+0000","last_active":"2024-02-21T22:53:44.322838+0000","last_peered":"2024-02-21T22:53:44.322838+0000","last_clean":"2024-02-21T22:53:44.322838+0000","last_became_active":"2024-02-21T22:53:43.000179+0000","last_became_peered":"2024-02-21T22:53:43.000179+0000","last_unstale":"2024-02-21T22:53:44.322838+0000","last_undegraded":"2024-02-21T22:53:44.322838+0000","last_fullsized":"2024-02-21T22:53:44.322838+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:06:03.706623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.340129+0000","last_change":"2024-02-21T22:53:43.013244+0000","last_active":"2024-02-21T22:53:44.340129+0000","last_peered":"2024-02-21T22:53:44.340129+0000","last_clean":"2024-02-21T22:53:44.340129+0000","last_became_active":"2024-02-21T22:53:43.012985+0000","last_became_peered":"2024-02-21T22:53:43.012985+0000","last_unstale":"2024-02-21T22:53:44.340129+0000","last_undegraded":"2024-02-21T22:53:44.340129+0000","last_fullsized":"2024-02-21T22:53:44.340129+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:38:31.580364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.990598+0000","last_change":"2024-02-21T22:53:43.001816+0000","last_active":"2024-02-21T22:53:43.990598+0000","last_peered":"2024-02-21T22:53:43.990598+0000","last_clean":"2024-02-21T22:53:43.990598+0000","last_became_active":"2024-02-21T22:53:43.001564+0000","last_became_peered":"2024-02-21T22:53:43.001564+0000","last_unstale":"2024-02-21T22:53:43.990598+0000","last_undegraded":"2024-02-21T22:53:43.990598+0000","last_fullsized":"2024-02-21T22:53:43.990598+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:26:25.990337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"32'4","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.323094+0000","last_change":"2024-02-21T22:53:41.994843+0000","last_active":"2024-02-21T22:53:44.323094+0000","last_peered":"2024-02-21T22:53:44.323094+0000","last_clean":"2024-02-21T22:53:44.323094+0000","last_became_active":"2024-02-21T22:53:41.994468+0000","last_became_peered":"2024-02-21T22:53:41.994468+0000","last_unstale":"2024-02-21T22:53:44.323094+0000","last_undegraded":"2024-02-21T22:53:44.323094+0000","last_fullsized":"2024-02-21T22:53:44.323094+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:27:18.184658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.323022+0000","last_change":"2024-02-21T22:53:43.008294+0000","last_active":"2024-02-21T22:53:44.323022+0000","last_peered":"2024-02-21T22:53:44.323022+0000","last_clean":"2024-02-21T22:53:44.323022+0000","last_became_active":"2024-02-21T22:53:43.008021+0000","last_became_peered":"2024-02-21T22:53:43.008021+0000","last_unstale":"2024-02-21T22:53:44.323022+0000","last_undegraded":"2024-02-21T22:53:44.323022+0000","last_fullsized":"2024-02-21T22:53:44.323022+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:15:36.152598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"32'1","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.990599+0000","last_change":"2024-02-21T22:53:41.987067+0000","last_active":"2024-02-21T22:53:43.990599+0000","last_peered":"2024-02-21T22:53:43.990599+0000","last_clean":"2024-02-21T22:53:43.990599+0000","last_became_active":"2024-02-21T22:53:41.986784+0000","last_became_peered":"2024-02-21T22:53:41.986784+0000","last_unstale":"2024-02-21T22:53:43.990599+0000","last_undegraded":"2024-02-21T22:53:43.990599+0000","last_fullsized":"2024-02-21T22:53:43.990599+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:34:59.792432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.991412+0000","last_change":"2024-02-21T22:53:43.016649+0000","last_active":"2024-02-21T22:53:43.991412+0000","last_peered":"2024-02-21T22:53:43.991412+0000","last_clean":"2024-02-21T22:53:43.991412+0000","last_became_active":"2024-02-21T22:53:43.016339+0000","last_became_peered":"2024-02-21T22:53:43.016339+0000","last_unstale":"2024-02-21T22:53:43.991412+0000","last_undegraded":"2024-02-21T22:53:43.991412+0000","last_fullsized":"2024-02-21T22:53:43.991412+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:40:05.306862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"32'2","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.340263+0000","last_change":"2024-02-21T22:53:41.991758+0000","last_active":"2024-02-21T22:53:44.340263+0000","last_peered":"2024-02-21T22:53:44.340263+0000","last_clean":"2024-02-21T22:53:44.340263+0000","last_became_active":"2024-02-21T22:53:41.990213+0000","last_became_peered":"2024-02-21T22:53:41.990213+0000","last_unstale":"2024-02-21T22:53:44.340263+0000","last_undegraded":"2024-02-21T22:53:44.340263+0000","last_fullsized":"2024-02-21T22:53:44.340263+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:54:00.352993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.990191+0000","last_change":"2024-02-21T22:53:43.011534+0000","last_active":"2024-02-21T22:53:43.990191+0000","last_peered":"2024-02-21T22:53:43.990191+0000","last_clean":"2024-02-21T22:53:43.990191+0000","last_became_active":"2024-02-21T22:53:43.011165+0000","last_became_peered":"2024-02-21T22:53:43.011165+0000","last_unstale":"2024-02-21T22:53:43.990191+0000","last_undegraded":"2024-02-21T22:53:43.990191+0000","last_fullsized":"2024-02-21T22:53:43.990191+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:41:56.581902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"32'2","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.236551+0000","last_change":"2024-02-21T22:53:41.989989+0000","last_active":"2024-02-21T22:53:44.236551+0000","last_peered":"2024-02-21T22:53:44.236551+0000","last_clean":"2024-02-21T22:53:44.236551+0000","last_became_active":"2024-02-21T22:53:41.989105+0000","last_became_peered":"2024-02-21T22:53:41.989105+0000","last_unstale":"2024-02-21T22:53:44.236551+0000","last_undegraded":"2024-02-21T22:53:44.236551+0000","last_fullsized":"2024-02-21T22:53:44.236551+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:22:53.606008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.340540+0000","last_change":"2024-02-21T22:53:43.012670+0000","last_active":"2024-02-21T22:53:44.340540+0000","last_peered":"2024-02-21T22:53:44.340540+0000","last_clean":"2024-02-21T22:53:44.340540+0000","last_became_active":"2024-02-21T22:53:43.012407+0000","last_became_peered":"2024-02-21T22:53:43.012407+0000","last_unstale":"2024-02-21T22:53:44.340540+0000","last_undegraded":"2024-02-21T22:53:44.340540+0000","last_fullsized":"2024-02-21T22:53:44.340540+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T02:25:22.385393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"32'1","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.991294+0000","last_change":"2024-02-21T22:53:41.992560+0000","last_active":"2024-02-21T22:53:43.991294+0000","last_peered":"2024-02-21T22:53:43.991294+0000","last_clean":"2024-02-21T22:53:43.991294+0000","last_became_active":"2024-02-21T22:53:41.992200+0000","last_became_peered":"2024-02-21T22:53:41.992200+0000","last_unstale":"2024-02-21T22:53:43.991294+0000","last_undegraded":"2024-02-21T22:53:43.991294+0000","last_fullsized":"2024-02-21T22:53:43.991294+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:47:38.675797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.340453+0000","last_change":"2024-02-21T22:53:43.003713+0000","last_active":"2024-02-21T22:53:44.340453+0000","last_peered":"2024-02-21T22:53:44.340453+0000","last_clean":"2024-02-21T22:53:44.340453+0000","last_became_active":"2024-02-21T22:53:43.003448+0000","last_became_peered":"2024-02-21T22:53:43.003448+0000","last_unstale":"2024-02-21T22:53:44.340453+0000","last_undegraded":"2024-02-21T22:53:44.340453+0000","last_fullsized":"2024-02-21T22:53:44.340453+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T02:25:22.385393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"32'1","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.991129+0000","last_change":"2024-02-21T22:53:41.989888+0000","last_active":"2024-02-21T22:53:43.991129+0000","last_peered":"2024-02-21T22:53:43.991129+0000","last_clean":"2024-02-21T22:53:43.991129+0000","last_became_active":"2024-02-21T22:53:41.989605+0000","last_became_peered":"2024-02-21T22:53:41.989605+0000","last_unstale":"2024-02-21T22:53:43.991129+0000","last_undegraded":"2024-02-21T22:53:43.991129+0000","last_fullsized":"2024-02-21T22:53:43.991129+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:28:50.954719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.990957+0000","last_change":"2024-02-21T22:53:43.011697+0000","last_active":"2024-02-21T22:53:43.990957+0000","last_peered":"2024-02-21T22:53:43.990957+0000","last_clean":"2024-02-21T22:53:43.990957+0000","last_became_active":"2024-02-21T22:53:43.011446+0000","last_became_peered":"2024-02-21T22:53:43.011446+0000","last_unstale":"2024-02-21T22:53:43.990957+0000","last_undegraded":"2024-02-21T22:53:43.990957+0000","last_fullsized":"2024-02-21T22:53:43.990957+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:53:37.219886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.340098+0000","last_change":"2024-02-21T22:53:41.990198+0000","last_active":"2024-02-21T22:53:44.340098+0000","last_peered":"2024-02-21T22:53:44.340098+0000","last_clean":"2024-02-21T22:53:44.340098+0000","last_became_active":"2024-02-21T22:53:41.989927+0000","last_became_peered":"2024-02-21T22:53:41.989927+0000","last_unstale":"2024-02-21T22:53:44.340098+0000","last_undegraded":"2024-02-21T22:53:44.340098+0000","last_fullsized":"2024-02-21T22:53:44.340098+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:08:08.137842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.989576+0000","last_change":"2024-02-21T22:53:43.008825+0000","last_active":"2024-02-21T22:53:43.989576+0000","last_peered":"2024-02-21T22:53:43.989576+0000","last_clean":"2024-02-21T22:53:43.989576+0000","last_became_active":"2024-02-21T22:53:43.008486+0000","last_became_peered":"2024-02-21T22:53:43.008486+0000","last_unstale":"2024-02-21T22:53:43.989576+0000","last_undegraded":"2024-02-21T22:53:43.989576+0000","last_fullsized":"2024-02-21T22:53:43.989576+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:02:41.596861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.990903+0000","last_change":"2024-02-21T22:53:41.985526+0000","last_active":"2024-02-21T22:53:43.990903+0000","last_peered":"2024-02-21T22:53:43.990903+0000","last_clean":"2024-02-21T22:53:43.990903+0000","last_became_active":"2024-02-21T22:53:41.985232+0000","last_became_peered":"2024-02-21T22:53:41.985232+0000","last_unstale":"2024-02-21T22:53:43.990903+0000","last_undegraded":"2024-02-21T22:53:43.990903+0000","last_fullsized":"2024-02-21T22:53:43.990903+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:46:31.483732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.340853+0000","last_change":"2024-02-21T22:53:43.005931+0000","last_active":"2024-02-21T22:53:44.340853+0000","last_peered":"2024-02-21T22:53:44.340853+0000","last_clean":"2024-02-21T22:53:44.340853+0000","last_became_active":"2024-02-21T22:53:43.005375+0000","last_became_peered":"2024-02-21T22:53:43.005375+0000","last_unstale":"2024-02-21T22:53:44.340853+0000","last_undegraded":"2024-02-21T22:53:44.340853+0000","last_fullsized":"2024-02-21T22:53:44.340853+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:00:32.372505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.340503+0000","last_change":"2024-02-21T22:53:41.987065+0000","last_active":"2024-02-21T22:53:44.340503+0000","last_peered":"2024-02-21T22:53:44.340503+0000","last_clean":"2024-02-21T22:53:44.340503+0000","last_became_active":"2024-02-21T22:53:41.986873+0000","last_became_peered":"2024-02-21T22:53:41.986873+0000","last_unstale":"2024-02-21T22:53:44.340503+0000","last_undegraded":"2024-02-21T22:53:44.340503+0000","last_fullsized":"2024-02-21T22:53:44.340503+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:53:36.215536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.340464+0000","last_change":"2024-02-21T22:53:43.010123+0000","last_active":"2024-02-21T22:53:44.340464+0000","last_peered":"2024-02-21T22:53:44.340464+0000","last_clean":"2024-02-21T22:53:44.340464+0000","last_became_active":"2024-02-21T22:53:43.009846+0000","last_became_peered":"2024-02-21T22:53:43.009846+0000","last_unstale":"2024-02-21T22:53:44.340464+0000","last_undegraded":"2024-02-21T22:53:44.340464+0000","last_fullsized":"2024-02-21T22:53:44.340464+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:18:34.897900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.990694+0000","last_change":"2024-02-21T22:53:41.987725+0000","last_active":"2024-02-21T22:53:43.990694+0000","last_peered":"2024-02-21T22:53:43.990694+0000","last_clean":"2024-02-21T22:53:43.990694+0000","last_became_active":"2024-02-21T22:53:41.987448+0000","last_became_peered":"2024-02-21T22:53:41.987448+0000","last_unstale":"2024-02-21T22:53:43.990694+0000","last_undegraded":"2024-02-21T22:53:43.990694+0000","last_fullsized":"2024-02-21T22:53:43.990694+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:52:02.783816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.340463+0000","last_change":"2024-02-21T22:53:42.997365+0000","last_active":"2024-02-21T22:53:44.340463+0000","last_peered":"2024-02-21T22:53:44.340463+0000","last_clean":"2024-02-21T22:53:44.340463+0000","last_became_active":"2024-02-21T22:53:42.997104+0000","last_became_peered":"2024-02-21T22:53:42.997104+0000","last_unstale":"2024-02-21T22:53:44.340463+0000","last_undegraded":"2024-02-21T22:53:44.340463+0000","last_fullsized":"2024-02-21T22:53:44.340463+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T10:22:33.646484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"32'3","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.340752+0000","last_change":"2024-02-21T22:53:41.994505+0000","last_active":"2024-02-21T22:53:44.340752+0000","last_peered":"2024-02-21T22:53:44.340752+0000","last_clean":"2024-02-21T22:53:44.340752+0000","last_became_active":"2024-02-21T22:53:41.994214+0000","last_became_peered":"2024-02-21T22:53:41.994214+0000","last_unstale":"2024-02-21T22:53:44.340752+0000","last_undegraded":"2024-02-21T22:53:44.340752+0000","last_fullsized":"2024-02-21T22:53:44.340752+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:10:09.126154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.340155+0000","last_change":"2024-02-21T22:53:43.005537+0000","last_active":"2024-02-21T22:53:44.340155+0000","last_peered":"2024-02-21T22:53:44.340155+0000","last_clean":"2024-02-21T22:53:44.340155+0000","last_became_active":"2024-02-21T22:53:43.004978+0000","last_became_peered":"2024-02-21T22:53:43.004978+0000","last_unstale":"2024-02-21T22:53:44.340155+0000","last_undegraded":"2024-02-21T22:53:44.340155+0000","last_fullsized":"2024-02-21T22:53:44.340155+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:03:52.457060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"33'10","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:51.101817+0000","last_change":"2024-02-21T22:53:41.989878+0000","last_active":"2024-02-21T22:53:51.101817+0000","last_peered":"2024-02-21T22:53:51.101817+0000","last_clean":"2024-02-21T22:53:51.101817+0000","last_became_active":"2024-02-21T22:53:41.989590+0000","last_became_peered":"2024-02-21T22:53:41.989590+0000","last_unstale":"2024-02-21T22:53:51.101817+0000","last_undegraded":"2024-02-21T22:53:51.101817+0000","last_fullsized":"2024-02-21T22:53:51.101817+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:06:02.702272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7145,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.989607+0000","last_change":"2024-02-21T22:53:43.008192+0000","last_active":"2024-02-21T22:53:43.989607+0000","last_peered":"2024-02-21T22:53:43.989607+0000","last_clean":"2024-02-21T22:53:43.989607+0000","last_became_active":"2024-02-21T22:53:43.007923+0000","last_became_peered":"2024-02-21T22:53:43.007923+0000","last_unstale":"2024-02-21T22:53:43.989607+0000","last_undegraded":"2024-02-21T22:53:43.989607+0000","last_fullsized":"2024-02-21T22:53:43.989607+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:53:37.531108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"32'2","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.991477+0000","last_change":"2024-02-21T22:53:41.986805+0000","last_active":"2024-02-21T22:53:43.991477+0000","last_peered":"2024-02-21T22:53:43.991477+0000","last_clean":"2024-02-21T22:53:43.991477+0000","last_became_active":"2024-02-21T22:53:41.985220+0000","last_became_peered":"2024-02-21T22:53:41.985220+0000","last_unstale":"2024-02-21T22:53:43.991477+0000","last_undegraded":"2024-02-21T22:53:43.991477+0000","last_fullsized":"2024-02-21T22:53:43.991477+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:21:25.274383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.340308+0000","last_change":"2024-02-21T22:53:43.003557+0000","last_active":"2024-02-21T22:53:44.340308+0000","last_peered":"2024-02-21T22:53:44.340308+0000","last_clean":"2024-02-21T22:53:44.340308+0000","last_became_active":"2024-02-21T22:53:43.003293+0000","last_became_peered":"2024-02-21T22:53:43.003293+0000","last_unstale":"2024-02-21T22:53:44.340308+0000","last_undegraded":"2024-02-21T22:53:44.340308+0000","last_fullsized":"2024-02-21T22:53:44.340308+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:34:47.098047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.989593+0000","last_change":"2024-02-21T22:53:41.987760+0000","last_active":"2024-02-21T22:53:43.989593+0000","last_peered":"2024-02-21T22:53:43.989593+0000","last_clean":"2024-02-21T22:53:43.989593+0000","last_became_active":"2024-02-21T22:53:41.987379+0000","last_became_peered":"2024-02-21T22:53:41.987379+0000","last_unstale":"2024-02-21T22:53:43.989593+0000","last_undegraded":"2024-02-21T22:53:43.989593+0000","last_fullsized":"2024-02-21T22:53:43.989593+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:28:09.845765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.340250+0000","last_change":"2024-02-21T22:53:43.014121+0000","last_active":"2024-02-21T22:53:44.340250+0000","last_peered":"2024-02-21T22:53:44.340250+0000","last_clean":"2024-02-21T22:53:44.340250+0000","last_became_active":"2024-02-21T22:53:43.013636+0000","last_became_peered":"2024-02-21T22:53:43.013636+0000","last_unstale":"2024-02-21T22:53:44.340250+0000","last_undegraded":"2024-02-21T22:53:44.340250+0000","last_fullsized":"2024-02-21T22:53:44.340250+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:31:54.235302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.340024+0000","last_change":"2024-02-21T22:53:41.989414+0000","last_active":"2024-02-21T22:53:44.340024+0000","last_peered":"2024-02-21T22:53:44.340024+0000","last_clean":"2024-02-21T22:53:44.340024+0000","last_became_active":"2024-02-21T22:53:41.988958+0000","last_became_peered":"2024-02-21T22:53:41.988958+0000","last_unstale":"2024-02-21T22:53:44.340024+0000","last_undegraded":"2024-02-21T22:53:44.340024+0000","last_fullsized":"2024-02-21T22:53:44.340024+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:09:00.593509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.322897+0000","last_change":"2024-02-21T22:53:43.010267+0000","last_active":"2024-02-21T22:53:44.322897+0000","last_peered":"2024-02-21T22:53:44.322897+0000","last_clean":"2024-02-21T22:53:44.322897+0000","last_became_active":"2024-02-21T22:53:43.010007+0000","last_became_peered":"2024-02-21T22:53:43.010007+0000","last_unstale":"2024-02-21T22:53:44.322897+0000","last_undegraded":"2024-02-21T22:53:44.322897+0000","last_fullsized":"2024-02-21T22:53:44.322897+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:53:37.219886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"32'8","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.340161+0000","last_change":"2024-02-21T22:53:41.990362+0000","last_active":"2024-02-21T22:53:44.340161+0000","last_peered":"2024-02-21T22:53:44.340161+0000","last_clean":"2024-02-21T22:53:44.340161+0000","last_became_active":"2024-02-21T22:53:41.989531+0000","last_became_peered":"2024-02-21T22:53:41.989531+0000","last_unstale":"2024-02-21T22:53:44.340161+0000","last_undegraded":"2024-02-21T22:53:44.340161+0000","last_fullsized":"2024-02-21T22:53:44.340161+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:10:09.126154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.991581+0000","last_change":"2024-02-21T22:53:43.010224+0000","last_active":"2024-02-21T22:53:43.991581+0000","last_peered":"2024-02-21T22:53:43.991581+0000","last_clean":"2024-02-21T22:53:43.991581+0000","last_became_active":"2024-02-21T22:53:43.009914+0000","last_became_peered":"2024-02-21T22:53:43.009914+0000","last_unstale":"2024-02-21T22:53:43.991581+0000","last_undegraded":"2024-02-21T22:53:43.991581+0000","last_fullsized":"2024-02-21T22:53:43.991581+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:02:41.596861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"32'1","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.990394+0000","last_change":"2024-02-21T22:53:41.988393+0000","last_active":"2024-02-21T22:53:43.990394+0000","last_peered":"2024-02-21T22:53:43.990394+0000","last_clean":"2024-02-21T22:53:43.990394+0000","last_became_active":"2024-02-21T22:53:41.987692+0000","last_became_peered":"2024-02-21T22:53:41.987692+0000","last_unstale":"2024-02-21T22:53:43.990394+0000","last_undegraded":"2024-02-21T22:53:43.990394+0000","last_fullsized":"2024-02-21T22:53:43.990394+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:08:08.137842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.340924+0000","last_change":"2024-02-21T22:53:43.009888+0000","last_active":"2024-02-21T22:53:44.340924+0000","last_peered":"2024-02-21T22:53:44.340924+0000","last_clean":"2024-02-21T22:53:44.340924+0000","last_became_active":"2024-02-21T22:53:43.009536+0000","last_became_peered":"2024-02-21T22:53:43.009536+0000","last_unstale":"2024-02-21T22:53:44.340924+0000","last_undegraded":"2024-02-21T22:53:44.340924+0000","last_fullsized":"2024-02-21T22:53:44.340924+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:54:49.339689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"32'2","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.991607+0000","last_change":"2024-02-21T22:53:41.986266+0000","last_active":"2024-02-21T22:53:43.991607+0000","last_peered":"2024-02-21T22:53:43.991607+0000","last_clean":"2024-02-21T22:53:43.991607+0000","last_became_active":"2024-02-21T22:53:41.985942+0000","last_became_peered":"2024-02-21T22:53:41.985942+0000","last_unstale":"2024-02-21T22:53:43.991607+0000","last_undegraded":"2024-02-21T22:53:43.991607+0000","last_fullsized":"2024-02-21T22:53:43.991607+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:29:52.528059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.989804+0000","last_change":"2024-02-21T22:53:43.010964+0000","last_active":"2024-02-21T22:53:43.989804+0000","last_peered":"2024-02-21T22:53:43.989804+0000","last_clean":"2024-02-21T22:53:43.989804+0000","last_became_active":"2024-02-21T22:53:43.010739+0000","last_became_peered":"2024-02-21T22:53:43.010739+0000","last_unstale":"2024-02-21T22:53:43.989804+0000","last_undegraded":"2024-02-21T22:53:43.989804+0000","last_fullsized":"2024-02-21T22:53:43.989804+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:31:54.235302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"32'1","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.991526+0000","last_change":"2024-02-21T22:53:41.987516+0000","last_active":"2024-02-21T22:53:43.991526+0000","last_peered":"2024-02-21T22:53:43.991526+0000","last_clean":"2024-02-21T22:53:43.991526+0000","last_became_active":"2024-02-21T22:53:41.986968+0000","last_became_peered":"2024-02-21T22:53:41.986968+0000","last_unstale":"2024-02-21T22:53:43.991526+0000","last_undegraded":"2024-02-21T22:53:43.991526+0000","last_fullsized":"2024-02-21T22:53:43.991526+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:08:36.876969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.236512+0000","last_change":"2024-02-21T22:53:43.001927+0000","last_active":"2024-02-21T22:53:44.236512+0000","last_peered":"2024-02-21T22:53:44.236512+0000","last_clean":"2024-02-21T22:53:44.236512+0000","last_became_active":"2024-02-21T22:53:43.001668+0000","last_became_peered":"2024-02-21T22:53:43.001668+0000","last_unstale":"2024-02-21T22:53:44.236512+0000","last_undegraded":"2024-02-21T22:53:44.236512+0000","last_fullsized":"2024-02-21T22:53:44.236512+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:52:03.788166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.991343+0000","last_change":"2024-02-21T22:53:41.990148+0000","last_active":"2024-02-21T22:53:43.991343+0000","last_peered":"2024-02-21T22:53:43.991343+0000","last_clean":"2024-02-21T22:53:43.991343+0000","last_became_active":"2024-02-21T22:53:41.989146+0000","last_became_peered":"2024-02-21T22:53:41.989146+0000","last_unstale":"2024-02-21T22:53:43.991343+0000","last_undegraded":"2024-02-21T22:53:43.991343+0000","last_fullsized":"2024-02-21T22:53:43.991343+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:13:43.209250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.236324+0000","last_change":"2024-02-21T22:53:43.011129+0000","last_active":"2024-02-21T22:53:44.236324+0000","last_peered":"2024-02-21T22:53:44.236324+0000","last_clean":"2024-02-21T22:53:44.236324+0000","last_became_active":"2024-02-21T22:53:43.010865+0000","last_became_peered":"2024-02-21T22:53:43.010865+0000","last_unstale":"2024-02-21T22:53:44.236324+0000","last_undegraded":"2024-02-21T22:53:44.236324+0000","last_fullsized":"2024-02-21T22:53:44.236324+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:21:26.278733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"32'2","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.990759+0000","last_change":"2024-02-21T22:53:41.984829+0000","last_active":"2024-02-21T22:53:43.990759+0000","last_peered":"2024-02-21T22:53:43.990759+0000","last_clean":"2024-02-21T22:53:43.990759+0000","last_became_active":"2024-02-21T22:53:41.984573+0000","last_became_peered":"2024-02-21T22:53:41.984573+0000","last_unstale":"2024-02-21T22:53:43.990759+0000","last_undegraded":"2024-02-21T22:53:43.990759+0000","last_fullsized":"2024-02-21T22:53:43.990759+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:44:42.045212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.236514+0000","last_change":"2024-02-21T22:53:43.001820+0000","last_active":"2024-02-21T22:53:44.236514+0000","last_peered":"2024-02-21T22:53:44.236514+0000","last_clean":"2024-02-21T22:53:44.236514+0000","last_became_active":"2024-02-21T22:53:43.001513+0000","last_became_peered":"2024-02-21T22:53:43.001513+0000","last_unstale":"2024-02-21T22:53:44.236514+0000","last_undegraded":"2024-02-21T22:53:44.236514+0000","last_fullsized":"2024-02-21T22:53:44.236514+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:28:10.850115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.322908+0000","last_change":"2024-02-21T22:53:41.991544+0000","last_active":"2024-02-21T22:53:44.322908+0000","last_peered":"2024-02-21T22:53:44.322908+0000","last_clean":"2024-02-21T22:53:44.322908+0000","last_became_active":"2024-02-21T22:53:41.991247+0000","last_became_peered":"2024-02-21T22:53:41.991247+0000","last_unstale":"2024-02-21T22:53:44.322908+0000","last_undegraded":"2024-02-21T22:53:44.322908+0000","last_fullsized":"2024-02-21T22:53:44.322908+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:44:42.045212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.236291+0000","last_change":"2024-02-21T22:53:43.000454+0000","last_active":"2024-02-21T22:53:44.236291+0000","last_peered":"2024-02-21T22:53:44.236291+0000","last_clean":"2024-02-21T22:53:44.236291+0000","last_became_active":"2024-02-21T22:53:43.000172+0000","last_became_peered":"2024-02-21T22:53:43.000172+0000","last_unstale":"2024-02-21T22:53:44.236291+0000","last_undegraded":"2024-02-21T22:53:44.236291+0000","last_fullsized":"2024-02-21T22:53:44.236291+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:29:53.532409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.990890+0000","last_change":"2024-02-21T22:53:41.988349+0000","last_active":"2024-02-21T22:53:43.990890+0000","last_peered":"2024-02-21T22:53:43.990890+0000","last_clean":"2024-02-21T22:53:43.990890+0000","last_became_active":"2024-02-21T22:53:41.987202+0000","last_became_peered":"2024-02-21T22:53:41.987202+0000","last_unstale":"2024-02-21T22:53:43.990890+0000","last_undegraded":"2024-02-21T22:53:43.990890+0000","last_fullsized":"2024-02-21T22:53:43.990890+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:38:22.676905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.340090+0000","last_change":"2024-02-21T22:53:43.008590+0000","last_active":"2024-02-21T22:53:44.340090+0000","last_peered":"2024-02-21T22:53:44.340090+0000","last_clean":"2024-02-21T22:53:44.340090+0000","last_became_active":"2024-02-21T22:53:43.007502+0000","last_became_peered":"2024-02-21T22:53:43.007502+0000","last_unstale":"2024-02-21T22:53:44.340090+0000","last_undegraded":"2024-02-21T22:53:44.340090+0000","last_fullsized":"2024-02-21T22:53:44.340090+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:02:41.596861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.340170+0000","last_change":"2024-02-21T22:53:41.993199+0000","last_active":"2024-02-21T22:53:44.340170+0000","last_peered":"2024-02-21T22:53:44.340170+0000","last_clean":"2024-02-21T22:53:44.340170+0000","last_became_active":"2024-02-21T22:53:41.992944+0000","last_became_peered":"2024-02-21T22:53:41.992944+0000","last_unstale":"2024-02-21T22:53:44.340170+0000","last_undegraded":"2024-02-21T22:53:44.340170+0000","last_fullsized":"2024-02-21T22:53:44.340170+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:09:00.593509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.236482+0000","last_change":"2024-02-21T22:53:43.007504+0000","last_active":"2024-02-21T22:53:44.236482+0000","last_peered":"2024-02-21T22:53:44.236482+0000","last_clean":"2024-02-21T22:53:44.236482+0000","last_became_active":"2024-02-21T22:53:43.007283+0000","last_became_peered":"2024-02-21T22:53:43.007283+0000","last_unstale":"2024-02-21T22:53:44.236482+0000","last_undegraded":"2024-02-21T22:53:44.236482+0000","last_fullsized":"2024-02-21T22:53:44.236482+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:35:00.796782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"32'2","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.990438+0000","last_change":"2024-02-21T22:53:41.994504+0000","last_active":"2024-02-21T22:53:43.990438+0000","last_peered":"2024-02-21T22:53:43.990438+0000","last_clean":"2024-02-21T22:53:43.990438+0000","last_became_active":"2024-02-21T22:53:41.994229+0000","last_became_peered":"2024-02-21T22:53:41.994229+0000","last_unstale":"2024-02-21T22:53:43.990438+0000","last_undegraded":"2024-02-21T22:53:43.990438+0000","last_fullsized":"2024-02-21T22:53:43.990438+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:09:00.593509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.340937+0000","last_change":"2024-02-21T22:53:43.006538+0000","last_active":"2024-02-21T22:53:44.340937+0000","last_peered":"2024-02-21T22:53:44.340937+0000","last_clean":"2024-02-21T22:53:44.340937+0000","last_became_active":"2024-02-21T22:53:43.006058+0000","last_became_peered":"2024-02-21T22:53:43.006058+0000","last_unstale":"2024-02-21T22:53:44.340937+0000","last_undegraded":"2024-02-21T22:53:44.340937+0000","last_fullsized":"2024-02-21T22:53:44.340937+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:18:34.897900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"33'3","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:49.994415+0000","last_change":"2024-02-21T22:53:41.985703+0000","last_active":"2024-02-21T22:53:49.994415+0000","last_peered":"2024-02-21T22:53:49.994415+0000","last_clean":"2024-02-21T22:53:49.994415+0000","last_became_active":"2024-02-21T22:53:41.985263+0000","last_became_peered":"2024-02-21T22:53:41.985263+0000","last_unstale":"2024-02-21T22:53:49.994415+0000","last_undegraded":"2024-02-21T22:53:49.994415+0000","last_fullsized":"2024-02-21T22:53:49.994415+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:28:09.845765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.990580+0000","last_change":"2024-02-21T22:53:43.005317+0000","last_active":"2024-02-21T22:53:43.990580+0000","last_peered":"2024-02-21T22:53:43.990580+0000","last_clean":"2024-02-21T22:53:43.990580+0000","last_became_active":"2024-02-21T22:53:43.005033+0000","last_became_peered":"2024-02-21T22:53:43.005033+0000","last_unstale":"2024-02-21T22:53:43.990580+0000","last_undegraded":"2024-02-21T22:53:43.990580+0000","last_fullsized":"2024-02-21T22:53:43.990580+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:53:37.219886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.989830+0000","last_change":"2024-02-21T22:53:41.986296+0000","last_active":"2024-02-21T22:53:43.989830+0000","last_peered":"2024-02-21T22:53:43.989830+0000","last_clean":"2024-02-21T22:53:43.989830+0000","last_became_active":"2024-02-21T22:53:41.985909+0000","last_became_peered":"2024-02-21T22:53:41.985909+0000","last_unstale":"2024-02-21T22:53:43.989830+0000","last_undegraded":"2024-02-21T22:53:43.989830+0000","last_fullsized":"2024-02-21T22:53:43.989830+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:34:59.792432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.322818+0000","last_change":"2024-02-21T22:53:43.000226+0000","last_active":"2024-02-21T22:53:44.322818+0000","last_peered":"2024-02-21T22:53:44.322818+0000","last_clean":"2024-02-21T22:53:44.322818+0000","last_became_active":"2024-02-21T22:53:42.999987+0000","last_became_peered":"2024-02-21T22:53:42.999987+0000","last_unstale":"2024-02-21T22:53:44.322818+0000","last_undegraded":"2024-02-21T22:53:44.322818+0000","last_fullsized":"2024-02-21T22:53:44.322818+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:54:01.357343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.990812+0000","last_change":"2024-02-21T22:53:41.991285+0000","last_active":"2024-02-21T22:53:43.990812+0000","last_peered":"2024-02-21T22:53:43.990812+0000","last_clean":"2024-02-21T22:53:43.990812+0000","last_became_active":"2024-02-21T22:53:41.990977+0000","last_became_peered":"2024-02-21T22:53:41.990977+0000","last_unstale":"2024-02-21T22:53:43.990812+0000","last_undegraded":"2024-02-21T22:53:43.990812+0000","last_fullsized":"2024-02-21T22:53:43.990812+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:27:18.184658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.990731+0000","last_change":"2024-02-21T22:53:42.999736+0000","last_active":"2024-02-21T22:53:43.990731+0000","last_peered":"2024-02-21T22:53:43.990731+0000","last_clean":"2024-02-21T22:53:43.990731+0000","last_became_active":"2024-02-21T22:53:42.999472+0000","last_became_peered":"2024-02-21T22:53:42.999472+0000","last_unstale":"2024-02-21T22:53:43.990731+0000","last_undegraded":"2024-02-21T22:53:43.990731+0000","last_fullsized":"2024-02-21T22:53:43.990731+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:15:36.152598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.989686+0000","last_change":"2024-02-21T22:53:41.991062+0000","last_active":"2024-02-21T22:53:43.989686+0000","last_peered":"2024-02-21T22:53:43.989686+0000","last_clean":"2024-02-21T22:53:43.989686+0000","last_became_active":"2024-02-21T22:53:41.990791+0000","last_became_peered":"2024-02-21T22:53:41.990791+0000","last_unstale":"2024-02-21T22:53:43.989686+0000","last_undegraded":"2024-02-21T22:53:43.989686+0000","last_fullsized":"2024-02-21T22:53:43.989686+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:52:02.783816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.340056+0000","last_change":"2024-02-21T22:53:42.999431+0000","last_active":"2024-02-21T22:53:44.340056+0000","last_peered":"2024-02-21T22:53:44.340056+0000","last_clean":"2024-02-21T22:53:44.340056+0000","last_became_active":"2024-02-21T22:53:42.999170+0000","last_became_peered":"2024-02-21T22:53:42.999170+0000","last_unstale":"2024-02-21T22:53:44.340056+0000","last_undegraded":"2024-02-21T22:53:44.340056+0000","last_fullsized":"2024-02-21T22:53:44.340056+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T02:25:22.385393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.991018+0000","last_change":"2024-02-21T22:53:41.995139+0000","last_active":"2024-02-21T22:53:43.991018+0000","last_peered":"2024-02-21T22:53:43.991018+0000","last_clean":"2024-02-21T22:53:43.991018+0000","last_became_active":"2024-02-21T22:53:41.994560+0000","last_became_peered":"2024-02-21T22:53:41.994560+0000","last_unstale":"2024-02-21T22:53:43.991018+0000","last_undegraded":"2024-02-21T22:53:43.991018+0000","last_fullsized":"2024-02-21T22:53:43.991018+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:44:42.045212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.990932+0000","last_change":"2024-02-21T22:53:43.015964+0000","last_active":"2024-02-21T22:53:43.990932+0000","last_peered":"2024-02-21T22:53:43.990932+0000","last_clean":"2024-02-21T22:53:43.990932+0000","last_became_active":"2024-02-21T22:53:43.015685+0000","last_became_peered":"2024-02-21T22:53:43.015685+0000","last_unstale":"2024-02-21T22:53:43.990932+0000","last_undegraded":"2024-02-21T22:53:43.990932+0000","last_fullsized":"2024-02-21T22:53:43.990932+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:06:03.706623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.340065+0000","last_change":"2024-02-21T22:53:41.988521+0000","last_active":"2024-02-21T22:53:44.340065+0000","last_peered":"2024-02-21T22:53:44.340065+0000","last_clean":"2024-02-21T22:53:44.340065+0000","last_became_active":"2024-02-21T22:53:41.987907+0000","last_became_peered":"2024-02-21T22:53:41.987907+0000","last_unstale":"2024-02-21T22:53:44.340065+0000","last_undegraded":"2024-02-21T22:53:44.340065+0000","last_fullsized":"2024-02-21T22:53:44.340065+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:52:02.783816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.340633+0000","last_change":"2024-02-21T22:53:43.001964+0000","last_active":"2024-02-21T22:53:44.340633+0000","last_peered":"2024-02-21T22:53:44.340633+0000","last_clean":"2024-02-21T22:53:44.340633+0000","last_became_active":"2024-02-21T22:53:43.001671+0000","last_became_peered":"2024-02-21T22:53:43.001671+0000","last_unstale":"2024-02-21T22:53:44.340633+0000","last_undegraded":"2024-02-21T22:53:44.340633+0000","last_fullsized":"2024-02-21T22:53:44.340633+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:34:47.098047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.322830+0000","last_change":"2024-02-21T22:53:41.991783+0000","last_active":"2024-02-21T22:53:44.322830+0000","last_peered":"2024-02-21T22:53:44.322830+0000","last_clean":"2024-02-21T22:53:44.322830+0000","last_became_active":"2024-02-21T22:53:41.991530+0000","last_became_peered":"2024-02-21T22:53:41.991530+0000","last_unstale":"2024-02-21T22:53:44.322830+0000","last_undegraded":"2024-02-21T22:53:44.322830+0000","last_fullsized":"2024-02-21T22:53:44.322830+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:40.967588+0000","last_clean_scrub_stamp":"2024-02-21T22:53:40.967588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:38:22.676905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":194,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.339918+0000","last_change":"2024-02-21T22:52:40.336187+0000","last_active":"2024-02-21T22:53:44.339918+0000","last_peered":"2024-02-21T22:53:44.339918+0000","last_clean":"2024-02-21T22:53:44.339918+0000","last_became_active":"2024-02-21T22:52:40.335061+0000","last_became_peered":"2024-02-21T22:52:40.335061+0000","last_unstale":"2024-02-21T22:53:44.339918+0000","last_undegraded":"2024-02-21T22:53:44.339918+0000","last_fullsized":"2024-02-21T22:53:44.339918+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:52:38.328863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:52:38.328863+0000","last_clean_scrub_stamp":"2024-02-21T22:52:38.328863+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:33:53.012414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":7943,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":15886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":45,"ondisk_log_size":45,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574866,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27976,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343864,"statfs":{"total":96636764160,"available":96608116736,"internally_reserved":0,"allocated":970752,"data_stored":737074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574867,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":380928,"data_stored":147232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574868,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":380928,"data_stored":147288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574867,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":380928,"data_stored":146720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574867,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":393216,"data_stored":153783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574867,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":376832,"data_stored":146686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574868,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":393216,"data_stored":153626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574866,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27960,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343880,"statfs":{"total":96636764160,"available":96608133120,"internally_reserved":0,"allocated":966656,"data_stored":736984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":7167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":7167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-21T22:53:59.839 INFO:tasks.ceph:pgid 5.3f last_scrub_stamp 2024-02-21T22:53:41.971938+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=41, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=54, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T22:53:59.839 INFO:tasks.ceph:pgid 5.3e last_scrub_stamp 2024-02-21T22:53:41.971938+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=41, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=54, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T22:53:59.839 INFO:tasks.ceph:pgid 5.3d last_scrub_stamp 2024-02-21T22:53:41.971938+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=41, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=54, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T22:53:59.839 INFO:tasks.ceph:pgid 5.3c last_scrub_stamp 2024-02-21T22:53:41.971938+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=41, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=54, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T22:53:59.839 INFO:tasks.ceph:pgid 5.3b last_scrub_stamp 2024-02-21T22:53:41.971938+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=41, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=54, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T22:53:59.840 INFO:tasks.ceph:pgid 5.3a last_scrub_stamp 2024-02-21T22:53:41.971938+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=41, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=54, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T22:53:59.840 INFO:tasks.ceph:pgid 5.39 last_scrub_stamp 2024-02-21T22:53:41.971938+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=41, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=54, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T22:53:59.840 INFO:tasks.ceph:pgid 5.38 last_scrub_stamp 2024-02-21T22:53:41.971938+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=41, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=54, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T22:53:59.840 INFO:tasks.ceph:pgid 5.37 last_scrub_stamp 2024-02-21T22:53:41.971938+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=41, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=54, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T22:53:59.840 INFO:tasks.ceph:pgid 5.36 last_scrub_stamp 2024-02-21T22:53:41.971938+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=41, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=54, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T22:53:59.840 INFO:tasks.ceph:pgid 5.35 last_scrub_stamp 2024-02-21T22:53:41.971938+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=41, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=54, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T22:53:59.841 INFO:tasks.ceph:pgid 5.34 last_scrub_stamp 2024-02-21T22:53:41.971938+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=41, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=54, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T22:53:59.841 INFO:tasks.ceph:pgid 5.33 last_scrub_stamp 2024-02-21T22:53:41.971938+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=41, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=54, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T22:53:59.841 INFO:tasks.ceph:pgid 5.32 last_scrub_stamp 2024-02-21T22:53:41.971938+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=41, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=54, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T22:53:59.841 INFO:tasks.ceph:pgid 5.31 last_scrub_stamp 2024-02-21T22:53:41.971938+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=41, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=54, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T22:53:59.841 INFO:tasks.ceph:pgid 5.30 last_scrub_stamp 2024-02-21T22:53:41.971938+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=41, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=54, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T22:53:59.841 INFO:tasks.ceph:pgid 5.2f last_scrub_stamp 2024-02-21T22:53:41.971938+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=41, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=54, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T22:53:59.842 INFO:tasks.ceph:pgid 5.2e last_scrub_stamp 2024-02-21T22:53:41.971938+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=41, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=54, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T22:53:59.842 INFO:tasks.ceph:pgid 5.2d last_scrub_stamp 2024-02-21T22:53:41.971938+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=41, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=54, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T22:53:59.842 INFO:tasks.ceph:pgid 5.2c last_scrub_stamp 2024-02-21T22:53:41.971938+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=41, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=54, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T22:53:59.842 INFO:tasks.ceph:pgid 5.2b last_scrub_stamp 2024-02-21T22:53:41.971938+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=41, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=54, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T22:53:59.842 INFO:tasks.ceph:pgid 5.2a last_scrub_stamp 2024-02-21T22:53:41.971938+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=41, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=54, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T22:53:59.842 INFO:tasks.ceph:pgid 5.29 last_scrub_stamp 2024-02-21T22:53:41.971938+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=41, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=54, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T22:53:59.842 INFO:tasks.ceph:pgid 5.28 last_scrub_stamp 2024-02-21T22:53:41.971938+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=41, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=54, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T22:53:59.843 INFO:tasks.ceph:pgid 5.27 last_scrub_stamp 2024-02-21T22:53:41.971938+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=41, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=54, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T22:53:59.843 INFO:tasks.ceph:pgid 5.26 last_scrub_stamp 2024-02-21T22:53:41.971938+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=41, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=54, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T22:53:59.843 INFO:tasks.ceph:pgid 5.25 last_scrub_stamp 2024-02-21T22:53:41.971938+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=41, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=54, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T22:53:59.843 INFO:tasks.ceph:pgid 5.24 last_scrub_stamp 2024-02-21T22:53:41.971938+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=41, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=54, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T22:53:59.843 INFO:tasks.ceph:pgid 5.23 last_scrub_stamp 2024-02-21T22:53:41.971938+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=41, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=54, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T22:53:59.843 INFO:tasks.ceph:pgid 5.22 last_scrub_stamp 2024-02-21T22:53:41.971938+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=41, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=54, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T22:53:59.844 INFO:tasks.ceph:pgid 5.21 last_scrub_stamp 2024-02-21T22:53:41.971938+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=41, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=54, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T22:53:59.844 INFO:tasks.ceph:pgid 5.20 last_scrub_stamp 2024-02-21T22:53:41.971938+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=41, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=54, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T22:53:59.844 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-02-21T22:53:41.971938+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=41, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=54, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T22:53:59.844 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-02-21T22:53:40.967588+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=40, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=54, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T22:53:59.844 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-02-21T22:53:41.971938+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=41, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=54, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T22:53:59.844 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-02-21T22:53:40.967588+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=40, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=54, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T22:53:59.845 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-02-21T22:53:41.971938+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=41, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=54, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T22:53:59.845 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-02-21T22:53:40.967588+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=40, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=54, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T22:53:59.845 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-02-21T22:53:41.971938+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=41, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=54, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T22:53:59.845 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-02-21T22:53:40.967588+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=40, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=54, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T22:53:59.845 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-02-21T22:53:41.971938+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=41, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=54, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T22:53:59.845 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-02-21T22:53:40.967588+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=40, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=54, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T22:53:59.845 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-02-21T22:53:41.971938+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=41, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=54, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T22:53:59.846 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-02-21T22:53:40.967588+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=40, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=54, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T22:53:59.846 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-02-21T22:53:41.971938+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=41, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=54, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T22:53:59.846 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-02-21T22:53:40.967588+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=40, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=54, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T22:53:59.846 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-02-21T22:53:41.971938+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=41, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=54, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T22:53:59.846 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-02-21T22:53:40.967588+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=40, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=54, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T22:53:59.846 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-02-21T22:53:41.971938+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=41, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=54, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T22:53:59.847 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-02-21T22:53:40.967588+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=40, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=54, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T22:53:59.847 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-02-21T22:53:41.971938+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=41, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=54, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T22:53:59.847 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-02-21T22:53:40.967588+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=40, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=54, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T22:53:59.847 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-02-21T22:53:41.971938+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=41, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=54, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T22:53:59.847 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-02-21T22:53:40.967588+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=40, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=54, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T22:53:59.847 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-02-21T22:53:41.971938+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=41, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=54, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T22:53:59.848 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-02-21T22:53:40.967588+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=40, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=54, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T22:53:59.848 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-02-21T22:53:41.971938+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=41, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=54, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T22:53:59.848 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-02-21T22:53:40.967588+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=40, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=54, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T22:53:59.848 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-02-21T22:53:41.971938+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=41, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=54, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T22:53:59.848 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-02-21T22:53:40.967588+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=40, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=54, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T22:53:59.848 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-02-21T22:53:41.971938+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=41, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=54, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T22:53:59.848 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-02-21T22:53:40.967588+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=40, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=54, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T22:53:59.849 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-02-21T22:53:41.971938+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=41, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=54, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T22:53:59.849 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-02-21T22:53:40.967588+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=40, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=54, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T22:53:59.849 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-02-21T22:53:41.971938+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=41, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=54, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T22:53:59.849 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-02-21T22:53:40.967588+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=40, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=54, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T22:53:59.849 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-02-21T22:53:41.971938+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=41, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=54, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T22:53:59.849 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-02-21T22:53:40.967588+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=40, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=54, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T22:53:59.850 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-02-21T22:53:41.971938+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=41, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=54, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T22:53:59.850 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-02-21T22:53:40.967588+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=40, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=54, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T22:53:59.850 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-02-21T22:53:41.971938+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=41, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=54, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T22:53:59.850 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-02-21T22:53:40.967588+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=40, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=54, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T22:53:59.850 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-02-21T22:53:41.971938+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=41, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=54, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T22:53:59.850 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-02-21T22:53:40.967588+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=40, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=54, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T22:53:59.850 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-02-21T22:53:41.971938+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=41, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=54, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T22:53:59.851 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-02-21T22:53:40.967588+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=40, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=54, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T22:53:59.851 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-02-21T22:53:41.971938+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=41, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=54, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T22:53:59.851 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-02-21T22:53:40.967588+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=40, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=54, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T22:53:59.851 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-02-21T22:53:41.971938+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=41, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=54, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T22:53:59.851 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-02-21T22:53:40.967588+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=40, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=54, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T22:53:59.851 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-02-21T22:53:41.971938+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=41, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=54, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T22:53:59.852 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-02-21T22:53:40.967588+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=40, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=54, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T22:53:59.852 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-02-21T22:53:41.971938+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=41, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=54, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T22:53:59.852 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-02-21T22:53:40.967588+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=40, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=54, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T22:53:59.852 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-02-21T22:53:41.971938+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=41, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=54, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T22:53:59.852 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-02-21T22:53:40.967588+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=40, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=54, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T22:53:59.852 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-02-21T22:53:41.971938+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=41, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=54, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T22:53:59.853 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-02-21T22:53:40.967588+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=40, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=54, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T22:53:59.853 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-02-21T22:53:41.971938+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=41, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=54, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T22:53:59.853 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-02-21T22:53:40.967588+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=40, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=54, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T22:53:59.853 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-02-21T22:53:41.971938+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=41, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=54, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T22:53:59.853 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-02-21T22:53:40.967588+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=40, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=54, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T22:53:59.853 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-02-21T22:53:41.971938+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=41, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=54, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T22:53:59.853 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-02-21T22:53:40.967588+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=40, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=54, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T22:53:59.854 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-02-21T22:53:41.971938+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=41, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=54, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T22:53:59.854 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-02-21T22:53:40.967588+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=40, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=54, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T22:53:59.854 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-02-21T22:52:38.328863+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=52, tm_sec=38, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=54, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T22:53:59.854 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-02-21T22:54:14.941 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T22:54:14.945 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T22:54:19.855 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-21T22:54:19.968 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:19.978+0000 7f34979aa640 1 Processor -- start 2024-02-21T22:54:19.968 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:19.979+0000 7f34979aa640 1 -- start start 2024-02-21T22:54:19.974 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:19.979+0000 7f34979aa640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f34900d0510 0x7f34900d08f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:54:19.974 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:19.979+0000 7f34979aa640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f34900cb930 0x7f34900cbdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:54:19.975 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:19.979+0000 7f34979aa640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34900cfa50 con 0x7f34900d1c30 2024-02-21T22:54:19.975 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:19.979+0000 7f34979aa640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34900d1450 con 0x7f34900cb930 2024-02-21T22:54:19.975 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:19.979+0000 7f34979aa640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34900d0e30 con 0x7f34900d0510 2024-02-21T22:54:19.975 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:19.980+0000 7f3494f45640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f34900d1c30 0x7f34900d2430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:34644/0 (socket says 172.21.15.116:34644) 2024-02-21T22:54:19.976 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:19.980+0000 7f3494f45640 1 -- 172.21.15.116:0/2491170457 learned_addr learned my addr 172.21.15.116:0/2491170457 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-02-21T22:54:19.976 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:19.980+0000 7f3495f47640 1 --2- 172.21.15.116:0/2491170457 >> v2:172.21.15.142:3300/0 conn(0x7f34900cb930 0x7f34900cbdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:54:19.976 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:19.980+0000 7f3495746640 1 --2- 172.21.15.116:0/2491170457 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f34900d0510 0x7f34900d08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:54:19.976 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:19.980+0000 7f3487fff640 1 -- 172.21.15.116:0/2491170457 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3390033091 0 0) 0x7f34900cfa50 con 0x7f34900d1c30 2024-02-21T22:54:19.977 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:19.980+0000 7f3487fff640 1 -- 172.21.15.116:0/2491170457 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f347c003520 con 0x7f34900d1c30 2024-02-21T22:54:19.977 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:19.980+0000 7f3495746640 1 -- 172.21.15.116:0/2491170457 >> v2:172.21.15.142:3300/0 conn(0x7f34900cb930 msgr2=0x7f34900cbdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:54:19.977 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:19.980+0000 7f3495746640 1 --2- 172.21.15.116:0/2491170457 >> v2:172.21.15.142:3300/0 conn(0x7f34900cb930 0x7f34900cbdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:54:19.977 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:19.980+0000 7f3495746640 1 -- 172.21.15.116:0/2491170457 >> v1:172.21.15.116:6789/0 conn(0x7f34900d1c30 legacy=0x7f34900d2430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:54:19.977 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:19.980+0000 7f3495746640 1 -- 172.21.15.116:0/2491170457 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34900cfcc0 con 0x7f34900d0510 2024-02-21T22:54:19.977 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:19.980+0000 7f3495f47640 1 --2- 172.21.15.116:0/2491170457 >> v2:172.21.15.142:3300/0 conn(0x7f34900cb930 0x7f34900cbdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T22:54:19.977 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:19.981+0000 7f3495746640 1 --2- 172.21.15.116:0/2491170457 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f34900d0510 0x7f34900d08f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f348c0097a0 tx=0x7f348c02b820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=794bbd14d1a86d7 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:54:19.978 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:19.981+0000 7f3487fff640 1 -- 172.21.15.116:0/2491170457 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f348c031780 con 0x7f34900d0510 2024-02-21T22:54:19.978 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:19.981+0000 7f3487fff640 1 -- 172.21.15.116:0/2491170457 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f348c037070 con 0x7f34900d0510 2024-02-21T22:54:19.978 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:19.981+0000 7f3487fff640 1 -- 172.21.15.116:0/2491170457 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f348c031b20 con 0x7f34900d0510 2024-02-21T22:54:19.978 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:19.981+0000 7f34979aa640 1 -- 172.21.15.116:0/2491170457 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f34900d0510 msgr2=0x7f34900d08f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:54:19.979 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:19.981+0000 7f34979aa640 1 --2- 172.21.15.116:0/2491170457 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f34900d0510 0x7f34900d08f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f348c0097a0 tx=0x7f348c02b820 comp rx=0 tx=0).stop 2024-02-21T22:54:19.979 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:19.982+0000 7f34979aa640 1 -- 172.21.15.116:0/2491170457 shutdown_connections 2024-02-21T22:54:19.979 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:19.982+0000 7f34979aa640 1 --2- 172.21.15.116:0/2491170457 >> v2:172.21.15.142:3300/0 conn(0x7f34900cb930 0x7f34900cbdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:54:19.979 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:19.982+0000 7f34979aa640 1 --2- 172.21.15.116:0/2491170457 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f34900d0510 0x7f34900d08f0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:54:19.979 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:19.982+0000 7f34979aa640 1 -- 172.21.15.116:0/2491170457 >> 172.21.15.116:0/2491170457 conn(0x7f34900d3e50 msgr2=0x7f34900d4260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:54:19.979 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:19.982+0000 7f34979aa640 1 -- 172.21.15.116:0/2491170457 shutdown_connections 2024-02-21T22:54:19.980 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:19.982+0000 7f34979aa640 1 -- 172.21.15.116:0/2491170457 wait complete. 2024-02-21T22:54:19.980 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:19.983+0000 7f34979aa640 1 Processor -- start 2024-02-21T22:54:19.980 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:19.983+0000 7f34979aa640 1 -- start start 2024-02-21T22:54:19.980 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:19.983+0000 7f34979aa640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f34900cb930 0x7f34900a14b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:54:19.981 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:19.983+0000 7f34979aa640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f34900d0510 0x7f34901f79e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:54:19.981 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:19.983+0000 7f34979aa640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f34900d1c30 0x7f3490158200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:54:19.981 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:19.983+0000 7f34979aa640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f349015e640 con 0x7f34900d0510 2024-02-21T22:54:19.981 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:19.983+0000 7f34979aa640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34900d10e0 con 0x7f34900d1c30 2024-02-21T22:54:19.982 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:19.983+0000 7f34979aa640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34900cc300 con 0x7f34900cb930 2024-02-21T22:54:19.982 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:19.984+0000 7f3494f45640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f34900d0510 0x7f34901f79e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:54:19.982 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:19.984+0000 7f3495746640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f34900cb930 0x7f34900a14b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:54:19.982 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:19.984+0000 7f3494f45640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f34900d0510 0x7f34901f79e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:51212/0 (socket says 172.21.15.116:51212) 2024-02-21T22:54:19.982 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:19.984+0000 7f3494f45640 1 -- 172.21.15.116:0/2776744738 learned_addr learned my addr 172.21.15.116:0/2776744738 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:54:19.983 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:19.984+0000 7f3495f47640 1 --2- 172.21.15.116:0/2776744738 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f34900d1c30 0x7f3490158200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:54:19.983 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:19.984+0000 7f3494f45640 1 -- 172.21.15.116:0/2776744738 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f34900cb930 msgr2=0x7f34900a14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:54:19.983 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:19.984+0000 7f3494f45640 1 --2- 172.21.15.116:0/2776744738 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f34900cb930 0x7f34900a14b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:54:19.983 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:19.984+0000 7f3494f45640 1 -- 172.21.15.116:0/2776744738 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f34900d1c30 msgr2=0x7f3490158200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:54:19.983 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:19.984+0000 7f3494f45640 1 --2- 172.21.15.116:0/2776744738 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f34900d1c30 0x7f3490158200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:54:19.984 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:19.984+0000 7f3494f45640 1 -- 172.21.15.116:0/2776744738 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f349009ea90 con 0x7f34900d0510 2024-02-21T22:54:19.984 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:19.984+0000 7f3494f45640 1 --2- 172.21.15.116:0/2776744738 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f34900d0510 0x7f34901f79e0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f348000c3c0 tx=0x7f348000c7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:54:19.984 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:19.984+0000 7f3485ffb640 1 -- 172.21.15.116:0/2776744738 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3480017070 con 0x7f34900d0510 2024-02-21T22:54:19.984 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:19.984+0000 7f3485ffb640 1 -- 172.21.15.116:0/2776744738 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3480005ce0 con 0x7f34900d0510 2024-02-21T22:54:19.984 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:19.984+0000 7f34979aa640 1 -- 172.21.15.116:0/2776744738 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f349009dcd0 con 0x7f34900d0510 2024-02-21T22:54:19.985 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:19.984+0000 7f3485ffb640 1 -- 172.21.15.116:0/2776744738 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34800072d0 con 0x7f34900d0510 2024-02-21T22:54:19.985 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:19.985+0000 7f34979aa640 1 -- 172.21.15.116:0/2776744738 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f349009e290 con 0x7f34900d0510 2024-02-21T22:54:19.986 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:19.986+0000 7f34979aa640 1 -- 172.21.15.116:0/2776744738 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34900752f0 con 0x7f34900d0510 2024-02-21T22:54:19.987 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:19.986+0000 7f3485ffb640 1 -- 172.21.15.116:0/2776744738 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f348001a070 con 0x7f34900d0510 2024-02-21T22:54:19.987 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:19.986+0000 7f3485ffb640 1 --2- 172.21.15.116:0/2776744738 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f347406b4d0 0x7f347406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:54:19.987 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:19.987+0000 7f3485ffb640 1 -- 172.21.15.116:0/2776744738 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f34800893e0 con 0x7f34900d0510 2024-02-21T22:54:19.987 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:19.987+0000 7f3495746640 1 --2- 172.21.15.116:0/2776744738 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f347406b4d0 0x7f347406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:54:19.988 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:19.987+0000 7f3495746640 1 --2- 172.21.15.116:0/2776744738 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f347406b4d0 0x7f347406d990 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f348c036000 tx=0x7f348c03d040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:54:19.988 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:19.991+0000 7f3485ffb640 1 -- 172.21.15.116:0/2776744738 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f3480057ca0 con 0x7f34900d0510 2024-02-21T22:54:20.147 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:20.158+0000 7f34979aa640 1 -- 172.21.15.116:0/2776744738 --> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f34900a1b40 con 0x7f347406b4d0 2024-02-21T22:54:20.153 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:20.164+0000 7f3485ffb640 1 -- 172.21.15.116:0/2776744738 <== mgr.4103 v2:172.21.15.142:6832/1381484782 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251741 (secure 0 0 0) 0x7f34900a1b40 con 0x7f347406b4d0 2024-02-21T22:54:20.156 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-02-21T22:54:20.158 INFO:teuthology.orchestra.run.smithi116.stderr:dumped all 2024-02-21T22:54:20.160 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:20.167+0000 7f34979aa640 1 -- 172.21.15.116:0/2776744738 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f347406b4d0 msgr2=0x7f347406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:54:20.160 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:20.167+0000 7f34979aa640 1 --2- 172.21.15.116:0/2776744738 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f347406b4d0 0x7f347406d990 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f348c036000 tx=0x7f348c03d040 comp rx=0 tx=0).stop 2024-02-21T22:54:20.160 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:20.167+0000 7f34979aa640 1 -- 172.21.15.116:0/2776744738 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f34900d0510 msgr2=0x7f34901f79e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:54:20.160 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:20.167+0000 7f34979aa640 1 --2- 172.21.15.116:0/2776744738 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f34900d0510 0x7f34901f79e0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f348000c3c0 tx=0x7f348000c7c0 comp rx=0 tx=0).stop 2024-02-21T22:54:20.160 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:20.167+0000 7f34979aa640 1 -- 172.21.15.116:0/2776744738 shutdown_connections 2024-02-21T22:54:20.160 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:20.167+0000 7f34979aa640 1 --2- 172.21.15.116:0/2776744738 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f34900d1c30 0x7f3490158200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:54:20.160 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:20.167+0000 7f34979aa640 1 --2- 172.21.15.116:0/2776744738 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f34900d0510 0x7f34901f79e0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:54:20.161 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:20.167+0000 7f34979aa640 1 --2- 172.21.15.116:0/2776744738 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f347406b4d0 0x7f347406d990 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:54:20.161 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:20.167+0000 7f34979aa640 1 --2- 172.21.15.116:0/2776744738 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f34900cb930 0x7f34900a14b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:54:20.161 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:20.167+0000 7f34979aa640 1 -- 172.21.15.116:0/2776744738 >> 172.21.15.116:0/2776744738 conn(0x7f34900d3e50 msgr2=0x7f349015bc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:54:20.161 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:20.167+0000 7f34979aa640 1 -- 172.21.15.116:0/2776744738 shutdown_connections 2024-02-21T22:54:20.161 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:20.167+0000 7f34979aa640 1 -- 172.21.15.116:0/2776744738 wait complete. 2024-02-21T22:54:20.168 INFO:teuthology.orchestra.run.smithi116.stdout:{"pg_ready":true,"pg_map":{"version":76,"stamp":"2024-02-21T22:54:18.302796+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":598311,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":212,"num_write_kb":2439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":164,"ondisk_log_size":164,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220272,"kb_used_data":4144,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754448,"statfs":{"total":773094113280,"available":772868554752,"internally_reserved":0,"allocated":4243456,"data_stored":2369550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001927"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:54:04.721538+0000","last_change":"2024-02-21T22:54:04.721562+0000","last_active":"2024-02-21T22:54:04.721538+0000","last_peered":"2024-02-21T22:54:04.721538+0000","last_clean":"2024-02-21T22:54:04.721538+0000","last_became_active":"2024-02-21T22:53:43.002238+0000","last_became_peered":"2024-02-21T22:53:43.002238+0000","last_unstale":"2024-02-21T22:54:04.721538+0000","last_undegraded":"2024-02-21T22:54:04.721538+0000","last_fullsized":"2024-02-21T22:54:04.721538+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:54:04.721469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:54:04.721469+0000","last_clean_scrub_stamp":"2024-02-21T22:54:04.721469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:02:36.638329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:54:09.319128+0000","last_change":"2024-02-21T22:54:09.319157+0000","last_active":"2024-02-21T22:54:09.319128+0000","last_peered":"2024-02-21T22:54:09.319128+0000","last_clean":"2024-02-21T22:54:09.319128+0000","last_became_active":"2024-02-21T22:53:43.000396+0000","last_became_peered":"2024-02-21T22:53:43.000396+0000","last_unstale":"2024-02-21T22:54:09.319128+0000","last_undegraded":"2024-02-21T22:54:09.319128+0000","last_fullsized":"2024-02-21T22:54:09.319128+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:54:09.319013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:54:09.319013+0000","last_clean_scrub_stamp":"2024-02-21T22:54:09.319013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:51:44.212776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:54:04.854030+0000","last_change":"2024-02-21T22:54:04.854073+0000","last_active":"2024-02-21T22:54:04.854030+0000","last_peered":"2024-02-21T22:54:04.854030+0000","last_clean":"2024-02-21T22:54:04.854030+0000","last_became_active":"2024-02-21T22:53:43.004321+0000","last_became_peered":"2024-02-21T22:53:43.004321+0000","last_unstale":"2024-02-21T22:54:04.854030+0000","last_undegraded":"2024-02-21T22:54:04.854030+0000","last_fullsized":"2024-02-21T22:54:04.854030+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:54:04.853910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:54:04.853910+0000","last_clean_scrub_stamp":"2024-02-21T22:54:04.853910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T10:01:11.936920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:54:06.656268+0000","last_change":"2024-02-21T22:54:06.656314+0000","last_active":"2024-02-21T22:54:06.656268+0000","last_peered":"2024-02-21T22:54:06.656268+0000","last_clean":"2024-02-21T22:54:06.656268+0000","last_became_active":"2024-02-21T22:53:43.010683+0000","last_became_peered":"2024-02-21T22:53:43.010683+0000","last_unstale":"2024-02-21T22:54:06.656268+0000","last_undegraded":"2024-02-21T22:54:06.656268+0000","last_fullsized":"2024-02-21T22:54:06.656268+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:54:06.656165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:54:06.656165+0000","last_clean_scrub_stamp":"2024-02-21T22:54:06.656165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:39:26.002519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:54:03.429092+0000","last_change":"2024-02-21T22:54:03.429115+0000","last_active":"2024-02-21T22:54:03.429092+0000","last_peered":"2024-02-21T22:54:03.429092+0000","last_clean":"2024-02-21T22:54:03.429092+0000","last_became_active":"2024-02-21T22:53:43.006405+0000","last_became_peered":"2024-02-21T22:53:43.006405+0000","last_unstale":"2024-02-21T22:54:03.429092+0000","last_undegraded":"2024-02-21T22:54:03.429092+0000","last_fullsized":"2024-02-21T22:54:03.429092+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:54:03.428990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:54:03.428990+0000","last_clean_scrub_stamp":"2024-02-21T22:54:03.428990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T02:25:43.842446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:58.217359+0000","last_change":"2024-02-21T22:53:58.217378+0000","last_active":"2024-02-21T22:53:58.217359+0000","last_peered":"2024-02-21T22:53:58.217359+0000","last_clean":"2024-02-21T22:53:58.217359+0000","last_became_active":"2024-02-21T22:53:42.997719+0000","last_became_peered":"2024-02-21T22:53:42.997719+0000","last_unstale":"2024-02-21T22:53:58.217359+0000","last_undegraded":"2024-02-21T22:53:58.217359+0000","last_fullsized":"2024-02-21T22:53:58.217359+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:58.217286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:58.217286+0000","last_clean_scrub_stamp":"2024-02-21T22:53:58.217286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:11:17.083657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:54:04.454474+0000","last_change":"2024-02-21T22:54:04.454492+0000","last_active":"2024-02-21T22:54:04.454474+0000","last_peered":"2024-02-21T22:54:04.454474+0000","last_clean":"2024-02-21T22:54:04.454474+0000","last_became_active":"2024-02-21T22:53:43.007675+0000","last_became_peered":"2024-02-21T22:53:43.007675+0000","last_unstale":"2024-02-21T22:54:04.454474+0000","last_undegraded":"2024-02-21T22:54:04.454474+0000","last_fullsized":"2024-02-21T22:54:04.454474+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:54:04.454409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:54:04.454409+0000","last_clean_scrub_stamp":"2024-02-21T22:54:04.454409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:32:28.488553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:54:01.480472+0000","last_change":"2024-02-21T22:54:01.480491+0000","last_active":"2024-02-21T22:54:01.480472+0000","last_peered":"2024-02-21T22:54:01.480472+0000","last_clean":"2024-02-21T22:54:01.480472+0000","last_became_active":"2024-02-21T22:53:43.000729+0000","last_became_peered":"2024-02-21T22:53:43.000729+0000","last_unstale":"2024-02-21T22:54:01.480472+0000","last_undegraded":"2024-02-21T22:54:01.480472+0000","last_fullsized":"2024-02-21T22:54:01.480472+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:54:01.480391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:54:01.480391+0000","last_clean_scrub_stamp":"2024-02-21T22:54:01.480391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T02:54:52.188216+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.991710+0000","last_change":"2024-02-21T22:53:43.016364+0000","last_active":"2024-02-21T22:53:43.991710+0000","last_peered":"2024-02-21T22:53:43.991710+0000","last_clean":"2024-02-21T22:53:43.991710+0000","last_became_active":"2024-02-21T22:53:43.015907+0000","last_became_peered":"2024-02-21T22:53:43.015907+0000","last_unstale":"2024-02-21T22:53:43.991710+0000","last_undegraded":"2024-02-21T22:53:43.991710+0000","last_fullsized":"2024-02-21T22:53:43.991710+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:54:03.669579+0000","last_change":"2024-02-21T22:54:03.669632+0000","last_active":"2024-02-21T22:54:03.669579+0000","last_peered":"2024-02-21T22:54:03.669579+0000","last_clean":"2024-02-21T22:54:03.669579+0000","last_became_active":"2024-02-21T22:53:43.005035+0000","last_became_peered":"2024-02-21T22:53:43.005035+0000","last_unstale":"2024-02-21T22:54:03.669579+0000","last_undegraded":"2024-02-21T22:54:03.669579+0000","last_fullsized":"2024-02-21T22:54:03.669579+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:54:03.669474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:54:03.669474+0000","last_clean_scrub_stamp":"2024-02-21T22:54:03.669474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:32:27.703618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:54:08.343237+0000","last_change":"2024-02-21T22:54:08.343277+0000","last_active":"2024-02-21T22:54:08.343237+0000","last_peered":"2024-02-21T22:54:08.343237+0000","last_clean":"2024-02-21T22:54:08.343237+0000","last_became_active":"2024-02-21T22:53:43.010956+0000","last_became_peered":"2024-02-21T22:53:43.010956+0000","last_unstale":"2024-02-21T22:54:08.343237+0000","last_undegraded":"2024-02-21T22:54:08.343237+0000","last_fullsized":"2024-02-21T22:54:08.343237+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:54:08.343126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:54:08.343126+0000","last_clean_scrub_stamp":"2024-02-21T22:54:08.343126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T02:41:37.760990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:54:08.724987+0000","last_change":"2024-02-21T22:54:08.725024+0000","last_active":"2024-02-21T22:54:08.724987+0000","last_peered":"2024-02-21T22:54:08.724987+0000","last_clean":"2024-02-21T22:54:08.724987+0000","last_became_active":"2024-02-21T22:53:43.007022+0000","last_became_peered":"2024-02-21T22:53:43.007022+0000","last_unstale":"2024-02-21T22:54:08.724987+0000","last_undegraded":"2024-02-21T22:54:08.724987+0000","last_fullsized":"2024-02-21T22:54:08.724987+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:54:08.724872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:54:08.724872+0000","last_clean_scrub_stamp":"2024-02-21T22:54:08.724872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:20:08.956779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:58.443762+0000","last_change":"2024-02-21T22:53:58.443783+0000","last_active":"2024-02-21T22:53:58.443762+0000","last_peered":"2024-02-21T22:53:58.443762+0000","last_clean":"2024-02-21T22:53:58.443762+0000","last_became_active":"2024-02-21T22:53:42.999406+0000","last_became_peered":"2024-02-21T22:53:42.999406+0000","last_unstale":"2024-02-21T22:53:58.443762+0000","last_undegraded":"2024-02-21T22:53:58.443762+0000","last_fullsized":"2024-02-21T22:53:58.443762+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:58.443676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:58.443676+0000","last_clean_scrub_stamp":"2024-02-21T22:53:58.443676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:26:42.462076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:54:12.330200+0000","last_change":"2024-02-21T22:54:12.330226+0000","last_active":"2024-02-21T22:54:12.330200+0000","last_peered":"2024-02-21T22:54:12.330200+0000","last_clean":"2024-02-21T22:54:12.330200+0000","last_became_active":"2024-02-21T22:53:43.004383+0000","last_became_peered":"2024-02-21T22:53:43.004383+0000","last_unstale":"2024-02-21T22:54:12.330200+0000","last_undegraded":"2024-02-21T22:54:12.330200+0000","last_fullsized":"2024-02-21T22:54:12.330200+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:54:12.330090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:54:12.330090+0000","last_clean_scrub_stamp":"2024-02-21T22:54:12.330090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T02:41:11.904061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:54:00.778621+0000","last_change":"2024-02-21T22:54:00.778640+0000","last_active":"2024-02-21T22:54:00.778621+0000","last_peered":"2024-02-21T22:54:00.778621+0000","last_clean":"2024-02-21T22:54:00.778621+0000","last_became_active":"2024-02-21T22:53:42.995407+0000","last_became_peered":"2024-02-21T22:53:42.995407+0000","last_unstale":"2024-02-21T22:54:00.778621+0000","last_undegraded":"2024-02-21T22:54:00.778621+0000","last_fullsized":"2024-02-21T22:54:00.778621+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:54:00.778546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:54:00.778546+0000","last_clean_scrub_stamp":"2024-02-21T22:54:00.778546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:17:52.321309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:54:07.383131+0000","last_change":"2024-02-21T22:54:07.383150+0000","last_active":"2024-02-21T22:54:07.383131+0000","last_peered":"2024-02-21T22:54:07.383131+0000","last_clean":"2024-02-21T22:54:07.383131+0000","last_became_active":"2024-02-21T22:53:43.009073+0000","last_became_peered":"2024-02-21T22:53:43.009073+0000","last_unstale":"2024-02-21T22:54:07.383131+0000","last_undegraded":"2024-02-21T22:54:07.383131+0000","last_fullsized":"2024-02-21T22:54:07.383131+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:54:07.383059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:54:07.383059+0000","last_clean_scrub_stamp":"2024-02-21T22:54:07.383059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:03:44.360533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:54:06.401320+0000","last_change":"2024-02-21T22:54:06.401354+0000","last_active":"2024-02-21T22:54:06.401320+0000","last_peered":"2024-02-21T22:54:06.401320+0000","last_clean":"2024-02-21T22:54:06.401320+0000","last_became_active":"2024-02-21T22:53:43.008404+0000","last_became_peered":"2024-02-21T22:53:43.008404+0000","last_unstale":"2024-02-21T22:54:06.401320+0000","last_undegraded":"2024-02-21T22:54:06.401320+0000","last_fullsized":"2024-02-21T22:54:06.401320+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:54:06.401215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:54:06.401215+0000","last_clean_scrub_stamp":"2024-02-21T22:54:06.401215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T10:01:13.484225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:54:08.325586+0000","last_change":"2024-02-21T22:54:08.325612+0000","last_active":"2024-02-21T22:54:08.325586+0000","last_peered":"2024-02-21T22:54:08.325586+0000","last_clean":"2024-02-21T22:54:08.325586+0000","last_became_active":"2024-02-21T22:53:42.999362+0000","last_became_peered":"2024-02-21T22:53:42.999362+0000","last_unstale":"2024-02-21T22:54:08.325586+0000","last_undegraded":"2024-02-21T22:54:08.325586+0000","last_fullsized":"2024-02-21T22:54:08.325586+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:54:08.325498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:54:08.325498+0000","last_clean_scrub_stamp":"2024-02-21T22:54:08.325498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T02:37:13.557086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.340383+0000","last_change":"2024-02-21T22:53:43.010970+0000","last_active":"2024-02-21T22:53:44.340383+0000","last_peered":"2024-02-21T22:53:44.340383+0000","last_clean":"2024-02-21T22:53:44.340383+0000","last_became_active":"2024-02-21T22:53:43.010702+0000","last_became_peered":"2024-02-21T22:53:43.010702+0000","last_unstale":"2024-02-21T22:53:44.340383+0000","last_undegraded":"2024-02-21T22:53:44.340383+0000","last_fullsized":"2024-02-21T22:53:44.340383+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:54:02.411724+0000","last_change":"2024-02-21T22:54:02.411754+0000","last_active":"2024-02-21T22:54:02.411724+0000","last_peered":"2024-02-21T22:54:02.411724+0000","last_clean":"2024-02-21T22:54:02.411724+0000","last_became_active":"2024-02-21T22:53:43.005993+0000","last_became_peered":"2024-02-21T22:53:43.005993+0000","last_unstale":"2024-02-21T22:54:02.411724+0000","last_undegraded":"2024-02-21T22:54:02.411724+0000","last_fullsized":"2024-02-21T22:54:02.411724+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:54:02.411581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:54:02.411581+0000","last_clean_scrub_stamp":"2024-02-21T22:54:02.411581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:42:17.021545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:54:10.646950+0000","last_change":"2024-02-21T22:54:10.646969+0000","last_active":"2024-02-21T22:54:10.646950+0000","last_peered":"2024-02-21T22:54:10.646950+0000","last_clean":"2024-02-21T22:54:10.646950+0000","last_became_active":"2024-02-21T22:53:43.014712+0000","last_became_peered":"2024-02-21T22:53:43.014712+0000","last_unstale":"2024-02-21T22:54:10.646950+0000","last_undegraded":"2024-02-21T22:54:10.646950+0000","last_fullsized":"2024-02-21T22:54:10.646950+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:54:10.646887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:54:10.646887+0000","last_clean_scrub_stamp":"2024-02-21T22:54:10.646887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:13:20.478207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:54:09.644517+0000","last_change":"2024-02-21T22:54:09.644537+0000","last_active":"2024-02-21T22:54:09.644517+0000","last_peered":"2024-02-21T22:54:09.644517+0000","last_clean":"2024-02-21T22:54:09.644517+0000","last_became_active":"2024-02-21T22:53:43.014570+0000","last_became_peered":"2024-02-21T22:53:43.014570+0000","last_unstale":"2024-02-21T22:54:09.644517+0000","last_undegraded":"2024-02-21T22:54:09.644517+0000","last_fullsized":"2024-02-21T22:54:09.644517+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:54:09.644448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:54:09.644448+0000","last_clean_scrub_stamp":"2024-02-21T22:54:09.644448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T02:41:39.062312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:54:03.786296+0000","last_change":"2024-02-21T22:54:03.786324+0000","last_active":"2024-02-21T22:54:03.786296+0000","last_peered":"2024-02-21T22:54:03.786296+0000","last_clean":"2024-02-21T22:54:03.786296+0000","last_became_active":"2024-02-21T22:53:43.002254+0000","last_became_peered":"2024-02-21T22:53:43.002254+0000","last_unstale":"2024-02-21T22:54:03.786296+0000","last_undegraded":"2024-02-21T22:54:03.786296+0000","last_fullsized":"2024-02-21T22:54:03.786296+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:54:03.786201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:54:03.786201+0000","last_clean_scrub_stamp":"2024-02-21T22:54:03.786201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:17:55.328963+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:54:01.790712+0000","last_change":"2024-02-21T22:54:01.790757+0000","last_active":"2024-02-21T22:54:01.790712+0000","last_peered":"2024-02-21T22:54:01.790712+0000","last_clean":"2024-02-21T22:54:01.790712+0000","last_became_active":"2024-02-21T22:53:42.996208+0000","last_became_peered":"2024-02-21T22:53:42.996208+0000","last_unstale":"2024-02-21T22:54:01.790712+0000","last_undegraded":"2024-02-21T22:54:01.790712+0000","last_fullsized":"2024-02-21T22:54:01.790712+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:54:01.790614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:54:01.790614+0000","last_clean_scrub_stamp":"2024-02-21T22:54:01.790614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:30:15.068041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:54:02.621037+0000","last_change":"2024-02-21T22:54:02.621085+0000","last_active":"2024-02-21T22:54:02.621037+0000","last_peered":"2024-02-21T22:54:02.621037+0000","last_clean":"2024-02-21T22:54:02.621037+0000","last_became_active":"2024-02-21T22:53:43.003710+0000","last_became_peered":"2024-02-21T22:53:43.003710+0000","last_unstale":"2024-02-21T22:54:02.621037+0000","last_undegraded":"2024-02-21T22:54:02.621037+0000","last_fullsized":"2024-02-21T22:54:02.621037+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:54:02.620941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:54:02.620941+0000","last_clean_scrub_stamp":"2024-02-21T22:54:02.620941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:30:15.898368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:54:10.342937+0000","last_change":"2024-02-21T22:54:10.342962+0000","last_active":"2024-02-21T22:54:10.342937+0000","last_peered":"2024-02-21T22:54:10.342937+0000","last_clean":"2024-02-21T22:54:10.342937+0000","last_became_active":"2024-02-21T22:53:43.000575+0000","last_became_peered":"2024-02-21T22:53:43.000575+0000","last_unstale":"2024-02-21T22:54:10.342937+0000","last_undegraded":"2024-02-21T22:54:10.342937+0000","last_fullsized":"2024-02-21T22:54:10.342937+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:54:10.342842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:54:10.342842+0000","last_clean_scrub_stamp":"2024-02-21T22:54:10.342842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:06:25.698091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:54:08.623640+0000","last_change":"2024-02-21T22:54:08.623666+0000","last_active":"2024-02-21T22:54:08.623640+0000","last_peered":"2024-02-21T22:54:08.623640+0000","last_clean":"2024-02-21T22:54:08.623640+0000","last_became_active":"2024-02-21T22:53:43.010808+0000","last_became_peered":"2024-02-21T22:53:43.010808+0000","last_unstale":"2024-02-21T22:54:08.623640+0000","last_undegraded":"2024-02-21T22:54:08.623640+0000","last_fullsized":"2024-02-21T22:54:08.623640+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:54:08.623556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:54:08.623556+0000","last_clean_scrub_stamp":"2024-02-21T22:54:08.623556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:33:05.337105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:54:02.796090+0000","last_change":"2024-02-21T22:54:02.796129+0000","last_active":"2024-02-21T22:54:02.796090+0000","last_peered":"2024-02-21T22:54:02.796090+0000","last_clean":"2024-02-21T22:54:02.796090+0000","last_became_active":"2024-02-21T22:53:42.999295+0000","last_became_peered":"2024-02-21T22:53:42.999295+0000","last_unstale":"2024-02-21T22:54:02.796090+0000","last_undegraded":"2024-02-21T22:54:02.796090+0000","last_fullsized":"2024-02-21T22:54:02.796090+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:54:02.795985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:54:02.795985+0000","last_clean_scrub_stamp":"2024-02-21T22:54:02.795985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:32:26.830129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:54:12.630767+0000","last_change":"2024-02-21T22:54:12.630787+0000","last_active":"2024-02-21T22:54:12.630767+0000","last_peered":"2024-02-21T22:54:12.630767+0000","last_clean":"2024-02-21T22:54:12.630767+0000","last_became_active":"2024-02-21T22:53:43.015533+0000","last_became_peered":"2024-02-21T22:53:43.015533+0000","last_unstale":"2024-02-21T22:54:12.630767+0000","last_undegraded":"2024-02-21T22:54:12.630767+0000","last_fullsized":"2024-02-21T22:54:12.630767+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:54:12.630689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:54:12.630689+0000","last_clean_scrub_stamp":"2024-02-21T22:54:12.630689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T10:34:16.711989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:54:03.415712+0000","last_change":"2024-02-21T22:54:03.415731+0000","last_active":"2024-02-21T22:54:03.415712+0000","last_peered":"2024-02-21T22:54:03.415712+0000","last_clean":"2024-02-21T22:54:03.415712+0000","last_became_active":"2024-02-21T22:53:43.006982+0000","last_became_peered":"2024-02-21T22:53:43.006982+0000","last_unstale":"2024-02-21T22:54:03.415712+0000","last_undegraded":"2024-02-21T22:54:03.415712+0000","last_fullsized":"2024-02-21T22:54:03.415712+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:54:03.415631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:54:03.415631+0000","last_clean_scrub_stamp":"2024-02-21T22:54:03.415631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:59:43.431375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:54:03.681620+0000","last_change":"2024-02-21T22:54:03.681639+0000","last_active":"2024-02-21T22:54:03.681620+0000","last_peered":"2024-02-21T22:54:03.681620+0000","last_clean":"2024-02-21T22:54:03.681620+0000","last_became_active":"2024-02-21T22:53:43.000179+0000","last_became_peered":"2024-02-21T22:53:43.000179+0000","last_unstale":"2024-02-21T22:54:03.681620+0000","last_undegraded":"2024-02-21T22:54:03.681620+0000","last_fullsized":"2024-02-21T22:54:03.681620+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:54:03.681549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:54:03.681549+0000","last_clean_scrub_stamp":"2024-02-21T22:54:03.681549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:28:06.720212+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:54:10.345867+0000","last_change":"2024-02-21T22:54:10.345899+0000","last_active":"2024-02-21T22:54:10.345867+0000","last_peered":"2024-02-21T22:54:10.345867+0000","last_clean":"2024-02-21T22:54:10.345867+0000","last_became_active":"2024-02-21T22:53:43.012985+0000","last_became_peered":"2024-02-21T22:53:43.012985+0000","last_unstale":"2024-02-21T22:54:10.345867+0000","last_undegraded":"2024-02-21T22:54:10.345867+0000","last_fullsized":"2024-02-21T22:54:10.345867+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:54:10.345786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:54:10.345786+0000","last_clean_scrub_stamp":"2024-02-21T22:54:10.345786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T02:26:24.218244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:54:02.801341+0000","last_change":"2024-02-21T22:54:02.801397+0000","last_active":"2024-02-21T22:54:02.801341+0000","last_peered":"2024-02-21T22:54:02.801341+0000","last_clean":"2024-02-21T22:54:02.801341+0000","last_became_active":"2024-02-21T22:53:43.001564+0000","last_became_peered":"2024-02-21T22:53:43.001564+0000","last_unstale":"2024-02-21T22:54:02.801341+0000","last_undegraded":"2024-02-21T22:54:02.801341+0000","last_fullsized":"2024-02-21T22:54:02.801341+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:54:02.801203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:54:02.801203+0000","last_clean_scrub_stamp":"2024-02-21T22:54:02.801203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T02:54:53.509028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"32'4","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:54:01.740171+0000","last_change":"2024-02-21T22:54:01.740196+0000","last_active":"2024-02-21T22:54:01.740171+0000","last_peered":"2024-02-21T22:54:01.740171+0000","last_clean":"2024-02-21T22:54:01.740171+0000","last_became_active":"2024-02-21T22:53:41.994468+0000","last_became_peered":"2024-02-21T22:53:41.994468+0000","last_unstale":"2024-02-21T22:54:01.740171+0000","last_undegraded":"2024-02-21T22:54:01.740171+0000","last_fullsized":"2024-02-21T22:54:01.740171+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-02-21T22:54:01.740098+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-02-21T22:54:01.740098+0000","last_clean_scrub_stamp":"2024-02-21T22:54:01.740098+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:18:54.666061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:54:05.770688+0000","last_change":"2024-02-21T22:54:05.770733+0000","last_active":"2024-02-21T22:54:05.770688+0000","last_peered":"2024-02-21T22:54:05.770688+0000","last_clean":"2024-02-21T22:54:05.770688+0000","last_became_active":"2024-02-21T22:53:43.008021+0000","last_became_peered":"2024-02-21T22:53:43.008021+0000","last_unstale":"2024-02-21T22:54:05.770688+0000","last_undegraded":"2024-02-21T22:54:05.770688+0000","last_fullsized":"2024-02-21T22:54:05.770688+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:54:05.770578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:54:05.770578+0000","last_clean_scrub_stamp":"2024-02-21T22:54:05.770578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:59:26.400937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"32'1","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:58.906087+0000","last_change":"2024-02-21T22:53:58.906127+0000","last_active":"2024-02-21T22:53:58.906087+0000","last_peered":"2024-02-21T22:53:58.906087+0000","last_clean":"2024-02-21T22:53:58.906087+0000","last_became_active":"2024-02-21T22:53:41.986784+0000","last_became_peered":"2024-02-21T22:53:41.986784+0000","last_unstale":"2024-02-21T22:53:58.906087+0000","last_undegraded":"2024-02-21T22:53:58.906087+0000","last_fullsized":"2024-02-21T22:53:58.906087+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'1","last_scrub_stamp":"2024-02-21T22:53:58.905969+0000","last_deep_scrub":"32'1","last_deep_scrub_stamp":"2024-02-21T22:53:58.905969+0000","last_clean_scrub_stamp":"2024-02-21T22:53:58.905969+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:00:49.306536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:43.991489+0000","last_change":"2024-02-21T22:53:43.016649+0000","last_active":"2024-02-21T22:53:43.991489+0000","last_peered":"2024-02-21T22:53:43.991489+0000","last_clean":"2024-02-21T22:53:43.991489+0000","last_became_active":"2024-02-21T22:53:43.016339+0000","last_became_peered":"2024-02-21T22:53:43.016339+0000","last_unstale":"2024-02-21T22:53:43.991489+0000","last_undegraded":"2024-02-21T22:53:43.991489+0000","last_fullsized":"2024-02-21T22:53:43.991489+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"32'2","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:54:05.349092+0000","last_change":"2024-02-21T22:54:05.349121+0000","last_active":"2024-02-21T22:54:05.349092+0000","last_peered":"2024-02-21T22:54:05.349092+0000","last_clean":"2024-02-21T22:54:05.349092+0000","last_became_active":"2024-02-21T22:53:41.990213+0000","last_became_peered":"2024-02-21T22:53:41.990213+0000","last_unstale":"2024-02-21T22:54:05.349092+0000","last_undegraded":"2024-02-21T22:54:05.349092+0000","last_fullsized":"2024-02-21T22:54:05.349092+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-02-21T22:54:05.348984+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-02-21T22:54:05.348984+0000","last_clean_scrub_stamp":"2024-02-21T22:54:05.348984+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:33:02.062532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:54:09.663559+0000","last_change":"2024-02-21T22:54:09.663580+0000","last_active":"2024-02-21T22:54:09.663559+0000","last_peered":"2024-02-21T22:54:09.663559+0000","last_clean":"2024-02-21T22:54:09.663559+0000","last_became_active":"2024-02-21T22:53:43.011165+0000","last_became_peered":"2024-02-21T22:53:43.011165+0000","last_unstale":"2024-02-21T22:54:09.663559+0000","last_undegraded":"2024-02-21T22:54:09.663559+0000","last_fullsized":"2024-02-21T22:54:09.663559+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:54:09.663482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:54:09.663482+0000","last_clean_scrub_stamp":"2024-02-21T22:54:09.663482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:20:09.895389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"32'2","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:57.481025+0000","last_change":"2024-02-21T22:53:57.481055+0000","last_active":"2024-02-21T22:53:57.481025+0000","last_peered":"2024-02-21T22:53:57.481025+0000","last_clean":"2024-02-21T22:53:57.481025+0000","last_became_active":"2024-02-21T22:53:41.989105+0000","last_became_peered":"2024-02-21T22:53:41.989105+0000","last_unstale":"2024-02-21T22:53:57.481025+0000","last_undegraded":"2024-02-21T22:53:57.481025+0000","last_fullsized":"2024-02-21T22:53:57.481025+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-02-21T22:53:57.480943+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-02-21T22:53:57.480943+0000","last_clean_scrub_stamp":"2024-02-21T22:53:57.480943+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:06:19.215628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:54:09.375383+0000","last_change":"2024-02-21T22:54:09.375423+0000","last_active":"2024-02-21T22:54:09.375383+0000","last_peered":"2024-02-21T22:54:09.375383+0000","last_clean":"2024-02-21T22:54:09.375383+0000","last_became_active":"2024-02-21T22:53:43.012407+0000","last_became_peered":"2024-02-21T22:53:43.012407+0000","last_unstale":"2024-02-21T22:54:09.375383+0000","last_undegraded":"2024-02-21T22:54:09.375383+0000","last_fullsized":"2024-02-21T22:54:09.375383+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:54:09.375292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:54:09.375292+0000","last_clean_scrub_stamp":"2024-02-21T22:54:09.375292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:13:19.206612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"32'1","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:54:06.614635+0000","last_change":"2024-02-21T22:54:06.614654+0000","last_active":"2024-02-21T22:54:06.614635+0000","last_peered":"2024-02-21T22:54:06.614635+0000","last_clean":"2024-02-21T22:54:06.614635+0000","last_became_active":"2024-02-21T22:53:41.992200+0000","last_became_peered":"2024-02-21T22:53:41.992200+0000","last_unstale":"2024-02-21T22:54:06.614635+0000","last_undegraded":"2024-02-21T22:54:06.614635+0000","last_fullsized":"2024-02-21T22:54:06.614635+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'1","last_scrub_stamp":"2024-02-21T22:54:06.614570+0000","last_deep_scrub":"32'1","last_deep_scrub_stamp":"2024-02-21T22:54:06.614570+0000","last_clean_scrub_stamp":"2024-02-21T22:54:06.614570+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:31:29.988162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:54:03.816815+0000","last_change":"2024-02-21T22:54:03.816861+0000","last_active":"2024-02-21T22:54:03.816815+0000","last_peered":"2024-02-21T22:54:03.816815+0000","last_clean":"2024-02-21T22:54:03.816815+0000","last_became_active":"2024-02-21T22:53:43.003448+0000","last_became_peered":"2024-02-21T22:53:43.003448+0000","last_unstale":"2024-02-21T22:54:03.816815+0000","last_undegraded":"2024-02-21T22:54:03.816815+0000","last_fullsized":"2024-02-21T22:54:03.816815+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:54:03.816732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:54:03.816732+0000","last_clean_scrub_stamp":"2024-02-21T22:54:03.816732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:31:27.190324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"32'1","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:54:04.611892+0000","last_change":"2024-02-21T22:54:04.611916+0000","last_active":"2024-02-21T22:54:04.611892+0000","last_peered":"2024-02-21T22:54:04.611892+0000","last_clean":"2024-02-21T22:54:04.611892+0000","last_became_active":"2024-02-21T22:53:41.989605+0000","last_became_peered":"2024-02-21T22:53:41.989605+0000","last_unstale":"2024-02-21T22:54:04.611892+0000","last_undegraded":"2024-02-21T22:54:04.611892+0000","last_fullsized":"2024-02-21T22:54:04.611892+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'1","last_scrub_stamp":"2024-02-21T22:54:04.611822+0000","last_deep_scrub":"32'1","last_deep_scrub_stamp":"2024-02-21T22:54:04.611822+0000","last_clean_scrub_stamp":"2024-02-21T22:54:04.611822+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:59:44.627567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:54:08.609022+0000","last_change":"2024-02-21T22:54:08.609055+0000","last_active":"2024-02-21T22:54:08.609022+0000","last_peered":"2024-02-21T22:54:08.609022+0000","last_clean":"2024-02-21T22:54:08.609022+0000","last_became_active":"2024-02-21T22:53:43.011446+0000","last_became_peered":"2024-02-21T22:53:43.011446+0000","last_unstale":"2024-02-21T22:54:08.609022+0000","last_undegraded":"2024-02-21T22:54:08.609022+0000","last_fullsized":"2024-02-21T22:54:08.609022+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:54:08.608922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:54:08.608922+0000","last_clean_scrub_stamp":"2024-02-21T22:54:08.608922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:03:45.586397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:54:03.305516+0000","last_change":"2024-02-21T22:54:03.305545+0000","last_active":"2024-02-21T22:54:03.305516+0000","last_peered":"2024-02-21T22:54:03.305516+0000","last_clean":"2024-02-21T22:54:03.305516+0000","last_became_active":"2024-02-21T22:53:41.989927+0000","last_became_peered":"2024-02-21T22:53:41.989927+0000","last_unstale":"2024-02-21T22:54:03.305516+0000","last_undegraded":"2024-02-21T22:54:03.305516+0000","last_fullsized":"2024-02-21T22:54:03.305516+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:54:03.305406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:54:03.305406+0000","last_clean_scrub_stamp":"2024-02-21T22:54:03.305406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:39:22.651760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:54:05.616100+0000","last_change":"2024-02-21T22:54:05.616124+0000","last_active":"2024-02-21T22:54:05.616100+0000","last_peered":"2024-02-21T22:54:05.616100+0000","last_clean":"2024-02-21T22:54:05.616100+0000","last_became_active":"2024-02-21T22:53:43.008486+0000","last_became_peered":"2024-02-21T22:53:43.008486+0000","last_unstale":"2024-02-21T22:54:05.616100+0000","last_undegraded":"2024-02-21T22:54:05.616100+0000","last_fullsized":"2024-02-21T22:54:05.616100+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:54:05.616006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:54:05.616006+0000","last_clean_scrub_stamp":"2024-02-21T22:54:05.616006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T10:01:12.699017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:59.701803+0000","last_change":"2024-02-21T22:53:59.701849+0000","last_active":"2024-02-21T22:53:59.701803+0000","last_peered":"2024-02-21T22:53:59.701803+0000","last_clean":"2024-02-21T22:53:59.701803+0000","last_became_active":"2024-02-21T22:53:41.985232+0000","last_became_peered":"2024-02-21T22:53:41.985232+0000","last_unstale":"2024-02-21T22:53:59.701803+0000","last_undegraded":"2024-02-21T22:53:59.701803+0000","last_fullsized":"2024-02-21T22:53:59.701803+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:59.701715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:59.701715+0000","last_clean_scrub_stamp":"2024-02-21T22:53:59.701715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:18:52.627677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:54:06.790957+0000","last_change":"2024-02-21T22:54:06.790999+0000","last_active":"2024-02-21T22:54:06.790957+0000","last_peered":"2024-02-21T22:54:06.790957+0000","last_clean":"2024-02-21T22:54:06.790957+0000","last_became_active":"2024-02-21T22:53:43.005375+0000","last_became_peered":"2024-02-21T22:53:43.005375+0000","last_unstale":"2024-02-21T22:54:06.790957+0000","last_undegraded":"2024-02-21T22:54:06.790957+0000","last_fullsized":"2024-02-21T22:54:06.790957+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:54:06.790887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:54:06.790887+0000","last_clean_scrub_stamp":"2024-02-21T22:54:06.790887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T10:51:58.378346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:59.244245+0000","last_change":"2024-02-21T22:53:59.244265+0000","last_active":"2024-02-21T22:53:59.244245+0000","last_peered":"2024-02-21T22:53:59.244245+0000","last_clean":"2024-02-21T22:53:59.244245+0000","last_became_active":"2024-02-21T22:53:41.986873+0000","last_became_peered":"2024-02-21T22:53:41.986873+0000","last_unstale":"2024-02-21T22:53:59.244245+0000","last_undegraded":"2024-02-21T22:53:59.244245+0000","last_fullsized":"2024-02-21T22:53:59.244245+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:59.244171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:59.244171+0000","last_clean_scrub_stamp":"2024-02-21T22:53:59.244171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:30:12.521598+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:44.340505+0000","last_change":"2024-02-21T22:53:43.010123+0000","last_active":"2024-02-21T22:53:44.340505+0000","last_peered":"2024-02-21T22:53:44.340505+0000","last_clean":"2024-02-21T22:53:44.340505+0000","last_became_active":"2024-02-21T22:53:43.009846+0000","last_became_peered":"2024-02-21T22:53:43.009846+0000","last_unstale":"2024-02-21T22:53:44.340505+0000","last_undegraded":"2024-02-21T22:53:44.340505+0000","last_fullsized":"2024-02-21T22:53:44.340505+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:41.971938+0000","last_clean_scrub_stamp":"2024-02-21T22:53:41.971938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:59.870343+0000","last_change":"2024-02-21T22:53:59.870362+0000","last_active":"2024-02-21T22:53:59.870343+0000","last_peered":"2024-02-21T22:53:59.870343+0000","last_clean":"2024-02-21T22:53:59.870343+0000","last_became_active":"2024-02-21T22:53:41.987448+0000","last_became_peered":"2024-02-21T22:53:41.987448+0000","last_unstale":"2024-02-21T22:53:59.870343+0000","last_undegraded":"2024-02-21T22:53:59.870343+0000","last_fullsized":"2024-02-21T22:53:59.870343+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:59.870266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:59.870266+0000","last_clean_scrub_stamp":"2024-02-21T22:53:59.870266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:37:01.831305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:54:06.381777+0000","last_change":"2024-02-21T22:54:06.381836+0000","last_active":"2024-02-21T22:54:06.381777+0000","last_peered":"2024-02-21T22:54:06.381777+0000","last_clean":"2024-02-21T22:54:06.381777+0000","last_became_active":"2024-02-21T22:53:42.997104+0000","last_became_peered":"2024-02-21T22:53:42.997104+0000","last_unstale":"2024-02-21T22:54:06.381777+0000","last_undegraded":"2024-02-21T22:54:06.381777+0000","last_fullsized":"2024-02-21T22:54:06.381777+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:54:06.381676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:54:06.381676+0000","last_clean_scrub_stamp":"2024-02-21T22:54:06.381676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T10:34:10.462976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"32'3","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:59.747359+0000","last_change":"2024-02-21T22:53:59.747385+0000","last_active":"2024-02-21T22:53:59.747359+0000","last_peered":"2024-02-21T22:53:59.747359+0000","last_clean":"2024-02-21T22:53:59.747359+0000","last_became_active":"2024-02-21T22:53:41.994214+0000","last_became_peered":"2024-02-21T22:53:41.994214+0000","last_unstale":"2024-02-21T22:53:59.747359+0000","last_undegraded":"2024-02-21T22:53:59.747359+0000","last_fullsized":"2024-02-21T22:53:59.747359+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-02-21T22:53:59.747273+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-02-21T22:53:59.747273+0000","last_clean_scrub_stamp":"2024-02-21T22:53:59.747273+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T02:54:50.455098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:54:05.824994+0000","last_change":"2024-02-21T22:54:05.825027+0000","last_active":"2024-02-21T22:54:05.824994+0000","last_peered":"2024-02-21T22:54:05.824994+0000","last_clean":"2024-02-21T22:54:05.824994+0000","last_became_active":"2024-02-21T22:53:43.004978+0000","last_became_peered":"2024-02-21T22:53:43.004978+0000","last_unstale":"2024-02-21T22:54:05.824994+0000","last_undegraded":"2024-02-21T22:54:05.824994+0000","last_fullsized":"2024-02-21T22:54:05.824994+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:54:05.824918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:54:05.824918+0000","last_clean_scrub_stamp":"2024-02-21T22:54:05.824918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:03:42.802393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"33'10","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:54:02.269568+0000","last_change":"2024-02-21T22:54:02.269604+0000","last_active":"2024-02-21T22:54:02.269568+0000","last_peered":"2024-02-21T22:54:02.269568+0000","last_clean":"2024-02-21T22:54:02.269568+0000","last_became_active":"2024-02-21T22:53:41.989590+0000","last_became_peered":"2024-02-21T22:53:41.989590+0000","last_unstale":"2024-02-21T22:54:02.269568+0000","last_undegraded":"2024-02-21T22:54:02.269568+0000","last_fullsized":"2024-02-21T22:54:02.269568+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2024-02-21T22:54:02.269472+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2024-02-21T22:54:02.269472+0000","last_clean_scrub_stamp":"2024-02-21T22:54:02.269472+0000","objects_scrubbed":4,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T10:01:09.352482+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7145,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:54:04.644416+0000","last_change":"2024-02-21T22:54:04.644438+0000","last_active":"2024-02-21T22:54:04.644416+0000","last_peered":"2024-02-21T22:54:04.644416+0000","last_clean":"2024-02-21T22:54:04.644416+0000","last_became_active":"2024-02-21T22:53:43.007923+0000","last_became_peered":"2024-02-21T22:53:43.007923+0000","last_unstale":"2024-02-21T22:54:04.644416+0000","last_undegraded":"2024-02-21T22:54:04.644416+0000","last_fullsized":"2024-02-21T22:54:04.644416+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:54:04.644330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:54:04.644330+0000","last_clean_scrub_stamp":"2024-02-21T22:54:04.644330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:31:28.017922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"32'2","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:54:02.677326+0000","last_change":"2024-02-21T22:54:02.677371+0000","last_active":"2024-02-21T22:54:02.677326+0000","last_peered":"2024-02-21T22:54:02.677326+0000","last_clean":"2024-02-21T22:54:02.677326+0000","last_became_active":"2024-02-21T22:53:41.985220+0000","last_became_peered":"2024-02-21T22:53:41.985220+0000","last_unstale":"2024-02-21T22:54:02.677326+0000","last_undegraded":"2024-02-21T22:54:02.677326+0000","last_fullsized":"2024-02-21T22:54:02.677326+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-02-21T22:54:02.677208+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-02-21T22:54:02.677208+0000","last_clean_scrub_stamp":"2024-02-21T22:54:02.677208+0000","objects_scrubbed":2,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:02:34.594069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:54:11.330490+0000","last_change":"2024-02-21T22:54:11.330515+0000","last_active":"2024-02-21T22:54:11.330490+0000","last_peered":"2024-02-21T22:54:11.330490+0000","last_clean":"2024-02-21T22:54:11.330490+0000","last_became_active":"2024-02-21T22:53:43.003293+0000","last_became_peered":"2024-02-21T22:53:43.003293+0000","last_unstale":"2024-02-21T22:54:11.330490+0000","last_undegraded":"2024-02-21T22:54:11.330490+0000","last_fullsized":"2024-02-21T22:54:11.330490+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:54:11.330393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:54:11.330393+0000","last_clean_scrub_stamp":"2024-02-21T22:54:11.330393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:23:45.552033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:58.682203+0000","last_change":"2024-02-21T22:53:58.682222+0000","last_active":"2024-02-21T22:53:58.682203+0000","last_peered":"2024-02-21T22:53:58.682203+0000","last_clean":"2024-02-21T22:53:58.682203+0000","last_became_active":"2024-02-21T22:53:41.987379+0000","last_became_peered":"2024-02-21T22:53:41.987379+0000","last_unstale":"2024-02-21T22:53:58.682203+0000","last_undegraded":"2024-02-21T22:53:58.682203+0000","last_fullsized":"2024-02-21T22:53:58.682203+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:58.682126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:58.682126+0000","last_clean_scrub_stamp":"2024-02-21T22:53:58.682126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:28:01.720789+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:54:11.309717+0000","last_change":"2024-02-21T22:54:11.309754+0000","last_active":"2024-02-21T22:54:11.309717+0000","last_peered":"2024-02-21T22:54:11.309717+0000","last_clean":"2024-02-21T22:54:11.309717+0000","last_became_active":"2024-02-21T22:53:43.013636+0000","last_became_peered":"2024-02-21T22:53:43.013636+0000","last_unstale":"2024-02-21T22:54:11.309717+0000","last_undegraded":"2024-02-21T22:54:11.309717+0000","last_fullsized":"2024-02-21T22:54:11.309717+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:54:11.309591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:54:11.309591+0000","last_clean_scrub_stamp":"2024-02-21T22:54:11.309591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T10:34:15.390891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:54:01.295470+0000","last_change":"2024-02-21T22:54:01.295499+0000","last_active":"2024-02-21T22:54:01.295470+0000","last_peered":"2024-02-21T22:54:01.295470+0000","last_clean":"2024-02-21T22:54:01.295470+0000","last_became_active":"2024-02-21T22:53:41.988958+0000","last_became_peered":"2024-02-21T22:53:41.988958+0000","last_unstale":"2024-02-21T22:54:01.295470+0000","last_undegraded":"2024-02-21T22:54:01.295470+0000","last_fullsized":"2024-02-21T22:54:01.295470+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:54:01.295368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:54:01.295368+0000","last_clean_scrub_stamp":"2024-02-21T22:54:01.295368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:31:24.668960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:54:06.748819+0000","last_change":"2024-02-21T22:54:06.748858+0000","last_active":"2024-02-21T22:54:06.748819+0000","last_peered":"2024-02-21T22:54:06.748819+0000","last_clean":"2024-02-21T22:54:06.748819+0000","last_became_active":"2024-02-21T22:53:43.010007+0000","last_became_peered":"2024-02-21T22:53:43.010007+0000","last_unstale":"2024-02-21T22:54:06.748819+0000","last_undegraded":"2024-02-21T22:54:06.748819+0000","last_fullsized":"2024-02-21T22:54:06.748819+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:54:06.748713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:54:06.748713+0000","last_clean_scrub_stamp":"2024-02-21T22:54:06.748713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:59:46.764457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"32'8","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:54:04.323377+0000","last_change":"2024-02-21T22:54:04.323414+0000","last_active":"2024-02-21T22:54:04.323377+0000","last_peered":"2024-02-21T22:54:04.323377+0000","last_clean":"2024-02-21T22:54:04.323377+0000","last_became_active":"2024-02-21T22:53:41.989531+0000","last_became_peered":"2024-02-21T22:53:41.989531+0000","last_unstale":"2024-02-21T22:54:04.323377+0000","last_undegraded":"2024-02-21T22:54:04.323377+0000","last_fullsized":"2024-02-21T22:54:04.323377+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-02-21T22:54:04.323281+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-02-21T22:54:04.323281+0000","last_clean_scrub_stamp":"2024-02-21T22:54:04.323281+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:55:22.978026+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:54:07.651595+0000","last_change":"2024-02-21T22:54:07.651637+0000","last_active":"2024-02-21T22:54:07.651595+0000","last_peered":"2024-02-21T22:54:07.651595+0000","last_clean":"2024-02-21T22:54:07.651595+0000","last_became_active":"2024-02-21T22:53:43.009914+0000","last_became_peered":"2024-02-21T22:53:43.009914+0000","last_unstale":"2024-02-21T22:54:07.651595+0000","last_undegraded":"2024-02-21T22:54:07.651595+0000","last_fullsized":"2024-02-21T22:54:07.651595+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:54:07.651481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:54:07.651481+0000","last_clean_scrub_stamp":"2024-02-21T22:54:07.651481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T10:01:14.734492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"32'1","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:59.667957+0000","last_change":"2024-02-21T22:53:59.668003+0000","last_active":"2024-02-21T22:53:59.667957+0000","last_peered":"2024-02-21T22:53:59.667957+0000","last_clean":"2024-02-21T22:53:59.667957+0000","last_became_active":"2024-02-21T22:53:41.987692+0000","last_became_peered":"2024-02-21T22:53:41.987692+0000","last_unstale":"2024-02-21T22:53:59.667957+0000","last_undegraded":"2024-02-21T22:53:59.667957+0000","last_fullsized":"2024-02-21T22:53:59.667957+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'1","last_scrub_stamp":"2024-02-21T22:53:59.667844+0000","last_deep_scrub":"32'1","last_deep_scrub_stamp":"2024-02-21T22:53:59.667844+0000","last_clean_scrub_stamp":"2024-02-21T22:53:59.667844+0000","objects_scrubbed":1,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:44:53.127928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:54:09.758088+0000","last_change":"2024-02-21T22:54:09.758108+0000","last_active":"2024-02-21T22:54:09.758088+0000","last_peered":"2024-02-21T22:54:09.758088+0000","last_clean":"2024-02-21T22:54:09.758088+0000","last_became_active":"2024-02-21T22:53:43.009536+0000","last_became_peered":"2024-02-21T22:53:43.009536+0000","last_unstale":"2024-02-21T22:54:09.758088+0000","last_undegraded":"2024-02-21T22:54:09.758088+0000","last_fullsized":"2024-02-21T22:54:09.758088+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:54:09.758019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:54:09.758019+0000","last_clean_scrub_stamp":"2024-02-21T22:54:09.758019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:51:16.556439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"32'2","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:54:00.676050+0000","last_change":"2024-02-21T22:54:00.676075+0000","last_active":"2024-02-21T22:54:00.676050+0000","last_peered":"2024-02-21T22:54:00.676050+0000","last_clean":"2024-02-21T22:54:00.676050+0000","last_became_active":"2024-02-21T22:53:41.985942+0000","last_became_peered":"2024-02-21T22:53:41.985942+0000","last_unstale":"2024-02-21T22:54:00.676050+0000","last_undegraded":"2024-02-21T22:54:00.676050+0000","last_fullsized":"2024-02-21T22:54:00.676050+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-02-21T22:54:00.675972+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-02-21T22:54:00.675972+0000","last_clean_scrub_stamp":"2024-02-21T22:54:00.675972+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T10:22:52.350518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:54:07.627447+0000","last_change":"2024-02-21T22:54:07.627488+0000","last_active":"2024-02-21T22:54:07.627447+0000","last_peered":"2024-02-21T22:54:07.627447+0000","last_clean":"2024-02-21T22:54:07.627447+0000","last_became_active":"2024-02-21T22:53:43.010739+0000","last_became_peered":"2024-02-21T22:53:43.010739+0000","last_unstale":"2024-02-21T22:54:07.627447+0000","last_undegraded":"2024-02-21T22:54:07.627447+0000","last_fullsized":"2024-02-21T22:54:07.627447+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:54:07.627348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:54:07.627348+0000","last_clean_scrub_stamp":"2024-02-21T22:54:07.627348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T10:51:59.214808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"32'1","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:54:01.673498+0000","last_change":"2024-02-21T22:54:01.673555+0000","last_active":"2024-02-21T22:54:01.673498+0000","last_peered":"2024-02-21T22:54:01.673498+0000","last_clean":"2024-02-21T22:54:01.673498+0000","last_became_active":"2024-02-21T22:53:41.986968+0000","last_became_peered":"2024-02-21T22:53:41.986968+0000","last_unstale":"2024-02-21T22:54:01.673498+0000","last_undegraded":"2024-02-21T22:54:01.673498+0000","last_fullsized":"2024-02-21T22:54:01.673498+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'1","last_scrub_stamp":"2024-02-21T22:54:01.673373+0000","last_deep_scrub":"32'1","last_deep_scrub_stamp":"2024-02-21T22:54:01.673373+0000","last_clean_scrub_stamp":"2024-02-21T22:54:01.673373+0000","objects_scrubbed":1,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:28:04.712036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:54:01.428080+0000","last_change":"2024-02-21T22:54:01.428116+0000","last_active":"2024-02-21T22:54:01.428080+0000","last_peered":"2024-02-21T22:54:01.428080+0000","last_clean":"2024-02-21T22:54:01.428080+0000","last_became_active":"2024-02-21T22:53:43.001668+0000","last_became_peered":"2024-02-21T22:53:43.001668+0000","last_unstale":"2024-02-21T22:54:01.428080+0000","last_undegraded":"2024-02-21T22:54:01.428080+0000","last_fullsized":"2024-02-21T22:54:01.428080+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:54:01.427973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:54:01.427973+0000","last_clean_scrub_stamp":"2024-02-21T22:54:01.427973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:32:13.691337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:54:05.594538+0000","last_change":"2024-02-21T22:54:05.594557+0000","last_active":"2024-02-21T22:54:05.594538+0000","last_peered":"2024-02-21T22:54:05.594538+0000","last_clean":"2024-02-21T22:54:05.594538+0000","last_became_active":"2024-02-21T22:53:41.989146+0000","last_became_peered":"2024-02-21T22:53:41.989146+0000","last_unstale":"2024-02-21T22:54:05.594538+0000","last_undegraded":"2024-02-21T22:54:05.594538+0000","last_fullsized":"2024-02-21T22:54:05.594538+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:54:05.594473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:54:05.594473+0000","last_clean_scrub_stamp":"2024-02-21T22:54:05.594473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:32:29.628618+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:54:05.420280+0000","last_change":"2024-02-21T22:54:05.420338+0000","last_active":"2024-02-21T22:54:05.420280+0000","last_peered":"2024-02-21T22:54:05.420280+0000","last_clean":"2024-02-21T22:54:05.420280+0000","last_became_active":"2024-02-21T22:53:43.010865+0000","last_became_peered":"2024-02-21T22:53:43.010865+0000","last_unstale":"2024-02-21T22:54:05.420280+0000","last_undegraded":"2024-02-21T22:54:05.420280+0000","last_fullsized":"2024-02-21T22:54:05.420280+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:54:05.420180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:54:05.420180+0000","last_clean_scrub_stamp":"2024-02-21T22:54:05.420180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:18:58.346142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"32'2","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:56.915192+0000","last_change":"2024-02-21T22:53:56.915216+0000","last_active":"2024-02-21T22:53:56.915192+0000","last_peered":"2024-02-21T22:53:56.915192+0000","last_clean":"2024-02-21T22:53:56.915192+0000","last_became_active":"2024-02-21T22:53:41.984573+0000","last_became_peered":"2024-02-21T22:53:41.984573+0000","last_unstale":"2024-02-21T22:53:56.915192+0000","last_undegraded":"2024-02-21T22:53:56.915192+0000","last_fullsized":"2024-02-21T22:53:56.915192+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-02-21T22:53:56.915109+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-02-21T22:53:56.915109+0000","last_clean_scrub_stamp":"2024-02-21T22:53:56.915109+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:42:11.525074+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:54:00.460135+0000","last_change":"2024-02-21T22:54:00.460181+0000","last_active":"2024-02-21T22:54:00.460135+0000","last_peered":"2024-02-21T22:54:00.460135+0000","last_clean":"2024-02-21T22:54:00.460135+0000","last_became_active":"2024-02-21T22:53:43.001513+0000","last_became_peered":"2024-02-21T22:53:43.001513+0000","last_unstale":"2024-02-21T22:54:00.460135+0000","last_undegraded":"2024-02-21T22:54:00.460135+0000","last_fullsized":"2024-02-21T22:54:00.460135+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:54:00.460032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:54:00.460032+0000","last_clean_scrub_stamp":"2024-02-21T22:54:00.460032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:53:56.019202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:59.798174+0000","last_change":"2024-02-21T22:53:59.798196+0000","last_active":"2024-02-21T22:53:59.798174+0000","last_peered":"2024-02-21T22:53:59.798174+0000","last_clean":"2024-02-21T22:53:59.798174+0000","last_became_active":"2024-02-21T22:53:41.991247+0000","last_became_peered":"2024-02-21T22:53:41.991247+0000","last_unstale":"2024-02-21T22:53:59.798174+0000","last_undegraded":"2024-02-21T22:53:59.798174+0000","last_fullsized":"2024-02-21T22:53:59.798174+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:59.798106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:59.798106+0000","last_clean_scrub_stamp":"2024-02-21T22:53:59.798106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T02:25:40.211562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:59.426557+0000","last_change":"2024-02-21T22:53:59.426577+0000","last_active":"2024-02-21T22:53:59.426557+0000","last_peered":"2024-02-21T22:53:59.426557+0000","last_clean":"2024-02-21T22:53:59.426557+0000","last_became_active":"2024-02-21T22:53:43.000172+0000","last_became_peered":"2024-02-21T22:53:43.000172+0000","last_unstale":"2024-02-21T22:53:59.426557+0000","last_undegraded":"2024-02-21T22:53:59.426557+0000","last_fullsized":"2024-02-21T22:53:59.426557+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:59.426465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:59.426465+0000","last_clean_scrub_stamp":"2024-02-21T22:53:59.426465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:40:22.761390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:54:03.652184+0000","last_change":"2024-02-21T22:54:03.652203+0000","last_active":"2024-02-21T22:54:03.652184+0000","last_peered":"2024-02-21T22:54:03.652184+0000","last_clean":"2024-02-21T22:54:03.652184+0000","last_became_active":"2024-02-21T22:53:41.987202+0000","last_became_peered":"2024-02-21T22:53:41.987202+0000","last_unstale":"2024-02-21T22:54:03.652184+0000","last_undegraded":"2024-02-21T22:54:03.652184+0000","last_fullsized":"2024-02-21T22:54:03.652184+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:54:03.652118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:54:03.652118+0000","last_clean_scrub_stamp":"2024-02-21T22:54:03.652118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:17:55.194880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:54:05.406470+0000","last_change":"2024-02-21T22:54:05.406491+0000","last_active":"2024-02-21T22:54:05.406470+0000","last_peered":"2024-02-21T22:54:05.406470+0000","last_clean":"2024-02-21T22:54:05.406470+0000","last_became_active":"2024-02-21T22:53:43.007502+0000","last_became_peered":"2024-02-21T22:53:43.007502+0000","last_unstale":"2024-02-21T22:54:05.406470+0000","last_undegraded":"2024-02-21T22:54:05.406470+0000","last_fullsized":"2024-02-21T22:54:05.406470+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:54:05.406388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:54:05.406388+0000","last_clean_scrub_stamp":"2024-02-21T22:54:05.406388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:31:28.779980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:58.774758+0000","last_change":"2024-02-21T22:53:58.774778+0000","last_active":"2024-02-21T22:53:58.774758+0000","last_peered":"2024-02-21T22:53:58.774758+0000","last_clean":"2024-02-21T22:53:58.774758+0000","last_became_active":"2024-02-21T22:53:41.992944+0000","last_became_peered":"2024-02-21T22:53:41.992944+0000","last_unstale":"2024-02-21T22:53:58.774758+0000","last_undegraded":"2024-02-21T22:53:58.774758+0000","last_fullsized":"2024-02-21T22:53:58.774758+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:58.774690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:58.774690+0000","last_clean_scrub_stamp":"2024-02-21T22:53:58.774690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:44:52.234774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:54:04.382403+0000","last_change":"2024-02-21T22:54:04.382430+0000","last_active":"2024-02-21T22:54:04.382403+0000","last_peered":"2024-02-21T22:54:04.382403+0000","last_clean":"2024-02-21T22:54:04.382403+0000","last_became_active":"2024-02-21T22:53:43.007283+0000","last_became_peered":"2024-02-21T22:53:43.007283+0000","last_unstale":"2024-02-21T22:54:04.382403+0000","last_undegraded":"2024-02-21T22:54:04.382403+0000","last_fullsized":"2024-02-21T22:54:04.382403+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:54:04.382315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:54:04.382315+0000","last_clean_scrub_stamp":"2024-02-21T22:54:04.382315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:24:59.600048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"32'2","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:54:01.636891+0000","last_change":"2024-02-21T22:54:01.636919+0000","last_active":"2024-02-21T22:54:01.636891+0000","last_peered":"2024-02-21T22:54:01.636891+0000","last_clean":"2024-02-21T22:54:01.636891+0000","last_became_active":"2024-02-21T22:53:41.994229+0000","last_became_peered":"2024-02-21T22:53:41.994229+0000","last_unstale":"2024-02-21T22:54:01.636891+0000","last_undegraded":"2024-02-21T22:54:01.636891+0000","last_fullsized":"2024-02-21T22:54:01.636891+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-02-21T22:54:01.636801+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-02-21T22:54:01.636801+0000","last_clean_scrub_stamp":"2024-02-21T22:54:01.636801+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:11:20.503172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:54:07.764094+0000","last_change":"2024-02-21T22:54:07.764114+0000","last_active":"2024-02-21T22:54:07.764094+0000","last_peered":"2024-02-21T22:54:07.764094+0000","last_clean":"2024-02-21T22:54:07.764094+0000","last_became_active":"2024-02-21T22:53:43.006058+0000","last_became_peered":"2024-02-21T22:53:43.006058+0000","last_unstale":"2024-02-21T22:54:07.764094+0000","last_undegraded":"2024-02-21T22:54:07.764094+0000","last_fullsized":"2024-02-21T22:54:07.764094+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:54:07.764017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:54:07.764017+0000","last_clean_scrub_stamp":"2024-02-21T22:54:07.764017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:33:04.477566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"33'3","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:57.889766+0000","last_change":"2024-02-21T22:53:57.889806+0000","last_active":"2024-02-21T22:53:57.889766+0000","last_peered":"2024-02-21T22:53:57.889766+0000","last_clean":"2024-02-21T22:53:57.889766+0000","last_became_active":"2024-02-21T22:53:41.985263+0000","last_became_peered":"2024-02-21T22:53:41.985263+0000","last_unstale":"2024-02-21T22:53:57.889766+0000","last_undegraded":"2024-02-21T22:53:57.889766+0000","last_fullsized":"2024-02-21T22:53:57.889766+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'3","last_scrub_stamp":"2024-02-21T22:53:57.889662+0000","last_deep_scrub":"33'3","last_deep_scrub_stamp":"2024-02-21T22:53:57.889662+0000","last_clean_scrub_stamp":"2024-02-21T22:53:57.889662+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:35:03.015771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:54:04.740911+0000","last_change":"2024-02-21T22:54:04.740959+0000","last_active":"2024-02-21T22:54:04.740911+0000","last_peered":"2024-02-21T22:54:04.740911+0000","last_clean":"2024-02-21T22:54:04.740911+0000","last_became_active":"2024-02-21T22:53:43.005033+0000","last_became_peered":"2024-02-21T22:53:43.005033+0000","last_unstale":"2024-02-21T22:54:04.740911+0000","last_undegraded":"2024-02-21T22:54:04.740911+0000","last_fullsized":"2024-02-21T22:54:04.740911+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:54:04.740806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:54:04.740806+0000","last_clean_scrub_stamp":"2024-02-21T22:54:04.740806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:59:44.756550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:57.641603+0000","last_change":"2024-02-21T22:53:57.641622+0000","last_active":"2024-02-21T22:53:57.641603+0000","last_peered":"2024-02-21T22:53:57.641603+0000","last_clean":"2024-02-21T22:53:57.641603+0000","last_became_active":"2024-02-21T22:53:41.985909+0000","last_became_peered":"2024-02-21T22:53:41.985909+0000","last_unstale":"2024-02-21T22:53:57.641603+0000","last_undegraded":"2024-02-21T22:53:57.641603+0000","last_fullsized":"2024-02-21T22:53:57.641603+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:57.641530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:57.641530+0000","last_clean_scrub_stamp":"2024-02-21T22:53:57.641530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:36:59.602568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:54:02.730305+0000","last_change":"2024-02-21T22:54:02.730333+0000","last_active":"2024-02-21T22:54:02.730305+0000","last_peered":"2024-02-21T22:54:02.730305+0000","last_clean":"2024-02-21T22:54:02.730305+0000","last_became_active":"2024-02-21T22:53:42.999987+0000","last_became_peered":"2024-02-21T22:53:42.999987+0000","last_unstale":"2024-02-21T22:54:02.730305+0000","last_undegraded":"2024-02-21T22:54:02.730305+0000","last_fullsized":"2024-02-21T22:54:02.730305+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:54:02.730223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:54:02.730223+0000","last_clean_scrub_stamp":"2024-02-21T22:54:02.730223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T10:22:54.404769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:54:00.841351+0000","last_change":"2024-02-21T22:54:00.841377+0000","last_active":"2024-02-21T22:54:00.841351+0000","last_peered":"2024-02-21T22:54:00.841351+0000","last_clean":"2024-02-21T22:54:00.841351+0000","last_became_active":"2024-02-21T22:53:41.990977+0000","last_became_peered":"2024-02-21T22:53:41.990977+0000","last_unstale":"2024-02-21T22:54:00.841351+0000","last_undegraded":"2024-02-21T22:54:00.841351+0000","last_fullsized":"2024-02-21T22:54:00.841351+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:54:00.841260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:54:00.841260+0000","last_clean_scrub_stamp":"2024-02-21T22:54:00.841260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:03:35.476519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:54:01.796899+0000","last_change":"2024-02-21T22:54:01.796920+0000","last_active":"2024-02-21T22:54:01.796899+0000","last_peered":"2024-02-21T22:54:01.796899+0000","last_clean":"2024-02-21T22:54:01.796899+0000","last_became_active":"2024-02-21T22:53:42.999472+0000","last_became_peered":"2024-02-21T22:53:42.999472+0000","last_unstale":"2024-02-21T22:54:01.796899+0000","last_undegraded":"2024-02-21T22:54:01.796899+0000","last_fullsized":"2024-02-21T22:54:01.796899+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:54:01.796814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:54:01.796814+0000","last_clean_scrub_stamp":"2024-02-21T22:54:01.796814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:44:55.256898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:54:00.631827+0000","last_change":"2024-02-21T22:54:00.631852+0000","last_active":"2024-02-21T22:54:00.631827+0000","last_peered":"2024-02-21T22:54:00.631827+0000","last_clean":"2024-02-21T22:54:00.631827+0000","last_became_active":"2024-02-21T22:53:41.990791+0000","last_became_peered":"2024-02-21T22:53:41.990791+0000","last_unstale":"2024-02-21T22:54:00.631827+0000","last_undegraded":"2024-02-21T22:54:00.631827+0000","last_fullsized":"2024-02-21T22:54:00.631827+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:54:00.631739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:54:00.631739+0000","last_clean_scrub_stamp":"2024-02-21T22:54:00.631739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T02:54:51.339564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:54:07.369329+0000","last_change":"2024-02-21T22:54:07.369367+0000","last_active":"2024-02-21T22:54:07.369329+0000","last_peered":"2024-02-21T22:54:07.369329+0000","last_clean":"2024-02-21T22:54:07.369329+0000","last_became_active":"2024-02-21T22:53:42.999170+0000","last_became_peered":"2024-02-21T22:53:42.999170+0000","last_unstale":"2024-02-21T22:54:07.369329+0000","last_undegraded":"2024-02-21T22:54:07.369329+0000","last_fullsized":"2024-02-21T22:54:07.369329+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:54:07.369209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:54:07.369209+0000","last_clean_scrub_stamp":"2024-02-21T22:54:07.369209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:03:09.562135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:58.655719+0000","last_change":"2024-02-21T22:53:58.655761+0000","last_active":"2024-02-21T22:53:58.655719+0000","last_peered":"2024-02-21T22:53:58.655719+0000","last_clean":"2024-02-21T22:53:58.655719+0000","last_became_active":"2024-02-21T22:53:41.994560+0000","last_became_peered":"2024-02-21T22:53:41.994560+0000","last_unstale":"2024-02-21T22:53:58.655719+0000","last_undegraded":"2024-02-21T22:53:58.655719+0000","last_fullsized":"2024-02-21T22:53:58.655719+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:58.655604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:58.655604+0000","last_clean_scrub_stamp":"2024-02-21T22:53:58.655604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:24:53.873337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:54:11.655666+0000","last_change":"2024-02-21T22:54:11.655708+0000","last_active":"2024-02-21T22:54:11.655666+0000","last_peered":"2024-02-21T22:54:11.655666+0000","last_clean":"2024-02-21T22:54:11.655666+0000","last_became_active":"2024-02-21T22:53:43.015685+0000","last_became_peered":"2024-02-21T22:53:43.015685+0000","last_unstale":"2024-02-21T22:54:11.655666+0000","last_undegraded":"2024-02-21T22:54:11.655666+0000","last_fullsized":"2024-02-21T22:54:11.655666+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:54:11.655590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:54:11.655590+0000","last_clean_scrub_stamp":"2024-02-21T22:54:11.655590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T02:26:25.528048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:54:00.278742+0000","last_change":"2024-02-21T22:54:00.278777+0000","last_active":"2024-02-21T22:54:00.278742+0000","last_peered":"2024-02-21T22:54:00.278742+0000","last_clean":"2024-02-21T22:54:00.278742+0000","last_became_active":"2024-02-21T22:53:41.987907+0000","last_became_peered":"2024-02-21T22:53:41.987907+0000","last_unstale":"2024-02-21T22:54:00.278742+0000","last_undegraded":"2024-02-21T22:54:00.278742+0000","last_fullsized":"2024-02-21T22:54:00.278742+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:54:00.278615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:54:00.278615+0000","last_clean_scrub_stamp":"2024-02-21T22:54:00.278615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:32:24.312759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:54:02.463687+0000","last_change":"2024-02-21T22:54:02.463706+0000","last_active":"2024-02-21T22:54:02.463687+0000","last_peered":"2024-02-21T22:54:02.463687+0000","last_clean":"2024-02-21T22:54:02.463687+0000","last_became_active":"2024-02-21T22:53:43.001671+0000","last_became_peered":"2024-02-21T22:53:43.001671+0000","last_unstale":"2024-02-21T22:54:02.463687+0000","last_undegraded":"2024-02-21T22:54:02.463687+0000","last_fullsized":"2024-02-21T22:54:02.463687+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:54:02.463616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:54:02.463616+0000","last_clean_scrub_stamp":"2024-02-21T22:54:02.463616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:17:54.006378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:54:00.771250+0000","last_change":"2024-02-21T22:54:00.771268+0000","last_active":"2024-02-21T22:54:00.771250+0000","last_peered":"2024-02-21T22:54:00.771250+0000","last_clean":"2024-02-21T22:54:00.771250+0000","last_became_active":"2024-02-21T22:53:41.991530+0000","last_became_peered":"2024-02-21T22:53:41.991530+0000","last_unstale":"2024-02-21T22:54:00.771250+0000","last_undegraded":"2024-02-21T22:54:00.771250+0000","last_fullsized":"2024-02-21T22:54:00.771250+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:54:00.771180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:54:00.771180+0000","last_clean_scrub_stamp":"2024-02-21T22:54:00.771180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:24:55.988912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"33'119","reported_seq":205,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:54:00.456680+0000","last_change":"2024-02-21T22:54:00.456727+0000","last_active":"2024-02-21T22:54:00.456680+0000","last_peered":"2024-02-21T22:54:00.456680+0000","last_clean":"2024-02-21T22:54:00.456680+0000","last_became_active":"2024-02-21T22:52:40.335061+0000","last_became_peered":"2024-02-21T22:52:40.335061+0000","last_unstale":"2024-02-21T22:54:00.456680+0000","last_undegraded":"2024-02-21T22:54:00.456680+0000","last_fullsized":"2024-02-21T22:54:00.456680+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'119","last_scrub_stamp":"2024-02-21T22:54:00.456576+0000","last_deep_scrub":"33'119","last_deep_scrub_stamp":"2024-02-21T22:54:00.456576+0000","last_clean_scrub_stamp":"2024-02-21T22:54:00.456576+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:56:29.348173+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":7943,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":15886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":45,"ondisk_log_size":45,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574870,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27964,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343876,"statfs":{"total":96636764160,"available":96608129024,"internally_reserved":0,"allocated":970752,"data_stored":737074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574871,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":380928,"data_stored":147232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574872,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":380928,"data_stored":147288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574871,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":380928,"data_stored":146720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574871,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":393216,"data_stored":153783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574871,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":376832,"data_stored":146686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574872,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":393216,"data_stored":153783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574870,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27960,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343880,"statfs":{"total":96636764160,"available":96608133120,"internally_reserved":0,"allocated":966656,"data_stored":736984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":7167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":7167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-21T22:54:20.172 INFO:tasks.ceph:pgid 5.37 last_scrub_stamp 2024-02-21T22:53:41.971938+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=41, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=54, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T22:54:20.173 INFO:tasks.ceph:pgid 5.2d last_scrub_stamp 2024-02-21T22:53:41.971938+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=41, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=54, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T22:54:20.173 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-02-21T22:53:41.971938+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=41, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=54, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T22:54:20.174 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-02-21T22:53:41.971938+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=41, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=54, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T22:54:20.174 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-02-21T22:54:40.176 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-21T22:54:40.289 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.298+0000 7fbd72d5d640 1 Processor -- start 2024-02-21T22:54:40.289 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.298+0000 7fbd72d5d640 1 -- start start 2024-02-21T22:54:40.292 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.299+0000 7fbd72d5d640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fbd6c0d0510 0x7fbd6c0d08f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:54:40.292 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.299+0000 7fbd72d5d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbd6c0cb930 0x7fbd6c0cbdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:54:40.292 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.299+0000 7fbd72d5d640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd6c0cfa50 con 0x7fbd6c0d1c30 2024-02-21T22:54:40.292 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.299+0000 7fbd72d5d640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd6c0d1450 con 0x7fbd6c0d0510 2024-02-21T22:54:40.292 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.299+0000 7fbd72d5d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd6c0d0e30 con 0x7fbd6c0cb930 2024-02-21T22:54:40.293 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.299+0000 7fbd70af9640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fbd6c0d0510 0x7fbd6c0d08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:54:40.293 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.299+0000 7fbd70af9640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fbd6c0d0510 0x7fbd6c0d08f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:33472/0 (socket says 172.21.15.116:33472) 2024-02-21T22:54:40.293 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.300+0000 7fbd70af9640 1 -- 172.21.15.116:0/1208194482 learned_addr learned my addr 172.21.15.116:0/1208194482 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:54:40.293 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.300+0000 7fbd712fa640 1 --2- 172.21.15.116:0/1208194482 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbd6c0cb930 0x7fbd6c0cbdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:54:40.293 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.300+0000 7fbd70af9640 1 -- 172.21.15.116:0/1208194482 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbd6c0cb930 msgr2=0x7fbd6c0cbdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:54:40.293 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.300+0000 7fbd70af9640 1 --2- 172.21.15.116:0/1208194482 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbd6c0cb930 0x7fbd6c0cbdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:54:40.293 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.300+0000 7fbd70af9640 1 -- 172.21.15.116:0/1208194482 >> v1:172.21.15.142:6789/0 conn(0x7fbd6c0d1c30 legacy=0x7fbd6c0d2430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:54:40.293 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.300+0000 7fbd70af9640 1 -- 172.21.15.116:0/1208194482 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd6c0cfcc0 con 0x7fbd6c0d0510 2024-02-21T22:54:40.294 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.300+0000 7fbd6b7fe640 1 -- 172.21.15.116:0/1208194482 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4264722799 0 0) 0x7fbd6c0cfa50 con 0x7fbd6c0d1c30 2024-02-21T22:54:40.294 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.301+0000 7fbd70af9640 1 --2- 172.21.15.116:0/1208194482 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbd6c0d0510 0x7fbd6c0d08f0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fbd5c009870 tx=0x7fbd5c02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=326efcf4df8734da server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:54:40.294 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.301+0000 7fbd6b7fe640 1 -- 172.21.15.116:0/1208194482 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd5c035020 con 0x7fbd6c0d0510 2024-02-21T22:54:40.294 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.301+0000 7fbd6b7fe640 1 -- 172.21.15.116:0/1208194482 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd5c031640 con 0x7fbd6c0d0510 2024-02-21T22:54:40.294 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.301+0000 7fbd6b7fe640 1 -- 172.21.15.116:0/1208194482 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd5c02d040 con 0x7fbd6c0d0510 2024-02-21T22:54:40.294 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.301+0000 7fbd72d5d640 1 -- 172.21.15.116:0/1208194482 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbd6c0d0510 msgr2=0x7fbd6c0d08f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:54:40.294 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.301+0000 7fbd72d5d640 1 --2- 172.21.15.116:0/1208194482 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbd6c0d0510 0x7fbd6c0d08f0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fbd5c009870 tx=0x7fbd5c02b8f0 comp rx=0 tx=0).stop 2024-02-21T22:54:40.294 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.301+0000 7fbd72d5d640 1 -- 172.21.15.116:0/1208194482 shutdown_connections 2024-02-21T22:54:40.295 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.301+0000 7fbd72d5d640 1 --2- 172.21.15.116:0/1208194482 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbd6c0cb930 0x7fbd6c0cbdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:54:40.295 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.301+0000 7fbd72d5d640 1 --2- 172.21.15.116:0/1208194482 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbd6c0d0510 0x7fbd6c0d08f0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:54:40.295 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.301+0000 7fbd72d5d640 1 -- 172.21.15.116:0/1208194482 >> 172.21.15.116:0/1208194482 conn(0x7fbd6c0d3e50 msgr2=0x7fbd6c0d4260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:54:40.295 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.301+0000 7fbd72d5d640 1 -- 172.21.15.116:0/1208194482 shutdown_connections 2024-02-21T22:54:40.295 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.301+0000 7fbd72d5d640 1 -- 172.21.15.116:0/1208194482 wait complete. 2024-02-21T22:54:40.298 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.303+0000 7fbd72d5d640 1 Processor -- start 2024-02-21T22:54:40.298 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.303+0000 7fbd72d5d640 1 -- start start 2024-02-21T22:54:40.298 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.303+0000 7fbd72d5d640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbd6c0cb930 0x7fbd6c146210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:54:40.298 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.303+0000 7fbd72d5d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbd6c0d0510 0x7fbd6c148290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:54:40.299 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.303+0000 7fbd72d5d640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbd6c0d1c30 0x7fbd6c1468a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:54:40.299 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.303+0000 7fbd72d5d640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd6c15e640 con 0x7fbd6c0cb930 2024-02-21T22:54:40.299 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.303+0000 7fbd72d5d640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd6c0d10e0 con 0x7fbd6c0d1c30 2024-02-21T22:54:40.299 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.303+0000 7fbd72d5d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd6c0cc300 con 0x7fbd6c0d0510 2024-02-21T22:54:40.299 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.304+0000 7fbd70af9640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbd6c0cb930 0x7fbd6c146210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:54:40.299 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.304+0000 7fbd70af9640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbd6c0cb930 0x7fbd6c146210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:33474/0 (socket says 172.21.15.116:33474) 2024-02-21T22:54:40.299 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.304+0000 7fbd70af9640 1 -- 172.21.15.116:0/145695311 learned_addr learned my addr 172.21.15.116:0/145695311 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:54:40.299 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.304+0000 7fbd6bfff640 1 --2- 172.21.15.116:0/145695311 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbd6c0d0510 0x7fbd6c148290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:54:40.300 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.304+0000 7fbd712fa640 1 --2- 172.21.15.116:0/145695311 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbd6c0d1c30 0x7fbd6c1468a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:54:40.300 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.304+0000 7fbd70af9640 1 -- 172.21.15.116:0/145695311 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbd6c0d0510 msgr2=0x7fbd6c148290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:54:40.300 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.304+0000 7fbd70af9640 1 --2- 172.21.15.116:0/145695311 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbd6c0d0510 0x7fbd6c148290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:54:40.300 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.304+0000 7fbd70af9640 1 -- 172.21.15.116:0/145695311 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbd6c0d1c30 msgr2=0x7fbd6c1468a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:54:40.300 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.304+0000 7fbd70af9640 1 --2- 172.21.15.116:0/145695311 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbd6c0d1c30 0x7fbd6c1468a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:54:40.300 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.304+0000 7fbd70af9640 1 -- 172.21.15.116:0/145695311 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd6c1471f0 con 0x7fbd6c0cb930 2024-02-21T22:54:40.300 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.304+0000 7fbd70af9640 1 --2- 172.21.15.116:0/145695311 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbd6c0cb930 0x7fbd6c146210 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fbd5c02b930 tx=0x7fbd5c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:54:40.300 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.304+0000 7fbd697fa640 1 -- 172.21.15.116:0/145695311 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd5c040070 con 0x7fbd6c0cb930 2024-02-21T22:54:40.301 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.304+0000 7fbd697fa640 1 -- 172.21.15.116:0/145695311 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd5c03e070 con 0x7fbd6c0cb930 2024-02-21T22:54:40.301 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.304+0000 7fbd72d5d640 1 -- 172.21.15.116:0/145695311 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd6c1474d0 con 0x7fbd6c0cb930 2024-02-21T22:54:40.301 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.304+0000 7fbd697fa640 1 -- 172.21.15.116:0/145695311 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd5c035040 con 0x7fbd6c0cb930 2024-02-21T22:54:40.301 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.304+0000 7fbd72d5d640 1 -- 172.21.15.116:0/145695311 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd6c147a90 con 0x7fbd6c0cb930 2024-02-21T22:54:40.301 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.305+0000 7fbd72d5d640 1 -- 172.21.15.116:0/145695311 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd6c0752f0 con 0x7fbd6c0cb930 2024-02-21T22:54:40.301 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.306+0000 7fbd697fa640 1 -- 172.21.15.116:0/145695311 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fbd5c038020 con 0x7fbd6c0cb930 2024-02-21T22:54:40.301 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.306+0000 7fbd697fa640 1 --2- 172.21.15.116:0/145695311 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fbd5806b4d0 0x7fbd5806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:54:40.301 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.306+0000 7fbd697fa640 1 -- 172.21.15.116:0/145695311 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbd5c0aba70 con 0x7fbd6c0cb930 2024-02-21T22:54:40.302 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.306+0000 7fbd6bfff640 1 --2- 172.21.15.116:0/145695311 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fbd5806b4d0 0x7fbd5806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:54:40.302 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.307+0000 7fbd6bfff640 1 --2- 172.21.15.116:0/145695311 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fbd5806b4d0 0x7fbd5806d990 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fbd6c0cdd00 tx=0x7fbd60009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:54:40.302 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.311+0000 7fbd697fa640 1 -- 172.21.15.116:0/145695311 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7fbd5c07a2a0 con 0x7fbd6c0cb930 2024-02-21T22:54:40.472 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.481+0000 7fbd72d5d640 1 -- 172.21.15.116:0/145695311 --> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbd6c0d2210 con 0x7fbd5806b4d0 2024-02-21T22:54:40.478 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.488+0000 7fbd697fa640 1 -- 172.21.15.116:0/145695311 <== mgr.4103 v2:172.21.15.142:6832/1381484782 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251889 (secure 0 0 0) 0x7fbd6c0d2210 con 0x7fbd5806b4d0 2024-02-21T22:54:40.481 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-02-21T22:54:40.482 INFO:teuthology.orchestra.run.smithi116.stderr:dumped all 2024-02-21T22:54:40.484 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.490+0000 7fbd72d5d640 1 -- 172.21.15.116:0/145695311 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fbd5806b4d0 msgr2=0x7fbd5806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:54:40.484 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.490+0000 7fbd72d5d640 1 --2- 172.21.15.116:0/145695311 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fbd5806b4d0 0x7fbd5806d990 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fbd6c0cdd00 tx=0x7fbd60009040 comp rx=0 tx=0).stop 2024-02-21T22:54:40.484 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.490+0000 7fbd72d5d640 1 -- 172.21.15.116:0/145695311 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbd6c0cb930 msgr2=0x7fbd6c146210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:54:40.484 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.490+0000 7fbd72d5d640 1 --2- 172.21.15.116:0/145695311 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbd6c0cb930 0x7fbd6c146210 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fbd5c02b930 tx=0x7fbd5c0046c0 comp rx=0 tx=0).stop 2024-02-21T22:54:40.485 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.490+0000 7fbd72d5d640 1 -- 172.21.15.116:0/145695311 shutdown_connections 2024-02-21T22:54:40.485 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.491+0000 7fbd72d5d640 1 --2- 172.21.15.116:0/145695311 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbd6c0d1c30 0x7fbd6c1468a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:54:40.485 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.491+0000 7fbd72d5d640 1 --2- 172.21.15.116:0/145695311 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7fbd5806b4d0 0x7fbd5806d990 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:54:40.485 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.491+0000 7fbd72d5d640 1 --2- 172.21.15.116:0/145695311 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbd6c0d0510 0x7fbd6c148290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:54:40.485 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.491+0000 7fbd72d5d640 1 --2- 172.21.15.116:0/145695311 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbd6c0cb930 0x7fbd6c146210 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:54:40.485 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.491+0000 7fbd72d5d640 1 -- 172.21.15.116:0/145695311 >> 172.21.15.116:0/145695311 conn(0x7fbd6c0d3e50 msgr2=0x7fbd6c0cc6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:54:40.485 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.491+0000 7fbd72d5d640 1 -- 172.21.15.116:0/145695311 shutdown_connections 2024-02-21T22:54:40.485 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.491+0000 7fbd72d5d640 1 -- 172.21.15.116:0/145695311 wait complete. 2024-02-21T22:54:40.492 INFO:teuthology.orchestra.run.smithi116.stdout:{"pg_ready":true,"pg_map":{"version":87,"stamp":"2024-02-21T22:54:40.306464+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":598311,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":212,"num_write_kb":2439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":164,"ondisk_log_size":164,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220272,"kb_used_data":4144,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754448,"statfs":{"total":773094113280,"available":772868554752,"internally_reserved":0,"allocated":4243456,"data_stored":2369550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002042"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:54:04.721538+0000","last_change":"2024-02-21T22:54:04.721562+0000","last_active":"2024-02-21T22:54:04.721538+0000","last_peered":"2024-02-21T22:54:04.721538+0000","last_clean":"2024-02-21T22:54:04.721538+0000","last_became_active":"2024-02-21T22:53:43.002238+0000","last_became_peered":"2024-02-21T22:53:43.002238+0000","last_unstale":"2024-02-21T22:54:04.721538+0000","last_undegraded":"2024-02-21T22:54:04.721538+0000","last_fullsized":"2024-02-21T22:54:04.721538+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:54:04.721469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:54:04.721469+0000","last_clean_scrub_stamp":"2024-02-21T22:54:04.721469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:02:36.638329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:54:09.319128+0000","last_change":"2024-02-21T22:54:09.319157+0000","last_active":"2024-02-21T22:54:09.319128+0000","last_peered":"2024-02-21T22:54:09.319128+0000","last_clean":"2024-02-21T22:54:09.319128+0000","last_became_active":"2024-02-21T22:53:43.000396+0000","last_became_peered":"2024-02-21T22:53:43.000396+0000","last_unstale":"2024-02-21T22:54:09.319128+0000","last_undegraded":"2024-02-21T22:54:09.319128+0000","last_fullsized":"2024-02-21T22:54:09.319128+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:54:09.319013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:54:09.319013+0000","last_clean_scrub_stamp":"2024-02-21T22:54:09.319013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:51:44.212776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:54:04.854030+0000","last_change":"2024-02-21T22:54:04.854073+0000","last_active":"2024-02-21T22:54:04.854030+0000","last_peered":"2024-02-21T22:54:04.854030+0000","last_clean":"2024-02-21T22:54:04.854030+0000","last_became_active":"2024-02-21T22:53:43.004321+0000","last_became_peered":"2024-02-21T22:53:43.004321+0000","last_unstale":"2024-02-21T22:54:04.854030+0000","last_undegraded":"2024-02-21T22:54:04.854030+0000","last_fullsized":"2024-02-21T22:54:04.854030+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:54:04.853910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:54:04.853910+0000","last_clean_scrub_stamp":"2024-02-21T22:54:04.853910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T10:01:11.936920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:54:06.656268+0000","last_change":"2024-02-21T22:54:06.656314+0000","last_active":"2024-02-21T22:54:06.656268+0000","last_peered":"2024-02-21T22:54:06.656268+0000","last_clean":"2024-02-21T22:54:06.656268+0000","last_became_active":"2024-02-21T22:53:43.010683+0000","last_became_peered":"2024-02-21T22:53:43.010683+0000","last_unstale":"2024-02-21T22:54:06.656268+0000","last_undegraded":"2024-02-21T22:54:06.656268+0000","last_fullsized":"2024-02-21T22:54:06.656268+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:54:06.656165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:54:06.656165+0000","last_clean_scrub_stamp":"2024-02-21T22:54:06.656165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:39:26.002519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:54:03.429092+0000","last_change":"2024-02-21T22:54:03.429115+0000","last_active":"2024-02-21T22:54:03.429092+0000","last_peered":"2024-02-21T22:54:03.429092+0000","last_clean":"2024-02-21T22:54:03.429092+0000","last_became_active":"2024-02-21T22:53:43.006405+0000","last_became_peered":"2024-02-21T22:53:43.006405+0000","last_unstale":"2024-02-21T22:54:03.429092+0000","last_undegraded":"2024-02-21T22:54:03.429092+0000","last_fullsized":"2024-02-21T22:54:03.429092+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:54:03.428990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:54:03.428990+0000","last_clean_scrub_stamp":"2024-02-21T22:54:03.428990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T02:25:43.842446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:58.217359+0000","last_change":"2024-02-21T22:53:58.217378+0000","last_active":"2024-02-21T22:53:58.217359+0000","last_peered":"2024-02-21T22:53:58.217359+0000","last_clean":"2024-02-21T22:53:58.217359+0000","last_became_active":"2024-02-21T22:53:42.997719+0000","last_became_peered":"2024-02-21T22:53:42.997719+0000","last_unstale":"2024-02-21T22:53:58.217359+0000","last_undegraded":"2024-02-21T22:53:58.217359+0000","last_fullsized":"2024-02-21T22:53:58.217359+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:58.217286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:58.217286+0000","last_clean_scrub_stamp":"2024-02-21T22:53:58.217286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:11:17.083657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:54:04.454474+0000","last_change":"2024-02-21T22:54:04.454492+0000","last_active":"2024-02-21T22:54:04.454474+0000","last_peered":"2024-02-21T22:54:04.454474+0000","last_clean":"2024-02-21T22:54:04.454474+0000","last_became_active":"2024-02-21T22:53:43.007675+0000","last_became_peered":"2024-02-21T22:53:43.007675+0000","last_unstale":"2024-02-21T22:54:04.454474+0000","last_undegraded":"2024-02-21T22:54:04.454474+0000","last_fullsized":"2024-02-21T22:54:04.454474+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:54:04.454409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:54:04.454409+0000","last_clean_scrub_stamp":"2024-02-21T22:54:04.454409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:32:28.488553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:54:01.480472+0000","last_change":"2024-02-21T22:54:01.480491+0000","last_active":"2024-02-21T22:54:01.480472+0000","last_peered":"2024-02-21T22:54:01.480472+0000","last_clean":"2024-02-21T22:54:01.480472+0000","last_became_active":"2024-02-21T22:53:43.000729+0000","last_became_peered":"2024-02-21T22:53:43.000729+0000","last_unstale":"2024-02-21T22:54:01.480472+0000","last_undegraded":"2024-02-21T22:54:01.480472+0000","last_fullsized":"2024-02-21T22:54:01.480472+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:54:01.480391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:54:01.480391+0000","last_clean_scrub_stamp":"2024-02-21T22:54:01.480391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T02:54:52.188216+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:54:13.644978+0000","last_change":"2024-02-21T22:54:13.644999+0000","last_active":"2024-02-21T22:54:13.644978+0000","last_peered":"2024-02-21T22:54:13.644978+0000","last_clean":"2024-02-21T22:54:13.644978+0000","last_became_active":"2024-02-21T22:53:43.015907+0000","last_became_peered":"2024-02-21T22:53:43.015907+0000","last_unstale":"2024-02-21T22:54:13.644978+0000","last_undegraded":"2024-02-21T22:54:13.644978+0000","last_fullsized":"2024-02-21T22:54:13.644978+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:54:13.644910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:54:13.644910+0000","last_clean_scrub_stamp":"2024-02-21T22:54:13.644910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:03:15.837836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:54:03.669579+0000","last_change":"2024-02-21T22:54:03.669632+0000","last_active":"2024-02-21T22:54:03.669579+0000","last_peered":"2024-02-21T22:54:03.669579+0000","last_clean":"2024-02-21T22:54:03.669579+0000","last_became_active":"2024-02-21T22:53:43.005035+0000","last_became_peered":"2024-02-21T22:53:43.005035+0000","last_unstale":"2024-02-21T22:54:03.669579+0000","last_undegraded":"2024-02-21T22:54:03.669579+0000","last_fullsized":"2024-02-21T22:54:03.669579+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:54:03.669474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:54:03.669474+0000","last_clean_scrub_stamp":"2024-02-21T22:54:03.669474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:32:27.703618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:54:08.343237+0000","last_change":"2024-02-21T22:54:08.343277+0000","last_active":"2024-02-21T22:54:08.343237+0000","last_peered":"2024-02-21T22:54:08.343237+0000","last_clean":"2024-02-21T22:54:08.343237+0000","last_became_active":"2024-02-21T22:53:43.010956+0000","last_became_peered":"2024-02-21T22:53:43.010956+0000","last_unstale":"2024-02-21T22:54:08.343237+0000","last_undegraded":"2024-02-21T22:54:08.343237+0000","last_fullsized":"2024-02-21T22:54:08.343237+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:54:08.343126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:54:08.343126+0000","last_clean_scrub_stamp":"2024-02-21T22:54:08.343126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T02:41:37.760990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:54:08.724987+0000","last_change":"2024-02-21T22:54:08.725024+0000","last_active":"2024-02-21T22:54:08.724987+0000","last_peered":"2024-02-21T22:54:08.724987+0000","last_clean":"2024-02-21T22:54:08.724987+0000","last_became_active":"2024-02-21T22:53:43.007022+0000","last_became_peered":"2024-02-21T22:53:43.007022+0000","last_unstale":"2024-02-21T22:54:08.724987+0000","last_undegraded":"2024-02-21T22:54:08.724987+0000","last_fullsized":"2024-02-21T22:54:08.724987+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:54:08.724872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:54:08.724872+0000","last_clean_scrub_stamp":"2024-02-21T22:54:08.724872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:20:08.956779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:58.443762+0000","last_change":"2024-02-21T22:53:58.443783+0000","last_active":"2024-02-21T22:53:58.443762+0000","last_peered":"2024-02-21T22:53:58.443762+0000","last_clean":"2024-02-21T22:53:58.443762+0000","last_became_active":"2024-02-21T22:53:42.999406+0000","last_became_peered":"2024-02-21T22:53:42.999406+0000","last_unstale":"2024-02-21T22:53:58.443762+0000","last_undegraded":"2024-02-21T22:53:58.443762+0000","last_fullsized":"2024-02-21T22:53:58.443762+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:58.443676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:58.443676+0000","last_clean_scrub_stamp":"2024-02-21T22:53:58.443676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:26:42.462076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:54:12.330200+0000","last_change":"2024-02-21T22:54:12.330226+0000","last_active":"2024-02-21T22:54:12.330200+0000","last_peered":"2024-02-21T22:54:12.330200+0000","last_clean":"2024-02-21T22:54:12.330200+0000","last_became_active":"2024-02-21T22:53:43.004383+0000","last_became_peered":"2024-02-21T22:53:43.004383+0000","last_unstale":"2024-02-21T22:54:12.330200+0000","last_undegraded":"2024-02-21T22:54:12.330200+0000","last_fullsized":"2024-02-21T22:54:12.330200+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:54:12.330090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:54:12.330090+0000","last_clean_scrub_stamp":"2024-02-21T22:54:12.330090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T02:41:11.904061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:54:00.778621+0000","last_change":"2024-02-21T22:54:00.778640+0000","last_active":"2024-02-21T22:54:00.778621+0000","last_peered":"2024-02-21T22:54:00.778621+0000","last_clean":"2024-02-21T22:54:00.778621+0000","last_became_active":"2024-02-21T22:53:42.995407+0000","last_became_peered":"2024-02-21T22:53:42.995407+0000","last_unstale":"2024-02-21T22:54:00.778621+0000","last_undegraded":"2024-02-21T22:54:00.778621+0000","last_fullsized":"2024-02-21T22:54:00.778621+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:54:00.778546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:54:00.778546+0000","last_clean_scrub_stamp":"2024-02-21T22:54:00.778546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:17:52.321309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:54:07.383131+0000","last_change":"2024-02-21T22:54:07.383150+0000","last_active":"2024-02-21T22:54:07.383131+0000","last_peered":"2024-02-21T22:54:07.383131+0000","last_clean":"2024-02-21T22:54:07.383131+0000","last_became_active":"2024-02-21T22:53:43.009073+0000","last_became_peered":"2024-02-21T22:53:43.009073+0000","last_unstale":"2024-02-21T22:54:07.383131+0000","last_undegraded":"2024-02-21T22:54:07.383131+0000","last_fullsized":"2024-02-21T22:54:07.383131+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:54:07.383059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:54:07.383059+0000","last_clean_scrub_stamp":"2024-02-21T22:54:07.383059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:03:44.360533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:54:06.401320+0000","last_change":"2024-02-21T22:54:06.401354+0000","last_active":"2024-02-21T22:54:06.401320+0000","last_peered":"2024-02-21T22:54:06.401320+0000","last_clean":"2024-02-21T22:54:06.401320+0000","last_became_active":"2024-02-21T22:53:43.008404+0000","last_became_peered":"2024-02-21T22:53:43.008404+0000","last_unstale":"2024-02-21T22:54:06.401320+0000","last_undegraded":"2024-02-21T22:54:06.401320+0000","last_fullsized":"2024-02-21T22:54:06.401320+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:54:06.401215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:54:06.401215+0000","last_clean_scrub_stamp":"2024-02-21T22:54:06.401215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T10:01:13.484225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:54:08.325586+0000","last_change":"2024-02-21T22:54:08.325612+0000","last_active":"2024-02-21T22:54:08.325586+0000","last_peered":"2024-02-21T22:54:08.325586+0000","last_clean":"2024-02-21T22:54:08.325586+0000","last_became_active":"2024-02-21T22:53:42.999362+0000","last_became_peered":"2024-02-21T22:53:42.999362+0000","last_unstale":"2024-02-21T22:54:08.325586+0000","last_undegraded":"2024-02-21T22:54:08.325586+0000","last_fullsized":"2024-02-21T22:54:08.325586+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:54:08.325498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:54:08.325498+0000","last_clean_scrub_stamp":"2024-02-21T22:54:08.325498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T02:37:13.557086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:54:14.355544+0000","last_change":"2024-02-21T22:54:14.355569+0000","last_active":"2024-02-21T22:54:14.355544+0000","last_peered":"2024-02-21T22:54:14.355544+0000","last_clean":"2024-02-21T22:54:14.355544+0000","last_became_active":"2024-02-21T22:53:43.010702+0000","last_became_peered":"2024-02-21T22:53:43.010702+0000","last_unstale":"2024-02-21T22:54:14.355544+0000","last_undegraded":"2024-02-21T22:54:14.355544+0000","last_fullsized":"2024-02-21T22:54:14.355544+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:54:14.355439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:54:14.355439+0000","last_clean_scrub_stamp":"2024-02-21T22:54:14.355439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:36:30.211489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:54:02.411724+0000","last_change":"2024-02-21T22:54:02.411754+0000","last_active":"2024-02-21T22:54:02.411724+0000","last_peered":"2024-02-21T22:54:02.411724+0000","last_clean":"2024-02-21T22:54:02.411724+0000","last_became_active":"2024-02-21T22:53:43.005993+0000","last_became_peered":"2024-02-21T22:53:43.005993+0000","last_unstale":"2024-02-21T22:54:02.411724+0000","last_undegraded":"2024-02-21T22:54:02.411724+0000","last_fullsized":"2024-02-21T22:54:02.411724+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:54:02.411581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:54:02.411581+0000","last_clean_scrub_stamp":"2024-02-21T22:54:02.411581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:42:17.021545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:54:10.646950+0000","last_change":"2024-02-21T22:54:10.646969+0000","last_active":"2024-02-21T22:54:10.646950+0000","last_peered":"2024-02-21T22:54:10.646950+0000","last_clean":"2024-02-21T22:54:10.646950+0000","last_became_active":"2024-02-21T22:53:43.014712+0000","last_became_peered":"2024-02-21T22:53:43.014712+0000","last_unstale":"2024-02-21T22:54:10.646950+0000","last_undegraded":"2024-02-21T22:54:10.646950+0000","last_fullsized":"2024-02-21T22:54:10.646950+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:54:10.646887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:54:10.646887+0000","last_clean_scrub_stamp":"2024-02-21T22:54:10.646887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:13:20.478207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:54:09.644517+0000","last_change":"2024-02-21T22:54:09.644537+0000","last_active":"2024-02-21T22:54:09.644517+0000","last_peered":"2024-02-21T22:54:09.644517+0000","last_clean":"2024-02-21T22:54:09.644517+0000","last_became_active":"2024-02-21T22:53:43.014570+0000","last_became_peered":"2024-02-21T22:53:43.014570+0000","last_unstale":"2024-02-21T22:54:09.644517+0000","last_undegraded":"2024-02-21T22:54:09.644517+0000","last_fullsized":"2024-02-21T22:54:09.644517+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:54:09.644448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:54:09.644448+0000","last_clean_scrub_stamp":"2024-02-21T22:54:09.644448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T02:41:39.062312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:54:03.786296+0000","last_change":"2024-02-21T22:54:03.786324+0000","last_active":"2024-02-21T22:54:03.786296+0000","last_peered":"2024-02-21T22:54:03.786296+0000","last_clean":"2024-02-21T22:54:03.786296+0000","last_became_active":"2024-02-21T22:53:43.002254+0000","last_became_peered":"2024-02-21T22:53:43.002254+0000","last_unstale":"2024-02-21T22:54:03.786296+0000","last_undegraded":"2024-02-21T22:54:03.786296+0000","last_fullsized":"2024-02-21T22:54:03.786296+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:54:03.786201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:54:03.786201+0000","last_clean_scrub_stamp":"2024-02-21T22:54:03.786201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:17:55.328963+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:54:01.790712+0000","last_change":"2024-02-21T22:54:01.790757+0000","last_active":"2024-02-21T22:54:01.790712+0000","last_peered":"2024-02-21T22:54:01.790712+0000","last_clean":"2024-02-21T22:54:01.790712+0000","last_became_active":"2024-02-21T22:53:42.996208+0000","last_became_peered":"2024-02-21T22:53:42.996208+0000","last_unstale":"2024-02-21T22:54:01.790712+0000","last_undegraded":"2024-02-21T22:54:01.790712+0000","last_fullsized":"2024-02-21T22:54:01.790712+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:54:01.790614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:54:01.790614+0000","last_clean_scrub_stamp":"2024-02-21T22:54:01.790614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:30:15.068041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:54:02.621037+0000","last_change":"2024-02-21T22:54:02.621085+0000","last_active":"2024-02-21T22:54:02.621037+0000","last_peered":"2024-02-21T22:54:02.621037+0000","last_clean":"2024-02-21T22:54:02.621037+0000","last_became_active":"2024-02-21T22:53:43.003710+0000","last_became_peered":"2024-02-21T22:53:43.003710+0000","last_unstale":"2024-02-21T22:54:02.621037+0000","last_undegraded":"2024-02-21T22:54:02.621037+0000","last_fullsized":"2024-02-21T22:54:02.621037+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:54:02.620941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:54:02.620941+0000","last_clean_scrub_stamp":"2024-02-21T22:54:02.620941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:30:15.898368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:54:10.342937+0000","last_change":"2024-02-21T22:54:10.342962+0000","last_active":"2024-02-21T22:54:10.342937+0000","last_peered":"2024-02-21T22:54:10.342937+0000","last_clean":"2024-02-21T22:54:10.342937+0000","last_became_active":"2024-02-21T22:53:43.000575+0000","last_became_peered":"2024-02-21T22:53:43.000575+0000","last_unstale":"2024-02-21T22:54:10.342937+0000","last_undegraded":"2024-02-21T22:54:10.342937+0000","last_fullsized":"2024-02-21T22:54:10.342937+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:54:10.342842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:54:10.342842+0000","last_clean_scrub_stamp":"2024-02-21T22:54:10.342842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:06:25.698091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:54:08.623640+0000","last_change":"2024-02-21T22:54:08.623666+0000","last_active":"2024-02-21T22:54:08.623640+0000","last_peered":"2024-02-21T22:54:08.623640+0000","last_clean":"2024-02-21T22:54:08.623640+0000","last_became_active":"2024-02-21T22:53:43.010808+0000","last_became_peered":"2024-02-21T22:53:43.010808+0000","last_unstale":"2024-02-21T22:54:08.623640+0000","last_undegraded":"2024-02-21T22:54:08.623640+0000","last_fullsized":"2024-02-21T22:54:08.623640+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:54:08.623556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:54:08.623556+0000","last_clean_scrub_stamp":"2024-02-21T22:54:08.623556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:33:05.337105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:54:02.796090+0000","last_change":"2024-02-21T22:54:02.796129+0000","last_active":"2024-02-21T22:54:02.796090+0000","last_peered":"2024-02-21T22:54:02.796090+0000","last_clean":"2024-02-21T22:54:02.796090+0000","last_became_active":"2024-02-21T22:53:42.999295+0000","last_became_peered":"2024-02-21T22:53:42.999295+0000","last_unstale":"2024-02-21T22:54:02.796090+0000","last_undegraded":"2024-02-21T22:54:02.796090+0000","last_fullsized":"2024-02-21T22:54:02.796090+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:54:02.795985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:54:02.795985+0000","last_clean_scrub_stamp":"2024-02-21T22:54:02.795985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:32:26.830129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:54:12.630767+0000","last_change":"2024-02-21T22:54:12.630787+0000","last_active":"2024-02-21T22:54:12.630767+0000","last_peered":"2024-02-21T22:54:12.630767+0000","last_clean":"2024-02-21T22:54:12.630767+0000","last_became_active":"2024-02-21T22:53:43.015533+0000","last_became_peered":"2024-02-21T22:53:43.015533+0000","last_unstale":"2024-02-21T22:54:12.630767+0000","last_undegraded":"2024-02-21T22:54:12.630767+0000","last_fullsized":"2024-02-21T22:54:12.630767+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:54:12.630689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:54:12.630689+0000","last_clean_scrub_stamp":"2024-02-21T22:54:12.630689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T10:34:16.711989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:54:03.415712+0000","last_change":"2024-02-21T22:54:03.415731+0000","last_active":"2024-02-21T22:54:03.415712+0000","last_peered":"2024-02-21T22:54:03.415712+0000","last_clean":"2024-02-21T22:54:03.415712+0000","last_became_active":"2024-02-21T22:53:43.006982+0000","last_became_peered":"2024-02-21T22:53:43.006982+0000","last_unstale":"2024-02-21T22:54:03.415712+0000","last_undegraded":"2024-02-21T22:54:03.415712+0000","last_fullsized":"2024-02-21T22:54:03.415712+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:54:03.415631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:54:03.415631+0000","last_clean_scrub_stamp":"2024-02-21T22:54:03.415631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:59:43.431375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:54:03.681620+0000","last_change":"2024-02-21T22:54:03.681639+0000","last_active":"2024-02-21T22:54:03.681620+0000","last_peered":"2024-02-21T22:54:03.681620+0000","last_clean":"2024-02-21T22:54:03.681620+0000","last_became_active":"2024-02-21T22:53:43.000179+0000","last_became_peered":"2024-02-21T22:53:43.000179+0000","last_unstale":"2024-02-21T22:54:03.681620+0000","last_undegraded":"2024-02-21T22:54:03.681620+0000","last_fullsized":"2024-02-21T22:54:03.681620+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:54:03.681549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:54:03.681549+0000","last_clean_scrub_stamp":"2024-02-21T22:54:03.681549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:28:06.720212+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:54:10.345867+0000","last_change":"2024-02-21T22:54:10.345899+0000","last_active":"2024-02-21T22:54:10.345867+0000","last_peered":"2024-02-21T22:54:10.345867+0000","last_clean":"2024-02-21T22:54:10.345867+0000","last_became_active":"2024-02-21T22:53:43.012985+0000","last_became_peered":"2024-02-21T22:53:43.012985+0000","last_unstale":"2024-02-21T22:54:10.345867+0000","last_undegraded":"2024-02-21T22:54:10.345867+0000","last_fullsized":"2024-02-21T22:54:10.345867+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:54:10.345786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:54:10.345786+0000","last_clean_scrub_stamp":"2024-02-21T22:54:10.345786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T02:26:24.218244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:54:02.801341+0000","last_change":"2024-02-21T22:54:02.801397+0000","last_active":"2024-02-21T22:54:02.801341+0000","last_peered":"2024-02-21T22:54:02.801341+0000","last_clean":"2024-02-21T22:54:02.801341+0000","last_became_active":"2024-02-21T22:53:43.001564+0000","last_became_peered":"2024-02-21T22:53:43.001564+0000","last_unstale":"2024-02-21T22:54:02.801341+0000","last_undegraded":"2024-02-21T22:54:02.801341+0000","last_fullsized":"2024-02-21T22:54:02.801341+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:54:02.801203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:54:02.801203+0000","last_clean_scrub_stamp":"2024-02-21T22:54:02.801203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T02:54:53.509028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"32'4","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:54:01.740171+0000","last_change":"2024-02-21T22:54:01.740196+0000","last_active":"2024-02-21T22:54:01.740171+0000","last_peered":"2024-02-21T22:54:01.740171+0000","last_clean":"2024-02-21T22:54:01.740171+0000","last_became_active":"2024-02-21T22:53:41.994468+0000","last_became_peered":"2024-02-21T22:53:41.994468+0000","last_unstale":"2024-02-21T22:54:01.740171+0000","last_undegraded":"2024-02-21T22:54:01.740171+0000","last_fullsized":"2024-02-21T22:54:01.740171+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-02-21T22:54:01.740098+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-02-21T22:54:01.740098+0000","last_clean_scrub_stamp":"2024-02-21T22:54:01.740098+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:18:54.666061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:54:05.770688+0000","last_change":"2024-02-21T22:54:05.770733+0000","last_active":"2024-02-21T22:54:05.770688+0000","last_peered":"2024-02-21T22:54:05.770688+0000","last_clean":"2024-02-21T22:54:05.770688+0000","last_became_active":"2024-02-21T22:53:43.008021+0000","last_became_peered":"2024-02-21T22:53:43.008021+0000","last_unstale":"2024-02-21T22:54:05.770688+0000","last_undegraded":"2024-02-21T22:54:05.770688+0000","last_fullsized":"2024-02-21T22:54:05.770688+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:54:05.770578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:54:05.770578+0000","last_clean_scrub_stamp":"2024-02-21T22:54:05.770578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:59:26.400937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"32'1","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:58.906087+0000","last_change":"2024-02-21T22:53:58.906127+0000","last_active":"2024-02-21T22:53:58.906087+0000","last_peered":"2024-02-21T22:53:58.906087+0000","last_clean":"2024-02-21T22:53:58.906087+0000","last_became_active":"2024-02-21T22:53:41.986784+0000","last_became_peered":"2024-02-21T22:53:41.986784+0000","last_unstale":"2024-02-21T22:53:58.906087+0000","last_undegraded":"2024-02-21T22:53:58.906087+0000","last_fullsized":"2024-02-21T22:53:58.906087+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'1","last_scrub_stamp":"2024-02-21T22:53:58.905969+0000","last_deep_scrub":"32'1","last_deep_scrub_stamp":"2024-02-21T22:53:58.905969+0000","last_clean_scrub_stamp":"2024-02-21T22:53:58.905969+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:00:49.306536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:54:14.620889+0000","last_change":"2024-02-21T22:54:14.620929+0000","last_active":"2024-02-21T22:54:14.620889+0000","last_peered":"2024-02-21T22:54:14.620889+0000","last_clean":"2024-02-21T22:54:14.620889+0000","last_became_active":"2024-02-21T22:53:43.016339+0000","last_became_peered":"2024-02-21T22:53:43.016339+0000","last_unstale":"2024-02-21T22:54:14.620889+0000","last_undegraded":"2024-02-21T22:54:14.620889+0000","last_fullsized":"2024-02-21T22:54:14.620889+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:54:14.620776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:54:14.620776+0000","last_clean_scrub_stamp":"2024-02-21T22:54:14.620776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T02:37:19.852365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"32'2","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:54:05.349092+0000","last_change":"2024-02-21T22:54:05.349121+0000","last_active":"2024-02-21T22:54:05.349092+0000","last_peered":"2024-02-21T22:54:05.349092+0000","last_clean":"2024-02-21T22:54:05.349092+0000","last_became_active":"2024-02-21T22:53:41.990213+0000","last_became_peered":"2024-02-21T22:53:41.990213+0000","last_unstale":"2024-02-21T22:54:05.349092+0000","last_undegraded":"2024-02-21T22:54:05.349092+0000","last_fullsized":"2024-02-21T22:54:05.349092+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-02-21T22:54:05.348984+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-02-21T22:54:05.348984+0000","last_clean_scrub_stamp":"2024-02-21T22:54:05.348984+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:33:02.062532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:54:09.663559+0000","last_change":"2024-02-21T22:54:09.663580+0000","last_active":"2024-02-21T22:54:09.663559+0000","last_peered":"2024-02-21T22:54:09.663559+0000","last_clean":"2024-02-21T22:54:09.663559+0000","last_became_active":"2024-02-21T22:53:43.011165+0000","last_became_peered":"2024-02-21T22:53:43.011165+0000","last_unstale":"2024-02-21T22:54:09.663559+0000","last_undegraded":"2024-02-21T22:54:09.663559+0000","last_fullsized":"2024-02-21T22:54:09.663559+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:54:09.663482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:54:09.663482+0000","last_clean_scrub_stamp":"2024-02-21T22:54:09.663482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:20:09.895389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"32'2","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:57.481025+0000","last_change":"2024-02-21T22:53:57.481055+0000","last_active":"2024-02-21T22:53:57.481025+0000","last_peered":"2024-02-21T22:53:57.481025+0000","last_clean":"2024-02-21T22:53:57.481025+0000","last_became_active":"2024-02-21T22:53:41.989105+0000","last_became_peered":"2024-02-21T22:53:41.989105+0000","last_unstale":"2024-02-21T22:53:57.481025+0000","last_undegraded":"2024-02-21T22:53:57.481025+0000","last_fullsized":"2024-02-21T22:53:57.481025+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-02-21T22:53:57.480943+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-02-21T22:53:57.480943+0000","last_clean_scrub_stamp":"2024-02-21T22:53:57.480943+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:06:19.215628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:54:09.375383+0000","last_change":"2024-02-21T22:54:09.375423+0000","last_active":"2024-02-21T22:54:09.375383+0000","last_peered":"2024-02-21T22:54:09.375383+0000","last_clean":"2024-02-21T22:54:09.375383+0000","last_became_active":"2024-02-21T22:53:43.012407+0000","last_became_peered":"2024-02-21T22:53:43.012407+0000","last_unstale":"2024-02-21T22:54:09.375383+0000","last_undegraded":"2024-02-21T22:54:09.375383+0000","last_fullsized":"2024-02-21T22:54:09.375383+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:54:09.375292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:54:09.375292+0000","last_clean_scrub_stamp":"2024-02-21T22:54:09.375292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:13:19.206612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"32'1","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:54:06.614635+0000","last_change":"2024-02-21T22:54:06.614654+0000","last_active":"2024-02-21T22:54:06.614635+0000","last_peered":"2024-02-21T22:54:06.614635+0000","last_clean":"2024-02-21T22:54:06.614635+0000","last_became_active":"2024-02-21T22:53:41.992200+0000","last_became_peered":"2024-02-21T22:53:41.992200+0000","last_unstale":"2024-02-21T22:54:06.614635+0000","last_undegraded":"2024-02-21T22:54:06.614635+0000","last_fullsized":"2024-02-21T22:54:06.614635+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'1","last_scrub_stamp":"2024-02-21T22:54:06.614570+0000","last_deep_scrub":"32'1","last_deep_scrub_stamp":"2024-02-21T22:54:06.614570+0000","last_clean_scrub_stamp":"2024-02-21T22:54:06.614570+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:31:29.988162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:54:03.816815+0000","last_change":"2024-02-21T22:54:03.816861+0000","last_active":"2024-02-21T22:54:03.816815+0000","last_peered":"2024-02-21T22:54:03.816815+0000","last_clean":"2024-02-21T22:54:03.816815+0000","last_became_active":"2024-02-21T22:53:43.003448+0000","last_became_peered":"2024-02-21T22:53:43.003448+0000","last_unstale":"2024-02-21T22:54:03.816815+0000","last_undegraded":"2024-02-21T22:54:03.816815+0000","last_fullsized":"2024-02-21T22:54:03.816815+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:54:03.816732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:54:03.816732+0000","last_clean_scrub_stamp":"2024-02-21T22:54:03.816732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:31:27.190324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"32'1","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:54:04.611892+0000","last_change":"2024-02-21T22:54:04.611916+0000","last_active":"2024-02-21T22:54:04.611892+0000","last_peered":"2024-02-21T22:54:04.611892+0000","last_clean":"2024-02-21T22:54:04.611892+0000","last_became_active":"2024-02-21T22:53:41.989605+0000","last_became_peered":"2024-02-21T22:53:41.989605+0000","last_unstale":"2024-02-21T22:54:04.611892+0000","last_undegraded":"2024-02-21T22:54:04.611892+0000","last_fullsized":"2024-02-21T22:54:04.611892+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'1","last_scrub_stamp":"2024-02-21T22:54:04.611822+0000","last_deep_scrub":"32'1","last_deep_scrub_stamp":"2024-02-21T22:54:04.611822+0000","last_clean_scrub_stamp":"2024-02-21T22:54:04.611822+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:59:44.627567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:54:08.609022+0000","last_change":"2024-02-21T22:54:08.609055+0000","last_active":"2024-02-21T22:54:08.609022+0000","last_peered":"2024-02-21T22:54:08.609022+0000","last_clean":"2024-02-21T22:54:08.609022+0000","last_became_active":"2024-02-21T22:53:43.011446+0000","last_became_peered":"2024-02-21T22:53:43.011446+0000","last_unstale":"2024-02-21T22:54:08.609022+0000","last_undegraded":"2024-02-21T22:54:08.609022+0000","last_fullsized":"2024-02-21T22:54:08.609022+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:54:08.608922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:54:08.608922+0000","last_clean_scrub_stamp":"2024-02-21T22:54:08.608922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:03:45.586397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:54:03.305516+0000","last_change":"2024-02-21T22:54:03.305545+0000","last_active":"2024-02-21T22:54:03.305516+0000","last_peered":"2024-02-21T22:54:03.305516+0000","last_clean":"2024-02-21T22:54:03.305516+0000","last_became_active":"2024-02-21T22:53:41.989927+0000","last_became_peered":"2024-02-21T22:53:41.989927+0000","last_unstale":"2024-02-21T22:54:03.305516+0000","last_undegraded":"2024-02-21T22:54:03.305516+0000","last_fullsized":"2024-02-21T22:54:03.305516+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:54:03.305406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:54:03.305406+0000","last_clean_scrub_stamp":"2024-02-21T22:54:03.305406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:39:22.651760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:54:05.616100+0000","last_change":"2024-02-21T22:54:05.616124+0000","last_active":"2024-02-21T22:54:05.616100+0000","last_peered":"2024-02-21T22:54:05.616100+0000","last_clean":"2024-02-21T22:54:05.616100+0000","last_became_active":"2024-02-21T22:53:43.008486+0000","last_became_peered":"2024-02-21T22:53:43.008486+0000","last_unstale":"2024-02-21T22:54:05.616100+0000","last_undegraded":"2024-02-21T22:54:05.616100+0000","last_fullsized":"2024-02-21T22:54:05.616100+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:54:05.616006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:54:05.616006+0000","last_clean_scrub_stamp":"2024-02-21T22:54:05.616006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T10:01:12.699017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:59.701803+0000","last_change":"2024-02-21T22:53:59.701849+0000","last_active":"2024-02-21T22:53:59.701803+0000","last_peered":"2024-02-21T22:53:59.701803+0000","last_clean":"2024-02-21T22:53:59.701803+0000","last_became_active":"2024-02-21T22:53:41.985232+0000","last_became_peered":"2024-02-21T22:53:41.985232+0000","last_unstale":"2024-02-21T22:53:59.701803+0000","last_undegraded":"2024-02-21T22:53:59.701803+0000","last_fullsized":"2024-02-21T22:53:59.701803+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:59.701715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:59.701715+0000","last_clean_scrub_stamp":"2024-02-21T22:53:59.701715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:18:52.627677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:54:06.790957+0000","last_change":"2024-02-21T22:54:06.790999+0000","last_active":"2024-02-21T22:54:06.790957+0000","last_peered":"2024-02-21T22:54:06.790957+0000","last_clean":"2024-02-21T22:54:06.790957+0000","last_became_active":"2024-02-21T22:53:43.005375+0000","last_became_peered":"2024-02-21T22:53:43.005375+0000","last_unstale":"2024-02-21T22:54:06.790957+0000","last_undegraded":"2024-02-21T22:54:06.790957+0000","last_fullsized":"2024-02-21T22:54:06.790957+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:54:06.790887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:54:06.790887+0000","last_clean_scrub_stamp":"2024-02-21T22:54:06.790887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T10:51:58.378346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:59.244245+0000","last_change":"2024-02-21T22:53:59.244265+0000","last_active":"2024-02-21T22:53:59.244245+0000","last_peered":"2024-02-21T22:53:59.244245+0000","last_clean":"2024-02-21T22:53:59.244245+0000","last_became_active":"2024-02-21T22:53:41.986873+0000","last_became_peered":"2024-02-21T22:53:41.986873+0000","last_unstale":"2024-02-21T22:53:59.244245+0000","last_undegraded":"2024-02-21T22:53:59.244245+0000","last_fullsized":"2024-02-21T22:53:59.244245+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:59.244171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:59.244171+0000","last_clean_scrub_stamp":"2024-02-21T22:53:59.244171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:30:12.521598+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:54:13.377222+0000","last_change":"2024-02-21T22:54:13.377247+0000","last_active":"2024-02-21T22:54:13.377222+0000","last_peered":"2024-02-21T22:54:13.377222+0000","last_clean":"2024-02-21T22:54:13.377222+0000","last_became_active":"2024-02-21T22:53:43.009846+0000","last_became_peered":"2024-02-21T22:53:43.009846+0000","last_unstale":"2024-02-21T22:54:13.377222+0000","last_undegraded":"2024-02-21T22:54:13.377222+0000","last_fullsized":"2024-02-21T22:54:13.377222+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:54:13.377125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:54:13.377125+0000","last_clean_scrub_stamp":"2024-02-21T22:54:13.377125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:06:00.320165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:59.870343+0000","last_change":"2024-02-21T22:53:59.870362+0000","last_active":"2024-02-21T22:53:59.870343+0000","last_peered":"2024-02-21T22:53:59.870343+0000","last_clean":"2024-02-21T22:53:59.870343+0000","last_became_active":"2024-02-21T22:53:41.987448+0000","last_became_peered":"2024-02-21T22:53:41.987448+0000","last_unstale":"2024-02-21T22:53:59.870343+0000","last_undegraded":"2024-02-21T22:53:59.870343+0000","last_fullsized":"2024-02-21T22:53:59.870343+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:59.870266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:59.870266+0000","last_clean_scrub_stamp":"2024-02-21T22:53:59.870266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:37:01.831305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:54:06.381777+0000","last_change":"2024-02-21T22:54:06.381836+0000","last_active":"2024-02-21T22:54:06.381777+0000","last_peered":"2024-02-21T22:54:06.381777+0000","last_clean":"2024-02-21T22:54:06.381777+0000","last_became_active":"2024-02-21T22:53:42.997104+0000","last_became_peered":"2024-02-21T22:53:42.997104+0000","last_unstale":"2024-02-21T22:54:06.381777+0000","last_undegraded":"2024-02-21T22:54:06.381777+0000","last_fullsized":"2024-02-21T22:54:06.381777+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:54:06.381676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:54:06.381676+0000","last_clean_scrub_stamp":"2024-02-21T22:54:06.381676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T10:34:10.462976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"32'3","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:59.747359+0000","last_change":"2024-02-21T22:53:59.747385+0000","last_active":"2024-02-21T22:53:59.747359+0000","last_peered":"2024-02-21T22:53:59.747359+0000","last_clean":"2024-02-21T22:53:59.747359+0000","last_became_active":"2024-02-21T22:53:41.994214+0000","last_became_peered":"2024-02-21T22:53:41.994214+0000","last_unstale":"2024-02-21T22:53:59.747359+0000","last_undegraded":"2024-02-21T22:53:59.747359+0000","last_fullsized":"2024-02-21T22:53:59.747359+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-02-21T22:53:59.747273+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-02-21T22:53:59.747273+0000","last_clean_scrub_stamp":"2024-02-21T22:53:59.747273+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T02:54:50.455098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:54:05.824994+0000","last_change":"2024-02-21T22:54:05.825027+0000","last_active":"2024-02-21T22:54:05.824994+0000","last_peered":"2024-02-21T22:54:05.824994+0000","last_clean":"2024-02-21T22:54:05.824994+0000","last_became_active":"2024-02-21T22:53:43.004978+0000","last_became_peered":"2024-02-21T22:53:43.004978+0000","last_unstale":"2024-02-21T22:54:05.824994+0000","last_undegraded":"2024-02-21T22:54:05.824994+0000","last_fullsized":"2024-02-21T22:54:05.824994+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:54:05.824918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:54:05.824918+0000","last_clean_scrub_stamp":"2024-02-21T22:54:05.824918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:03:42.802393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"33'10","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:54:02.269568+0000","last_change":"2024-02-21T22:54:02.269604+0000","last_active":"2024-02-21T22:54:02.269568+0000","last_peered":"2024-02-21T22:54:02.269568+0000","last_clean":"2024-02-21T22:54:02.269568+0000","last_became_active":"2024-02-21T22:53:41.989590+0000","last_became_peered":"2024-02-21T22:53:41.989590+0000","last_unstale":"2024-02-21T22:54:02.269568+0000","last_undegraded":"2024-02-21T22:54:02.269568+0000","last_fullsized":"2024-02-21T22:54:02.269568+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2024-02-21T22:54:02.269472+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2024-02-21T22:54:02.269472+0000","last_clean_scrub_stamp":"2024-02-21T22:54:02.269472+0000","objects_scrubbed":4,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T10:01:09.352482+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7145,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:54:04.644416+0000","last_change":"2024-02-21T22:54:04.644438+0000","last_active":"2024-02-21T22:54:04.644416+0000","last_peered":"2024-02-21T22:54:04.644416+0000","last_clean":"2024-02-21T22:54:04.644416+0000","last_became_active":"2024-02-21T22:53:43.007923+0000","last_became_peered":"2024-02-21T22:53:43.007923+0000","last_unstale":"2024-02-21T22:54:04.644416+0000","last_undegraded":"2024-02-21T22:54:04.644416+0000","last_fullsized":"2024-02-21T22:54:04.644416+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:54:04.644330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:54:04.644330+0000","last_clean_scrub_stamp":"2024-02-21T22:54:04.644330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:31:28.017922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"32'2","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:54:02.677326+0000","last_change":"2024-02-21T22:54:02.677371+0000","last_active":"2024-02-21T22:54:02.677326+0000","last_peered":"2024-02-21T22:54:02.677326+0000","last_clean":"2024-02-21T22:54:02.677326+0000","last_became_active":"2024-02-21T22:53:41.985220+0000","last_became_peered":"2024-02-21T22:53:41.985220+0000","last_unstale":"2024-02-21T22:54:02.677326+0000","last_undegraded":"2024-02-21T22:54:02.677326+0000","last_fullsized":"2024-02-21T22:54:02.677326+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-02-21T22:54:02.677208+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-02-21T22:54:02.677208+0000","last_clean_scrub_stamp":"2024-02-21T22:54:02.677208+0000","objects_scrubbed":2,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:02:34.594069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:54:11.330490+0000","last_change":"2024-02-21T22:54:11.330515+0000","last_active":"2024-02-21T22:54:11.330490+0000","last_peered":"2024-02-21T22:54:11.330490+0000","last_clean":"2024-02-21T22:54:11.330490+0000","last_became_active":"2024-02-21T22:53:43.003293+0000","last_became_peered":"2024-02-21T22:53:43.003293+0000","last_unstale":"2024-02-21T22:54:11.330490+0000","last_undegraded":"2024-02-21T22:54:11.330490+0000","last_fullsized":"2024-02-21T22:54:11.330490+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:54:11.330393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:54:11.330393+0000","last_clean_scrub_stamp":"2024-02-21T22:54:11.330393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:23:45.552033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:58.682203+0000","last_change":"2024-02-21T22:53:58.682222+0000","last_active":"2024-02-21T22:53:58.682203+0000","last_peered":"2024-02-21T22:53:58.682203+0000","last_clean":"2024-02-21T22:53:58.682203+0000","last_became_active":"2024-02-21T22:53:41.987379+0000","last_became_peered":"2024-02-21T22:53:41.987379+0000","last_unstale":"2024-02-21T22:53:58.682203+0000","last_undegraded":"2024-02-21T22:53:58.682203+0000","last_fullsized":"2024-02-21T22:53:58.682203+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:58.682126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:58.682126+0000","last_clean_scrub_stamp":"2024-02-21T22:53:58.682126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:28:01.720789+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:54:11.309717+0000","last_change":"2024-02-21T22:54:11.309754+0000","last_active":"2024-02-21T22:54:11.309717+0000","last_peered":"2024-02-21T22:54:11.309717+0000","last_clean":"2024-02-21T22:54:11.309717+0000","last_became_active":"2024-02-21T22:53:43.013636+0000","last_became_peered":"2024-02-21T22:53:43.013636+0000","last_unstale":"2024-02-21T22:54:11.309717+0000","last_undegraded":"2024-02-21T22:54:11.309717+0000","last_fullsized":"2024-02-21T22:54:11.309717+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:54:11.309591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:54:11.309591+0000","last_clean_scrub_stamp":"2024-02-21T22:54:11.309591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T10:34:15.390891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:54:01.295470+0000","last_change":"2024-02-21T22:54:01.295499+0000","last_active":"2024-02-21T22:54:01.295470+0000","last_peered":"2024-02-21T22:54:01.295470+0000","last_clean":"2024-02-21T22:54:01.295470+0000","last_became_active":"2024-02-21T22:53:41.988958+0000","last_became_peered":"2024-02-21T22:53:41.988958+0000","last_unstale":"2024-02-21T22:54:01.295470+0000","last_undegraded":"2024-02-21T22:54:01.295470+0000","last_fullsized":"2024-02-21T22:54:01.295470+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:54:01.295368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:54:01.295368+0000","last_clean_scrub_stamp":"2024-02-21T22:54:01.295368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:31:24.668960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:54:06.748819+0000","last_change":"2024-02-21T22:54:06.748858+0000","last_active":"2024-02-21T22:54:06.748819+0000","last_peered":"2024-02-21T22:54:06.748819+0000","last_clean":"2024-02-21T22:54:06.748819+0000","last_became_active":"2024-02-21T22:53:43.010007+0000","last_became_peered":"2024-02-21T22:53:43.010007+0000","last_unstale":"2024-02-21T22:54:06.748819+0000","last_undegraded":"2024-02-21T22:54:06.748819+0000","last_fullsized":"2024-02-21T22:54:06.748819+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:54:06.748713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:54:06.748713+0000","last_clean_scrub_stamp":"2024-02-21T22:54:06.748713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:59:46.764457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"32'8","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:54:04.323377+0000","last_change":"2024-02-21T22:54:04.323414+0000","last_active":"2024-02-21T22:54:04.323377+0000","last_peered":"2024-02-21T22:54:04.323377+0000","last_clean":"2024-02-21T22:54:04.323377+0000","last_became_active":"2024-02-21T22:53:41.989531+0000","last_became_peered":"2024-02-21T22:53:41.989531+0000","last_unstale":"2024-02-21T22:54:04.323377+0000","last_undegraded":"2024-02-21T22:54:04.323377+0000","last_fullsized":"2024-02-21T22:54:04.323377+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-02-21T22:54:04.323281+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-02-21T22:54:04.323281+0000","last_clean_scrub_stamp":"2024-02-21T22:54:04.323281+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:55:22.978026+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:54:07.651595+0000","last_change":"2024-02-21T22:54:07.651637+0000","last_active":"2024-02-21T22:54:07.651595+0000","last_peered":"2024-02-21T22:54:07.651595+0000","last_clean":"2024-02-21T22:54:07.651595+0000","last_became_active":"2024-02-21T22:53:43.009914+0000","last_became_peered":"2024-02-21T22:53:43.009914+0000","last_unstale":"2024-02-21T22:54:07.651595+0000","last_undegraded":"2024-02-21T22:54:07.651595+0000","last_fullsized":"2024-02-21T22:54:07.651595+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:54:07.651481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:54:07.651481+0000","last_clean_scrub_stamp":"2024-02-21T22:54:07.651481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T10:01:14.734492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"32'1","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:59.667957+0000","last_change":"2024-02-21T22:53:59.668003+0000","last_active":"2024-02-21T22:53:59.667957+0000","last_peered":"2024-02-21T22:53:59.667957+0000","last_clean":"2024-02-21T22:53:59.667957+0000","last_became_active":"2024-02-21T22:53:41.987692+0000","last_became_peered":"2024-02-21T22:53:41.987692+0000","last_unstale":"2024-02-21T22:53:59.667957+0000","last_undegraded":"2024-02-21T22:53:59.667957+0000","last_fullsized":"2024-02-21T22:53:59.667957+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'1","last_scrub_stamp":"2024-02-21T22:53:59.667844+0000","last_deep_scrub":"32'1","last_deep_scrub_stamp":"2024-02-21T22:53:59.667844+0000","last_clean_scrub_stamp":"2024-02-21T22:53:59.667844+0000","objects_scrubbed":1,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:44:53.127928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:54:09.758088+0000","last_change":"2024-02-21T22:54:09.758108+0000","last_active":"2024-02-21T22:54:09.758088+0000","last_peered":"2024-02-21T22:54:09.758088+0000","last_clean":"2024-02-21T22:54:09.758088+0000","last_became_active":"2024-02-21T22:53:43.009536+0000","last_became_peered":"2024-02-21T22:53:43.009536+0000","last_unstale":"2024-02-21T22:54:09.758088+0000","last_undegraded":"2024-02-21T22:54:09.758088+0000","last_fullsized":"2024-02-21T22:54:09.758088+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:54:09.758019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:54:09.758019+0000","last_clean_scrub_stamp":"2024-02-21T22:54:09.758019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:51:16.556439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"32'2","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:54:00.676050+0000","last_change":"2024-02-21T22:54:00.676075+0000","last_active":"2024-02-21T22:54:00.676050+0000","last_peered":"2024-02-21T22:54:00.676050+0000","last_clean":"2024-02-21T22:54:00.676050+0000","last_became_active":"2024-02-21T22:53:41.985942+0000","last_became_peered":"2024-02-21T22:53:41.985942+0000","last_unstale":"2024-02-21T22:54:00.676050+0000","last_undegraded":"2024-02-21T22:54:00.676050+0000","last_fullsized":"2024-02-21T22:54:00.676050+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-02-21T22:54:00.675972+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-02-21T22:54:00.675972+0000","last_clean_scrub_stamp":"2024-02-21T22:54:00.675972+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T10:22:52.350518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:54:07.627447+0000","last_change":"2024-02-21T22:54:07.627488+0000","last_active":"2024-02-21T22:54:07.627447+0000","last_peered":"2024-02-21T22:54:07.627447+0000","last_clean":"2024-02-21T22:54:07.627447+0000","last_became_active":"2024-02-21T22:53:43.010739+0000","last_became_peered":"2024-02-21T22:53:43.010739+0000","last_unstale":"2024-02-21T22:54:07.627447+0000","last_undegraded":"2024-02-21T22:54:07.627447+0000","last_fullsized":"2024-02-21T22:54:07.627447+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:54:07.627348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:54:07.627348+0000","last_clean_scrub_stamp":"2024-02-21T22:54:07.627348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T10:51:59.214808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"32'1","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:54:01.673498+0000","last_change":"2024-02-21T22:54:01.673555+0000","last_active":"2024-02-21T22:54:01.673498+0000","last_peered":"2024-02-21T22:54:01.673498+0000","last_clean":"2024-02-21T22:54:01.673498+0000","last_became_active":"2024-02-21T22:53:41.986968+0000","last_became_peered":"2024-02-21T22:53:41.986968+0000","last_unstale":"2024-02-21T22:54:01.673498+0000","last_undegraded":"2024-02-21T22:54:01.673498+0000","last_fullsized":"2024-02-21T22:54:01.673498+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'1","last_scrub_stamp":"2024-02-21T22:54:01.673373+0000","last_deep_scrub":"32'1","last_deep_scrub_stamp":"2024-02-21T22:54:01.673373+0000","last_clean_scrub_stamp":"2024-02-21T22:54:01.673373+0000","objects_scrubbed":1,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:28:04.712036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:54:01.428080+0000","last_change":"2024-02-21T22:54:01.428116+0000","last_active":"2024-02-21T22:54:01.428080+0000","last_peered":"2024-02-21T22:54:01.428080+0000","last_clean":"2024-02-21T22:54:01.428080+0000","last_became_active":"2024-02-21T22:53:43.001668+0000","last_became_peered":"2024-02-21T22:53:43.001668+0000","last_unstale":"2024-02-21T22:54:01.428080+0000","last_undegraded":"2024-02-21T22:54:01.428080+0000","last_fullsized":"2024-02-21T22:54:01.428080+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:54:01.427973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:54:01.427973+0000","last_clean_scrub_stamp":"2024-02-21T22:54:01.427973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:32:13.691337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:54:05.594538+0000","last_change":"2024-02-21T22:54:05.594557+0000","last_active":"2024-02-21T22:54:05.594538+0000","last_peered":"2024-02-21T22:54:05.594538+0000","last_clean":"2024-02-21T22:54:05.594538+0000","last_became_active":"2024-02-21T22:53:41.989146+0000","last_became_peered":"2024-02-21T22:53:41.989146+0000","last_unstale":"2024-02-21T22:54:05.594538+0000","last_undegraded":"2024-02-21T22:54:05.594538+0000","last_fullsized":"2024-02-21T22:54:05.594538+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:54:05.594473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:54:05.594473+0000","last_clean_scrub_stamp":"2024-02-21T22:54:05.594473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:32:29.628618+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:54:05.420280+0000","last_change":"2024-02-21T22:54:05.420338+0000","last_active":"2024-02-21T22:54:05.420280+0000","last_peered":"2024-02-21T22:54:05.420280+0000","last_clean":"2024-02-21T22:54:05.420280+0000","last_became_active":"2024-02-21T22:53:43.010865+0000","last_became_peered":"2024-02-21T22:53:43.010865+0000","last_unstale":"2024-02-21T22:54:05.420280+0000","last_undegraded":"2024-02-21T22:54:05.420280+0000","last_fullsized":"2024-02-21T22:54:05.420280+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:54:05.420180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:54:05.420180+0000","last_clean_scrub_stamp":"2024-02-21T22:54:05.420180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:18:58.346142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"32'2","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:56.915192+0000","last_change":"2024-02-21T22:53:56.915216+0000","last_active":"2024-02-21T22:53:56.915192+0000","last_peered":"2024-02-21T22:53:56.915192+0000","last_clean":"2024-02-21T22:53:56.915192+0000","last_became_active":"2024-02-21T22:53:41.984573+0000","last_became_peered":"2024-02-21T22:53:41.984573+0000","last_unstale":"2024-02-21T22:53:56.915192+0000","last_undegraded":"2024-02-21T22:53:56.915192+0000","last_fullsized":"2024-02-21T22:53:56.915192+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-02-21T22:53:56.915109+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-02-21T22:53:56.915109+0000","last_clean_scrub_stamp":"2024-02-21T22:53:56.915109+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:42:11.525074+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:54:00.460135+0000","last_change":"2024-02-21T22:54:00.460181+0000","last_active":"2024-02-21T22:54:00.460135+0000","last_peered":"2024-02-21T22:54:00.460135+0000","last_clean":"2024-02-21T22:54:00.460135+0000","last_became_active":"2024-02-21T22:53:43.001513+0000","last_became_peered":"2024-02-21T22:53:43.001513+0000","last_unstale":"2024-02-21T22:54:00.460135+0000","last_undegraded":"2024-02-21T22:54:00.460135+0000","last_fullsized":"2024-02-21T22:54:00.460135+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:54:00.460032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:54:00.460032+0000","last_clean_scrub_stamp":"2024-02-21T22:54:00.460032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:53:56.019202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:59.798174+0000","last_change":"2024-02-21T22:53:59.798196+0000","last_active":"2024-02-21T22:53:59.798174+0000","last_peered":"2024-02-21T22:53:59.798174+0000","last_clean":"2024-02-21T22:53:59.798174+0000","last_became_active":"2024-02-21T22:53:41.991247+0000","last_became_peered":"2024-02-21T22:53:41.991247+0000","last_unstale":"2024-02-21T22:53:59.798174+0000","last_undegraded":"2024-02-21T22:53:59.798174+0000","last_fullsized":"2024-02-21T22:53:59.798174+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:59.798106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:59.798106+0000","last_clean_scrub_stamp":"2024-02-21T22:53:59.798106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T02:25:40.211562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:59.426557+0000","last_change":"2024-02-21T22:53:59.426577+0000","last_active":"2024-02-21T22:53:59.426557+0000","last_peered":"2024-02-21T22:53:59.426557+0000","last_clean":"2024-02-21T22:53:59.426557+0000","last_became_active":"2024-02-21T22:53:43.000172+0000","last_became_peered":"2024-02-21T22:53:43.000172+0000","last_unstale":"2024-02-21T22:53:59.426557+0000","last_undegraded":"2024-02-21T22:53:59.426557+0000","last_fullsized":"2024-02-21T22:53:59.426557+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:59.426465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:59.426465+0000","last_clean_scrub_stamp":"2024-02-21T22:53:59.426465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:40:22.761390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:54:03.652184+0000","last_change":"2024-02-21T22:54:03.652203+0000","last_active":"2024-02-21T22:54:03.652184+0000","last_peered":"2024-02-21T22:54:03.652184+0000","last_clean":"2024-02-21T22:54:03.652184+0000","last_became_active":"2024-02-21T22:53:41.987202+0000","last_became_peered":"2024-02-21T22:53:41.987202+0000","last_unstale":"2024-02-21T22:54:03.652184+0000","last_undegraded":"2024-02-21T22:54:03.652184+0000","last_fullsized":"2024-02-21T22:54:03.652184+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:54:03.652118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:54:03.652118+0000","last_clean_scrub_stamp":"2024-02-21T22:54:03.652118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:17:55.194880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:54:05.406470+0000","last_change":"2024-02-21T22:54:05.406491+0000","last_active":"2024-02-21T22:54:05.406470+0000","last_peered":"2024-02-21T22:54:05.406470+0000","last_clean":"2024-02-21T22:54:05.406470+0000","last_became_active":"2024-02-21T22:53:43.007502+0000","last_became_peered":"2024-02-21T22:53:43.007502+0000","last_unstale":"2024-02-21T22:54:05.406470+0000","last_undegraded":"2024-02-21T22:54:05.406470+0000","last_fullsized":"2024-02-21T22:54:05.406470+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:54:05.406388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:54:05.406388+0000","last_clean_scrub_stamp":"2024-02-21T22:54:05.406388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:31:28.779980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:58.774758+0000","last_change":"2024-02-21T22:53:58.774778+0000","last_active":"2024-02-21T22:53:58.774758+0000","last_peered":"2024-02-21T22:53:58.774758+0000","last_clean":"2024-02-21T22:53:58.774758+0000","last_became_active":"2024-02-21T22:53:41.992944+0000","last_became_peered":"2024-02-21T22:53:41.992944+0000","last_unstale":"2024-02-21T22:53:58.774758+0000","last_undegraded":"2024-02-21T22:53:58.774758+0000","last_fullsized":"2024-02-21T22:53:58.774758+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:58.774690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:58.774690+0000","last_clean_scrub_stamp":"2024-02-21T22:53:58.774690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:44:52.234774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:54:04.382403+0000","last_change":"2024-02-21T22:54:04.382430+0000","last_active":"2024-02-21T22:54:04.382403+0000","last_peered":"2024-02-21T22:54:04.382403+0000","last_clean":"2024-02-21T22:54:04.382403+0000","last_became_active":"2024-02-21T22:53:43.007283+0000","last_became_peered":"2024-02-21T22:53:43.007283+0000","last_unstale":"2024-02-21T22:54:04.382403+0000","last_undegraded":"2024-02-21T22:54:04.382403+0000","last_fullsized":"2024-02-21T22:54:04.382403+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:54:04.382315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:54:04.382315+0000","last_clean_scrub_stamp":"2024-02-21T22:54:04.382315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:24:59.600048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"32'2","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:54:01.636891+0000","last_change":"2024-02-21T22:54:01.636919+0000","last_active":"2024-02-21T22:54:01.636891+0000","last_peered":"2024-02-21T22:54:01.636891+0000","last_clean":"2024-02-21T22:54:01.636891+0000","last_became_active":"2024-02-21T22:53:41.994229+0000","last_became_peered":"2024-02-21T22:53:41.994229+0000","last_unstale":"2024-02-21T22:54:01.636891+0000","last_undegraded":"2024-02-21T22:54:01.636891+0000","last_fullsized":"2024-02-21T22:54:01.636891+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-02-21T22:54:01.636801+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-02-21T22:54:01.636801+0000","last_clean_scrub_stamp":"2024-02-21T22:54:01.636801+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:11:20.503172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:54:07.764094+0000","last_change":"2024-02-21T22:54:07.764114+0000","last_active":"2024-02-21T22:54:07.764094+0000","last_peered":"2024-02-21T22:54:07.764094+0000","last_clean":"2024-02-21T22:54:07.764094+0000","last_became_active":"2024-02-21T22:53:43.006058+0000","last_became_peered":"2024-02-21T22:53:43.006058+0000","last_unstale":"2024-02-21T22:54:07.764094+0000","last_undegraded":"2024-02-21T22:54:07.764094+0000","last_fullsized":"2024-02-21T22:54:07.764094+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:54:07.764017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:54:07.764017+0000","last_clean_scrub_stamp":"2024-02-21T22:54:07.764017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:33:04.477566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"33'3","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:57.889766+0000","last_change":"2024-02-21T22:53:57.889806+0000","last_active":"2024-02-21T22:53:57.889766+0000","last_peered":"2024-02-21T22:53:57.889766+0000","last_clean":"2024-02-21T22:53:57.889766+0000","last_became_active":"2024-02-21T22:53:41.985263+0000","last_became_peered":"2024-02-21T22:53:41.985263+0000","last_unstale":"2024-02-21T22:53:57.889766+0000","last_undegraded":"2024-02-21T22:53:57.889766+0000","last_fullsized":"2024-02-21T22:53:57.889766+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'3","last_scrub_stamp":"2024-02-21T22:53:57.889662+0000","last_deep_scrub":"33'3","last_deep_scrub_stamp":"2024-02-21T22:53:57.889662+0000","last_clean_scrub_stamp":"2024-02-21T22:53:57.889662+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:35:03.015771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:54:04.740911+0000","last_change":"2024-02-21T22:54:04.740959+0000","last_active":"2024-02-21T22:54:04.740911+0000","last_peered":"2024-02-21T22:54:04.740911+0000","last_clean":"2024-02-21T22:54:04.740911+0000","last_became_active":"2024-02-21T22:53:43.005033+0000","last_became_peered":"2024-02-21T22:53:43.005033+0000","last_unstale":"2024-02-21T22:54:04.740911+0000","last_undegraded":"2024-02-21T22:54:04.740911+0000","last_fullsized":"2024-02-21T22:54:04.740911+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:54:04.740806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:54:04.740806+0000","last_clean_scrub_stamp":"2024-02-21T22:54:04.740806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:59:44.756550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:57.641603+0000","last_change":"2024-02-21T22:53:57.641622+0000","last_active":"2024-02-21T22:53:57.641603+0000","last_peered":"2024-02-21T22:53:57.641603+0000","last_clean":"2024-02-21T22:53:57.641603+0000","last_became_active":"2024-02-21T22:53:41.985909+0000","last_became_peered":"2024-02-21T22:53:41.985909+0000","last_unstale":"2024-02-21T22:53:57.641603+0000","last_undegraded":"2024-02-21T22:53:57.641603+0000","last_fullsized":"2024-02-21T22:53:57.641603+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:57.641530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:57.641530+0000","last_clean_scrub_stamp":"2024-02-21T22:53:57.641530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:36:59.602568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:54:02.730305+0000","last_change":"2024-02-21T22:54:02.730333+0000","last_active":"2024-02-21T22:54:02.730305+0000","last_peered":"2024-02-21T22:54:02.730305+0000","last_clean":"2024-02-21T22:54:02.730305+0000","last_became_active":"2024-02-21T22:53:42.999987+0000","last_became_peered":"2024-02-21T22:53:42.999987+0000","last_unstale":"2024-02-21T22:54:02.730305+0000","last_undegraded":"2024-02-21T22:54:02.730305+0000","last_fullsized":"2024-02-21T22:54:02.730305+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:54:02.730223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:54:02.730223+0000","last_clean_scrub_stamp":"2024-02-21T22:54:02.730223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T10:22:54.404769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:54:00.841351+0000","last_change":"2024-02-21T22:54:00.841377+0000","last_active":"2024-02-21T22:54:00.841351+0000","last_peered":"2024-02-21T22:54:00.841351+0000","last_clean":"2024-02-21T22:54:00.841351+0000","last_became_active":"2024-02-21T22:53:41.990977+0000","last_became_peered":"2024-02-21T22:53:41.990977+0000","last_unstale":"2024-02-21T22:54:00.841351+0000","last_undegraded":"2024-02-21T22:54:00.841351+0000","last_fullsized":"2024-02-21T22:54:00.841351+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:54:00.841260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:54:00.841260+0000","last_clean_scrub_stamp":"2024-02-21T22:54:00.841260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:03:35.476519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:54:01.796899+0000","last_change":"2024-02-21T22:54:01.796920+0000","last_active":"2024-02-21T22:54:01.796899+0000","last_peered":"2024-02-21T22:54:01.796899+0000","last_clean":"2024-02-21T22:54:01.796899+0000","last_became_active":"2024-02-21T22:53:42.999472+0000","last_became_peered":"2024-02-21T22:53:42.999472+0000","last_unstale":"2024-02-21T22:54:01.796899+0000","last_undegraded":"2024-02-21T22:54:01.796899+0000","last_fullsized":"2024-02-21T22:54:01.796899+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:54:01.796814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:54:01.796814+0000","last_clean_scrub_stamp":"2024-02-21T22:54:01.796814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:44:55.256898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:54:00.631827+0000","last_change":"2024-02-21T22:54:00.631852+0000","last_active":"2024-02-21T22:54:00.631827+0000","last_peered":"2024-02-21T22:54:00.631827+0000","last_clean":"2024-02-21T22:54:00.631827+0000","last_became_active":"2024-02-21T22:53:41.990791+0000","last_became_peered":"2024-02-21T22:53:41.990791+0000","last_unstale":"2024-02-21T22:54:00.631827+0000","last_undegraded":"2024-02-21T22:54:00.631827+0000","last_fullsized":"2024-02-21T22:54:00.631827+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:54:00.631739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:54:00.631739+0000","last_clean_scrub_stamp":"2024-02-21T22:54:00.631739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T02:54:51.339564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:54:07.369329+0000","last_change":"2024-02-21T22:54:07.369367+0000","last_active":"2024-02-21T22:54:07.369329+0000","last_peered":"2024-02-21T22:54:07.369329+0000","last_clean":"2024-02-21T22:54:07.369329+0000","last_became_active":"2024-02-21T22:53:42.999170+0000","last_became_peered":"2024-02-21T22:53:42.999170+0000","last_unstale":"2024-02-21T22:54:07.369329+0000","last_undegraded":"2024-02-21T22:54:07.369329+0000","last_fullsized":"2024-02-21T22:54:07.369329+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:54:07.369209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:54:07.369209+0000","last_clean_scrub_stamp":"2024-02-21T22:54:07.369209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:03:09.562135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:53:58.655719+0000","last_change":"2024-02-21T22:53:58.655761+0000","last_active":"2024-02-21T22:53:58.655719+0000","last_peered":"2024-02-21T22:53:58.655719+0000","last_clean":"2024-02-21T22:53:58.655719+0000","last_became_active":"2024-02-21T22:53:41.994560+0000","last_became_peered":"2024-02-21T22:53:41.994560+0000","last_unstale":"2024-02-21T22:53:58.655719+0000","last_undegraded":"2024-02-21T22:53:58.655719+0000","last_fullsized":"2024-02-21T22:53:58.655719+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:53:58.655604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:53:58.655604+0000","last_clean_scrub_stamp":"2024-02-21T22:53:58.655604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:24:53.873337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:54:11.655666+0000","last_change":"2024-02-21T22:54:11.655708+0000","last_active":"2024-02-21T22:54:11.655666+0000","last_peered":"2024-02-21T22:54:11.655666+0000","last_clean":"2024-02-21T22:54:11.655666+0000","last_became_active":"2024-02-21T22:53:43.015685+0000","last_became_peered":"2024-02-21T22:53:43.015685+0000","last_unstale":"2024-02-21T22:54:11.655666+0000","last_undegraded":"2024-02-21T22:54:11.655666+0000","last_fullsized":"2024-02-21T22:54:11.655666+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:54:11.655590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:54:11.655590+0000","last_clean_scrub_stamp":"2024-02-21T22:54:11.655590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T02:26:25.528048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:54:00.278742+0000","last_change":"2024-02-21T22:54:00.278777+0000","last_active":"2024-02-21T22:54:00.278742+0000","last_peered":"2024-02-21T22:54:00.278742+0000","last_clean":"2024-02-21T22:54:00.278742+0000","last_became_active":"2024-02-21T22:53:41.987907+0000","last_became_peered":"2024-02-21T22:53:41.987907+0000","last_unstale":"2024-02-21T22:54:00.278742+0000","last_undegraded":"2024-02-21T22:54:00.278742+0000","last_fullsized":"2024-02-21T22:54:00.278742+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:54:00.278615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:54:00.278615+0000","last_clean_scrub_stamp":"2024-02-21T22:54:00.278615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:32:24.312759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:54:02.463687+0000","last_change":"2024-02-21T22:54:02.463706+0000","last_active":"2024-02-21T22:54:02.463687+0000","last_peered":"2024-02-21T22:54:02.463687+0000","last_clean":"2024-02-21T22:54:02.463687+0000","last_became_active":"2024-02-21T22:53:43.001671+0000","last_became_peered":"2024-02-21T22:53:43.001671+0000","last_unstale":"2024-02-21T22:54:02.463687+0000","last_undegraded":"2024-02-21T22:54:02.463687+0000","last_fullsized":"2024-02-21T22:54:02.463687+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:54:02.463616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:54:02.463616+0000","last_clean_scrub_stamp":"2024-02-21T22:54:02.463616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:17:54.006378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:54:00.771250+0000","last_change":"2024-02-21T22:54:00.771268+0000","last_active":"2024-02-21T22:54:00.771250+0000","last_peered":"2024-02-21T22:54:00.771250+0000","last_clean":"2024-02-21T22:54:00.771250+0000","last_became_active":"2024-02-21T22:53:41.991530+0000","last_became_peered":"2024-02-21T22:53:41.991530+0000","last_unstale":"2024-02-21T22:54:00.771250+0000","last_undegraded":"2024-02-21T22:54:00.771250+0000","last_fullsized":"2024-02-21T22:54:00.771250+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T22:54:00.771180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T22:54:00.771180+0000","last_clean_scrub_stamp":"2024-02-21T22:54:00.771180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:24:55.988912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"33'119","reported_seq":205,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-21T22:54:00.456680+0000","last_change":"2024-02-21T22:54:00.456727+0000","last_active":"2024-02-21T22:54:00.456680+0000","last_peered":"2024-02-21T22:54:00.456680+0000","last_clean":"2024-02-21T22:54:00.456680+0000","last_became_active":"2024-02-21T22:52:40.335061+0000","last_became_peered":"2024-02-21T22:52:40.335061+0000","last_unstale":"2024-02-21T22:54:00.456680+0000","last_undegraded":"2024-02-21T22:54:00.456680+0000","last_fullsized":"2024-02-21T22:54:00.456680+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'119","last_scrub_stamp":"2024-02-21T22:54:00.456576+0000","last_deep_scrub":"33'119","last_deep_scrub_stamp":"2024-02-21T22:54:00.456576+0000","last_clean_scrub_stamp":"2024-02-21T22:54:00.456576+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:56:29.348173+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":7943,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":15886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":45,"ondisk_log_size":45,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574875,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27964,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343876,"statfs":{"total":96636764160,"available":96608129024,"internally_reserved":0,"allocated":970752,"data_stored":737074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574876,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":380928,"data_stored":147232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574877,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":380928,"data_stored":147288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574876,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":380928,"data_stored":146720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574876,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":393216,"data_stored":153783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574876,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":376832,"data_stored":146686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574877,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":393216,"data_stored":153783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574875,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27960,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343880,"statfs":{"total":96636764160,"available":96608133120,"internally_reserved":0,"allocated":966656,"data_stored":736984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":7167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":7167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-21T22:54:40.498 DEBUG:teuthology.orchestra.run.smithi116:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-02-21T22:54:40.632 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.642+0000 7f6a81cde640 1 Processor -- start 2024-02-21T22:54:40.633 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.642+0000 7f6a81cde640 1 -- start start 2024-02-21T22:54:40.634 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.643+0000 7f6a81cde640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f6a7c06e310 0x7f6a7c0cd800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:54:40.635 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.643+0000 7f6a81cde640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a7c071d90 con 0x7f6a7c0b34d0 2024-02-21T22:54:40.635 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.643+0000 7f6a81cde640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a7c072070 con 0x7f6a7c15ae80 2024-02-21T22:54:40.635 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.643+0000 7f6a81cde640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a7c072350 con 0x7f6a7c06e310 2024-02-21T22:54:40.635 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.643+0000 7f6a7affd640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f6a7c0b34d0 0x7f6a7c0cd0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:50088/0 (socket says 172.21.15.116:50088) 2024-02-21T22:54:40.635 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.643+0000 7f6a7affd640 1 -- 172.21.15.116:0/3197171710 learned_addr learned my addr 172.21.15.116:0/3197171710 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-02-21T22:54:40.635 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.643+0000 7f6a7bfff640 1 --2- 172.21.15.116:0/3197171710 >> v2:172.21.15.142:3300/0 conn(0x7f6a7c06e310 0x7f6a7c0cd800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:54:40.635 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.643+0000 7f6a7a7fc640 1 -- 172.21.15.116:0/3197171710 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2410943230 0 0) 0x7f6a7c071d90 con 0x7f6a7c0b34d0 2024-02-21T22:54:40.636 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.643+0000 7f6a7a7fc640 1 -- 172.21.15.116:0/3197171710 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a64003520 con 0x7f6a7c0b34d0 2024-02-21T22:54:40.636 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.643+0000 7f6a7a7fc640 1 -- 172.21.15.116:0/3197171710 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1770723297 0 0) 0x7f6a7c072070 con 0x7f6a7c15ae80 2024-02-21T22:54:40.636 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.643+0000 7f6a7a7fc640 1 -- 172.21.15.116:0/3197171710 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a7c071d90 con 0x7f6a7c15ae80 2024-02-21T22:54:40.636 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.643+0000 7f6a7bfff640 1 -- 172.21.15.116:0/3197171710 >> v1:172.21.15.142:6789/0 conn(0x7f6a7c15ae80 legacy=0x7f6a7c0b2dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:54:40.636 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.643+0000 7f6a7bfff640 1 -- 172.21.15.116:0/3197171710 >> v1:172.21.15.116:6789/0 conn(0x7f6a7c0b34d0 legacy=0x7f6a7c0cd0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:54:40.636 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.643+0000 7f6a7bfff640 1 -- 172.21.15.116:0/3197171710 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a7c072630 con 0x7f6a7c06e310 2024-02-21T22:54:40.636 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.644+0000 7f6a7bfff640 1 --2- 172.21.15.116:0/3197171710 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a7c06e310 0x7f6a7c0cd800 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f6a74009d90 tx=0x7f6a7402bf50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=349599dd40fb8bc4 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:54:40.636 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.644+0000 7f6a7a7fc640 1 -- 172.21.15.116:0/3197171710 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a74039070 con 0x7f6a7c06e310 2024-02-21T22:54:40.636 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.644+0000 7f6a7a7fc640 1 -- 172.21.15.116:0/3197171710 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a7402cd00 con 0x7f6a7c06e310 2024-02-21T22:54:40.637 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.644+0000 7f6a7a7fc640 1 -- 172.21.15.116:0/3197171710 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a74034660 con 0x7f6a7c06e310 2024-02-21T22:54:40.639 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.645+0000 7f6a81cde640 1 -- 172.21.15.116:0/3197171710 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a7c06e310 msgr2=0x7f6a7c0cd800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:54:40.639 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.645+0000 7f6a81cde640 1 --2- 172.21.15.116:0/3197171710 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a7c06e310 0x7f6a7c0cd800 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f6a74009d90 tx=0x7f6a7402bf50 comp rx=0 tx=0).stop 2024-02-21T22:54:40.639 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.645+0000 7f6a81cde640 1 -- 172.21.15.116:0/3197171710 shutdown_connections 2024-02-21T22:54:40.639 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.645+0000 7f6a81cde640 1 --2- 172.21.15.116:0/3197171710 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a7c06e310 0x7f6a7c0cd800 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:54:40.640 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.645+0000 7f6a81cde640 1 -- 172.21.15.116:0/3197171710 >> 172.21.15.116:0/3197171710 conn(0x7f6a7c0b1740 msgr2=0x7f6a7c0b1b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:54:40.640 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.645+0000 7f6a81cde640 1 -- 172.21.15.116:0/3197171710 shutdown_connections 2024-02-21T22:54:40.640 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.645+0000 7f6a81cde640 1 -- 172.21.15.116:0/3197171710 wait complete. 2024-02-21T22:54:40.640 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.646+0000 7f6a81cde640 1 Processor -- start 2024-02-21T22:54:40.640 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.646+0000 7f6a81cde640 1 -- start start 2024-02-21T22:54:40.640 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.647+0000 7f6a81cde640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6a7c06e310 0x7f6a7c0b0e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:54:40.640 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.647+0000 7f6a81cde640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a7c0b34d0 0x7f6a7c0cd260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:54:40.641 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.647+0000 7f6a81cde640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a7c148ca0 0x7f6a7c14f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:54:40.641 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.647+0000 7f6a81cde640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a7c071aa0 con 0x7f6a7c06e310 2024-02-21T22:54:40.641 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.647+0000 7f6a81cde640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a7c071920 con 0x7f6a7c148ca0 2024-02-21T22:54:40.641 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.647+0000 7f6a81cde640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a7c0b4490 con 0x7f6a7c0b34d0 2024-02-21T22:54:40.641 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.647+0000 7f6a7b7fe640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6a7c06e310 0x7f6a7c0b0e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:54:40.641 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.647+0000 7f6a7b7fe640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6a7c06e310 0x7f6a7c0b0e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:33490/0 (socket says 172.21.15.116:33490) 2024-02-21T22:54:40.641 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.647+0000 7f6a7bfff640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a7c148ca0 0x7f6a7c14f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:54:40.641 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.647+0000 7f6a7affd640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a7c0b34d0 0x7f6a7c0cd260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:54:40.642 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.647+0000 7f6a7b7fe640 1 -- 172.21.15.116:0/1588430052 learned_addr learned my addr 172.21.15.116:0/1588430052 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:54:40.642 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.647+0000 7f6a7b7fe640 1 -- 172.21.15.116:0/1588430052 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a7c0b34d0 msgr2=0x7f6a7c0cd260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:54:40.642 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.647+0000 7f6a7b7fe640 1 --2- 172.21.15.116:0/1588430052 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a7c0b34d0 0x7f6a7c0cd260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:54:40.642 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.647+0000 7f6a7b7fe640 1 -- 172.21.15.116:0/1588430052 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a7c148ca0 msgr2=0x7f6a7c14f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:54:40.642 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.647+0000 7f6a7b7fe640 1 --2- 172.21.15.116:0/1588430052 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a7c148ca0 0x7f6a7c14f6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:54:40.642 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.647+0000 7f6a7b7fe640 1 -- 172.21.15.116:0/1588430052 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a7c14b3b0 con 0x7f6a7c06e310 2024-02-21T22:54:40.642 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.648+0000 7f6a7b7fe640 1 --2- 172.21.15.116:0/1588430052 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6a7c06e310 0x7f6a7c0b0e90 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f6a6c00c430 tx=0x7f6a6c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:54:40.642 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.648+0000 7f6a63fff640 1 -- 172.21.15.116:0/1588430052 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a6c017070 con 0x7f6a7c06e310 2024-02-21T22:54:40.642 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.648+0000 7f6a63fff640 1 -- 172.21.15.116:0/1588430052 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a6c0052f0 con 0x7f6a7c06e310 2024-02-21T22:54:40.643 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.648+0000 7f6a63fff640 1 -- 172.21.15.116:0/1588430052 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a6c003830 con 0x7f6a7c06e310 2024-02-21T22:54:40.643 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.648+0000 7f6a81cde640 1 -- 172.21.15.116:0/1588430052 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a7c14b690 con 0x7f6a7c06e310 2024-02-21T22:54:40.643 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.648+0000 7f6a81cde640 1 -- 172.21.15.116:0/1588430052 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a7c14bc50 con 0x7f6a7c06e310 2024-02-21T22:54:40.643 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.649+0000 7f6a81cde640 1 -- 172.21.15.116:0/1588430052 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a7c0752f0 con 0x7f6a7c06e310 2024-02-21T22:54:40.643 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.649+0000 7f6a63fff640 1 -- 172.21.15.116:0/1588430052 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f6a6c01a070 con 0x7f6a7c06e310 2024-02-21T22:54:40.644 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.649+0000 7f6a63fff640 1 --2- 172.21.15.116:0/1588430052 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f6a6806b4d0 0x7f6a6806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:54:40.644 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.650+0000 7f6a63fff640 1 -- 172.21.15.116:0/1588430052 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6a6c089480 con 0x7f6a7c06e310 2024-02-21T22:54:40.644 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.650+0000 7f6a7affd640 1 --2- 172.21.15.116:0/1588430052 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f6a6806b4d0 0x7f6a6806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:54:40.644 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.650+0000 7f6a7affd640 1 --2- 172.21.15.116:0/1588430052 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f6a6806b4d0 0x7f6a6806d990 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f6a7c06e180 tx=0x7f6a70007d50 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:54:40.644 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.654+0000 7f6a63fff640 1 -- 172.21.15.116:0/1588430052 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f6a6c057cb0 con 0x7f6a7c06e310 2024-02-21T22:54:40.814 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.824+0000 7f6a81cde640 1 -- 172.21.15.116:0/1588430052 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f6a7c06eb30 con 0x7f6a7c06e310 2024-02-21T22:54:40.817 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.827+0000 7f6a63fff640 1 -- 172.21.15.116:0/1588430052 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v11)=0 v11) v1 ==== 123+0+0 (secure 0 0 0) 0x7f6a6c05bd50 con 0x7f6a7c06e310 2024-02-21T22:54:40.818 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.828+0000 7f6a63fff640 1 -- 172.21.15.116:0/1588430052 <== mon.0 v2:172.21.15.116:3300/0 8 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f6a6c060310 con 0x7f6a7c06e310 2024-02-21T22:54:40.820 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.829+0000 7f6a81cde640 1 -- 172.21.15.116:0/1588430052 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f6a6806b4d0 msgr2=0x7f6a6806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:54:40.820 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.829+0000 7f6a81cde640 1 --2- 172.21.15.116:0/1588430052 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f6a6806b4d0 0x7f6a6806d990 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f6a7c06e180 tx=0x7f6a70007d50 comp rx=0 tx=0).stop 2024-02-21T22:54:40.820 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.829+0000 7f6a81cde640 1 -- 172.21.15.116:0/1588430052 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6a7c06e310 msgr2=0x7f6a7c0b0e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:54:40.820 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.829+0000 7f6a81cde640 1 --2- 172.21.15.116:0/1588430052 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6a7c06e310 0x7f6a7c0b0e90 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f6a6c00c430 tx=0x7f6a6c00c8f0 comp rx=0 tx=0).stop 2024-02-21T22:54:40.821 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.829+0000 7f6a81cde640 1 -- 172.21.15.116:0/1588430052 shutdown_connections 2024-02-21T22:54:40.821 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.829+0000 7f6a81cde640 1 --2- 172.21.15.116:0/1588430052 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a7c148ca0 0x7f6a7c14f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:54:40.821 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.829+0000 7f6a81cde640 1 --2- 172.21.15.116:0/1588430052 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f6a6806b4d0 0x7f6a6806d990 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:54:40.821 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.829+0000 7f6a81cde640 1 --2- 172.21.15.116:0/1588430052 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a7c0b34d0 0x7f6a7c0cd260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:54:40.821 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.830+0000 7f6a81cde640 1 --2- 172.21.15.116:0/1588430052 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6a7c06e310 0x7f6a7c0b0e90 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:54:40.821 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.830+0000 7f6a81cde640 1 -- 172.21.15.116:0/1588430052 >> 172.21.15.116:0/1588430052 conn(0x7f6a7c0b1740 msgr2=0x7f6a7c159fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:54:40.821 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.830+0000 7f6a81cde640 1 -- 172.21.15.116:0/1588430052 shutdown_connections 2024-02-21T22:54:40.821 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.830+0000 7f6a81cde640 1 -- 172.21.15.116:0/1588430052 wait complete. 2024-02-21T22:54:40.831 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-02-21T22:54:40.832 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-21T22:54:40.939 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.942+0000 7f810e26d640 1 Processor -- start 2024-02-21T22:54:40.940 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.942+0000 7f810e26d640 1 -- start start 2024-02-21T22:54:40.940 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.943+0000 7f810e26d640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f810815afb0 0x7f81080af080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:54:40.940 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.943+0000 7f810e26d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8108070b70 0x7f8108071580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:54:40.940 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.943+0000 7f810e26d640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81080710e0 con 0x7f8108071ac0 2024-02-21T22:54:40.940 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.943+0000 7f810e26d640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f810815b390 con 0x7f810815afb0 2024-02-21T22:54:40.940 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.943+0000 7f810e26d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81080713c0 con 0x7f8108070b70 2024-02-21T22:54:40.940 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.943+0000 7f8107fff640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f810815afb0 0x7f81080af080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:54:40.940 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.943+0000 7f810c80a640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f8108071ac0 0x7f81080ad560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.116:43788/0 (socket says 172.21.15.116:43788) 2024-02-21T22:54:40.941 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.943+0000 7f81077fe640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8108070b70 0x7f8108071580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:54:40.941 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.943+0000 7f810c80a640 1 -- 172.21.15.116:0/1960469771 learned_addr learned my addr 172.21.15.116:0/1960469771 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-02-21T22:54:40.941 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.943+0000 7f81077fe640 1 -- 172.21.15.116:0/1960469771 >> v2:172.21.15.142:3300/0 conn(0x7f810815afb0 msgr2=0x7f81080af080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T22:54:40.941 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.943+0000 7f81077fe640 1 --2- 172.21.15.116:0/1960469771 >> v2:172.21.15.142:3300/0 conn(0x7f810815afb0 0x7f81080af080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:54:40.941 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.943+0000 7f81077fe640 1 -- 172.21.15.116:0/1960469771 >> v1:172.21.15.142:6789/0 conn(0x7f8108071ac0 legacy=0x7f81080ad560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:54:40.941 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.944+0000 7f81077fe640 1 -- 172.21.15.116:0/1960469771 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81080b2d80 con 0x7f8108070b70 2024-02-21T22:54:40.941 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.944+0000 7f8107fff640 1 --2- 172.21.15.116:0/1960469771 >> v2:172.21.15.142:3300/0 conn(0x7f810815afb0 0x7f81080af080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T22:54:40.942 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.944+0000 7f81077fe640 1 --2- 172.21.15.116:0/1960469771 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8108070b70 0x7f8108071580 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f80fc0097a0 tx=0x7f80fc02b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3371acd80a4f3681 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:54:40.942 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.944+0000 7f8106ffd640 1 -- 172.21.15.116:0/1960469771 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80fc034070 con 0x7f8108070b70 2024-02-21T22:54:40.942 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.944+0000 7f8106ffd640 1 -- 172.21.15.116:0/1960469771 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f80fc030610 con 0x7f8108070b70 2024-02-21T22:54:40.942 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.945+0000 7f8106ffd640 1 -- 172.21.15.116:0/1960469771 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80fc030a00 con 0x7f8108070b70 2024-02-21T22:54:40.942 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.945+0000 7f810e26d640 1 -- 172.21.15.116:0/1960469771 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8108070b70 msgr2=0x7f8108071580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:54:40.942 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.945+0000 7f810e26d640 1 --2- 172.21.15.116:0/1960469771 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8108070b70 0x7f8108071580 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f80fc0097a0 tx=0x7f80fc02b960 comp rx=0 tx=0).stop 2024-02-21T22:54:40.942 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.945+0000 7f810e26d640 1 -- 172.21.15.116:0/1960469771 shutdown_connections 2024-02-21T22:54:40.943 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.945+0000 7f810e26d640 1 --2- 172.21.15.116:0/1960469771 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8108070b70 0x7f8108071580 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:54:40.943 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.945+0000 7f810e26d640 1 --2- 172.21.15.116:0/1960469771 >> v2:172.21.15.142:3300/0 conn(0x7f810815afb0 0x7f81080af080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:54:40.943 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.945+0000 7f810e26d640 1 -- 172.21.15.116:0/1960469771 >> 172.21.15.116:0/1960469771 conn(0x7f81080b18e0 msgr2=0x7f81080b1cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:54:40.943 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.945+0000 7f810e26d640 1 -- 172.21.15.116:0/1960469771 shutdown_connections 2024-02-21T22:54:40.943 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.945+0000 7f810e26d640 1 -- 172.21.15.116:0/1960469771 wait complete. 2024-02-21T22:54:40.943 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.946+0000 7f810e26d640 1 Processor -- start 2024-02-21T22:54:40.943 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.946+0000 7f810e26d640 1 -- start start 2024-02-21T22:54:40.943 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.947+0000 7f810e26d640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8108070b70 0x7f81080ae8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:54:40.944 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.947+0000 7f810e26d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8108071ac0 0x7f81080ca6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:54:40.944 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.947+0000 7f810e26d640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f810815afb0 0x7f81080cac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:54:40.944 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.947+0000 7f810e26d640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81080af5c0 con 0x7f8108070b70 2024-02-21T22:54:40.944 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.947+0000 7f810e26d640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81080b3340 con 0x7f810815afb0 2024-02-21T22:54:40.944 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.947+0000 7f810e26d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81080b4870 con 0x7f8108071ac0 2024-02-21T22:54:40.944 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.947+0000 7f8107fff640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8108070b70 0x7f81080ae8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:54:40.944 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.947+0000 7f8107fff640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8108070b70 0x7f81080ae8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:33498/0 (socket says 172.21.15.116:33498) 2024-02-21T22:54:40.944 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.947+0000 7f8107fff640 1 -- 172.21.15.116:0/3513279344 learned_addr learned my addr 172.21.15.116:0/3513279344 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-21T22:54:40.945 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.947+0000 7f81077fe640 1 --2- 172.21.15.116:0/3513279344 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8108071ac0 0x7f81080ca6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:54:40.945 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.947+0000 7f810c80a640 1 --2- 172.21.15.116:0/3513279344 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f810815afb0 0x7f81080cac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:54:40.945 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.948+0000 7f8107fff640 1 -- 172.21.15.116:0/3513279344 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8108071ac0 msgr2=0x7f81080ca6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:54:40.945 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.948+0000 7f8107fff640 1 --2- 172.21.15.116:0/3513279344 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8108071ac0 0x7f81080ca6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:54:40.945 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.948+0000 7f8107fff640 1 -- 172.21.15.116:0/3513279344 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f810815afb0 msgr2=0x7f81080cac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:54:40.945 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.948+0000 7f8107fff640 1 --2- 172.21.15.116:0/3513279344 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f810815afb0 0x7f81080cac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:54:40.945 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.948+0000 7f8107fff640 1 -- 172.21.15.116:0/3513279344 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81080ccb00 con 0x7f8108070b70 2024-02-21T22:54:40.945 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.948+0000 7f8107fff640 1 --2- 172.21.15.116:0/3513279344 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8108070b70 0x7f81080ae8c0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f80f800e960 tx=0x7f80f800ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:54:40.946 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.948+0000 7f8104ff9640 1 -- 172.21.15.116:0/3513279344 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80f8017070 con 0x7f8108070b70 2024-02-21T22:54:40.946 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.948+0000 7f8104ff9640 1 -- 172.21.15.116:0/3513279344 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f80f800ca00 con 0x7f8108070b70 2024-02-21T22:54:40.946 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.948+0000 7f8104ff9640 1 -- 172.21.15.116:0/3513279344 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80f800cdf0 con 0x7f8108070b70 2024-02-21T22:54:40.947 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.948+0000 7f810e26d640 1 -- 172.21.15.116:0/3513279344 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81080ccde0 con 0x7f8108070b70 2024-02-21T22:54:40.947 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.948+0000 7f810e26d640 1 -- 172.21.15.116:0/3513279344 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81080cd3a0 con 0x7f8108070b70 2024-02-21T22:54:40.947 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.949+0000 7f810e26d640 1 -- 172.21.15.116:0/3513279344 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81080752f0 con 0x7f8108070b70 2024-02-21T22:54:40.947 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.949+0000 7f8104ff9640 1 -- 172.21.15.116:0/3513279344 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f80f801a070 con 0x7f8108070b70 2024-02-21T22:54:40.948 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.950+0000 7f8104ff9640 1 --2- 172.21.15.116:0/3513279344 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f80f406b4d0 0x7f80f406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T22:54:40.948 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.950+0000 7f8104ff9640 1 -- 172.21.15.116:0/3513279344 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f80f808a480 con 0x7f8108070b70 2024-02-21T22:54:40.948 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.950+0000 7f81077fe640 1 --2- 172.21.15.116:0/3513279344 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f80f406b4d0 0x7f80f406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T22:54:40.948 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.950+0000 7f81077fe640 1 --2- 172.21.15.116:0/3513279344 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f80f406b4d0 0x7f80f406d990 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f80fc036000 tx=0x7f80fc03b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T22:54:40.948 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:40.954+0000 7f8104ff9640 1 -- 172.21.15.116:0/3513279344 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f80f8058c20 con 0x7f8108070b70 2024-02-21T22:54:41.151 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:41.161+0000 7f810e26d640 1 -- 172.21.15.116:0/3513279344 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f81080b2b60 con 0x7f8108070b70 2024-02-21T22:54:41.152 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:41.161+0000 7f8104ff9640 1 -- 172.21.15.116:0/3513279344 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+4943 (secure 0 0 0) 0x7f80f805ccc0 con 0x7f8108070b70 2024-02-21T22:54:41.152 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-02-21T22:54:41.152 INFO:teuthology.orchestra.run.smithi116.stdout:{"epoch":13,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4808,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6834/422696755","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":422696755},{"type":"v1","addr":"172.21.15.116:6834","nonce":422696755}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":4820,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/1258680028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":1258680028},{"type":"v1","addr":"172.21.15.142:6836","nonce":1258680028}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":5097,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6835/758247165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6833","nonce":758247165},{"type":"v1","addr":"172.21.15.116:6835","nonce":758247165}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-21T22:53:42.328760+0000","modified":"2024-02-21T22:53:44.339386+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5098},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5098":{"gid":5098,"name":"d","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6837/3133486359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":3133486359},{"type":"v1","addr":"172.21.15.142:6837","nonce":3133486359}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-02-21T22:54:41.153 INFO:teuthology.orchestra.run.smithi116.stderr:dumped fsmap epoch 13 2024-02-21T22:54:41.154 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:41.163+0000 7f810e26d640 1 -- 172.21.15.116:0/3513279344 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f80f406b4d0 msgr2=0x7f80f406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:54:41.154 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:41.163+0000 7f810e26d640 1 --2- 172.21.15.116:0/3513279344 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f80f406b4d0 0x7f80f406d990 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f80fc036000 tx=0x7f80fc03b040 comp rx=0 tx=0).stop 2024-02-21T22:54:41.154 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:41.163+0000 7f810e26d640 1 -- 172.21.15.116:0/3513279344 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8108070b70 msgr2=0x7f81080ae8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T22:54:41.154 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:41.163+0000 7f810e26d640 1 --2- 172.21.15.116:0/3513279344 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8108070b70 0x7f81080ae8c0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f80f800e960 tx=0x7f80f800ee20 comp rx=0 tx=0).stop 2024-02-21T22:54:41.154 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:41.163+0000 7f810e26d640 1 -- 172.21.15.116:0/3513279344 shutdown_connections 2024-02-21T22:54:41.155 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:41.163+0000 7f810e26d640 1 --2- 172.21.15.116:0/3513279344 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f810815afb0 0x7f81080cac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:54:41.155 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:41.163+0000 7f810e26d640 1 --2- 172.21.15.116:0/3513279344 >> [v2:172.21.15.142:6832/1381484782,v1:172.21.15.142:6833/1381484782] conn(0x7f80f406b4d0 0x7f80f406d990 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:54:41.155 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:41.163+0000 7f810e26d640 1 --2- 172.21.15.116:0/3513279344 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8108071ac0 0x7f81080ca6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:54:41.155 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:41.163+0000 7f810e26d640 1 --2- 172.21.15.116:0/3513279344 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8108070b70 0x7f81080ae8c0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T22:54:41.155 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:41.163+0000 7f810e26d640 1 -- 172.21.15.116:0/3513279344 >> 172.21.15.116:0/3513279344 conn(0x7f81080b18e0 msgr2=0x7f81080b09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T22:54:41.155 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:41.164+0000 7f810e26d640 1 -- 172.21.15.116:0/3513279344 shutdown_connections 2024-02-21T22:54:41.155 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-21T22:54:41.164+0000 7f810e26d640 1 -- 172.21.15.116:0/3513279344 wait complete. 2024-02-21T22:54:41.165 DEBUG:tasks.cephfs.filesystem:already dead... 2024-02-21T22:54:41.165 INFO:teuthology.misc:Shutting down mds daemons... 2024-02-21T22:54:41.165 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-02-21T22:54:41.165 INFO:teuthology.orchestra.run:waiting for 300 2024-02-21T22:54:41.176 INFO:tasks.ceph.mds.a:Stopped 2024-02-21T22:54:41.177 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-02-21T22:54:41.177 INFO:teuthology.orchestra.run:waiting for 300 2024-02-21T22:54:41.224 INFO:tasks.ceph.mds.c:Stopped 2024-02-21T22:54:41.225 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-02-21T22:54:41.225 INFO:teuthology.orchestra.run:waiting for 300 2024-02-21T22:54:41.234 INFO:tasks.ceph.mds.b:Stopped 2024-02-21T22:54:41.234 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-02-21T22:54:41.234 INFO:teuthology.orchestra.run:waiting for 300 2024-02-21T22:54:41.285 INFO:tasks.ceph.mds.d:Stopped 2024-02-21T22:54:41.285 INFO:teuthology.misc:Shutting down osd daemons... 2024-02-21T22:54:41.285 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-02-21T22:54:41.285 INFO:teuthology.orchestra.run:waiting for 300 2024-02-21T22:54:41.316 INFO:tasks.ceph.osd.0:Stopped 2024-02-21T22:54:41.316 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-02-21T22:54:41.316 INFO:teuthology.orchestra.run:waiting for 300 2024-02-21T22:54:41.383 INFO:tasks.ceph.osd.1:Stopped 2024-02-21T22:54:41.384 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-02-21T22:54:41.384 INFO:teuthology.orchestra.run:waiting for 300 2024-02-21T22:54:41.448 INFO:tasks.ceph.osd.2:Stopped 2024-02-21T22:54:41.448 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-02-21T22:54:41.448 INFO:teuthology.orchestra.run:waiting for 300 2024-02-21T22:54:41.516 INFO:tasks.ceph.osd.3:Stopped 2024-02-21T22:54:41.516 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-02-21T22:54:41.516 INFO:teuthology.orchestra.run:waiting for 300 2024-02-21T22:54:41.553 INFO:tasks.ceph.osd.4:Stopped 2024-02-21T22:54:41.554 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-02-21T22:54:41.554 INFO:teuthology.orchestra.run:waiting for 300 2024-02-21T22:54:41.623 INFO:tasks.ceph.osd.5:Stopped 2024-02-21T22:54:41.623 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-02-21T22:54:41.624 INFO:teuthology.orchestra.run:waiting for 300 2024-02-21T22:54:41.688 INFO:tasks.ceph.osd.6:Stopped 2024-02-21T22:54:41.689 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-02-21T22:54:41.689 INFO:teuthology.orchestra.run:waiting for 300 2024-02-21T22:54:41.754 INFO:tasks.ceph.osd.7:Stopped 2024-02-21T22:54:41.754 INFO:teuthology.misc:Shutting down mgr daemons... 2024-02-21T22:54:41.755 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-02-21T22:54:41.755 INFO:teuthology.orchestra.run:waiting for 300 2024-02-21T22:54:41.779 INFO:tasks.ceph.mgr.y:Stopped 2024-02-21T22:54:41.779 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-02-21T22:54:41.779 INFO:teuthology.orchestra.run:waiting for 300 2024-02-21T22:54:41.822 INFO:tasks.ceph.mgr.x:Stopped 2024-02-21T22:54:41.822 INFO:teuthology.misc:Shutting down mon daemons... 2024-02-21T22:54:41.822 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-02-21T22:54:41.823 INFO:teuthology.orchestra.run:waiting for 300 2024-02-21T22:54:41.833 INFO:tasks.ceph.mon.a:Stopped 2024-02-21T22:54:41.833 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-02-21T22:54:41.833 INFO:teuthology.orchestra.run:waiting for 300 2024-02-21T22:54:41.873 INFO:tasks.ceph.mon.b:Stopped 2024-02-21T22:54:41.873 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-02-21T22:54:41.874 INFO:teuthology.orchestra.run:waiting for 300 2024-02-21T22:54:41.924 INFO:tasks.ceph.mon.c:Stopped 2024-02-21T22:54:41.925 INFO:tasks.ceph:Checking cluster log for badness... 2024-02-21T22:54:41.925 DEBUG:teuthology.orchestra.run.smithi116:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2024-02-21T22:54:41.955 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi116.front.sepia.ceph.com 2024-02-21T22:54:41.956 DEBUG:teuthology.orchestra.run.smithi116:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-02-21T22:54:42.196 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi116.front.sepia.ceph.com 2024-02-21T22:54:42.196 DEBUG:teuthology.orchestra.run.smithi116:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-02-21T22:54:42.295 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi116.front.sepia.ceph.com 2024-02-21T22:54:42.295 DEBUG:teuthology.orchestra.run.smithi116:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-02-21T22:54:42.360 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi116.front.sepia.ceph.com 2024-02-21T22:54:42.360 DEBUG:teuthology.orchestra.run.smithi116:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-02-21T22:54:42.411 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi142.front.sepia.ceph.com 2024-02-21T22:54:42.412 DEBUG:teuthology.orchestra.run.smithi142:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-02-21T22:54:42.587 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi142.front.sepia.ceph.com 2024-02-21T22:54:42.587 DEBUG:teuthology.orchestra.run.smithi142:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-02-21T22:54:42.701 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi142.front.sepia.ceph.com 2024-02-21T22:54:42.701 DEBUG:teuthology.orchestra.run.smithi142:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-02-21T22:54:42.768 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi142.front.sepia.ceph.com 2024-02-21T22:54:42.768 DEBUG:teuthology.orchestra.run.smithi142:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-02-21T22:54:42.826 INFO:tasks.ceph:Archiving mon data... 2024-02-21T22:54:42.827 DEBUG:teuthology.misc:Transferring archived files from smithi116:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/leonidus-2024-02-21_22:31:03-fs-wip-lusov-qdb-distro-default-smithi/7569994/data/mon.a.tgz 2024-02-21T22:54:42.827 DEBUG:teuthology.orchestra.run.smithi116:> mktemp 2024-02-21T22:54:42.843 INFO:teuthology.orchestra.run.smithi116.stdout:/tmp/tmp.MEVLcIO7Yt 2024-02-21T22:54:42.843 DEBUG:teuthology.orchestra.run.smithi116:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.MEVLcIO7Yt 2024-02-21T22:54:42.977 DEBUG:teuthology.orchestra.run.smithi116:> sudo chmod 0666 /tmp/tmp.MEVLcIO7Yt 2024-02-21T22:54:43.062 DEBUG:teuthology.orchestra.remote:smithi116:/tmp/tmp.MEVLcIO7Yt is 279KB 2024-02-21T22:54:43.158 DEBUG:teuthology.orchestra.run.smithi116:> rm -fr /tmp/tmp.MEVLcIO7Yt 2024-02-21T22:54:43.172 DEBUG:teuthology.misc:Transferring archived files from smithi142:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/leonidus-2024-02-21_22:31:03-fs-wip-lusov-qdb-distro-default-smithi/7569994/data/mon.b.tgz 2024-02-21T22:54:43.172 DEBUG:teuthology.orchestra.run.smithi142:> mktemp 2024-02-21T22:54:43.190 INFO:teuthology.orchestra.run.smithi142.stdout:/tmp/tmp.BLXLe92q8k 2024-02-21T22:54:43.191 DEBUG:teuthology.orchestra.run.smithi142:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.BLXLe92q8k 2024-02-21T22:54:43.343 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 0666 /tmp/tmp.BLXLe92q8k 2024-02-21T22:54:43.429 DEBUG:teuthology.orchestra.remote:smithi142:/tmp/tmp.BLXLe92q8k is 378KB 2024-02-21T22:54:43.526 DEBUG:teuthology.orchestra.run.smithi142:> rm -fr /tmp/tmp.BLXLe92q8k 2024-02-21T22:54:43.541 DEBUG:teuthology.misc:Transferring archived files from smithi142:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/leonidus-2024-02-21_22:31:03-fs-wip-lusov-qdb-distro-default-smithi/7569994/data/mon.c.tgz 2024-02-21T22:54:43.541 DEBUG:teuthology.orchestra.run.smithi142:> mktemp 2024-02-21T22:54:43.595 INFO:teuthology.orchestra.run.smithi142.stdout:/tmp/tmp.2rpYOoKcrp 2024-02-21T22:54:43.596 DEBUG:teuthology.orchestra.run.smithi142:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.2rpYOoKcrp 2024-02-21T22:54:43.732 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 0666 /tmp/tmp.2rpYOoKcrp 2024-02-21T22:54:43.816 DEBUG:teuthology.orchestra.remote:smithi142:/tmp/tmp.2rpYOoKcrp is 378KB 2024-02-21T22:54:43.912 DEBUG:teuthology.orchestra.run.smithi142:> rm -fr /tmp/tmp.2rpYOoKcrp 2024-02-21T22:54:43.926 INFO:tasks.ceph:Cleaning ceph cluster... 2024-02-21T22:54:43.927 DEBUG:teuthology.orchestra.run.smithi116:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-02-21T22:54:43.929 DEBUG:teuthology.orchestra.run.smithi142:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-02-21T22:54:44.012 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-02-21T22:54:44.047 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-02-21T22:54:44.047 INFO:tasks.ceph:Archiving crash dumps... 2024-02-21T22:54:44.049 DEBUG:teuthology.misc:Transferring archived files from smithi116:/var/lib/ceph/crash to /home/teuthworker/archive/leonidus-2024-02-21_22:31:03-fs-wip-lusov-qdb-distro-default-smithi/7569994/remote/smithi116/crash 2024-02-21T22:54:44.050 DEBUG:teuthology.orchestra.run.smithi116:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-02-21T22:54:44.080 DEBUG:teuthology.misc:Transferring archived files from smithi142:/var/lib/ceph/crash to /home/teuthworker/archive/leonidus-2024-02-21_22:31:03-fs-wip-lusov-qdb-distro-default-smithi/7569994/remote/smithi142/crash 2024-02-21T22:54:44.081 DEBUG:teuthology.orchestra.run.smithi142:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-02-21T22:54:44.113 INFO:tasks.ceph:Shutting down logrotate 2024-02-21T22:54:44.113 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T22:54:44.125 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T22:54:44.203 DEBUG:teuthology.orchestra.run.smithi116:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-02-21T22:54:44.231 DEBUG:teuthology.orchestra.run.smithi142:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-02-21T22:54:44.257 INFO:tasks.ceph:Compressing logs... 2024-02-21T22:54:44.258 DEBUG:teuthology.orchestra.run.smithi116:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-02-21T22:54:44.274 DEBUG:teuthology.orchestra.run.smithi142:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-02-21T22:54:44.365 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-02-21T22:54:44.365 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37453.log 2024-02-21T22:54:44.365 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37533.log 2024-02-21T22:54:44.366 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.37453.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37333.log 2024-02-21T22:54:44.366 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.37533.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.37453.log.gz 2024-02-21T22:54:44.366 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.43516.log 2024-02-21T22:54:44.366 INFO:teuthology.orchestra.run.smithi142.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.37533.log.gz 2024-02-21T22:54:44.367 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.37333.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.43908.log 2024-02-21T22:54:44.367 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.1.43516.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.37333.log.gz 2024-02-21T22:54:44.367 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-02-21T22:54:44.367 INFO:teuthology.orchestra.run.smithi142.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.43516.log.gz 2024-02-21T22:54:44.368 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.3.43908.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.3.43908.log.gz 2024-02-21T22:54:44.368 INFO:teuthology.orchestra.run.smithi142.stderr: --verbose -- /var/log/ceph/ceph-mds.b.log 2024-02-21T22:54:44.368 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-02-21T22:54:44.368 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-02-21T22:54:44.369 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-02-21T22:54:44.369 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-02-21T22:54:44.369 INFO:teuthology.orchestra.run.smithi142.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-02-21T22:54:44.369 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37373.log 2024-02-21T22:54:44.370 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37413.log 2024-02-21T22:54:44.370 INFO:teuthology.orchestra.run.smithi142.stderr: 93.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-02-21T22:54:44.370 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.37373.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-02-21T22:54:44.370 INFO:teuthology.orchestra.run.smithi142.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.37373.log.gz/var/log/ceph/ceph-client.admin.37413.log: 2024-02-21T22:54:44.371 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-02-21T22:54:44.371 INFO:teuthology.orchestra.run.smithi142.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.37413.log.gz 2024-02-21T22:54:44.371 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37293.log 2024-02-21T22:54:44.371 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37573.log 2024-02-21T22:54:44.372 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.37293.log: 91.6% -- replaced with /var/log/ceph/ceph.log.gz 2024-02-21T22:54:44.372 INFO:teuthology.orchestra.run.smithi142.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.37293.log.gz 2024-02-21T22:54:44.372 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37493.log 2024-02-21T22:54:44.373 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.37573.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-02-21T22:54:44.373 INFO:teuthology.orchestra.run.smithi142.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.37573.log.gz 2024-02-21T22:54:44.373 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.37493.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-02-21T22:54:44.373 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-mds.d.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.37493.log.gz 2024-02-21T22:54:44.380 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-mon.c.log: 91.6% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-02-21T22:54:44.401 INFO:teuthology.orchestra.run.smithi142.stderr: 94.5% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-02-21T22:54:44.406 INFO:teuthology.orchestra.run.smithi142.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-02-21T22:54:44.414 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45631.log 2024-02-21T22:54:44.414 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46873.log 2024-02-21T22:54:44.414 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.45631.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49444.log 2024-02-21T22:54:44.414 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.46873.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52435.log 2024-02-21T22:54:44.415 INFO:teuthology.orchestra.run.smithi116.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45631.log.gz 2024-02-21T22:54:44.415 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.49444.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46873.log.gz 2024-02-21T22:54:44.415 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51146.log 2024-02-21T22:54:44.415 INFO:teuthology.orchestra.run.smithi116.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49444.log.gz 2024-02-21T22:54:44.415 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.52435.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-02-21T22:54:44.415 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.51146.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44833.log 2024-02-21T22:54:44.415 INFO:teuthology.orchestra.run.smithi116.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.52435.log.gz 2024-02-21T22:54:44.415 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- 88.7% /var/log/ceph/ceph-client.admin.50426.log -- replaced with /var/log/ceph/ceph-client.admin.51146.log.gz 2024-02-21T22:54:44.416 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-02-21T22:54:44.416 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.44833.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42953.log 2024-02-21T22:54:44.416 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.50426.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.44833.log.gz 2024-02-21T22:54:44.416 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52248.log 2024-02-21T22:54:44.416 INFO:teuthology.orchestra.run.smithi116.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.50426.log.gz 2024-02-21T22:54:44.416 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.42953.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.31089.log 2024-02-21T22:54:44.416 INFO:teuthology.orchestra.run.smithi116.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42953.log.gz 2024-02-21T22:54:44.416 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.52248.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45673.log 2024-02-21T22:54:44.417 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph.tmp-client.admin.31089.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.52248.log.gz 2024-02-21T22:54:44.417 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50594.log 2024-02-21T22:54:44.417 INFO:teuthology.orchestra.run.smithi116.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.31089.log.gz 2024-02-21T22:54:44.417 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.45673.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50552.log 2024-02-21T22:54:44.417 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.50594.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44119.log 2024-02-21T22:54:44.417 INFO:teuthology.orchestra.run.smithi116.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45673.log.gz 2024-02-21T22:54:44.417 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.50552.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52027.log 2024-02-21T22:54:44.417 INFO:teuthology.orchestra.run.smithi116.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.50594.log.gz 2024-02-21T22:54:44.418 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.44119.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.50552.log.gz 2024-02-21T22:54:44.418 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48172.log 2024-02-21T22:54:44.418 INFO:teuthology.orchestra.run.smithi116.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44119.log.gz 2024-02-21T22:54:44.418 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48514.log 2024-02-21T22:54:44.418 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.52027.log: /var/log/ceph/ceph-client.admin.48172.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52070.log 2024-02-21T22:54:44.418 INFO:teuthology.orchestra.run.smithi116.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.52027.log.gz 2024-02-21T22:54:44.418 INFO:teuthology.orchestra.run.smithi116.stderr: 87.9%gzip -- replaced with /var/log/ceph/ceph-client.admin.48172.log.gz 2024-02-21T22:54:44.418 INFO:teuthology.orchestra.run.smithi116.stderr: -5/var/log/ceph/ceph-client.admin.48514.log: --verbose -- /var/log/ceph/ceph-client.admin.50282.log 2024-02-21T22:54:44.419 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.52070.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45211.log 2024-02-21T22:54:44.419 INFO:teuthology.orchestra.run.smithi116.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48514.log.gz 2024-02-21T22:54:44.419 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.50282.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.52070.log.gz 2024-02-21T22:54:44.419 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44635.log 2024-02-21T22:54:44.419 INFO:teuthology.orchestra.run.smithi116.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.50282.log.gz 2024-02-21T22:54:44.419 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37533.log/var/log/ceph/ceph-client.admin.45211.log: 2024-02-21T22:54:44.419 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.44635.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48897.log 2024-02-21T22:54:44.419 INFO:teuthology.orchestra.run.smithi116.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45211.log.gz 2024-02-21T22:54:44.419 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.37533.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.44635.log.gz 2024-02-21T22:54:44.420 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51901.log 2024-02-21T22:54:44.420 INFO:teuthology.orchestra.run.smithi116.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.37533.log.gz 2024-02-21T22:54:44.420 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.48897.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48052.log 2024-02-21T22:54:44.420 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.51901.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.48897.log.gz 2024-02-21T22:54:44.420 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42872.log 2024-02-21T22:54:44.420 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.48052.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.51901.log.gz 2024-02-21T22:54:44.420 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48214.log 2024-02-21T22:54:44.420 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.42872.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.48052.log.gz 2024-02-21T22:54:44.421 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43359.log 2024-02-21T22:54:44.421 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.48214.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.42872.log.gz 2024-02-21T22:54:44.421 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44293.log 2024-02-21T22:54:44.421 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.43359.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48214.log.gz 2024-02-21T22:54:44.421 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51733.log 2024-02-21T22:54:44.421 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.44293.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43359.log.gz 2024-02-21T22:54:44.421 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48761.log 2024-02-21T22:54:44.421 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.51733.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44293.log.gz 2024-02-21T22:54:44.422 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45421.log 2024-02-21T22:54:44.422 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.48761.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.51733.log.gz 2024-02-21T22:54:44.422 INFO:teuthology.orchestra.run.smithi116.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.48761.log.gz 2024-02-21T22:54:44.422 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45253.log 2024-02-21T22:54:44.422 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.45421.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49402.log 2024-02-21T22:54:44.422 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.45253.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43573.log 2024-02-21T22:54:44.422 INFO:teuthology.orchestra.run.smithi116.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45421.log.gz 2024-02-21T22:54:44.422 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.49402.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45253.log.gz 2024-02-21T22:54:44.422 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50384.log 2024-02-21T22:54:44.423 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.43573.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49402.log.gz 2024-02-21T22:54:44.423 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43275.log 2024-02-21T22:54:44.423 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.50384.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.43573.log.gz 2024-02-21T22:54:44.423 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49108.log 2024-02-21T22:54:44.423 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.43275.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.50384.log.gz 2024-02-21T22:54:44.423 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44965.log 2024-02-21T22:54:44.423 INFO:teuthology.orchestra.run.smithi116.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43275.log.gz 2024-02-21T22:54:44.423 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.49108.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47968.log 2024-02-21T22:54:44.423 INFO:teuthology.orchestra.run.smithi116.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49108.log.gz 2024-02-21T22:54:44.424 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.44965.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47563.log 2024-02-21T22:54:44.424 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.47968.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44965.log.gz 2024-02-21T22:54:44.424 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.2.46701.log 2024-02-21T22:54:44.424 INFO:teuthology.orchestra.run.smithi116.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.47968.log.gz 2024-02-21T22:54:44.424 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.47563.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47731.log 2024-02-21T22:54:44.424 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.2.46701.log: 88.4%gzip -- replaced with /var/log/ceph/ceph-client.admin.47563.log.gz 2024-02-21T22:54:44.424 INFO:teuthology.orchestra.run.smithi116.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.45379.log 2024-02-21T22:54:44.424 INFO:teuthology.orchestra.run.smithi116.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.2.46701.log.gz 2024-02-21T22:54:44.425 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.47731.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48340.log 2024-02-21T22:54:44.425 INFO:teuthology.orchestra.run.smithi116.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47731.log.gz 2024-02-21T22:54:44.425 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.45379.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50240.log 2024-02-21T22:54:44.425 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.48340.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45379.log.gz 2024-02-21T22:54:44.425 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49024.log 2024-02-21T22:54:44.425 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.50240.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48340.log.gz 2024-02-21T22:54:44.425 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43489.log 2024-02-21T22:54:44.425 INFO:teuthology.orchestra.run.smithi116.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.50240.log.gz 2024-02-21T22:54:44.426 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.49024.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45463.log 2024-02-21T22:54:44.426 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.43489.log: gzip -5 --verbose 88.2% -- /var/log/ceph/ceph-client.admin.51859.log -- replaced with /var/log/ceph/ceph-client.admin.49024.log.gz 2024-02-21T22:54:44.426 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-02-21T22:54:44.426 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.45463.log: 88.3%gzip -- replaced with /var/log/ceph/ceph-client.admin.43489.log.gz 2024-02-21T22:54:44.426 INFO:teuthology.orchestra.run.smithi116.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.51188.log 2024-02-21T22:54:44.426 INFO:teuthology.orchestra.run.smithi116.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45463.log.gz 2024-02-21T22:54:44.426 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.51859.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49192.log 2024-02-21T22:54:44.426 INFO:teuthology.orchestra.run.smithi116.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.51859.log.gz 2024-02-21T22:54:44.427 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.51188.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51230.log 2024-02-21T22:54:44.427 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.49192.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.51188.log.gz 2024-02-21T22:54:44.427 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47017.log 2024-02-21T22:54:44.427 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.51230.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49192.log.gz 2024-02-21T22:54:44.427 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47101.log 2024-02-21T22:54:44.427 INFO:teuthology.orchestra.run.smithi116.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.51230.log.gz 2024-02-21T22:54:44.427 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.47017.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43699.log 2024-02-21T22:54:44.427 INFO:teuthology.orchestra.run.smithi116.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47017.log.gz 2024-02-21T22:54:44.428 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.47101.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43783.log 2024-02-21T22:54:44.428 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.43699.log: gzip -5 --verbose 88.3% -- /var/log/ceph/ceph-client.admin.48940.log -- replaced with /var/log/ceph/ceph-client.admin.47101.log.gz 2024-02-21T22:54:44.428 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-02-21T22:54:44.428 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.43783.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43699.log.gz 2024-02-21T22:54:44.428 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52290.log 2024-02-21T22:54:44.428 INFO:teuthology.orchestra.run.smithi116.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43783.log.gz 2024-02-21T22:54:44.428 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.48940.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50510.log 2024-02-21T22:54:44.428 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.52290.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48940.log.gz 2024-02-21T22:54:44.429 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51607.log 2024-02-21T22:54:44.429 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.50510.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43825.log 87.4% 2024-02-21T22:54:44.429 INFO:teuthology.orchestra.run.smithi116.stderr: -- replaced with /var/log/ceph/ceph-client.admin.52290.log.gz 2024-02-21T22:54:44.429 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.51607.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.50510.log.gz 2024-02-21T22:54:44.429 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49318.log 2024-02-21T22:54:44.429 INFO:teuthology.orchestra.run.smithi116.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.51607.log.gz 2024-02-21T22:54:44.429 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.43825.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44634.log 2024-02-21T22:54:44.429 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.49318.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43825.log.gz 2024-02-21T22:54:44.430 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51272.log 2024-02-21T22:54:44.430 INFO:teuthology.orchestra.run.smithi116.stderr: 88.5%/var/log/ceph/ceph-client.admin.44634.log: -- replaced with /var/log/ceph/ceph-client.admin.49318.log.gz 2024-02-21T22:54:44.430 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43401.log 2024-02-21T22:54:44.430 INFO:teuthology.orchestra.run.smithi116.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44634.log.gz 2024-02-21T22:54:44.430 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.51272.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52475.log 2024-02-21T22:54:44.430 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.43401.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.51272.log.gz 2024-02-21T22:54:44.430 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47479.log 2024-02-21T22:54:44.430 INFO:teuthology.orchestra.run.smithi116.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43401.log.gz 2024-02-21T22:54:44.431 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.52475.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49234.log 2024-02-21T22:54:44.431 INFO:teuthology.orchestra.run.smithi116.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.52475.log.gz 2024-02-21T22:54:44.431 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.47479.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44295.log 2024-02-21T22:54:44.431 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.49234.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47479.log.gz 2024-02-21T22:54:44.431 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51481.log 2024-02-21T22:54:44.431 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.44295.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49234.log.gz 2024-02-21T22:54:44.431 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43445.log 2024-02-21T22:54:44.431 INFO:teuthology.orchestra.run.smithi116.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.44295.log.gz 2024-02-21T22:54:44.432 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.51481.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49774.log 2024-02-21T22:54:44.432 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.43445.log: 87.4%gzip -- replaced with /var/log/ceph/ceph-client.admin.51481.log.gz 2024-02-21T22:54:44.432 INFO:teuthology.orchestra.run.smithi116.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.48472.log 2024-02-21T22:54:44.432 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.49774.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43445.log.gz 2024-02-21T22:54:44.432 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46933.log 2024-02-21T22:54:44.432 INFO:teuthology.orchestra.run.smithi116.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.49774.log.gz 2024-02-21T22:54:44.432 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.48472.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45295.log 2024-02-21T22:54:44.432 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.46933.log: gzip 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48472.log.gz -5 2024-02-21T22:54:44.432 INFO:teuthology.orchestra.run.smithi116.stderr: --verbose -- /var/log/ceph/ceph.audit.log 2024-02-21T22:54:44.433 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.45295.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46933.log.gz 2024-02-21T22:54:44.433 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37414.log 2024-02-21T22:54:44.433 INFO:teuthology.orchestra.run.smithi116.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45295.log.gz 2024-02-21T22:54:44.433 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44964.log 2024-02-21T22:54:44.433 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.37414.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48010.log 2024-02-21T22:54:44.433 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.44964.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.37414.log.gz 2024-02-21T22:54:44.433 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47647.log 2024-02-21T22:54:44.433 INFO:teuthology.orchestra.run.smithi116.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44964.log.gz 2024-02-21T22:54:44.434 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.48010.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50342.log 2024-02-21T22:54:44.434 INFO:teuthology.orchestra.run.smithi116.stderr: 89.0% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-02-21T22:54:44.434 INFO:teuthology.orchestra.run.smithi116.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48010.log.gz 2024-02-21T22:54:44.434 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.47647.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45337.log 2024-02-21T22:54:44.434 INFO:teuthology.orchestra.run.smithi116.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.47647.log.gz 2024-02-21T22:54:44.434 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.50342.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44969.log 2024-02-21T22:54:44.434 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.45337.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.50342.log.gz 2024-02-21T22:54:44.434 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44301.log 2024-02-21T22:54:44.434 INFO:teuthology.orchestra.run.smithi116.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45337.log.gz 2024-02-21T22:54:44.435 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.44969.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43233.log 2024-02-21T22:54:44.435 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.44301.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.44969.log.gz 2024-02-21T22:54:44.435 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48256.log 2024-02-21T22:54:44.435 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.43233.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47227.log 2024-02-21T22:54:44.435 INFO:teuthology.orchestra.run.smithi116.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44301.log.gz 2024-02-21T22:54:44.435 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.48256.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.43233.log.gz 2024-02-21T22:54:44.435 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49984.log 2024-02-21T22:54:44.435 INFO:teuthology.orchestra.run.smithi116.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48256.log.gz 2024-02-21T22:54:44.436 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.47227.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50114.log 2024-02-21T22:54:44.436 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.49984.log: 88.3%gzip -- replaced with /var/log/ceph/ceph-client.admin.47227.log.gz 2024-02-21T22:54:44.436 INFO:teuthology.orchestra.run.smithi116.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.50026.log 2024-02-21T22:54:44.436 INFO:teuthology.orchestra.run.smithi116.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.49984.log.gz 2024-02-21T22:54:44.436 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.50114.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44973.log 2024-02-21T22:54:44.436 INFO:teuthology.orchestra.run.smithi116.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.50114.log.gz 2024-02-21T22:54:44.436 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.50026.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46975.log 2024-02-21T22:54:44.436 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.44973.log: 87.7%gzip -- replaced with /var/log/ceph/ceph-client.admin.50026.log.gz 2024-02-21T22:54:44.436 INFO:teuthology.orchestra.run.smithi116.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.52112.log 2024-02-21T22:54:44.437 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.46975.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.44973.log.gz 2024-02-21T22:54:44.437 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.46270.log 2024-02-21T22:54:44.437 INFO:teuthology.orchestra.run.smithi116.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46975.log.gz 2024-02-21T22:54:44.437 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.52112.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44077.log 2024-02-21T22:54:44.437 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.0.46270.log: 88.1%gzip -- replaced with /var/log/ceph/ceph-client.admin.52112.log.gz -5 2024-02-21T22:54:44.437 INFO:teuthology.orchestra.run.smithi116.stderr: --verbose -- /var/log/ceph/ceph-client.admin.45757.log 2024-02-21T22:54:44.437 INFO:teuthology.orchestra.run.smithi116.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.46270.log.gz 2024-02-21T22:54:44.437 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.44077.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45799.log 2024-02-21T22:54:44.438 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.45757.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44077.log.gz 2024-02-21T22:54:44.438 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43130.log 2024-02-21T22:54:44.438 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.45799.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45757.log.gz 2024-02-21T22:54:44.438 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-02-21T22:54:44.438 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.43130.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44971.log 2024-02-21T22:54:44.438 INFO:teuthology.orchestra.run.smithi116.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43130.log.gz 2024-02-21T22:54:44.438 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-osd.1.log: 91.5% -- replaced with /var/log/ceph/ceph-client.admin.45799.log.gz 2024-02-21T22:54:44.439 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50070.log 2024-02-21T22:54:44.439 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.44971.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45715.log 2024-02-21T22:54:44.439 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.50070.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.44971.log.gz 2024-02-21T22:54:44.439 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47059.log 2024-02-21T22:54:44.439 INFO:teuthology.orchestra.run.smithi116.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.50070.log.gz 2024-02-21T22:54:44.439 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.50847.log 2024-02-21T22:54:44.439 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.45715.log: /var/log/ceph/ceph-client.admin.47059.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43531.log 2024-02-21T22:54:44.439 INFO:teuthology.orchestra.run.smithi116.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45715.log.gz 2024-02-21T22:54:44.439 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.0.50847.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.50847.log.gz 2024-02-21T22:54:44.440 INFO:teuthology.orchestra.run.smithi116.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47059.log.gz 2024-02-21T22:54:44.440 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47311.log 2024-02-21T22:54:44.440 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.43531.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48298.log 2024-02-21T22:54:44.440 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.47311.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43531.log.gz 2024-02-21T22:54:44.440 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47353.log 2024-02-21T22:54:44.440 INFO:teuthology.orchestra.run.smithi116.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47311.log.gz 2024-02-21T22:54:44.440 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52162.log 2024-02-21T22:54:44.440 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.48298.log: /var/log/ceph/ceph-client.admin.47353.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50468.log 2024-02-21T22:54:44.441 INFO:teuthology.orchestra.run.smithi116.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48298.log.gz 2024-02-21T22:54:44.441 INFO:teuthology.orchestra.run.smithi116.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47353.log.gz 2024-02-21T22:54:44.441 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.52162.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49605.log 2024-02-21T22:54:44.441 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.50468.log: /var/log/ceph/ceph-client.admin.49276.log 2024-02-21T22:54:44.441 INFO:teuthology.orchestra.run.smithi116.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.52162.log.gz 2024-02-21T22:54:44.441 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.49605.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.50468.log.gzgzip 2024-02-21T22:54:44.441 INFO:teuthology.orchestra.run.smithi116.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.49732.log 2024-02-21T22:54:44.441 INFO:teuthology.orchestra.run.smithi116.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.49605.log.gz 2024-02-21T22:54:44.442 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47815.log 2024-02-21T22:54:44.442 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.49276.log: /var/log/ceph/ceph-client.admin.49732.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45169.log 2024-02-21T22:54:44.442 INFO:teuthology.orchestra.run.smithi116.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49276.log.gz 2024-02-21T22:54:44.442 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.47815.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49732.log.gz 2024-02-21T22:54:44.442 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45589.log 2024-02-21T22:54:44.442 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.45169.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47815.log.gz 2024-02-21T22:54:44.442 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48598.log 2024-02-21T22:54:44.442 INFO:teuthology.orchestra.run.smithi116.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.45169.log.gz 2024-02-21T22:54:44.442 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.45589.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49150.log 2024-02-21T22:54:44.443 INFO:teuthology.orchestra.run.smithi116.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45589.log.gz 2024-02-21T22:54:44.443 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51649.log 2024-02-21T22:54:44.443 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.48598.log: /var/log/ceph/ceph-client.admin.49150.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-02-21T22:54:44.443 INFO:teuthology.orchestra.run.smithi116.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48598.log.gz 2024-02-21T22:54:44.443 INFO:teuthology.orchestra.run.smithi116.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49150.log.gz 2024-02-21T22:54:44.443 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.51649.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44299.log 2024-02-21T22:54:44.443 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43951.log 2024-02-21T22:54:44.443 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-osd.3.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.51649.log.gz 2024-02-21T22:54:44.444 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.44299.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45547.log 2024-02-21T22:54:44.444 INFO:teuthology.orchestra.run.smithi116.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.44299.log.gz 2024-02-21T22:54:44.444 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.43951.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47269.log 2024-02-21T22:54:44.444 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.45547.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43951.log.gz 2024-02-21T22:54:44.444 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44636.log 2024-02-21T22:54:44.444 INFO:teuthology.orchestra.run.smithi116.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45547.log.gz 2024-02-21T22:54:44.444 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.47269.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48556.log 2024-02-21T22:54:44.444 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.44636.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52204.log 2024-02-21T22:54:44.445 INFO:teuthology.orchestra.run.smithi116.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47269.log.gz 2024-02-21T22:54:44.445 INFO:teuthology.orchestra.run.smithi116.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44636.log.gz 2024-02-21T22:54:44.445 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.48556.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44629.log 2024-02-21T22:54:44.445 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.52204.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.48556.log.gz 2024-02-21T22:54:44.445 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44035.log 2024-02-21T22:54:44.445 INFO:teuthology.orchestra.run.smithi116.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.52204.log.gz 2024-02-21T22:54:44.445 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.44629.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43867.log 2024-02-21T22:54:44.445 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.44035.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44629.log.gz 2024-02-21T22:54:44.446 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52517.log 2024-02-21T22:54:44.446 INFO:teuthology.orchestra.run.smithi116.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44035.log.gz 2024-02-21T22:54:44.446 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.43867.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49816.log 2024-02-21T22:54:44.446 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.52517.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47437.log 2024-02-21T22:54:44.446 INFO:teuthology.orchestra.run.smithi116.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43867.log.gz 2024-02-21T22:54:44.446 INFO:teuthology.orchestra.run.smithi116.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.52517.log.gz 2024-02-21T22:54:44.446 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.49816.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49360.log 2024-02-21T22:54:44.446 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.47437.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50660.log 2024-02-21T22:54:44.446 INFO:teuthology.orchestra.run.smithi116.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49816.log.gz 2024-02-21T22:54:44.447 INFO:teuthology.orchestra.run.smithi116.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47437.log.gz 2024-02-21T22:54:44.447 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.49360.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49524.log 2024-02-21T22:54:44.447 INFO:teuthology.orchestra.run.smithi116.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.49360.log.gz 2024-02-21T22:54:44.447 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.50660.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52393.log 2024-02-21T22:54:44.447 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43993.log 2024-02-21T22:54:44.447 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.49524.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.50660.log.gz 2024-02-21T22:54:44.447 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.52393.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51817.log 2024-02-21T22:54:44.447 INFO:teuthology.orchestra.run.smithi116.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.49524.log.gz 2024-02-21T22:54:44.447 INFO:teuthology.orchestra.run.smithi116.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.52393.log.gz 2024-02-21T22:54:44.448 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.43993.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37164.log 2024-02-21T22:54:44.448 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.51817.log: gzip -5 --verbose 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43993.log.gz 2024-02-21T22:54:44.448 INFO:teuthology.orchestra.run.smithi116.stderr: -- /var/log/ceph/ceph-client.admin.47773.log 2024-02-21T22:54:44.448 INFO:teuthology.orchestra.run.smithi116.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.51817.log.gz 2024-02-21T22:54:44.448 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.37164.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44294.log 2024-02-21T22:54:44.448 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.47773.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52333.log 2024-02-21T22:54:44.448 INFO:teuthology.orchestra.run.smithi116.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.37164.log.gz 2024-02-21T22:54:44.448 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.44294.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47773.log.gz 2024-02-21T22:54:44.449 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-02-21T22:54:44.449 INFO:teuthology.orchestra.run.smithi116.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.44294.log.gz 2024-02-21T22:54:44.449 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.52333.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47926.log 2024-02-21T22:54:44.449 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43741.log 2024-02-21T22:54:44.449 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-mgr.y.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.52333.log.gz 2024-02-21T22:54:44.449 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.47926.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44291.log 2024-02-21T22:54:44.449 INFO:teuthology.orchestra.run.smithi116.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.47926.log.gz 2024-02-21T22:54:44.449 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.43741.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47605.log 2024-02-21T22:54:44.449 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.44291.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43741.log.gz 2024-02-21T22:54:44.450 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46831.log 2024-02-21T22:54:44.450 INFO:teuthology.orchestra.run.smithi116.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44291.log.gz 2024-02-21T22:54:44.450 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44296.log 2024-02-21T22:54:44.450 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.47605.log: /var/log/ceph/ceph-client.admin.46831.log: gzip -5 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47605.log.gz 2024-02-21T22:54:44.450 INFO:teuthology.orchestra.run.smithi116.stderr: --verbose -- /var/log/ceph/ceph-client.admin.51104.log 2024-02-21T22:54:44.450 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.44296.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46831.log.gz 2024-02-21T22:54:44.450 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48094.log 2024-02-21T22:54:44.450 INFO:teuthology.orchestra.run.smithi116.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.44296.log.gz 2024-02-21T22:54:44.451 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.51104.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50156.log 2024-02-21T22:54:44.451 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.48094.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.51104.log.gz 2024-02-21T22:54:44.451 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43615.log 2024-02-21T22:54:44.451 INFO:teuthology.orchestra.run.smithi116.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48094.log.gz 2024-02-21T22:54:44.451 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49858.log 2024-02-21T22:54:44.451 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.50156.log: /var/log/ceph/ceph-client.admin.43615.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50198.log 2024-02-21T22:54:44.451 INFO:teuthology.orchestra.run.smithi116.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.50156.log.gz 2024-02-21T22:54:44.451 INFO:teuthology.orchestra.run.smithi116.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43615.log.gz 2024-02-21T22:54:44.451 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.49858.log: 92.6% -- replaced with /var/log/ceph/ceph-mgr.y.log.gzgzip 2024-02-21T22:54:44.452 INFO:teuthology.orchestra.run.smithi116.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.49900.log 2024-02-21T22:54:44.452 INFO:teuthology.orchestra.run.smithi116.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.49858.log.gz 2024-02-21T22:54:44.452 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.50198.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48718.log 2024-02-21T22:54:44.452 INFO:teuthology.orchestra.run.smithi116.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.50198.log.gz 2024-02-21T22:54:44.452 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.49900.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49689.log 2024-02-21T22:54:44.452 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48430.log 2024-02-21T22:54:44.452 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.48718.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49900.log.gz 2024-02-21T22:54:44.452 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.49689.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47143.log 2024-02-21T22:54:44.453 INFO:teuthology.orchestra.run.smithi116.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48718.log.gz 2024-02-21T22:54:44.453 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.48430.log: gzip 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49689.log.gz 2024-02-21T22:54:44.453 INFO:teuthology.orchestra.run.smithi116.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.44632.log 2024-02-21T22:54:44.453 INFO:teuthology.orchestra.run.smithi116.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.48430.log.gz 2024-02-21T22:54:44.453 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.47143.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45505.log 2024-02-21T22:54:44.453 INFO:teuthology.orchestra.run.smithi116.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47143.log.gz 2024-02-21T22:54:44.453 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.44632.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-02-21T22:54:44.453 INFO:teuthology.orchestra.run.smithi116.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.44632.log.gz 2024-02-21T22:54:44.453 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.45505.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43172.log 2024-02-21T22:54:44.454 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44628.log 2024-02-21T22:54:44.454 INFO:teuthology.orchestra.run.smithi116.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45505.log.gz 2024-02-21T22:54:44.454 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.43172.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49066.log 2024-02-21T22:54:44.454 INFO:teuthology.orchestra.run.smithi116.stderr: 87.9%/var/log/ceph/ceph-client.admin.44628.log: -- replaced with /var/log/ceph/ceph-client.admin.43172.log.gz 2024-02-21T22:54:44.454 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51523.log 2024-02-21T22:54:44.454 INFO:teuthology.orchestra.run.smithi116.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44628.log.gz 2024-02-21T22:54:44.454 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.49066.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47185.log 2024-02-21T22:54:44.454 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.51523.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.49066.log.gz 2024-02-21T22:54:44.455 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51565.log 2024-02-21T22:54:44.455 INFO:teuthology.orchestra.run.smithi116.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.51523.log.gz 2024-02-21T22:54:44.455 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.47185.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51691.log 2024-02-21T22:54:44.455 INFO:teuthology.orchestra.run.smithi116.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.47185.log.gz 2024-02-21T22:54:44.455 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.51565.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-02-21T22:54:44.455 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.51691.log: 88.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43657.log 2024-02-21T22:54:44.455 INFO:teuthology.orchestra.run.smithi116.stderr: -- replaced with /var/log/ceph/ceph-client.admin.51565.log.gz 2024-02-21T22:54:44.455 INFO:teuthology.orchestra.run.smithi116.stderr: 88.1%/var/log/ceph/ceph.log: -- replaced with /var/log/ceph/ceph-client.admin.51691.log.gz 2024-02-21T22:54:44.455 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47395.log 2024-02-21T22:54:44.456 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5/var/log/ceph/ceph-client.admin.43657.log: --verbose -- /var/log/ceph/ceph-client.admin.48853.log 2024-02-21T22:54:44.456 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.47395.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43657.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-02-21T22:54:44.456 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-02-21T22:54:44.456 INFO:teuthology.orchestra.run.smithi116.stderr: 85.1% -- replaced with /var/log/ceph/ceph.log.gz 2024-02-21T22:54:44.456 INFO:teuthology.orchestra.run.smithi116.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47395.log.gz 2024-02-21T22:54:44.456 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.48853.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48676.log 2024-02-21T22:54:44.456 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-osd.2.log: gzip 87.9% -- replaced with /var/log/ceph/ceph-client.admin.48853.log.gz 2024-02-21T22:54:44.456 INFO:teuthology.orchestra.run.smithi116.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.45937.log 2024-02-21T22:54:44.457 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.48676.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-02-21T22:54:44.457 INFO:teuthology.orchestra.run.smithi116.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.48676.log.gz 2024-02-21T22:54:44.457 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.45937.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44633.log 2024-02-21T22:54:44.457 INFO:teuthology.orchestra.run.smithi116.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45937.log.gz 2024-02-21T22:54:44.457 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44972.log 2024-02-21T22:54:44.457 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46401.log 2024-02-21T22:54:44.457 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.44633.log: /var/log/ceph/ceph-client.admin.44972.log: 91.9% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-02-21T22:54:44.457 INFO:teuthology.orchestra.run.smithi116.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44633.log.gz 2024-02-21T22:54:44.458 INFO:teuthology.orchestra.run.smithi116.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44972.log.gz 2024-02-21T22:54:44.458 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47689.log 2024-02-21T22:54:44.458 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.46401.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51943.log 2024-02-21T22:54:44.458 INFO:teuthology.orchestra.run.smithi116.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.46401.log.gz 2024-02-21T22:54:44.458 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.47689.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44300.log 2024-02-21T22:54:44.458 INFO:teuthology.orchestra.run.smithi116.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47689.log.gz 2024-02-21T22:54:44.458 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49942.log 2024-02-21T22:54:44.458 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.51943.log: /var/log/ceph/ceph-client.admin.44300.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.51943.log.gz 2024-02-21T22:54:44.458 INFO:teuthology.orchestra.run.smithi116.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44300.log.gz 2024-02-21T22:54:44.459 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51775.log 2024-02-21T22:54:44.459 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43909.log 2024-02-21T22:54:44.459 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.49942.log: /var/log/ceph/ceph-client.admin.51775.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49647.log 2024-02-21T22:54:44.459 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.43909.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.49942.log.gz 2024-02-21T22:54:44.459 INFO:teuthology.orchestra.run.smithi116.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.51775.log.gz 2024-02-21T22:54:44.459 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44637.log 2024-02-21T22:54:44.459 INFO:teuthology.orchestra.run.smithi116.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43909.log.gz 2024-02-21T22:54:44.459 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51985.log 2024-02-21T22:54:44.459 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.49647.log: /var/log/ceph/ceph-client.admin.44637.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47521.log 2024-02-21T22:54:44.460 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.51985.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.49647.log.gz 2024-02-21T22:54:44.460 INFO:teuthology.orchestra.run.smithi116.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44637.log.gz 2024-02-21T22:54:44.460 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43049.log 2024-02-21T22:54:44.460 INFO:teuthology.orchestra.run.smithi116.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.51985.log.gz 2024-02-21T22:54:44.460 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48982.log 2024-02-21T22:54:44.460 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.47521.log: /var/log/ceph/ceph-client.admin.43049.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-02-21T22:54:44.460 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.48982.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.47521.log.gz 2024-02-21T22:54:44.460 INFO:teuthology.orchestra.run.smithi116.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.43049.log.gz 2024-02-21T22:54:44.461 INFO:teuthology.orchestra.run.smithi116.stderr:gzip 89.5% -5 --verbose -- /var/log/ceph/ceph-client.admin.43317.log 2024-02-21T22:54:44.461 INFO:teuthology.orchestra.run.smithi116.stderr: -- replaced with /var/log/ceph/ceph-client.admin.48982.log.gz 2024-02-21T22:54:44.461 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44960.log 2024-02-21T22:54:44.461 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-mds.a.log: /var/log/ceph/ceph-client.admin.43317.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48803.log 2024-02-21T22:54:44.461 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.44960.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43317.log.gz 2024-02-21T22:54:44.461 INFO:teuthology.orchestra.run.smithi116.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.44960.log.gz 2024-02-21T22:54:44.461 INFO:teuthology.orchestra.run.smithi116.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-02-21T22:54:44.461 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.48803.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.48803.log.gz 2024-02-21T22:54:44.463 INFO:teuthology.orchestra.run.smithi142.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-02-21T22:54:44.463 INFO:teuthology.orchestra.run.smithi142.stderr: 93.2% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-02-21T22:54:44.463 INFO:teuthology.orchestra.run.smithi116.stderr: 93.3% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-02-21T22:54:44.463 INFO:teuthology.orchestra.run.smithi116.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-02-21T22:54:44.463 INFO:teuthology.orchestra.run.smithi116.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-02-21T22:54:44.463 INFO:teuthology.orchestra.run.smithi116.stderr: 93.1% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-02-21T22:54:44.470 INFO:teuthology.orchestra.run.smithi142.stderr: 93.3% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-02-21T22:54:44.471 INFO:teuthology.orchestra.run.smithi142.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-02-21T22:54:44.477 INFO:teuthology.orchestra.run.smithi142.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-02-21T22:54:44.480 INFO:teuthology.orchestra.run.smithi142.stderr: 2024-02-21T22:54:44.480 INFO:teuthology.orchestra.run.smithi142.stderr:real 0m0.164s 2024-02-21T22:54:44.480 INFO:teuthology.orchestra.run.smithi142.stderr:user 0m0.826s 2024-02-21T22:54:44.480 INFO:teuthology.orchestra.run.smithi142.stderr:sys 0m0.064s 2024-02-21T22:54:44.496 INFO:teuthology.orchestra.run.smithi116.stderr: 91.0% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-02-21T22:54:44.498 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-02-21T22:54:44.498 INFO:teuthology.orchestra.run.smithi116.stderr:real 0m0.213s 2024-02-21T22:54:44.498 INFO:teuthology.orchestra.run.smithi116.stderr:user 0m0.700s 2024-02-21T22:54:44.498 INFO:teuthology.orchestra.run.smithi116.stderr:sys 0m0.139s 2024-02-21T22:54:44.498 INFO:tasks.ceph:Archiving logs... 2024-02-21T22:54:44.499 DEBUG:teuthology.misc:Transferring archived files from smithi116:/var/log/ceph to /home/teuthworker/archive/leonidus-2024-02-21_22:31:03-fs-wip-lusov-qdb-distro-default-smithi/7569994/remote/smithi116/log 2024-02-21T22:54:44.499 DEBUG:teuthology.orchestra.run.smithi116:> sudo tar c -f - -C /var/log/ceph -- . 2024-02-21T22:54:44.822 DEBUG:teuthology.misc:Transferring archived files from smithi142:/var/log/ceph to /home/teuthworker/archive/leonidus-2024-02-21_22:31:03-fs-wip-lusov-qdb-distro-default-smithi/7569994/remote/smithi142/log 2024-02-21T22:54:44.823 DEBUG:teuthology.orchestra.run.smithi142:> sudo tar c -f - -C /var/log/ceph -- . 2024-02-21T22:54:44.979 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-02-21T22:54:44.994 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-02-21T22:54:44.995 DEBUG:teuthology.orchestra.run.smithi116:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-02-21T22:54:44.997 DEBUG:teuthology.orchestra.run.smithi142:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-02-21T22:54:45.079 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-02-21T22:54:45.087 INFO:teuthology.task.clock:Checking final clock skew... 2024-02-21T22:54:45.087 DEBUG:teuthology.orchestra.run.smithi116:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-21T22:54:45.090 DEBUG:teuthology.orchestra.run.smithi142:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-21T22:54:45.101 INFO:teuthology.orchestra.run.smithi116.stderr:bash: line 1: ntpq: command not found 2024-02-21T22:54:45.103 INFO:teuthology.orchestra.run.smithi142.stderr:bash: line 1: ntpq: command not found 2024-02-21T22:54:45.105 INFO:teuthology.orchestra.run.smithi116.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-02-21T22:54:45.105 INFO:teuthology.orchestra.run.smithi116.stdout:=============================================================================== 2024-02-21T22:54:45.106 INFO:teuthology.orchestra.run.smithi116.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 50 +512us[ +553us] +/- 82ms 2024-02-21T22:54:45.106 INFO:teuthology.orchestra.run.smithi116.stdout:^* hv02.front.sepia.ceph.com 3 6 377 48 +21us[ +62us] +/- 61ms 2024-02-21T22:54:45.106 INFO:teuthology.orchestra.run.smithi116.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 50 -360us[ -320us] +/- 61ms 2024-02-21T22:54:45.106 INFO:teuthology.orchestra.run.smithi116.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-02-21T22:54:45.107 INFO:teuthology.orchestra.run.smithi142.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-02-21T22:54:45.107 INFO:teuthology.orchestra.run.smithi142.stdout:=============================================================================== 2024-02-21T22:54:45.107 INFO:teuthology.orchestra.run.smithi142.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 50 +555us[ +555us] +/- 82ms 2024-02-21T22:54:45.107 INFO:teuthology.orchestra.run.smithi142.stdout:^* hv02.front.sepia.ceph.com 3 6 377 114 +83us[ +29us] +/- 60ms 2024-02-21T22:54:45.108 INFO:teuthology.orchestra.run.smithi142.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 50 -328us[ -328us] +/- 61ms 2024-02-21T22:54:45.108 INFO:teuthology.orchestra.run.smithi142.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-02-21T22:54:45.109 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-02-21T22:54:45.117 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-02-21T22:54:45.118 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-02-21T22:54:45.126 DEBUG:teuthology.orchestra.run.smithi116:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-02-21T22:54:45.217 DEBUG:teuthology.orchestra.run.smithi142:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-02-21T22:54:45.282 DEBUG:teuthology.orchestra.run.smithi116:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-02-21T22:54:45.313 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-21T22:54:45.314 DEBUG:teuthology.orchestra.run.smithi142:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-02-21T22:54:45.344 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-21T22:54:45.345 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-02-21T22:54:45.357 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-02-21T22:54:45.370 INFO:teuthology.task.internal:Duration was 735.412733 seconds 2024-02-21T22:54:45.371 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-02-21T22:54:45.381 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-02-21T22:54:45.381 DEBUG:teuthology.orchestra.run.smithi116:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-02-21T22:54:45.383 DEBUG:teuthology.orchestra.run.smithi142:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-02-21T22:54:45.424 INFO:teuthology.orchestra.run.smithi116.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-02-21T22:54:45.428 INFO:teuthology.orchestra.run.smithi142.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-02-21T22:54:45.952 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-02-21T22:54:45.953 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi116.front.sepia.ceph.com 2024-02-21T22:54:45.953 DEBUG:teuthology.orchestra.run.smithi116:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-02-21T22:54:45.973 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi142.front.sepia.ceph.com 2024-02-21T22:54:45.973 DEBUG:teuthology.orchestra.run.smithi142:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-02-21T22:54:46.016 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-02-21T22:54:46.017 DEBUG:teuthology.orchestra.run.smithi116:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-02-21T22:54:46.019 DEBUG:teuthology.orchestra.run.smithi142:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-02-21T22:54:46.086 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-02-21T22:54:46.086 DEBUG:teuthology.orchestra.run.smithi116:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-02-21T22:54:46.089 DEBUG:teuthology.orchestra.run.smithi142:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-02-21T22:54:46.227 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-02-21T22:54:46.237 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-02-21T22:54:46.237 DEBUG:teuthology.orchestra.run.smithi116:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-02-21T22:54:46.264 DEBUG:teuthology.orchestra.run.smithi142:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-02-21T22:54:46.292 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-02-21T22:54:46.302 DEBUG:teuthology.orchestra.run.smithi116:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-02-21T22:54:46.307 DEBUG:teuthology.orchestra.run.smithi142:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-02-21T22:54:46.330 INFO:teuthology.orchestra.run.smithi116.stdout:kernel.core_pattern = core 2024-02-21T22:54:46.357 INFO:teuthology.orchestra.run.smithi142.stdout:kernel.core_pattern = core 2024-02-21T22:54:46.373 DEBUG:teuthology.orchestra.run.smithi116:> test -e /home/ubuntu/cephtest/archive/coredump 2024-02-21T22:54:46.400 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-21T22:54:46.400 DEBUG:teuthology.orchestra.run.smithi142:> test -e /home/ubuntu/cephtest/archive/coredump 2024-02-21T22:54:46.427 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-21T22:54:46.427 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-02-21T22:54:46.438 INFO:teuthology.task.internal:Transferring archived files... 2024-02-21T22:54:46.438 DEBUG:teuthology.misc:Transferring archived files from smithi116:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/leonidus-2024-02-21_22:31:03-fs-wip-lusov-qdb-distro-default-smithi/7569994/remote/smithi116 2024-02-21T22:54:46.439 DEBUG:teuthology.orchestra.run.smithi116:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-02-21T22:54:46.482 DEBUG:teuthology.misc:Transferring archived files from smithi142:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/leonidus-2024-02-21_22:31:03-fs-wip-lusov-qdb-distro-default-smithi/7569994/remote/smithi142 2024-02-21T22:54:46.482 DEBUG:teuthology.orchestra.run.smithi142:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-02-21T22:54:46.517 INFO:teuthology.task.internal:Removing archive directory... 2024-02-21T22:54:46.518 DEBUG:teuthology.orchestra.run.smithi116:> rm -rf -- /home/ubuntu/cephtest/archive 2024-02-21T22:54:46.520 DEBUG:teuthology.orchestra.run.smithi142:> rm -rf -- /home/ubuntu/cephtest/archive 2024-02-21T22:54:46.567 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-02-21T22:54:46.578 INFO:teuthology.task.internal:Not uploading archives. 2024-02-21T22:54:46.579 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-02-21T22:54:46.588 INFO:teuthology.task.internal:Tidying up after the test... 2024-02-21T22:54:46.588 DEBUG:teuthology.orchestra.run.smithi116:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-02-21T22:54:46.591 DEBUG:teuthology.orchestra.run.smithi142:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-02-21T22:54:46.603 INFO:teuthology.orchestra.run.smithi116.stdout: 262166 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 21 22:54 /home/ubuntu/cephtest 2024-02-21T22:54:46.621 INFO:teuthology.orchestra.run.smithi142.stdout: 262166 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 21 22:54 /home/ubuntu/cephtest 2024-02-21T22:54:46.622 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-02-21T22:54:46.633 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-02-21T22:54:46.655 INFO:teuthology.nuke:Checking targets against current locks 2024-02-21T22:54:46.682 DEBUG:teuthology.nuke:shortname: smithi116 2024-02-21T22:54:46.683 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-02-21T22:54:46.709 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi116.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2024-02-21_22:31:03-fs-wip-lusov-qdb-distro-default-smithi/7569994', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-21 22:32:35.737239', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKSYPdxFnYUkLRhg2JtiX1Zh5vfjR56FP+IfctDddmogYEscSQau+lo7M8WnEmFUldp0gBrzWER2oPOVT4f43bc='} 2024-02-21T22:54:46.713 DEBUG:teuthology.nuke:shortname: smithi142 2024-02-21T22:54:46.713 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-02-21T22:54:46.733 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi142.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2024-02-21_22:31:03-fs-wip-lusov-qdb-distro-default-smithi/7569994', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-21 22:32:35.738456', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAObk+c0UTDo0O7FrphxqiW/noBoV3ao4Z+yYnKrmwK36r+iZ9qGOrFRurPgUxgH1MK7gk7y6SlrFCFjeovIrYc='} 2024-02-21T22:54:46.770 INFO:teuthology.orchestra.console.smithi116:Power off 2024-02-21T22:54:46.771 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-21T22:54:46.789 INFO:teuthology.orchestra.console.smithi142:Power off 2024-02-21T22:54:46.790 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-21T22:54:46.799 DEBUG:teuthology.orchestra.console.smithi116:power off output: Chassis Power Control: Down/Off 2024-02-21T22:54:46.799 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-21T22:54:46.812 DEBUG:teuthology.orchestra.console.smithi142:power off output: Chassis Power Control: Down/Off 2024-02-21T22:54:46.813 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-21T22:54:46.826 DEBUG:teuthology.orchestra.console.smithi116:check power output: Chassis Power is on 2024-02-21T22:54:46.836 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is on 2024-02-21T22:54:50.827 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-21T22:54:50.837 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-21T22:54:50.938 DEBUG:teuthology.orchestra.console.smithi116:check power output: Chassis Power is on 2024-02-21T22:54:50.948 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is on 2024-02-21T22:54:54.940 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-21T22:54:54.949 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-21T22:54:55.050 DEBUG:teuthology.orchestra.console.smithi116:check power output: Chassis Power is on 2024-02-21T22:54:55.060 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is on 2024-02-21T22:54:59.054 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-21T22:54:59.063 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-21T22:54:59.165 DEBUG:teuthology.orchestra.console.smithi116:check power output: Chassis Power is off 2024-02-21T22:54:59.173 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is off 2024-02-21T22:54:59.266 INFO:teuthology.orchestra.console.smithi116:Power off completed 2024-02-21T22:54:59.274 INFO:teuthology.orchestra.console.smithi142:Power off completed 2024-02-21T22:54:59.379 INFO:teuthology.run:Summary data: description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} subvol_versions/create_subvol_version_v1 tasks/xfstests-dev} duration: 735.4127333164215 failure_reason: 'Test failure: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev)' flavor: default owner: scheduled_leonidus@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=b5029807d21e46418a3ae52b5ed55054 status: fail success: false 2024-02-21T22:54:59.380 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-21T22:54:59.473 INFO:teuthology.run:FAIL